Genesis: Visual Augmentation Primitives for Multimodal Chain-of-Thought Reasoning
cs.CV
Submitted: 2026-10-11
Updated: 2026-10-11
Project page: https://qwenlm.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent multimodal large language models achieve promising results on visual reasoning tasks, approaching human-level performance on existing STEM benchmarks.
Abstract
Recent multimodal large language models achieve promising results on visual reasoning tasks, approaching human-level performance on existing STEM benchmarks. However, these capabilities degrade under complex real-world scenes. We identify that chain-of-thought reasoning remains largely confined to the linguistic space, rarely anchoring each step in visual evidence. The main cause is the absence of such data during training. In this work, we introduce a training data augmentation pipeline, Visual Augmentation Primitives (VAP), which leverages state-of-the-art vision generative models to synthesize diverse photorealistic training samples and corresponding reasoning text. VAP introduces some basic operators and applies them to a seed image and gets a variant. It also constructs coherent multimodal reasoning chains throughout the generation process. Such training data force models to perceive visual content and perform logical reasoning according to them at every step. We further introduce multimodal chain-of-thought rubric-based reinforcement learning to enhance this. It rewards not only text reasoning but also visual reasoning by scoring intermediate reasoning steps for logical validity, completeness, and consistency. Moreover, we construct the UNREAL benchmark to systematically evaluate visual reasoning on hyperrealistic scenes across controllable difficulty levels. Experiments show that a 4B model built on this framework surpasses 8B baselines, with performance improving consistently as the model scales to 32B, validating the scaling law for visual reasoning.
Sources
- ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models
- BabyVision: Visual Reasoning Beyond Language
- Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains
- Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark
- VisualTrans: A Benchmark for Real-World Visual Transformation Reasoning
- SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension
- ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Models
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations
- Towards Cross-View Point Correspondence in Vision-Language Models
- LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts
- TraceVision: Trajectory-Aware Vision-Language Model for Human-Like Spatial Understanding
- Multimodal Chain-of-Thought Reasoning in Language Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models