Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning
cs.CV
Submitted: 2026-05-25
Updated: 2026-10-13
Comments: NeurIPS 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Visual reasoning through reinforcement learning with verifiable rewards (RLVR) has achieved remarkable progress.
Terminology
Abstract
Visual reasoning through reinforcement learning with verifiable rewards (RLVR) has achieved remarkable progress. However, when dealing with multi-source inputs, existing approaches tend to treat them as a mere accumulation of information, lacking explicit mechanisms to distinguish whether integrating additional sources yields information gain or introduces interference. Therefore, they struggle to effectively model dynamic interaction when integrating multiple sources, particularly when they differ significantly in physical properties and semantics, e.g., infrared and depth, leading to inferior performance to mono-source reasoning when a certain source holds the dominant signal. To address this issue, we propose MARS, a novel mono-anchored multi-source reasoning framework that models each visual modality as an independent information source. Specifically, by treating mono-source rewards as dynamic anchors, our method explicitly incorporates the information gain introduced by multi-source fusion into advantage normalization and adaptively emphasizes mutual promotion between sources while suppressing potential noise or conflicts during RLVR. From theoretical analysis, our method effectively quantifies information gain introduced by multi-source integration in gradient estimation, enabling consistent modality regulation. Empirical results also show impressive 3.2% and 4.9% performance gains on GRPO and DAPO across diverse datasets, confirming the effectiveness of our method. Code is available at https://github.com/AI9Stars/MARS.
Sources
- Qwen3-VL Technical Report
- Qwen2.5-VL Technical Report
- UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- LLaVA-OneVision: Easy Visual Task Transfer
- LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models
- Imagination Helps Visual Reasoning, But Not Yet in Latent Space
- Migician: Revealing the Magic of Free-Form Multi-Image Grounding in Multimodal Large Language Models
- VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- Kimi-VL Technical Report
- Learning to Reason under Off-Policy Guidance
- R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization
- DAPO: An Open-Source LLM Reinforcement Learning System at Scale
- SPARK: Multi-Vision Sensor Perception and Reasoning Benchmark for Large-scale Vision-Language Models
- ExGRPO: Learning to Reason from Experience
- R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning
- Group Sequence Policy Optimization
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models