GeoReader: Learning Latent Geometry for Spatial Reasoning in Vision-Language Models
cs.CV, cs.AI, cs.LG, cs.MM
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: 35 pages, 11 figures, 15 tables; Project Page at https://iris0329.github.io/georeader-homepage/ GitHub Repo at https://github.com/iris0329/GeoReader
Code: https://github.com/iris0329/GeoReader
Project page: https://iris0329.github.io/georeader-homepage
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Vision-language models (VLMs) struggle with metric and multi-view relationships that remain implicit in RGB observations.
Terminology
Abstract
Vision-language models (VLMs) struggle with metric and multi-view relationships that remain implicit in RGB observations. Geometry foundation models recover this structure from RGB, but existing methods either fuse the estimated features with visual tokens and learn to use them from question answering alone, or align VLM latents with geometry features. Capturing geometry, however, does not ensure its use: zeroing the aligned latents of a released feature-alignment model leaves its accuracy unchanged. We introduce GeoReader, a framework that learns geometric representations for the VLM that reads them. First, we train lightweight Geometric Readers to produce continuous input tokens, supervising them with geometry descriptions decoded by a frozen VLM, so that the Readers express geometry in a form the target model can already read. We then freeze the Readers to preserve this interface while fine-tuning the VLM on spatial QA, with geometry injection conditioned on the question. Geometry descriptions serve only as training targets: at inference, the VLM answers directly from the continuous geometric tokens without generating a geometry chain of thought. With geometry predicted from RGB images, our approach reaches 94.3 on MindCube-Tiny with Qwen3-VL-4B and, with a multi-source QA mixture, an average of 72.5 across six additional spatial benchmarks with Qwen3.5-9B. These results suggest that a useful geometric representation is one the receiving model can use, not merely one from which geometry can be reconstructed.
Sources
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning
- Training Large Language Models to Reason in a Continuous Latent Space
- Token-Wise Latent Streaming from Slow Reasoners to Fast Planners for Dynamic Vision Language Navigation
- Imagination Helps Visual Reasoning, But Not Yet in Latent Space
- SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data
- SpaceR: Reinforcing MLLMs in Video Spatial Reasoning
- Reason Through the Latent! Making Latent Visual Reasoning Necessary
- The 2017 DAVIS Challenge on Video Object Segmentation
- Qwen2.5-VL Technical Report
- Qwen3-VL Technical Report
- AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- What's Holding Back Latent Visual Reasoning?
- N3D-VLM: Native 3D Grounding Enables Accurate Spatial Reasoning in Vision-Language Models
- SpatioLM: Towards General Physical Spatial Intelligence in Vision-Language Models
- Leveraging Latent Visual Reasoning in Silence
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models