DynThinker: Unifying Static 3D and Dynamic 4D Spatial Reasoning
cs.CV
Submitted: 2026-10-14
Updated: 2026-10-14
Code: https://github.com/QwenLM/Qwen3-VL
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D.
Abstract
Achieving general spatial intelligence requires a unified understanding of both static 3D and dynamic 4D. However, we find that existing models struggle to excel at both: 3D post-training can weaken dynamic understanding, while 4D-specialized models often lack strong static 3D reasoning. Our analysis reveals that this spatial--dynamic interference is highly non-uniform across parameter groups, with the balance between static and dynamic capabilities particularly sensitive to changes in late-layer MLPs. To address this interference, we propose DynThinker, a unified framework for jointly strengthening static and dynamic spatial reasoning. Decoupled Exponential Moving Average (D-EMA) applies configurable group-wise averaging to constrain drift in interference-sensitive pretrained parameters while preserving flexibility for capability enhancement. Spatial-Dynamic Fusion (SDF) complements D-EMA by selectively integrating spatial and temporal priors from a dynamic geometry encoder into intermediate VLM representations under semantic guidance. Across ten metrics spanning nine static 3D and dynamic 4D benchmarks, DynThinker achieves the highest average score among all evaluated models. Notably, DynThinker achieves 56.0 on ReVSI, 67.2 on DSR-Bench, and 51.2 and 40.1 under the sample-wise and group-wise evaluation protocols of DSI-Bench, respectively, setting new state-of-the-art results among the compared open-source models across all four evaluations within a unified model.
Sources
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- Scaling Spatial Intelligence with Multimodal Foundation Models
- PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videos
- VGGT-Det: Mining VGGT Internal Priors for Sensor-Geometry-Free Multi-View Indoor 3D Object Detection
- 4DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing
- Emerging Properties in Unified Multimodal Pretraining
- VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction
- Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- GPT-4o System Card
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- LLaVA-OneVision: Easy Visual Task Transfer
- ViewSpatial-Bench: Evaluating Multi-perspective Spatial Localization in Vision-Language Models
- Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Model
- Thinking with Geometry: Active Geometry Integration for Spatial Reasoning
- SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models
- Evo-0: Vision-Language-Action Model with Implicit Spatial Understanding
- FAST: Efficient Action Tokenization for Vision-Language-Action Models
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models