Uni-RS: A Spatially Faithful Unified Understanding and Generation Model for Remote Sensing
cs.CV, cs.AI
Submitted: 2026-01-25
Updated: 2026-10-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: Unified remote sensing multimodal models exhibit a pronounced spatial reversal curse: Although they can accurately recognize and describe object locations in images, they often fail to faithfully
Terminology
Abstract
Unified remote sensing multimodal models exhibit a pronounced spatial reversal curse: Although they can accurately recognize and describe object locations in images, they often fail to faithfully execute the same spatial relations during text-to-image generation, where such relations constitute core semantic information in remote sensing. Motivated by this observation, we propose Uni-RS, the first unified multimodal model tailored for remote sensing, to explicitly address the spatial asymmetry between understanding and generation. Specifically, we first introduce explicit Spatial-Layout Planning to transform textual instructions into spatial layout plans, decoupling geometric planning from visual synthesis. We then impose Spatial-Aware Query Supervision to bias learnable queries toward spatial relations explicitly specified in the instruction. Finally, we develop Image-Caption Spatial Layout Variation to expose the model to systematic geometry-consistent spatial transformations. Extensive experiments across multiple benchmarks show that our approach substantially improves spatial faithfulness in text-to-image generation, while maintaining strong performance on multimodal understanding tasks like image captioning, visual grounding, and VQA tasks.
Sources
- Qwen3-VL Technical Report
- Qwen2.5-VL Technical Report
- BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset
- Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scaling
- Emerging Properties in Unified Multimodal Pretraining
- GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning
- SegEarth-R1: Geospatial Pixel Reasoning via Large Language Model
- GeoReason: Aligning Thinking And Answering In Remote Sensing Vision-Language Models Via Logical Consistency Reinforcement Learning
- Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
- SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding
- Transfer between Modalities with MetaQueries
- Chameleon: Mixed-Modal Early-Fusion Foundation Models
- Emu3: Next-Token Prediction is All You Need
- GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
- Qwen-Image Technical Report
- SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
- Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunities
- Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models