Cracking Mobile Manipulation: From Failure Diagnosis to Agentic Robot System
cs.RO
Submitted: 2026-10-14
Updated: 2026-10-14
Code: https://github.com/PKU-VaLuE-Lab/Cracking-Mobile-Manipulation
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent vision-language-action (VLA) models have shown strong performance on local robot manipulation, yet their success does not readily translate to long-horizon mobile manipulation.
Abstract
Recent vision-language-action (VLA) models have shown strong performance on local robot manipulation, yet their success does not readily translate to long-horizon mobile manipulation. In our experiments, a pretrained subtask VLA achieves 80% success rate on atomic manipulation tasks but only 19% when these skills are composed into mobile manipulation. We argue that this gap stems from failures across the execution process rather than from local manipulation capability alone. To uncover these bottlenecks, we systematically diagnose failures in long-horizon mobile manipulation and identify three dominant regimes: task planning, navigation and base positioning, and local manipulation. Based on this diagnosis, we develop failure-guided agentic intervention that augments a fixed subtask VLA with demonstration-based planning guidance, adaptive visual memory, accessibility-aware base adjustment, and local end-effector adjustment. On RoboCasa365, these interventions progressively improve task success from 19% to 47%, with the finalized system reaching 49% on held-out episode seeds, compared with 18% for the baseline. The same design improves performance from 14% to 37% on BEHAVIOR-1K and from 5/20 to 13/20 on real-robot tasks. These results suggest that reliable mobile manipulation can be advanced by diagnosing and intervening on the current bottleneck, rather than uniformly scaling the underlying policy. Our code will be released at https://github.com/PKU-VaLuE-Lab/Cracking-Mobile-Manipulation.git.
Sources
- Qwen3-VL Technical Report
- ABot-M0.5: Unified Mobility-and-Manipulation World Action Model
- StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing
- CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation
- Addressing the Orchestration Gap in Generalist Robots via Physical Agency
- EBench: Elemental Diagnosis of Generalist Mobile Manipulation Policies
- Gemini Robotics: Bringing AI into the Physical World
- Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model
- RLDX-1 Technical Report
- Towards Long-horizon Embodied Agents with Tool-Aligned Vision-Language-Action Models
- MoMaStage: Skill-State Graph Guided Planning and Closed-Loop Execution for Long-Horizon Indoor Mobile Manipulation
- MobiGuide: Vocabulary-Guided Online Recovery for Mobile Manipulation
- FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models
- RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation
- CheckVLA: Execution-Time Verification with Action-Conditioned World Model for Long-Horizon Mobile Manipulation
- ASPIRE: Agentic /Skills Discovery for Robotics
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- DINOv2: Learning Robust Visual Features without Supervision
- VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies