IronMan: Information-Constrained Video-Action Learning for Robot Manipulation
cs.RO
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: 21 pages, 12 figures, 5 tables
License: http://creativecommons.org/licenses/by/4.0/
The gist: Video Action Models (VAMs) couple visual dynamics modeling with action generation for robot manipulation.
Abstract
Video Action Models (VAMs) couple visual dynamics modeling with action generation for robot manipulation. However, video representations are not naturally suited to action generation, as exposing the action policy to excessive visual detail can impair its generalization ability. Therefore, we introduce IronMan (Information-constRained videO-actioN learning for robot MANipulation), a robust video-action learning framework built on the information bottleneck principle. The core principle of this framework is to impose information constraints that suppress irrelevant visual information while preserving action-relevant dynamics cues. IronMan employs a dynamics-aware bottleneck that distills noisy, entangled one-step video features into compact world representations. Extensive simulation and real-world experiments demonstrate strong in-distribution (ID) performance and out-of-distribution (OOD) robustness while maintaining efficient inference. IronMan achieves success rates of 99.0% on LIBERO and 79.4% on RoboTwin clean2clean, outperforming all the evaluated baselines. Under OOD shifts, IronMan achieves a success rate of 79.1% on LIBERO-Plus, exceeding the strongest baseline by 10.4 percentage points. Project page: https://youngsoul0731.github.io/ironman-project-page/
Sources
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
- RynnVLA-002: A Unified Vision-Language-Action and World Model
- WorldVLA: Towards Autoregressive Action World Model
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- $\pi^{*}_{0.6}$: a VLA That Learns From Experience
- ${\pi}_{0.7}$: a Steerable Generalist Robotic Foundation Model with Emergent Capabilities
- OpenVLA: An Open-Source Vision-Language-Action Model
- Causal World Modeling for Robot Control
- Video Generators are Robot Policies
- Flow Matching for Generative Modeling
- Being-H0.7: A Latent World-Action Model from Egocentric Videos
- DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control
- Cosmos World Foundation Model Platform for Physical AI
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing
- World Guidance: World Modeling in Condition Space for Action Generation
- Wan: Open and Advanced Large-Scale Video Generative Models
- ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies