ProWorld: Multi-View World Model with Proprioceptive Feedback for Closed-Loop Policy Evaluation
cs.RO
Submitted: 2026-10-11
Updated: 2026-10-11
Project page: https://zijunwa.github.io/proworld/Abstract
License: http://creativecommons.org/licenses/by/4.0/
The gist: Evaluating robot manipulation policies through repeated physical trials is costly.
Terminology
Abstract
Evaluating robot manipulation policies through repeated physical trials is costly. We study whether an action-conditioned world model can serve as a closed-loop test environment whose policy success rates track those on real robots. Beyond realistic video, the model must return the camera views and proprioceptive state needed for the policy's next action and preserve failed-action outcomes to avoid overestimating policy capability. We introduce ProWorld, a world model that jointly predicts multi-view video and robot state, then feeds both back to a frozen policy for repeated interaction. ProWorld comprises a shared transformer for joint video-state flow prediction and Shared-Time View Encoding to distinguish cameras while preserving temporal synchronization. To reduce interaction hallucinations that turn missed grasps into successful lifts, we augment training with failed interactions collected in high-fidelity simulation, reducing inflated success rates in the generated environment. ProWorld achieves the highest overall TriWorldBench score among the compared methods. Across three policies and four local manipulation tasks, it attains a Pearson correlation of 0.95 and a Spearman correlation of 0.94 between generated and real success rates. These results support joint visual-proprioceptive feedback and failure-aware training as a basis for world-model-based policy evaluation.
Sources
- AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems
- Scalable Behavior Cloning with Open Data, Training, and Evaluation
- Motus: A Unified Latent Action World Model
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy
- DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos
- GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation
- Ctrl-World: A Controllable Generative World Model for Robot Manipulation
- DreamGen: Unlocking Generalization in Robot Learning through Video World Models
- RoboWorld: Fast and Reliable Neural Simulators for Generalist Robot Policy Evaluation
- Galaxea Open-World Dataset and G0 Dual-System VLA Model
- What Are We Actually Benchmarking in Robot Manipulation?
- Xiaomi-Robotics-U0: Unified Embodied Synthesis with World Foundation Model
- Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulation
- TriWorldBench: A Tri-View Consistency Perspective on Embodied World Models
- World Simulation with Video Foundation Models for Physical AI
- Cosmos 3: Omnimodal World Models for Physical AI
- GE-Sim 2.0: A Roadmap Towards Comprehensive Closed-loop Video World Simulators for Robotic Manipulation
- WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Models
- WorldArena 2.0: Extending Embodied World Model Benchmarking on Modality, Functionality and Platform
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies