Streaming-WAM: Action-Conditioned World-Action Model for Asynchronous Robot Manipulation
cs.RO
Submitted: 2026-09-24
Updated: 2026-09-24
Code: https://github.com/SJTU-DENG-Lab/Streaming-WAM
License: http://creativecommons.org/licenses/by/4.0/
The gist: World action models (WAMs) that use future visual prediction at inference time incur substantial generation costs.
Terminology
Abstract
World action models (WAMs) that use future visual prediction at inference time incur substantial generation costs. Asynchronous execution reduces waiting by overlapping inference with robot motion, but visual predictions used for subsequent action generation must anticipate the effects of actions already scheduled for execution during inference. We introduce Streaming-WAM, which couples action-conditioned world modeling with asynchronous robot control to account for committed actions in future visual prediction. At each streaming update, the model conditions future visual prediction on the latest observation and the committed actions, which form the fixed prefix of the next action chunk. The resulting action-conditioned visual features guide generation of the remaining actions within the same joint update, so the continuation is informed by the scene changes expected during execution of the fixed prefix. On LIBERO, Streaming-WAM achieves an average success rate of 98.35% and reduces mean episode time by a factor of 2.93 relative to Fast-WAM. On the real-world Stamp Paper task, mean episode time falls from 90 s with synchronous Joint-WAM to 38 s with Streaming-WAM. These results show that Streaming-WAM supports efficient asynchronous control while maintaining high task success rates.
Sources
- Flash-WAM: Modality-Aware Distillation for World Action Models
- Training-Time Action Conditioning for Efficient Real-Time Chunking
- AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
- LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
- FutureRTC: Real-Time Robot Execution with Anticipatory-Conditioned Action Chunking
- Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
- FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution
- Light-WAM: Efficient World Action Models with State-Fusion Action Decoding
- Faster-WAM: Do World Action Models Need Deep Action Modules?
- DiT4DiT: Jointly Modeling Video Dynamics and Actions for Generalizable Robot Control
- World Action Models in Real Time: An Empirical Study of Smooth Execution via Asynchronous Deployment
- SelfWAM: A Self-Grounded Unified World Action Model for Fast Robot Control
- VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference
- GlanceWAM: Sparse Test-Time Imagination for World-Action Models
- EagleVLA: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference
- GigaWorld-Policy: An Efficient Action-Centered World--Action Model
- World Action Models are Zero-shot Policies
- Fast-WAM: Do World Action Models Need Test-time Future Imagination?
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies