StreamingWAM: Streaming World Action Modeling via Chunk-Wise Staircase Flow Matching
cs.RO
Submitted: 2026-10-11
Updated: 2026-10-11
Comments: 20 pages, 9 figures. Project page: https://renshaojie233.github.io/StreamingWAM/
Project page: https://renshaojie233.github.io/StreamingWAM
License: http://creativecommons.org/licenses/by/4.0/
The gist: World Action Models (WAMs), often built upon pretrained video-generation world models, have emerged as a promising framework for general-purpose and open-ended robot control.
Terminology
Abstract
World Action Models (WAMs), often built upon pretrained video-generation world models, have emerged as a promising framework for general-purpose and open-ended robot control. However, their real-world deployment often suffers from discontinuous and jerky execution. Existing methods typically address this issue by either improving inference efficiency or enhancing action continuity across prediction chunks, without jointly addressing both challenges. To bridge this gap, we propose StreamingWAM, a streaming-diffusion framework for WAM-based robot control. StreamingWAM combines a noise ladder for chunk-wise action prediction, a prefix rollout module for cross-chunk continuity, and dense video-history memory for temporally consistent conditioning. Experiments on LIBERO, LIBERO-Plus, RoboTwin 2.0, and real-world robotic tasks demonstrate that StreamingWAM improves action continuity across static and dynamic settings, achieving competitive performance while reducing steady-state replanning latency to 72.9 ms in simulation and 57.3 ms on the real robot. The method also produces smoother action transitions, while the streaming staircase reduces sensitivity to the execution horizon K.
Sources
- Training-Time Action Conditioning for Efficient Real-Time Chunking
- UniVLA: Learning to Act Anywhere with Task-centric Latent Actions
- AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing
- WorldVLA: Towards Autoregressive Action World Model
- Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
- Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
- Streaming Diffusion Policy: Fast Policy Synthesis with Variable Noise Diffusion Models
- DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset
- Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success
- Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planning
- Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
- Causal World Modeling for Robot Control
- Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulation
- FASTER: Rethinking Real-Time Flow VLAs
- Faster-WAM: Do World Action Models Need Deep Action Modules?
- World Action Models in Real Time: An Empirical Study of Smooth Execution via Asynchronous Deployment
- FAST: Efficient Action Tokenization for Vision-Language-Action Models
- VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies