When Do Discrete Actions Make Good Continuous Controllers?
cs.RO
Submitted: 2026-10-14
Updated: 2026-10-14
Comments: 53 pages (12 main text), 19 figures, 12 tables. Project page: https://iscoyizj.github.io/discrete-action-website/
Project page: https://iscoyizj.github.io/discrete-action-website
License: http://creativecommons.org/licenses/by/4.0/
The gist: Though modern AI models like LLMs predict discrete tokens, today's robotic foundation models represent actions as continuous vectors.
Abstract
Though modern AI models like LLMs predict discrete tokens, today's robotic foundation models represent actions as continuous vectors. In this paper, we challenge this common consensus by asking if continuous action parametrizations are superior to their discrete counterparts. We conduct an extensive comparison of single-step regression and multi-step flow variants of both continuous and discrete policies in both from-scratch single-task and multi-task VLA training, in both simulation and on real hardware. In all regimes, we find that discrete action prediction, even the most naive, uniform-bin quantization, can match or even outperform continuous-action policies in task success rate. Moreover, we find that the challenge to discrete action policies is not action precision, but rather factorization error introduced by product-distribution predictions across time and action dimensions. We show that, when paired with the correct interventions---iterative computation through discrete flows, or distribution sharpening through classifier-free guidance---discrete flow policies can turn this weakness into a strength, enabling more responsive action changes during a predicted action chunk. Lastly, we show that attempts to explicitly inject geometric information into discrete policies, e.g. through corruption processes that emulate continuous flow matching, do not yield consistent improvements. Taken together, our findings question existing assumptions that robotic action prediction requires distinct design decisions compared to other AI domains, and motivates the possibility of discrete action prediction as a compelling alternative to today's continuous action parametrizations. Link for the webpage https://iscoyizj.github.io/discrete-action-website/
Sources
- Building Normalizing Flows with Stochastic Interpolants
- PaliGemma: A versatile 3B VLM for transfer
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- End to End Learning for Self-Driving Cars
- RT-1: Robotics Transformer for Real-World Control at Scale
- RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control
- Understanding Behavior Cloning with Action Quantization
- MaskGIT: Masked Generative Image Transformer
- Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Process
- DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching
- Diffusion Policy: Visuomotor Policy Learning via Action Diffusion
- Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matching
- DriveFine: Refining-Augmented Masked Diffusion VLA for Precise and Robust Driving
- LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models
- Discrete Flow Matching
- Gemma 2: Improving Open Language Models at a Practical Size
- Classifier-Free Diffusion Guidance
- Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
- AdaFlow: Imitation Learning with Variance-Adaptive Flow-Based Policies
- Inner Monologue: Embodied Reasoning through Planning with Language Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies