EqC: Equilibrium Energy Control for Introspective Lifelong Robot Learning
cs.RO
Submitted: 2026-10-13
Updated: 2026-10-13
Code: https://github.com/hrh6666/EqC
License: http://creativecommons.org/licenses/by/4.0/
The gist: Long-term robot autonomy depends on more than effective action generation: a policy must recognize when its behavior is no longer sufficiently supported and use assistance to improve.
Abstract
Long-term robot autonomy depends on more than effective action generation: a policy must recognize when its behavior is no longer sufficiently supported and use assistance to improve. We introduce Equilibrium Energy Control (EqC), a framework for introspective lifelong robot learning built around an explicit conditional energy landscape. EqC casts generative action refinement as equilibrium-seeking optimization, while the geometry of the refinement process reveals whether the generated behavior remains consistent with the learned landscape. This competence signal enables Energy-Gated DAgger, where persistent energy-consistency violations trigger expert takeover and the resulting recovery trajectories are aggregated for subsequent policy updates. EqC integrates naturally into both Diffusion Transformer policies and flow-matching-based vision-language-action (VLA) policies. Across simulation and real-world bimanual manipulation, EqC matches or improves control performance and robustness while enabling timely intervention near the policy's competence boundary. A real-world study further shows how these interventions progressively expand the range of situations handled autonomously, providing a practical path from static generative controllers toward self-improving robot systems.
Sources
- Is Conditional Generative Modeling all you need for Decision-Making?
- Learning to Optimize Autonomy in Competence-Aware Systems
- $\pi_0$: A Vision-Language-Action Flow Model for General Robot Control
- Large Video Planner Enables Generalizable Robot Control
- RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation
- EBT-Policy: Energy Unlocks Emergent Physical Reasoning Capabilities
- LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models
- ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learning
- Flexible Locomotion Learning with Diffusion Model Predictive Control
- DiffuseLoco: Real-Time Legged Locomotion Control with Diffusion from Offline Datasets
- Planning with Diffusion for Flexible Behavior Synthesis
- Flow Matching for Generative Modeling
- G0.5: One Autoregressive Stream for Robot Reasoning and Action
- FAST: Efficient Action Tokenization for Vision-Language-Action Models
- $\pi_{0.5}$: a Vision-Language-Action Model with Open-World Generalization
- Revisiting Energy Based Models as Policies: Ranking Noise Contrastive Estimation and Interpolating Energy Models
- Qwen-VLA: Unifying Vision-Language-Action Modeling across Tasks, Environments, and Robot Embodiments
- Equilibrium Matching: Generative Modeling with Implicit Energy-Based Models
- Fast-WAM: Do World Action Models Need Test-time Future Imagination?
- Query-Efficient Imitation Learning for End-to-End Autonomous Driving
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies