KungfuAthleteBot: Learning High-Dynamic Motion from Videos with Unified Robust Recovery
cs.RO
Submitted: 2026-02-14
Updated: 2026-10-17
Comments: 18 pages, 8 figures,5 tables
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Learning highly dynamic motions from video provides a scalable alternative to expensive data collection for humanoid robots, yet it is challenged by height floating, missing kinematic and force
Terminology
Abstract
Learning highly dynamic motions from video provides a scalable alternative to expensive data collection for humanoid robots, yet it is challenged by height floating, missing kinematic and force information, and limited robustness. We present KungfuAthleteBot (KAB), a unified framework that systematically addresses these issues. We first build a high-dynamic motion dataset in collaboration with professional martial artists, alleviating data scarcity while improving motion quality. To eliminate height drift and global jitter during both aerial and landing phases, we introduce a physics-guided parabolic trajectory correction that enforces physical plausibility. To bridge the discrepancy between human and robot actuation in highly dynamic behaviors, we design a three-stage curriculum that progressively enables stable acquisition of such motions. In addition, we propose a direct, teacher-free training paradigm that jointly learns disturbance rejection and fall recovery within a single policy. To the best of our knowledge, KAB achieves the fastest recovery time reported for a unified policy (about 0.7 s). Experiments on a real humanoid robot demonstrate successful learning of highly dynamic motions from video and strong robustness, including rapid recovery under severe disturbances.
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies