Beyond Kinematic Tracking: Preserving Expressive Characteristics in Humanoid Whole-Body Control
cs.RO
Submitted: 2026-10-14
Updated: 2026-10-14
Comments: Under Review
License: http://creativecommons.org/licenses/by/4.0/
The gist: Whole-body control plays a crucial role in enabling humanoid robots to execute expressive motions.
Abstract
Whole-body control plays a crucial role in enabling humanoid robots to execute expressive motions. Faithful execution requires preserving both the intended action and its expressive characteristics. Existing whole-body trackers typically balance joint and keypoint tracking with physical stability across diverse motions, but these objectives do not necessarily prioritize the expressive characteristics of each action. Our analysis shows that lower average positional tracking error does not guarantee better preservation of dynamic and postural motion characteristics. To address this gap, we propose a residual learning framework with compensation objectives targeting amplitude, energy, body expansion, body lean, and pelvis height. To concentrate compensation while limiting interference with the underlying tracking behavior, motion-aware gating allocates correction capacity according to body-part activity, preserving larger correction ranges in more active parts and restricting them elsewhere. For each frozen tracker, we train motion-specific residual policies and distill them into a unified policy shared across motion categories. Simulation and physical experiments on the Unitree G1 across eight motion categories demonstrate superior preservation of dynamic and postural motion characteristics compared with the corresponding baselines.
Sources
- TextOp: Real-time Interactive Text-Driven Humanoid Robot Motion Generation and Control
- Humanoid-GPT: Scaling Data and Structure for Zero-Shot Motion Tracking
- GMT: General Motion Tracking for Humanoid Whole-Body Control
- ExBody2: Advanced Expressive Humanoid Whole-Body Control
- ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning
- MOSAIC: Bridging the Sim-to-Real Gap in Generalist Humanoid Motion Tracking and Teleoperation with Rapid Residual Adaptation
- Bionic Human-Motion Style Transfer for Physically Executable Whole-Body Control of Humanoid Robots
- BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion
- General Humanoid Whole-Body Control via Pretraining and Fast Adaptation
- Proximal Policy Optimization Algorithms
- SOMA: Unifying Parametric Human Body Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies