Precise SE(3) End-Effector Tracking in Whole-Body Humanoid Control
cs.RO, cs.SY, eess.SY
Submitted: 2026-10-07
Updated: 2026-10-07
Project page: https://resgac.github.io/ResGAC-website
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Precise end-effector tracking during humanoid whole-body motion is challenging due to floating-base oscillations, gravity, dynamic coupling, and locomotion-induced disturbances.
Terminology
Abstract
Precise end-effector tracking during humanoid whole-body motion is challenging due to floating-base oscillations, gravity, dynamic coupling, and locomotion-induced disturbances. We propose ResGAC, a whole-body humanoid controller for precise end-effector pose tracking that combines geometric admittance control (GAC) with residual reinforcement learning. GAC provides structured task-space feedback and generates nominal arm joint-position targets, while residual RL compensates for unmodeled dynamics and coordinates locomotion and balance in the shared joint-position action space. The left-invariant geometric formulation allows the same GAC law to be used across manipulation reference frames. This enables the use of a ground-attached heading frame that preserves planar locomotion while removing pelvis roll, pitch, and heave from the manipulation reference, thereby reducing reference-induced end-effector motion during locomotion. ResGAC is validated on a real Unitree G1 humanoid. Across four standing end-effector tracking benchmarks, ResGAC consistently outperforms representative baselines, including SONIC, achieving lower translational and rotational errors. Real-world experiments further demonstrate reduced propagation of pelvis motion to the desired end-effector pose using the proposed ground-attached heading frame. ResGAC achieves 90% success in a standing peg-in-hole task compared with 50% for SONIC, and accurate world-frame end-effector pose tracking during lower-body motion. Experimental videos are included in the supplementary material and are also available on the project website: https://resgac.github.io/ResGAC-website/.
Sources
- BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion
- OmniH2O: Universal and Dexterous Human-to-Humanoid Whole-Body Teleoperation and Learning
- HANDOFF: Humanoid Agentic Task-Space Whole-Body Control via Distilled Complementary Teachers
- HiWET: Hierarchical World-Frame End-Effector Tracking for Long-Horizon Humanoid Loco-Manipulation
- HOMIE: Humanoid Loco-Manipulation with Isomorphic Exoskeleton Cockpit
- Hold My Beer: Learning Gentle Humanoid Locomotion and End-Effector Stabilization Control
- SEEC: Stable End-Effector Control with Model-Enhanced Residual Learning for Humanoid Loco-Manipulation
- CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation
- FALCON: Learning Force-Adaptive Humanoid Loco-Manipulation
- ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning
- mjlab: A Lightweight Framework for GPU-Accelerated Robot Learning
- Learning Sim-to-Real Humanoid Locomotion in 15 Minutes
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies