BRACE: Adapting Whole-Body References for Force and Terrain Aware Humanoid Motion Tracking
cs.RO
Submitted: 2026-10-05
Updated: 2026-10-05
Code: https://github.com/unitreerobotics/unitree_ros
Project page: https://multiplylabs.github.io/brace
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Whole-body tracking has become the interface through which operators drive humanoid robots, yet the references it consumes are recorded on level ground and carrying nothing, so the tracker is aware
Abstract
Whole-body tracking has become the interface through which operators drive humanoid robots, yet the references it consumes are recorded on level ground and carrying nothing, so the tracker is aware of neither the forces the robot must exchange with objects nor the terrain it must stand on. Existing controllers address one side of this gap: force-capable policies command an end-effector force but prescribe no whole-body pose, while terrain-adaptive trackers treat loads as disturbances to reject rather than wrenches to command. We present BRACE, a whole-body tracker that exerts and compensates commanded hand forces from diverse poses while following a flat-ground reference on sloped terrain. Rather than leaving the tracker to absorb the load and the slope, BRACE folds both into the reference it follows: terrain conformance lifts footholds and root onto the local surface, and a wrench transformation resolves the hand displacement that produces a force jointly with the center-of-mass and center- of-pressure shifts it induces, bounded by teacher-specific arm-effort limits. Separate exertion and compensation teachers are distilled by DAgger into one flow-matching student that runs on proprioception alone, without a height map or measured wrench, so a teleoperator (even in remote locations) can supply a flat- ground trajectory and the robot resolves slope and load onboard. We extensive experiments on the Unitree-G1 to demonstrate the ability of BRACE to exert, compensate force and handle diverse terrain in simulation and real robot experiments.
Sources
- Track Any Motions under Any Disturbances
- ExBody2: Advanced Expressive Humanoid Whole-Body Control
- HAFO: A Force-Adaptive Control Framework for Humanoid Robots in Intense Interaction Environments
- Kinematics-Aware Multi-Policy Reinforcement Learning for Force-Capable Humanoid Loco-Manipulation
- CHIP: Adaptive Compliance for Humanoid Control through Hindsight Perturbation
- HEFT: Heavy-Payload Full-size Humanoid Teleoperation with Privileged Motion Guidance and Windowed Payload Curriculum
- Learning Whole-Body Humanoid Locomotion via Motion Generation and Motion Tracking
- Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terrain
- BFM-Zero: A Promptable Behavioral Foundation Model for Humanoid Control Using Unsupervised Reinforcement Learning
- SoftMimic: Learning Compliant Whole-body Control from Examples
- Isaac Lab: A GPU-Accelerated Simulation Framework for Multi-Modal Robot Learning
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- XRoboToolkit: A Cross-Platform Framework for Robot Teleoperation
- Retargeting Matters: General Motion Retargeting for Humanoid Motion Tracking
- MotionBricks: Scalable Real-Time Motions with Modular Latent Generative Model and Smart Primitives
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies