Contact-UAN: Unsupervised Actuator Networks as a Residual World Model for Humanoid Control
cs.RO
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: Project website: https://contact-uan.csail.mit.edu/
Code: https://github.com/isaac-sim/IsaacSim
Project page: https://contact-uan.csail.mit.edu
License: http://creativecommons.org/licenses/by/4.0/
The gist: Humanoid policies trained in simulation can transfer qualitatively to hardware while failing to transfer the force interactions learned during training, compromising torque efficiency, load
Terminology
Abstract
Humanoid policies trained in simulation can transfer qualitatively to hardware while failing to transfer the force interactions learned during training, compromising torque efficiency, load regulation, and robustness to impacts. This failure can arise from actuator sim-to-real gaps because forces depend on actuator torques. We introduce Contact-UAN, a residual world model that preserves a simulator's physics priors while correcting actuator dynamics to align simulated rollouts with recorded hardware rollouts. For humanoid motion with contact, this requires contact-consistent replay: if hardware playback in simulation begins with misaligned contact wrenches, the residual model learns to correct reset artifacts rather than actuator discrepancies. Using only onboard proprioception, Contact-UAN infers the simulator-side stance-foot pose needed to initialize replay with consistent contact forces. We show that a UAN trained on 6.5 minutes of real-world walking data generalizes to tasks that benefit from accurate force and impulse regulation and produces policies that transfer seamlessly to the real world, yielding 20% lower running torque, 43% lower force-tracking error, extreme compliance, accurate impedance control, and dynamic, robust jumps.
Sources
- ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control
- BeyondMimic: From Motion Tracking to Versatile Humanoid Control via Guided Diffusion
- Perceptive Humanoid Parkour: Chaining Dynamic Human Skills via Motion Matching
- SoftMimic: Learning Compliant Whole-body Control from Examples
- Towards bridging the gap: Systematic sim-to-real transfer for diverse legged robots
- Rapid Locomotion via Reinforcement Learning
- Learning to See Physical Properties with Active Sensing Motor Policies
- World Model for Robot Learning: A Comprehensive Survey
- Robotic World Model: A Neural Network Simulator for Robust Policy Optimization in Robotics
- Neural Fidelity Calibration for Informative Sim-to-Real Adaptation
- mjlab: A Lightweight Framework for GPU-Accelerated Robot Learning
- Uncertainty-Aware Robotic World Model Makes Offline Model-Based Reinforcement Learning Work on Real Robots
- High-Performance Reinforcement Learning on Spot: Optimizing Simulation Parameters with Distributional Measures
- Sim-to-Real of Humanoid Locomotion Policies via Joint Torque Space Perturbation Injection
- Hybrid Internal Model: Learning Agile Legged Locomotion with Simulated Robot Response
- MOSAIC: Bridging the Sim-to-Real Gap in Generalist Humanoid Motion Tracking and Teleoperation with Rapid Residual Adaptation
- RSL-RL: A Learning Library for Robotics Research
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies