Test-Time Compute for Humanoid Behavior Foundation Models
cs.RO
Submitted: 2026-10-10
Updated: 2026-10-14
Comments: The project page is available at https://bfmttc.github.io/
Code: https://github.com/google-deepmind/mujoco_warp
Project page: https://bfmttc.github.io
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Humanoid Behavior Foundation Models (BFMs) can execute impressive motions, but downstream applications such as loco-manipulation demand high whole-body positional accuracy.
Terminology
Abstract
Humanoid Behavior Foundation Models (BFMs) can execute impressive motions, but downstream applications such as loco-manipulation demand high whole-body positional accuracy. Existing BFMs suffer from a systematic command-execution gap, where executed motions deviate from desired ones. We show that additional test-time compute can improve execution without retraining the BFM. First, we introduce Test-Time Command Optimization (TTCO), which adapts the input command to the specific BFM to produce an executed trajectory closer to the desired motion. TTCO finds such commands by sampling-based optimization through closed-loop simulations of the BFM and robot dynamics. Across three BFMs on the AMASS dataset, TTCO reduces mean global body-position error by 79-84% in simulation. Second, we analyze test-time compute scaling and derive an approximate compute-optimal strategy that can sustain performance gains as the compute budget increases. Third, TTCO can generate BFM-specific action labels from recorded robot trajectories without requiring the original teleoperation body-motion commands. Simulation and real-robot experiments show that these labels are effective for training high-level loco-manipulation policies. This method also supports reusing existing demonstrations across BFMs.
Sources
- GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
- Large Language Monkeys: Scaling Inference Compute with Repeated Sampling
- TEXEDO : Test Time Scaling for Controller-aware Language-conditioned Humanoid Motion Generation
- HoloMotion-1 Technical Report
- KungfuBot2: Learning Versatile Motion Skills for Humanoid Whole-Body Control
- Predictive Sampling: Real-time Behaviour Synthesis with MuJoCo
- OpenHLM: An Empirical Recipe for Whole-Body Humanoid Loco-Manipulation
- An Introduction to Zero-Order Optimization Techniques for Robotics
- ELASTIC: Efficiently Learning to Adaptively Scale Test-Time Compute for Generative Control Policies
- OmniClone: Engineering a Robust, All-Rounder Whole-Body Humanoid Teleoperation System
- HEFT: Heavy-Payload Full-size Humanoid Teleoperation with Privileged Motion Guidance and Windowed Payload Curriculum
- Enabling Robust Cloth Manipulation via Inference-Time Simulator-in-the-Loop Refinement
- Robust and Generalized Humanoid Motion Tracking
- SPIDER: Scalable Physics-Informed Dexterous Retargeting
- Consensus-based optimization (CBO): Towards Global Optimality in Robotics
- HumanoidArena: Benchmarking Egocentric Hierarchical Whole-body Learning
- VLK: Learning Humanoid Loco-Manipulation from Synthetic Interactions in Reconstructed Scenes
- OmniXtreme: Breaking the Generality Barrier in High-Dynamic Humanoid Control
- Teleopit: A Full-Embodiment Humanoid Teleoperation System
- GRAIL: Generating Humanoid Loco-Manipulation from World Models
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies