LADDER: A Long-Horizon Robot Manipulation Benchmark
cs.RO, cs.LG
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: 30 pages. Project website: https://ladder.insait.ai
Project page: https://ladder.insait.ai
License: http://creativecommons.org/licenses/by/4.0/
The gist: General-purpose robot manipulation policies learn short-horizon skills effectively, but degrade rapidly on long-horizon tasks.
Terminology
Abstract
General-purpose robot manipulation policies learn short-horizon skills effectively, but degrade rapidly on long-horizon tasks. Existing benchmarks cannot isolate failures because task horizon is either too short or entangled with scene and object variations. We propose LADDER, a long-horizon robot manipulation benchmark scaling from 1 to 10 subgoals within the same environment over three suites (SimplerEnv-Long, RobotArena- infinity-Long, and RoboLab-Long), 145 tasks, eight categories, two embodiments, and 2,024 simulated episodes per system. We evaluate two orchestration paradigms: text subgoals for learned low-level policies (VoLo) and tool selection orchestration (CaP-X, GPT-Policy, PSP-Agent, TiPToP). Given the full instruction directly, low-level policies achieve 85.4% on single-subgoal tasks, but drop to near zero on extended tasks. While orchestration remedies this, it remains bounded by physical execution errors of the low-level policy rather than high-level planning and achieves only 25%. Tool selection orchestration with GPT-Policy on GPT-6 Astra significantly outperforms learned-policy methods, but incurs significant time and cost budget and succeeds only 62%. Real-world experiments across two embodiments confirm the collapse of the low-level policy and the gain from orchestration. Project website: https://ladder.insait.ai
Sources
- Qwen3-VL Technical Report
- VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulation
- In-Context Robot Learning with VLM Agents
- Cosmos 3: Omnimodal World Models for Physical AI
- TiPToP: A Modular Open-Vocabulary Robot Manipulation System That Plans
Related papers
- FMT x: An Efficient and Asymptotically Optimal Extension of the Fast Marching Tree for Dynamic Replanning
- MPCFormer: A physics-informed data-driven approach for explainable socially-aware autonomous driving
- RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policies
- ARC: A Reasoning Recipe for Robot Foundation Models
- HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments
- APT: Action Expert Pretraining Improves Instruction Generalization of Vision-Language-Action Policies