Harness 2: Recursive Agent Harnessing for an Open World
cs.AI, cs.CL, cs.LG
Submitted: 2026-10-09
Updated: 2026-10-09
Code: https://github.com/google-research/harness2
License: http://creativecommons.org/licenses/by/4.0/
The gist: LLM agents' capabilities depend not only on their underlying models but also on their execution harnesses.
Abstract
LLM agents' capabilities depend not only on their underlying models but also on their execution harnesses. Recursive self-improvement (RSI) offers a promising approach to automatically evolve these harnesses. However, deploying RSI in open-world settings still faces two critical challenges. First, open-world tasks are typically unseen during the harness design phase and novel at test time, leaving no ground-truth verifiers to reliably guide online harness edits. Second, the RSI process remains highly task-specific and fails to generalize to novel scenarios. We introduce Harness squared, a plug-and-play, recursive agent harnessing framework that addresses these challenges through two connected levels of recursion. Task-level recursion refines the current task's harness using a contrastive Propose-Probe-Compose step that reliably guides edits without ground-truth verifiers, and can be scaled further via parallel or sequential recursion. Harnessing-level recursion then extracts experience from these edits to update a continual improvement harness, enabling the agent to better adapt to future tasks. Across three professional benchmarks and four model-harness configurations, a single step consistently improves GLM-5 and Gemini 3.5 Flash over their base harnesses, yielding gains of up to 11.5 points on WorkBuddy-Bench, 4.5 points on JobBench, and 11.8 percentage points on LAB, with further gains as the task-level recursion budget increases.
Sources
- HarnessX: A Composable, Adaptive, and Evolvable Agent Harness Foundry
- The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
- MemoHarness: Agent Harnesses That Learn from Experience
- Harness Continual Learning: Continual Adaptation Beyond Model Parameters
- Continual Harness: Online Adaptation for Self-Improving Foundation Agents
- Recursive Harness Self-Improvement
- JobBench: Aligning Agent Work With Human Will
- Agentic Harness Engineering: Observability-Driven Automatic Evolution of Coding-Agent Harnesses
- Adaptive Auto-Harness: Sustained Self-Improvement for Agentic System Deployment on Open-Ended Task Streams
- EvolveNet: Collaborative Harness Evolution for Agent Self-Improvement
- TTHE: Test-Time Harness Evolution
- SkillOS: Learning Skill Curation for Self-Evolving Agents
- ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory
- AI4AI at Test-Time: Strong-to-Weak Capability Transfer via Harnesses
- Harness-R1: Learning to Edit Executable Runtime Harnesses from Agent Failure Trajectories
- Tencent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Construction
- Recursive Self-Aggregation Unlocks Deep Thinking in Large Language Models
- Rethinking the Evaluation of Harness Evolution for Agents
- MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolution
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems