Tev: Scaling Long-Horizon Agentic Environments with Dense Progress Rewards
cs.CL, cs.AI, cs.CV, cs.LG
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: https://tev-agent.github.io/
Code: https://github.com/MoonshotAI/Kimi-K3
Project page: https://tev-agent.github.io
License: http://creativecommons.org/licenses/by/4.0/
The gist: Long-horizon agents have drawn growing attention for their ability to work autonomously -- from hours to days -- on economically valuable tasks, a capability essential to automated discovery and
Abstract
Long-horizon agents have drawn growing attention for their ability to work autonomously -- from hours to days -- on economically valuable tasks, a capability essential to automated discovery and recursive self-improvement (RSI). Yet open-source models still struggle on long-horizon tasks, largely for lack of both training data and a working recipe, and scaling both is hard: long, complex tasks are difficult to curate and verify, and their rewards are sparse. We address both. First, we introduce Tev-Gym, the first long-horizon agent training dataset with verifiable, dense, progressive rewards -- 1,170 verified task environments across 7 domains. It is built on a latent-world-first approach that first constructs a latent world: a complete and correct hidden specification of the task domain, workflow, and expected state after each step. Each task is then progressively rendered from this specification into an agent-facing environment, enabling controllable complexity and a natural progress metric. Second, we turn this metric into a training recipe: via progress-potential reward shaping (PPRS), we convert progress into a dense per-step reward that improves training efficiency and makes otherwise-intractable tasks trainable. Training with this recipe yields Tev-27B, which achieves substantial gains on the Agents' Last Exam computing and math sciences domains (ALE-CM), matching GPT-6 Astra and Claude Opus 5 at Pass@5. Despite training only on ALE-related data, it generalizes to the Terminal-Bench (TB) 3.0 and 4.0 subsets, surpassing GLM 5.2 and Gemini 3.7 Flash, and reaches Claude Opus 4.8-level performance on middle-horizon tasks such as TB 2.1.
Sources
- SWE-rebench: An Automated Pipeline for Task Collection and Decontaminated Evaluation of Software Engineering Agents
- AutoForge: Automated Environment Synthesis for Agentic Reinforcement Learning
- DIVE: Scaling Diversity in Agentic Task Synthesis for Generalizable Tool Use
- Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles
- AgentFrontier: Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis
- Process Reward Models for LLM Agents: Practical Framework and Directions
- Process Reinforcement through Implicit Rewards
- Agent-World: Scaling Real-World Environment Synthesis for Evolving General Agent Intelligence
- SWE-Dev: Evaluating and Training Autonomous Feature-Driven Software Development
- Towards General Agentic Intelligence via Environment Scaling
- Group-in-Group Policy Optimization for LLM Agent Training
- Endless Terminals: Scaling RL Environments for Terminal Agents
- Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains
- GenEnv: Difficulty-Aligned Co-Evolution Between LLM Agents and Environment Simulators
- Breakpoint: Scalable evaluation of system-level reasoning in LLM code agents
- Skywork Open Reasoner 1 Technical Report
- ALE-Bench: A Benchmark for Long-Horizon Objective-Driven Algorithm Engineering
- Anchor: Mitigating Artifact Drift in Agent Benchmark Generation
- Tmax: A simple recipe for terminal agents
- R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering