SETA: Scaling Environments for Terminal Agents
cs.AI
Submitted: 2026-07-12
Updated: 2026-09-30
Code: https://github.com/camel-ai/seta
Project page: https://www.compilebench.com
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models (LLMs) are rapidly shifting toward agents that solve tasks through diverse interfaces, including web and graphical user interfaces (GUIs).
Terminology
Abstract
Large language models (LLMs) are rapidly shifting toward agents that solve tasks through diverse interfaces, including web and graphical user interfaces (GUIs). Among these, the terminal command line provides a text-based, general-purpose interface, covering tasks from system operations to data science and machine learning. However, scaling terminal-agent training remains challenging, as it requires diverse and coherent task instructions, executable environments, and reliable verification, while lacking naturally grounded supervision data. In this work, we propose SETA, a scalable framework for generating verifiable terminal environments for reinforcement learning (RL). The framework consists of two pipelines sharing a unified verification mechanism: SETA-Synth converts diverse sources into standardized RL environments, and SETA-Evol further expands from existing environments with adaptive control of difficulty and diversity. Together, we construct and release SETA-Env, the largest open-source verifiable terminal RL dataset to date, containing over 4,500 environments. We evaluate our dataset by training Qwen3-8B with GRPO on SETA-Env, achieving 12% pass rate on Terminal-Bench 2.0, the best reported result for an RL-trained model at the 8B scale. We further observe gains on DeepSeek-V4-Flash under the same terminal agent harness, with pass@1 on Terminal-Bench 2.0 improving from 40% to 43% and pass@5 improving from 54% to 58%. These results demonstrate that SETA- Env provides high-quality training environments for terminal agents and serves as a valuable resource for advancing research on terminal-based agent learning.
Sources
- DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence
- AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning
- Endless Terminals: Scaling RL Environments for Terminal Agents
- R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents
- Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
- CRUST-Bench: A Comprehensive Benchmark for C-to-safe-Rust Transpilation
- Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
- Training Software Engineering Agents and Verifiers with SWE-Gym
- On Data Engineering for Scaling LLM Terminal Capabilities
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewards
- ScaleEnv: Scaling Environment Synthesis from Scratch for Generalist Interactive Tool-Use Agent Training
- Large-Scale Terminal Agentic Trajectory Generation from Dockerized Environments
- OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
- SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
- SWE-smith: Scaling Data for Software Engineering Agents
- ReAct: Synergizing Reasoning and Acting in Language Models
- DAPO: An Open-Source LLM Reinforcement Learning System at Scale
- RLVE: Scaling Up Reinforcement Learning for Language Models with Adaptive Verifiable Environments
- WebArena: A Realistic Web Environment for Building Autonomous Agents
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems