The Agentic Scientist: Orchestrating Coding Agents for Automated Scientific (Co-)Discovery
cs.AI, cs.CL, cs.LG
Submitted: 2026-10-13
Updated: 2026-10-13
Comments: 88 pages
Code: https://github.com/SakanaAI/AI-Scientist-v3
License: http://creativecommons.org/licenses/by/4.0/
The gist: Modern coding agents are fundamentally reshaping the role of human input for computational research: they write code, launch in silico experiments, analyze their results, and autonomously operate
Abstract
Modern coding agents are fundamentally reshaping the role of human input for computational research: they write code, launch in silico experiments, analyze their results, and autonomously operate with ever-increasing time horizons. Despite these developments, fully autonomous research agents suffer from a limited ideation radius and myopic hill-climbing search dynamics. To bridge this gap, we introduce The Agentic Scientist, an end-to-end distributed pipeline for human researchers to conduct computational research alongside modern coding agents. Building on its predecessor, our system decomposes research into task drafting, idea generation, planning, sandboxed experimentation, result aggregation, baseline and ablation construction, post-hoc analysis, and report writing. Importantly, each step in the pipeline is powered by the next generation of coding agents and leverages agentic self-verification. The overall research process is driven by a meta-controller that manages parallel research agents and enforces rubric verification at each stage. This design enables the same orchestration layer to be reused across heterogeneous domains with different execution environments, agentic coding harnesses, and evaluation metrics. Our system can be used across a spectrum of autonomy: either as a co-scientist tool or to perform end-to-end scientific investigation. Within the co-scientist setting, we leveraged a development version of our system to submit a single research paper, which got accepted for publication at ALIFE 2026. We further apply The Agentic Scientist fully autonomously to open problem-solving tasks in machine learning, and demonstrate the system's capability of scientific discovery across different domains of computational research. Our ablations suggest that reliable scientific autonomy depends not only on base model capabilities, but also on the cross-agent orchestration layer.
Sources
- HPO-B: A Large-Scale Reproducible Benchmark for Black-Box HPO based on OpenML
- Training AI Scientists to Replicate Research
- Discovering Quality-Diversity Algorithms via Meta-Black-Box Optimization
- InternAgent-1.5: A Unified Agentic Framework for Long-Horizon Autonomous Scientific Discovery
- Can LLMs Beat Classical Hyperparameter Optimization Algorithms? A Study on autoresearch
- MLReplicate: Benchmarking Autonomous Research Systems for Machine Learning Reproducibility
- AutoScientists: Self-Organizing Agent Teams for Long-Running Scientific Experimentation
- Gemma 2: Improving Open Language Models at a Practical Size
- SciFig: Towards Automating Editable Figure Generation for Scientific Papers
- Efficient Long-Horizon Learning for Learned Optimization
- AIDE: AI-Driven Exploration in the Space of Code
- SAEBench: A Comprehensive Benchmark for Sparse Autoencoders in Language Model Interpretability
- The Semantic Scholar Open Data Platform
- Measuring AI Ability to Complete Long Software Tasks
- Discovering Attention-Based Genetic Algorithms via Meta-Black-Box Optimization
- Figures as Programs: Recursive Generation of Editable Scientific Figures
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- OpenAlex: A fully-open index of scholarly works, authors, venues, institutions, and concepts
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems