SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarm
cs.AI, cs.CL
Submitted: 2026-10-14
Updated: 2026-10-19
Code: https://github.com/openai/mle-bench
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Recursive self-improvement (RSI) in scientific research aims to improve agents' research capabilities through their own experimental experience.
Abstract
Recursive self-improvement (RSI) in scientific research aims to improve agents' research capabilities through their own experimental experience. Scientific agent swarms can combine evidence and implementations from different research directions to guide their agents' subsequent experiments. However, poor experimental results can leave unclear whether to revise a hypothesis or its implementation, while overall program scores can hide components useful to other agents. To address these challenges, we introduce SwarmRSI, a framework that evolves scientific agent swarms for recursive self-improvement. We devise Feedback-Guided Swarm Mutation to refine hypotheses and their implementations using experimental feedback from other agents. We also propose Complementary Swarm Recombination to reuse retained hypotheses and complementary program components across agents, allowing partial results to support new research. Recursive Swarm Evolution integrates both mechanisms into a feedback loop, using new experimental evidence to guide subsequent research. Experiments on OpenProblems, NatureBench and MLE-Bench Lite demonstrate SwarmRSI's state-of-the-art (SOTA) performance. Further evaluations show that accumulated research experience improves performance on held-out tasks. Biologists also reproduce its programs for follow-up biological analyses.
Sources
- SearchJev: A Fast and Calibrated System-1 Model for Search Agents
- MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discovery
- AQuA: Recursively Self-Improving Quantitative Trading Research Agents
- RubricReviewer: From Direct Critique to Objective and Comprehensive Rubric-Driven Peer Review
- AIDE: AI-Driven Exploration in the Space of Code
- Toward Generalist Autonomous Research via Hypothesis-Tree Refinement
- Agent-centric Information Access
- Agentic Discovery with Active Hypothesis Exploration for Visual Recognition
- Recursive Self-Improvement through Multi-Agent Self-Supervision
- The FM Agent
- HypoEvolve: Genetic Algorithms Enable Multi-Agent LLMs to Discover Scientific Hypotheses
- ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoning
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Self-Adaptive Cognitive Debiasing for Large Language Models in Decision-Making
- EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery
- DeepShop: A Benchmark for Deep Research Shopping Agents
- One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution
- MLE-STAR: Machine Learning Engineering Agent via Search and Targeted Refinement
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- EvoIdeator: Evolving Scientific Ideas through Checklist-Grounded Reinforcement Learning
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems