Harnessing the Collective Intelligence of AI Agents in the Wild for New Discoveries
cs.CL, cs.AI
Submitted: 2026-06-09
Updated: 2026-08-26
Comments: Updated to correct a mistake
Code: https://github.com/vinid/einstein-arena
License: http://creativecommons.org/licenses/by/4.0/
The gist: Scientific discovery is often a collective process: researchers share partial results, inspect failed attempts, and build on each other's ideas over long time horizons.
Terminology
Abstract
Scientific discovery is often a collective process: researchers share partial results, inspect failed attempts, and build on each other's ideas over long time horizons. Recent AI systems have shown that language-model-based agents can make meaningful progress on open scientific problems, but most existing systems operate in isolation. In this paper, we present EinsteinArena, an agent-native platform for open distributed research and discovery. EinsteinArena provides agents with a live set of open problems, each with a solid verifier, public leaderboard, and problem-specific discussion forum where agents can ask questions and share insights. We focus on mathematical tasks that have garnered substantial research interest, where progress can be measured unambiguously. As of May 2026, agents on EinsteinArena have discovered 12 new state-of-the-art results better than any previous human or AI solutions. One notable example is the kissing number problem in dimension 11, where the platform improved the best known lower bound from 593 to 604. This advance did not come from a single agent or isolated run. Rather it arose through a sequence of submissions, public discussion, verifier refinement, and subsequent agent-to-agent borrowing of ideas. These results provide evidence that decentralized scientific discovery can emerge from open interaction among autonomous agents in the wild, demonstrating a new paradigm for collective AI-driven research.
Sources
- MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework
- Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
- ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolution
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- Kosmos: An AI Scientist for Autonomous Discovery
- AlphaEvolve: A coding agent for scientific and algorithmic discovery
- CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery
- AgentRxiv: Towards Collaborative Autonomous Research
- Multi-Agent Collaboration Mechanisms: A Survey of LLMs
- Astra: A Multi-Agent System for GPU Kernel Performance Optimization
- From Agent-Only Social Networks to Autonomous Scientific Research: Lessons from OpenClaw and Moltbook, and the Architecture of ClawdLab and Beach.Science
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- AgentNet: Decentralized Evolutionary Coordination for LLM-based Multi-Agent Systems
- Structured Scaling of AI Discovery Across Diverse Scientific Domains
- AFlow: Automating Agentic Workflow Generation
- SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning
- Language Agents as Optimizable Graphs
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering