IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
cs.AI
Submitted: 2026-07-24
Updated: 2026-10-20
Comments: Under Review
Code: https://github.com/declare-lab/IDEAgent
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
The gist: Large Language Models (LLMs) have significantly advanced the automation of scientific discovery.
Terminology
Abstract
Large Language Models (LLMs) have significantly advanced the automation of scientific discovery. However, existing systems share a core limitation: they optimize ideas independently for either Quality or Diversity. This often results in closely related ideas or large sets of trivial, unsound, or unclear concepts. We instead argue that research ideation should be framed as a conjunction of Quality and Diversity objectives, i.e., a Quality-Diversity (QD) search. Accordingly, we introduce IDEAgent, a multi-agent framework that tracks idea evolution through lineages. We jointly drive Quality using multi-objective feedback for repair and refinement, while Diversity is achieved through lightweight sequential memory and explicit comparison against completed ideas, historical variants, and rejected proposals. To evaluate this joint objective, we develop Yield, a metric that computes the largest mutually diverse set of ideas satisfying predefined quality thresholds. Across 32 topics spanning 8 CS domains, IDEAgent outperforms the best baseline by 3.89x on Yield, while achieving Yield of at least 2 on 8x as many topics. We further analyze quality improvements, showing that repair and refinement improve logical rigor and clarity while preserving non-obviousness. Lastly, we extend IDEAgent to two algorithm discovery tasks for verifiable quality judgment and find that it still consistently outperforms all baselines, and yields the largest set of high-quality and diverse programs that beat a trivial/standard baseline. To encourage future research on QD-search-based ideation, we open-source IDEAgent at https://github.com/declare-lab/IDEAgent.
Sources
- What Does It Take to Be a Good AI Research Agent? Studying the Role of Ideation Diversity
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones?
- The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery
- On the Limits of LLM-as-Judge for Scientific Novelty Assessment
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
- Deep Ideation: Designing LLM Agents to Generate Novel Research Ideas on Scientific Concept Network
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems