GenoMAS: Guided Multi-Agent Programming for Scientific Discovery from Genomic Data

arXiv:2507.21035 · cs.AI, cs.LG, cs.MA, q-bio.GN · Submitted 2025-07-28 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "GenoMAS: Guided Multi-Agent Programming for Scientific Discovery from Genomic Data".

Jane: Here's the gist of the paper. My synthesis will be comprehensive, accurate, and structured to reflect the technical depth required for high-stakes scientific understanding.

Tom: Here is a detailed, combined summary of the paper "GenoMAS: Guided Multi-Agent Programming for Scientific Discovery from Genomic Data." Comprehensive Research Summary: GenoMAS Framework GenoMAS is a sophisticated multi-agent framework engineered to revolutionize scientific automation by treating agents not as mere tool orchestrators, but as collaborative programmers.

Jane: Its core innovation lies in integrating structured workflows with autonomous agents, enabling end-to-end code generation for complex genomic analysis tasks.

Tom: The framework addresses the fundamental tension between precise procedural control and adaptive error handling essential for trustworthy scientific automation.

Title and authors: Tom: So we're looking at this paper called "GenoMAS: Guided Multi-Agent Programming for Scientific Discovery from Genomic Data" and the authors are Haoyang Liu, Yijiang Li, and Haohan Wang from the University of Illinois at Urbana-Champaign and UC San Diego. It sounds like a pretty big deal because it's about using multiple AI agents to do scientific discovery based on genomic data.

Jane: Yeah, so what does that actually mean for someone who doesn't spend all day looking at complex genomic files? Basically, they’re talking about a system where you don't just have one program running; you have a team of specialized AIs collaborating to analyze data.

Lu: It frames the problem as moving away from just having these agents act like simple tool orchestrators and instead making them true collaborative programmers that can write and refine code for analysis, which is what this paper calls end-to-end code generation >

Meng: So, if we think about it practically, it means instead of me writing a script and hoping it works or breaking when the data gets messy, you have these specialized AIs handling the whole pipeline from start to finish >

Lalam: It’s like having a whole lab team where each person has a specific job in processing that massive genomic information.

The paper's summary: Tom: The core of what GenoMAS does is this guided planning framework where high-level instructions get broken down into something called Action Units, which are just structured text directives that the agents can turn into code and then revise as they go >

Jane: That sounds like a way to give the system control without it being too rigid, because if it hits a snag, the agents can decide whether to keep going or backtrack based on what they've learned about the data >

Lu: The paper emphasizes that scientific automation isn't just about planning workflows; it hinges on writing and revising code that executes them >

Meng: They show that this framework lets you use different types of LLMs simultaneously, meaning you can have one AI for coding and another for reviewing, so they’re all working in the same loop >

Lalam: And they use a typed message-passing protocol to make sure everyone knows exactly who is talking to whom, which keeps things organized and prevents them from getting stuck in circular dependencies.

The paper's improvements: Tom: The authors highlight several specific ways GenoMAS improves on older methods, like this guided planning mechanism that encodes workflows as those editable Action Units >

Jane: And they also focus on how the system handles errors by suggesting a three-stage process of writing, reviewing, and then revising the code until it gets approved >

Lu: They're also pushing for context-aware planning so the agents can revisit a previous step with modified parameters or skip steps if they don't need to >

Meng: And on the efficiency side, they have this dynamic memory where validated code snippets are cached, which saves time, tracking about fifty-seven point eight minutes in one session > <ref:2507.21035#pg2>

Lalam: Plus, when you need deep biology knowledge for something specific, you can route the request directly to a Domain Expert instead of always sending it through the Code Reviewer first.

Conclusion: Tom: So, to wrap up GenoMAS is presenting this multi-agent framework as a way to treat scientific automation as a coding problem and achieving end-to-end code generation for genomic analysis tasks >

Jane: It seems like the main implication is that we can build tools that are both highly structured with precise control and flexible enough to handle the messy, unpredictable nature of real biological data >

Lu: The heterogeneity of agents is a key contribution here because it proves that combining different LLMs with different strengths in coding, reasoning, and review roles works really well together >

Meng: From an engineering standpoint, the fact that they managed to achieve a Composite Similarity Correlation of eighty-nine point one three percent for data preprocessing on the GenoTEX benchmark is a solid number, even if they note that clinical trait preprocessing only hit about thirty-two point six one percent CSC >

Lalam: It shows that while they’ve made serious headway in handling the expression data, there’s still a clear gap where you really need that deep domain expertise for things like clinical features >

Haoyang Liu, Yijiang Li, Haohan Wang

University of Illinois at Urbana-Champaign · University of California, San Diego

cs.AI, cs.LG, cs.MA, q-bio.GN

Submitted: 2025-07-28

Updated: 2026-10-20

Comments: Accepted to EMNLP 2026 Findings. Project page at https://liu-hy.github.io/GenoMAS/ and code at https://github.com/Liu-Hy/GenoMAS

Code: https://github.com/Liu-Hy/GenoMAS

Project page: https://liu-hy.github.io/GenoMAS

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

The gist: My synthesis will be comprehensive, accurate, and structured to reflect the technical depth required for high-stakes scientific understanding.

Key concepts

Guided Planning Framework
This mechanism structures high-level scientific goals into 'Action Units,' which are like detailed instructions for the AI agents. Agents use this plan to decide whether to proceed, revise, or backtrack based on the current data context. It ensures logical coherence in code generation.
Heterogeneous Agent Composition
GenoMAS uses different specialized Large Language Models (LLMs) for different jobs, such as one for coding and another for deep biological knowledge. This combination allows agents to work together effectively, leveraging the unique strengths of each model to solve complex problems collaboratively.
Iterative Review Loop
This is a quality control process where generated code is written, reviewed by an agent, and then revised until it meets high standards. This cycle ensures robustness against errors at the workflow level by allowing agents to self-correct and refine their output repeatedly.

Terminology

Summary

My synthesis will be comprehensive, accurate, and structured to reflect the technical depth required for high-stakes scientific understanding.

Here is a detailed, combined summary of the paper GenoMAS: Guided Multi-Agent Programming for Scientific Discovery from Genomic Data.


Comprehensive Research Summary: GenoMAS Framework

GenoMAS is a sophisticated multi-agent framework engineered to revolutionize scientific automation by treating agents not as mere tool orchestrators, but as collaborative programmers. Its core innovation lies in integrating structured workflows with autonomous agents, enabling end-to-end code generation for complex genomic analysis tasks. The framework addresses the fundamental tension between precise procedural control and adaptive error handling essential for trustworthy scientific automation.

Core Architectural Philosophy and Design Principles

The architecture of GenoMAS is built upon several interconnected pillars:

  1. Guided Planning Framework: The system employs a guided planning mechanism where high-level task guidelines are unfolded into Action Units. These Action Units function as structured textual directives that can be transformed into, and refined as, executable code. This allows agents to maintain logical coherence by electing to advance, revise, bypass, or backtrack based on the current context and data idiosyncrasies.

  2. Heterogeneous Agent Composition: GenoMAS supports a diverse set of specialized LLMs with complementary strengths across different domains (coding synthesis, language reasoning, scientific review). This heterogeneity allows agents to operate in coordinated roles within the same execution loop.

  3. Typed Message-Passing Protocol: Communication between agents is governed by a strict topology-based routing system. Messages are typed (e.g., TASK REQUEST, CODE WRITING REQUEST, PLANNING RESPONSE), specifying the sender's role, message type, content, and target roles. This protocol enforces communication paths to prevent circular dependencies, ensuring precise coordination across the system.

  4. Dynamic Memory and Code Reuse: The framework incorporates a dynamic memory mechanism that caches validated code snippets. This significantly enhances efficiency by saving substantial time (e.g., 57.8 minutes tracked in one session) through the reuse of consistent processing steps common across different datasets, such as loading GEO files or normalizing expression values.

Specialized Agent Roles and LLM Backbone

GenoMAS orchestrates six specialized agents, each powered by a state-of-the-art LLM backbone selected for its specific capabilities:

  • PI Agent (Orchestration): Acts as the central coordinator, dynamically assigning tasks based on analysis requirements and task dependencies.

  • Data Engineer Agents (Programming): These handle data preprocessing. They are specialized: the GEO agent focuses on Gene Expression Omnibus (GEO) datasets, while the TCGA agent manages The Cancer Genome Atlas (TCGA) data, each possessing specific knowledge of their respective formats and preprocessing challenges.

  • Statistician Agent (Programming): Conducts downstream statistical analyses, utilizing regression models to identify trait-associated genes while rigorously accounting for confounding factors.

  • Code Reviewer Agent (Advisory): Validates generated code for both functionality and instruction conformance, suggesting targeted fixes.

  • Domain Expert Agent (Advisory): Provides critical biomedical insights necessary for decisions requiring deep biological knowledge, such as clinical feature extraction and gene identifier mapping.

The LLM selection is strategically tailored: Claude Sonnet 4 powers the programming agent for strong coding abilities; OpenAI o3 serves dual roles—guiding planning logic and enabling the Code Reviewer; and Gemini 2.5 Pro provides the backbone for the Domain Expert due to its top performance on GPQA and HLE benchmarks, ensuring broad scientific knowledge in biology.

Workflow Mechanics: Planning, Execution, and Iteration

The operational loop of GenoMAS is highly structured:

  1. Task Initiation: A programming agent receives a TASK REQUEST from the PI. It immediately enters a self-messaging planning phase by sending a PLANNING REQUEST to itself to analyze the context and select an appropriate Action Unit.

  2. Planning-Execution Cycle: Upon receiving its own PLANNING RESPONSE, the agent selects an Action Unit and then sends a CODE WRITING REQUEST (to itself or the Domain Expert, depending on required expertise).

  3. Code Review Loop: After generation, the agent initiates a quality assurance loop by sending a CODE REVIEW REQUEST to either the Code Reviewer or Domain Expert. This review assesses functionality and instruction conformance. If rejected, the agent receives feedback and sends a CODE REVISION REQUEST. This iterative cycle continues until code is approved or maximum revision rounds are exceeded.

  4. Domain Consultation: When specialized knowledge is needed (e.g., for clinical feature extraction), the system routes requests to the Domain Expert, which maintains continuity by receiving error information directly when domain-generated code fails, preserving the reasoning thread.

Performance and Empirical Validation

GenoMAS demonstrates substantial empirical superiority over prior art:

  • Benchmark Performance: On the GenoTEX benchmark, GenoMAS achieved a Composite Similarity Correlation of 89.13% for data preprocessing and an F1 score of 60.48% for gene identification.

  • Absolute Improvement: The system yielded an absolute improvement of 16.85% in the F1 score compared to prior methods like GenoAgent, while simultaneously achieving a 44.7% reduction in API cost.

  • Scientific Plausibility: Qualitative studies confirm that the outputs surface biologically plausible gene-phenotype associations, with a Gene Set Enrichment Analysis (GSEA) enrichment score of 0.53 and an FDR q-value of 0.16, indicating moderate concordance with established disease biology.

  • Bottleneck Identification: The framework successfully manages the inherent complexity of biological data by achieving excellent performance on gene expression data (91.15% CSC), while highlighting a significant gap in clinical trait preprocessing (32.61% CSC), underscoring the need for nuanced domain knowledge in that area.

Key Contributions and Autonomous Behaviors

The primary contributions of GenoMAS are:

  • Treating scientific automation as a coding problem by enabling end-to-end code generation.

  • Developing a guided planning mechanism that encodes workflows as editable Action Units, balancing procedural control with autonomous error handling.

  • Demonstrating the power of heterogeneous agent composition, proving that distinct LLMs can operate in coordinated roles.

Autonomous behaviors observed include proactive diagnostic code insertion during debugging and context-aware problem-solving to handle edge cases, leading to a high degree of self-coordination (97.7% self-coordinated interactions). Furthermore, agents generate structured Notes categorized by severity (INFO, WARNING, ERROR), which provide transparent documentation of observations and challenges encountered during preprocessing—enabling efficient human oversight and system improvement.

**In conclusion, GenoMAS represents a significant advancement in scientific automation by successfully synthesizing structured procedural control with autonomous adaptation. By leveraging guided planning, heterogeneous LLMs, and robust iterative review loops supported by dynamic memory, it delivers high-fidelity genomic analysis code while drastically improving computational efficiency and maintaining scientific rigor.

Improvements for AI systems

  1. Guided Planning Framework for Code Generation: Implement a guided planning framework that encodes workflows as editable action units (structured textual directives that can be transformed into, and refined as, executable code). This allows agents to select from existing action unit or "Create new code & save action unit," ensuring logical coherence while maintaining the flexibility to address edge cases.

  2. Heterogeneous Agent Composition: Integrate a diverse set of stateof-the-art LLMs as backbones, where the programming agent uses one model for coding (Claude Sonnet 4), another for reasoning (OpenAI o3), and a third for domain expertise (Gemini 2.5 Pro). This leverages complementary strengths to a shared analytic canvas.

  3. Robust Error Handling via Iterative Review: Establish a three-stage process of code writing, review, and revision where the Code Reviewer evaluates output and issues feedback, allowing programming agents to refine and resubmit their code until approval is granted. This iteration ensures robustness against systematic errors at the global workflow level.

  4. Context-Aware Planning for Adaptation: Equip programming agents with context-aware planning that allows them to revisit a previous step with modified parameters or skip optional steps when their preconditions are not met. This mechanism enables agents to dynamically adjust behavior based on task history and data characteristics, avoiding the failure modes observed in prior art.

  5. Dynamic Memory for Code Reuse: Maintain a dynamic memory of validated code snippets indexed by Action Unit type, allowing the system to reuse trusted patterns. This mechanism saves 57.8 minutes during the tracked session by transforming redundant code generation into efficient lookups, improving both efficiency and reliability.

  6. Domain-Informed Consultation for Reasoning: Enable programming agents to consult the Domain Expert agent in place of the Code Reviewer for Action Units requiring biomedical knowledge, allowing them to receive guidance in executable code form that is contextually grounded, biologically valid.

Sources

Related papers