More Reasoning Is Not Always Better: Executing Clinical Guidelines with LLMs and Rules
cs.CL
Submitted: 2026-10-11
Updated: 2026-10-11
License: http://creativecommons.org/licenses/by-sa/4.0/
The gist: Large language models (LLMs) have shown considerable promise in clinical decision support.
Abstract
Large language models (LLMs) have shown considerable promise in clinical decision support. However, existing approaches often rely on multi-step reasoning or multi-agent collaboration to execute clinical guidelines, introducing substantial computational overhead without reliably preventing decision errors. To address these limitations, we propose a framework for Medical Decision Execution (MedDEx) that integrates structured patient states with deterministic rule execution to support guideline-based treatment planning. MedDEx separates clinical record interpretation from guideline execution, leveraging LLMs to extract patient information and generate treatment plans while assigning guideline-defined decision logic to a rule executor. Experiments across multiple clinical guideline benchmarks demonstrate that MedDEx improves decision accuracy while reducing inference costs. Further analyses highlight the critical roles of structured patient representations and deterministic rule execution, suggesting that additional LLM reasoning does not necessarily translate into better guideline adherence.
Sources
- Benchmarking Clinical Decision Pathway Adherence in Large Language Models
- Improving Factuality and Reasoning in Language Models through Multiagent Debate
- The Llama 3 Herd of Models
- Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning
- DeltaFlow: Noise-Adaptive Bidirectional Gated Delta Networks for Embedded Language Flows
- Structured Outputs Enable General-Purpose LLMs to be Medical Experts
- LungCURE: Benchmarking Multimodal Real-World Clinical Reasoning for Precision Lung Cancer Diagnosis and Treatment
- MedDM:LLM-executable clinical guidance tree for clinical decision-making
- MedGUIDE: Benchmarking Clinical Decision-Making in Large Language Models
- DermAgent: A Self-Reflective Agentic System for Dermatological Image Analysis with Multi-Tool Reasoning and Traceable Decision-Making
- Qwen2.5 Technical Report
- AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environments
- MedGuideX: Internalizing Decision Logic from Executable Guidelines into Large Language Models for Clinical Reasoning
- The Consistency Illusion: How Multi-Agent Debate Hides Reasoning Misalignment
- Self-Consistency Improves Chain of Thought Reasoning in Language Models
- From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG
- Neuro-Symbolic Resolution of Recommendation Conflicts in Multimorbidity Clinical Guidelines
- Qwen3 Technical Report
- ReAct: Synergizing Reasoning and Acting in Language Models
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering