Better with Experience: Self-Evolving LLM Agents for Evidence-Grounded Health Community Notes
cs.CL, cs.SI
Submitted: 2026-06-01
Updated: 2026-10-12
Comments: EMNLP 2026 Findings
Code: https://github.com/NanoNets/docstrange
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large Language Model (LLM)-augmented Community Notes offer a scalable path for timely, evidence-grounded correction of health misinformation on social platforms.
Terminology
Abstract
Large Language Model (LLM)-augmented Community Notes offer a scalable path for timely, evidence-grounded correction of health misinformation on social platforms. However, they still reset at every post, leaving useful correction experience from prior cases unused. We introduce EvoNote, an agentic framework that enables health Community Notes generation to self-evolve through an evolving experience memory of prior misinformation correction episodes. Its core is fine-grained credit assignment: EvoNote grounds trajectory-level feedback in health-specific note qualities and distills it into action-level memory for claim analysis, evidence acquisition, and note writing. We evaluate EvoNote on MM-HealthCN, a 1.2K-instance multimodal benchmark of user-flagged health posts with human-written Community Notes and crowd-derived helpfulness labels. Under a human-validated hierarchical utility judge, EvoNote-generated notes are preferred over corresponding human-written notes in 89.6% of cases; on a separate set of Needs More Ratings posts without a crowd helpfulness verdict, EvoNote produces helpful notes for 82.0% of cases. It also reduces time to an available candidate correction from multi-hour post-to-note delays to under 2 minutes on average. Analyses link these quality gains to stronger evidence use and reusable correction strategies, positioning self-evolving note generation as a promising paradigm for scalable health misinformation governance.
Sources
- Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memory
- Community-based fact-checking reduces the spread of misleading posts on social media
- Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
- MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Models
- MemGPT: Towards LLMs as Operating Systems
- Zep: A Temporal Knowledge Graph Architecture for Agent Memory
- Collaboratively adding context to social media posts reduces the sharing of false news
- MedGemma Technical Report
- GitSearch: Enhancing Community Notes Generation with Gap-Informed Targeted Search
- Tongyi DeepResearch Technical Report
- RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learning
- Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memory
- Birdwatch: Crowd Wisdom and Bridging Algorithms can Inform Understanding and Reduce the Spread of Misinformation
- Beyond the Crowd: LLM-Augmented Community Notes for Governing Health Misinformation
- Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoning
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering