Better with Experience: Self-Evolving LLM Agents for Evidence-Grounded Health Community Notes

arXiv:2606.02215 · cs.CL, cs.SI · Submitted 2026-06-01 · Read on arXiv

cs.CL, cs.SI

Submitted: 2026-06-01

Updated: 2026-10-12

Comments: EMNLP 2026 Findings

Code: https://github.com/NanoNets/docstrange

License: http://creativecommons.org/licenses/by/4.0/

The gist: Large Language Model (LLM)-augmented Community Notes offer a scalable path for timely, evidence-grounded correction of health misinformation on social platforms.

Terminology

Abstract

Large Language Model (LLM)-augmented Community Notes offer a scalable path for timely, evidence-grounded correction of health misinformation on social platforms. However, they still reset at every post, leaving useful correction experience from prior cases unused. We introduce EvoNote, an agentic framework that enables health Community Notes generation to self-evolve through an evolving experience memory of prior misinformation correction episodes. Its core is fine-grained credit assignment: EvoNote grounds trajectory-level feedback in health-specific note qualities and distills it into action-level memory for claim analysis, evidence acquisition, and note writing. We evaluate EvoNote on MM-HealthCN, a 1.2K-instance multimodal benchmark of user-flagged health posts with human-written Community Notes and crowd-derived helpfulness labels. Under a human-validated hierarchical utility judge, EvoNote-generated notes are preferred over corresponding human-written notes in 89.6% of cases; on a separate set of Needs More Ratings posts without a crowd helpfulness verdict, EvoNote produces helpful notes for 82.0% of cases. It also reduces time to an available candidate correction from multi-hour post-to-note delays to under 2 minutes on average. Analyses link these quality gains to stronger evidence use and reusable correction strategies, positioning self-evolving note generation as a promising paradigm for scalable health misinformation governance.

Sources

Related papers