Agentic Clustering: Controllable Text Taxonomies via Multi-Agent Refinement
cs.CL
Submitted: 2026-05-31
Updated: 2026-10-09
Comments: v2: revised version with additional experiments, per-tier cost analysis and qualitative analysis
License: http://creativecommons.org/licenses/by/4.0/
The gist: Recent text-clustering methods use large language models to propose a cluster taxonomy from a corpus and then assign each text to it.
Terminology
Abstract
Recent text-clustering methods use large language models to propose a cluster taxonomy from a corpus and then assign each text to it. These pipelines are fundamentally programmatic: the sequence of LLM calls and the rules for stopping, merging, and splitting clusters are fixed in code in advance, so they generalise poorly across corpora of different structure and cannot easily incorporate user-supplied constraints such as a target cluster count or a clustering intent. We propose an agentic alternative in which an orchestrator LLM inspects the state of the discovery process at each step and dispatches one of a small set of specialised agents -- proposer, synthesizer, auditor, investigator, and critic -- adapting the pipeline to the corpus rather than executing a fixed one. On seven public text-clustering benchmarks the method achieves state-of-the-art performance, beating the strongest prior baseline by 47% in mean ARI.
Sources
- Top2Vec: Distributed Representations of Topics
- BERTopic: Neural topic modeling with a class-based TF-IDF procedure
- Text Clustering as Classification with LLMs
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering