The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Models
cs.CL
Submitted: 2026-04-27
Updated: 2026-10-16
License: http://creativecommons.org/licenses/by/4.0/
The gist: Large language models (LLMs) have powered multi-agent simulations such as survey respondents or application users.
Terminology
Abstract
Large language models (LLMs) have powered multi-agent simulations such as survey respondents or application users. However, LLMs lack the population-level diversity required by these simulations---responses from LLMs with detailed human profiles cluster into classes, unlike human responses that uniformly fill the entire space. In this paper, we formalize this as Persona Collapse and quantify its population-level structure with three diagnostic metrics: Coverage (how much of the persona space is occupied), Uniformity (how evenly agents spread across it), and Complexity (how rich the resulting behaviors are). Across eight LLMs on personality (BFI-44), moral reasoning, and self-introduction, persona collapse is universal but task-dependent: CoSER-Llama-8B collapses the most in personality while being the most diverse in moral reasoning. Moreover, sampling more personas cannot mitigate the collapse. We further show a fidelity--diversity tradeoff: the models with the highest per-persona fidelity produce the most polarized populations. Finally, persona-targeted fine-tuning further narrows the population instead of diversifying it.
Sources
- Consistently Simulating Human Personas with Multi-Turn Reinforcement Learning
- Improving Factuality and Reasoning in Language Models through Multiagent Debate
- Sentipolis: Emotion-Aware Agents for Social Simulations
- Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs
- Knowing But Not Doing: Convergent Morality and Divergent Action in LLMs
- PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traits
- Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate
- Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principles
- The Assistant Axis: Situating and Stabilizing the Default Persona of Language Models
- The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Models
- Training language models to follow instructions with human feedback
- Persona Generators: Generating Diverse Synthetic Personas for Arbitrary Contexts
- PersonaGym: Evaluating Persona Agents and LLMs
- Towards Understanding Sycophancy in Language Models
- CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulation
- MASCOT: Multi-Agent Socio-Collaborative Companion Systems
- Qwen3 Technical Report
- LLM Probability Concentration: How Alignment Shrinks the Generative Horizon
- The PIMMUR Principles: Ensuring Validity in Collective Behavior of LLM Societies
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering