The Model Plants the Trigger: Answer-Side Backdoor Attacks in Multi-Turn Large Language Models
cs.CR, cs.LG
Submitted: 2026-10-06
Updated: 2026-10-06
Code: https://github.com/Yibo124/answer-side-backdoor
License: http://creativecommons.org/licenses/by/4.0/
The gist: Safety alignment in Large Language Models (LLMs) remains vulnerable to backdoor attacks.
Terminology
Abstract
Safety alignment in Large Language Models (LLMs) remains vulnerable to backdoor attacks. Existing LLM backdoors are almost all input-centric: activation depends on explicit trigger patterns in the user input, so modern guardrails are built to sanitize the input space. We challenge this assumption with a novel answer-side backdoor for multi-turn dialogue. Instead of inserting the trigger into the input, the adversary uses a benign first-turn prompt to naturally induce the model to generate a specific, seemingly innocuous word. Once merged into the dialogue history, this self-generated word becomes the trigger. When a later harmful query arrives, the model detects its own trigger and bypasses its safety refusal, while the user input stays perfectly clean. Across four LLMs, our attack reaches near-perfect Attack Success Rates, approaching 100% at only a 5% poisoning rate, while preserving general utility and clean-input safety, and it evades mainstream input-centric defenses. Representation-level analysis shows that the self-generated trigger consistently suppresses the model's refusal signal, exposing a critical blind spot in current LLM defenses.
Sources
- Constitutional AI: Harmlessness from AI Feedback
- Enhancing Chat Language Models by Scaling High-quality Instructional Conversations
- Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderation
- Mistral 7B
- Revisiting Backdoor Attacks on LLMs: A Stealthy and Practical Poisoning Framework via Harmless Inputs
- Turn-Based Structural Triggers: Structure-Conditioned Backdoors in Multi-Turn LLMs
- GPT-4o System Card
- BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage
- Gemma: Open Models Based on Gemini Research and Technology
- Llama 2: Open Foundation and Fine-Tuned Chat Models
- MetaBackdoor: Exploiting Positional Encoding as a Backdoor Attack Surface in LLMs
- A Survey on Backdoor Threats in Large Language Models (LLMs): Attacks, Defenses, and Evaluations
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs