Hidden in Plain Sight: Advancing Harmful Content Understanding via Perception-Aware Adversarial Self-Play
cs.AI, cs.CL
Submitted: 2026-10-11
Updated: 2026-10-14
License: http://creativecommons.org/licenses/by-nc-nd/4.0/
The gist: Despite significant advances in language understanding, Large Language Models (LLMs) can still miss meaning hidden in plain sight, failing to identify harmful intent in expressions readily understood
Abstract
Despite significant advances in language understanding, Large Language Models (LLMs) can still miss meaning hidden in plain sight, failing to identify harmful intent in expressions readily understood by humans. Malicious users exploit this gap by strategically disguising harmful content to evade automated moderation, posing a serious threat to online platform safety. The vulnerability reflects a fundamental cognitive asymmetry between human readers, who integrate contextual, phonetic, and visual cues to decipher the intent behind deliberate obfuscation, and text-based LLMs, which rely primarily on token sequences and have limited exposure to evolving evasions. To bridge this asymmetry, we propose PASP (Perception-Aware Adversarial Self-Play), which combines multi-perceptual views with adversarial self-play to improve understanding of harmful intent as evasions evolve. Specifically, PASP constructs textual, phonetic, and visual views of each input, preserving its original context while exposing pronunciation and glyph cues obscured in token space. During adversarial self-play, an attacker uses defender feedback to generate intent-preserving evasions, while the defender is trained using an intent-invariance reward to understand harmful intent across changing surface forms. Extensive experiments show that PASP reduces adaptive attack success rates by up to 73.71% and 74.49% on ChineseHarm-Bench and EvoHarmBench, respectively, preserves model capabilities with minimal degradation, and effectively interprets real-world evasive expressions in e-commerce.
Sources
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools
- The Llama 3 Herd of Models
- Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations
- EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasion
- Disentangling Intent from Role: Adversarial Self-Play for Persona-Invariant Safety Alignment
- Learning Robust Reasoning through Guided Adversarial Self-Play
- DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
- ChineseHarm-Bench: A Chinese Harmful Content Detection Benchmark
- Chasing Moving Targets with Online Self-Play Reinforcement Learning for Safer Language Models
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
- GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning
- MAGIC: A Co-Evolving Attacker-Defender Adversarial Game for Robust LLM Safety
- S-GRPO: Unified Post-Training for Large Vision-Language Models
- Qwen3 Technical Report
- RigorLLM: Resilient Guardrails for Large Language Models against Undesired Content
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems