DANGERLENS: Probing Dangerous Representations Hidden by Safety Alignment
cs.AI
Submitted: 2026-10-14
Updated: 2026-10-14
License: http://creativecommons.org/licenses/by/4.0/
The gist: Safety alignment teaches language models to refuse harmful requests, yet the internal accessibility of hazardous concepts can retain traces of earlier training.
Terminology
Abstract
Safety alignment teaches language models to refuse harmful requests, yet the internal accessibility of hazardous concepts can retain traces of earlier training. Can checkpoints with equally safe behavior differ in what remains accessible behind their refusals? In this work, we investigate this question through paired training histories and a direct audit of intermediate representations. We introduce DANGERLENS, a probe that maps hidden states into vocabulary space and uses blinded semantic judgments to distinguish harmful goals and operational means from hazard recognition and safety control. Experiments on three Qwen1.5 scales show that checkpoints with prior harmful exposure generally retain greater hazardous concept accessibility after the same safety alignment, with the strongest separation in intermediate and later layers. The same harmful update also produces different behavioral trajectories from closely matched starting points. Human relevance validation and readout ablations reinforce the measured accessibility contrast. Our findings show that training history remains visible inside behaviorally matched models and motivate internal accessibility audits alongside output safety evaluations.
Sources
- Understanding intermediate layers using linear classifier probes
- Refusal in Language Models Is Mediated by a Single Direction
- Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
- Eliciting Latent Predictions from Transformers with the Tuned Lens
- Discovering Latent Knowledge in Language Models Without Supervision
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models
- InterMT: Multi-Turn Interleaved Preference Alignment with Human Feedback
- Towards Automated Circuit Discovery for Mechanistic Interpretability
- OR-Bench: An Over-Refusal Benchmark for Large Language Models
- Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
- RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models
- Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models
- ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection
- Designing and Interpreting Probes with Control Tasks
- TrustLLM: Trustworthiness in Large Language Models
- Alignment Dynamics in LLM Fine-Tuning
- PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference
- BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset
- Language Models Resist Alignment: Evidence From Data Compression
- Efficient Memory Management for Large Language Model Serving with PagedAttention
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems