Quiet Triggers, Loud Footprints: A Tri-Space Measurement Study of Backdoor Stealthiness
cs.CR, cs.AI
Submitted: 2026-10-14
Updated: 2026-10-14
Comments: S&P 2027
Code: https://github.com/fastai/imagenette
License: http://creativecommons.org/licenses/by/4.0/
The gist: Backdoor attacks on deep neural networks are commonly evaluated by attack success rate and benign accuracy, yet their stealthiness remains inconsistently defined and measured.
Abstract
Backdoor attacks on deep neural networks are commonly evaluated by attack success rate and benign accuracy, yet their stealthiness remains inconsistently defined and measured. Existing work often studies only one observable aspect of stealthiness, such as trigger imperceptibility, feature-space separability, parameter-space concentration, or evasion of particular defenses. This creates a fragmented picture: an attack may appear stealthy under one metric while leaving conspicuous footprints elsewhere. This paper presents a tri-space measurement study of backdoor stealthiness in image classification. We distinguish latent stealthiness---the ideal but unobservable difficulty of distinguishing a backdoored system from a benign one---from measurable footprints in three spaces: input, feature, and parameter space. Under this framework, we evaluate representative backdoor attacks across four datasets and three model architectures using a broad suite of footprint metrics. Our results show that stealthiness is not monolithic: attacks that are quiet in one space are often loud in another, and existing attacks rarely achieve consistently small footprints across all three spaces. We further analyze agreement and disagreement among stealthiness metrics and study how footprint measurements interact with attack success rate. Based on observed blind spots in existing measurements, we introduce two diagnostic metrics: Class-Specific Davies--Bouldin Index (CDBI), which captures class-conditional feature overlap, and TAC--UCLC Product (TUP), which identifies channels that are both trigger-responsive and downstream influential. These metrics are intended to augment, not replace, the broader measurement suite. Finally, we provide practical guidance for future stealthiness evaluations.
Sources
- Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
- WaNet -- Imperceptible Warping-based Backdoor Attack
- BppAttack: Stealthy and Efficient Trojan Attacks against Deep Neural Networks via Image Quantization and Contrastive Adversarial Learning
- Narcissus: A Practical Clean-Label Backdoor Attack with Limited Information
- Deep Feature Space Trojan Attack of Neural Networks by Controlled Detoxification
- Data Free Backdoor Attacks
- TABOR: A Highly Accurate Approach to Inspecting and Restoring Trojan Backdoors in AI Systems
- STRIP: A Defence Against Trojan Attacks on Deep Neural Networks
- Data-free Backdoor Removal based on Channel Lipschitzness
- Detecting Backdoor Attacks on Deep Neural Networks by Activation Clustering
- Hide and Seek: on the Stealthiness of Attacks against Deep Learning Systems
- Deep Residual Learning for Image Recognition
- Very Deep Convolutional Networks for Large-Scale Image Recognition
- The Unreasonable Effectiveness of Deep Features as a Perceptual Metric
- Improved Techniques for Training GANs
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Estimating the Social Cost of Corporate Data Breaches
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills