TARE: Weigh a Never-Poisoned Twin Before Reading Backdoor-Defense Costs
cs.CR, cs.AI
Submitted: 2026-10-04
Updated: 2026-10-04
Comments: 84 pages (9-page main text)
License: http://creativecommons.org/licenses/by/4.0/
The gist: Backdoor-defense leaderboards print a clean-accuracy drop and read it as removal cost.
Abstract
Backdoor-defense leaderboards print a clean-accuracy drop and read it as removal cost. Measured on the poisoned victim alone, the drop cannot separate removal from what the defense does to any model, and inherits the victim's start, which for three of BackdoorBench's sixteen attacks is a configuration file: WaNet, BPP and Input-Aware ship a MultiStepLR that never fires, so their victims never anneal and are the least accurate in 30/31 public CIFAR cells at at most 5%. On PreAct-ResNet18, fine-tuning-family defenses return a low start to their own level, so there the published cost is negative, the benchmark's rating clips the "gain" to zero, and 2 of 48 citing defense papers we read rest a no-cost claim on those cells; TSBD and CGD, re-run with their code, "gain" on a never-poisoned model too. A 2 times2 editing only that scheduler line isolates the cause, its swapped arms self-registered before they ran: the sign of the fine-tuning family's clean-model cost reverses both ways while its published gain on the annealed victim only shrinks toward zero, 44/44 seeds following the schedule, replicated on BPP, FT-SAM, CIFAR-100 and VGG19-BN and induced in a second toolkit. TARE runs the same defense on a never-poisoned twin of the same recipe, schedule and seed (on BackdoorBench, at most 10 poisoned images, admitted only below 5% attack success); what the twin loses is the tare. On the BadNets grid seven of eight defenses charge the twin (Neural Cleanse only where its detector fires), +0.13 (fine-tuning) to +5.70 points (I-BAU); the eighth, ABL, destroys it. Within an attack the start cancels from rankings, so the tare re-orders nothing there; what poisoning adds beyond it is printed under two estimators and not corrected, its removal share unidentified. We ship the three-key patch, a signed tare column (7 attacks times 8 defenses) and TARE-Z, a twin-free estimator for seed-stable defenses.
Sources
- SoK: The Last Line of Defense: On Backdoor Defense Evaluation
- A new Backdoor Attack in CNNs by training set corruption without label poisoning
- Measuring what Matters: Construct Validity in Large Language Model Benchmarks
- Backdoor Unlearning Generalization: A Path Toward the Removal of Unknown Triggers in LLMs
- How Do Large Language Models Acquire Factual Knowledge During Pretraining?
- Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoning
- Reference-Specific Unlearning Metrics Can Hide the Truth: A Reality Check
- Tools for Verifying Neural Models' Training Data
- Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning
- Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches
- How Hard is it to Rig a Benchmark? A Social Choice Analysis of Leaderboard Robustness
- BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chain
- Mapping Post-Training Forgetting in Language Models at Scale
- Editing Models with Task Arithmetic
- Metric Unreliability in Multimodal Machine Unlearning: A Systematic Analysis and Principled Unified Score
- Are We Truly Forgetting? A Critical Re-examination of Machine Unlearning Evaluation Protocols
- Purifying Generative LLMs from Backdoors without Prior Knowledge or Clean Reference
- Anti-Backdoor Learning: Training Clean Models on Poisoned Data
- Reconstructive Neuron Pruning for Backdoor Defense
- Invisible Backdoor Attack with Sample-Specific Triggers
Related papers
- SoK: AI-Augmented Binary Reversing
- Relaxed Sender Anonymity for CBDC Interbank Settlement: A Zero-Knowledge Approach on Permissioned EVM
- Calibration-Family Overfit: Why Trusted Sabotage Monitors Don't Transfer Across Lineages
- Efficient Fuzzy PSI under One-Sided Assumptions
- Sealing the Audit-Runtime Gap for LLM Skills
- Token Composition: A Graph Based on EVM Logs