When Does Trimming Help Conformal Prediction? A Retained-Law Diagnostic under Calibration Contamination
stat.ML, cs.LG
Submitted: 2026-05-07
Updated: 2026-10-12
Comments: Accepted at NeurIPS 2026
License: http://creativecommons.org/licenses/by/4.0/
The gist: Trimming suspicious calibration points is a common response to contamination in conformal prediction.
Terminology
Abstract
Trimming suspicious calibration points is a common response to contamination in conformal prediction. Its effect on clean-target coverage, however, is governed by the retained law induced by trimming, not by the contamination level alone. We analyse fixed-threshold trimming as conditioning rather than purification. It replaces the contaminated calibration law with a retained law, reducing clean-target coverage to a one-dimensional score-CDF transfer problem with an exact finite-sample identity. A componentwise bound on the transfer gap gives a population-level diagnostic. This separates a clean-side covariance cost from a retained-contamination cost, governed by the dirty-to-clean retention ratio. Trimming helps when the anomaly score separates retention probabilities while remaining score-neutral on the clean population. Otherwise, it cannot substantially reduce contamination through the retained mixture coefficient. We also give finite-sample certificate templates that provide numerical guarantees under independent audit.
Sources
- A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantification
- Conformal Prediction under Levy-Prokhorov Distribution Shifts: Robustness to Local and Global Perturbations
- Noise-Adaptive Conformal Classification with Marginal Coverage
- Conformal Prediction with Cellwise Outliers: A Detect-then-Impute Approach
- A Conformal Prediction Score that is Robust to Label Noise
- Exploring the Noise Robustness of Online Conformal Prediction
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- Efficient quadratic entropy with distance sketches
- Embedding-Bias in Conditional Independence Testing
- From Log-Odds to Shapley Values: An Explanatory Geometry for the Weighted Naive Bayes Classifier