EviStress: Evidence Stress Learning for Generalizable Face Forgery Detection with Textual Explanations
cs.CV
Submitted: 2026-10-12
Updated: 2026-10-12
License: http://creativecommons.org/licenses/by/4.0/
The gist: The rapid spread of face forgeries on the Web challenges the credibility of visual content.
Abstract
The rapid spread of face forgeries on the Web challenges the credibility of visual content. In practical Web environments, manipulated media originate from evolving generation pipelines and undergo diverse processing during dissemination, making reliable authenticity assessment under unseen manipulations and visual changes a critical challenge. We observe that a standard LoRA-adapted CLIP detector exhibits uneven patch-level decision dependence, concen trating a disproportionate share of class-specific relevance on a small fraction of visual patches. To improve robustness to variations in such highly dependent evidence, we propose EviStress, a two-stage framework for generalizable face forgery detection with textual explanations. In the first stage, Evidence-Targeted Patch Perturbation (ETPP) estimates patch dependence from global, relational, and semantic cues and assigns positively correlated perturbation probabilities, explicitly stress-testing highly dependent visual evidence during training. We further introduce Discriminative Variation Preservation (DVP), which constrains the residual between clean and perturbed representations to retain authenticity discriminative information. In the second stage, Intrinsic Evidence Instruction Tuning (IEIT) transfers the adapted CLIP encoder into LLaVA as its vision tower and performs parameter-efficient multimodal instruction tuning, enabling authenticity prediction and textual explanation directly from the learned forgery-sensitive representation without an external detector. Experiments demonstrate improved cross-dataset and cross-method generalization and corruption robustness, with the multimodal model providing authenticity predictions and human-readable explanations.
Sources
- X2-DFD: A framework for eXplainable and eXtendable Deepfake Detection
- The DeepFake Detection Challenge (DFDC) Dataset
- Exploring Specular Reflection Inconsistency for Generalizable Face Forgery Detection
- FFAA: Multimodal Large Language Model based Explainable Open-World Face Forgery Analysis Assistant
- Exposing DeepFake Videos By Detecting Face Warping Artifacts
- MLLM-Enhanced Face Forgery Detection: A Vision-Language Fusion Solution
- Can Multi-modal (reasoning) LLMs work as deepfake detectors?
- Veritas: Generalizable Deepfake Detection via Pattern-Aware Reasoning
- LLMs Are Not Yet Ready for Deepfake Image Detection
- Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detection
- DeepfakeBench: A Comprehensive Benchmark of Deepfake Detection
Related papers
- Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
- AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
- Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
- MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
- TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
- A Survey on Efficient Vision-Language-Action Models