Physics-Aware Deepfake Detection via Distance-Speech Consistency

arXiv:2610.18485 · cs.CV · Submitted 2026-10-13 · Read on arXiv

cs.CV

Submitted: 2026-10-13

Updated: 2026-10-13

Comments: Interspeech 2026, Project Page: https://byulharang.github.io/PADD/

Journal ref: Proc. Interspeech 2026, pp. 2424-2428 (2026)

DOI: 10.21437/Interspeech.2026-1541

Project page: https://byulharang.github.io/PADD

License: http://creativecommons.org/licenses/by/4.0/

The gist: Recent progress in generative models has made talking-head deepfakes highly realistic and easy to create, jeopardizing public trust.

Terminology

Abstract

Recent progress in generative models has made talking-head deepfakes highly realistic and easy to create, jeopardizing public trust. However, most audio-visual deepfake detectors rely on lip-speech synchronization and are designed for static, frontal videos, limiting their reliability in dynamic, in-the-wild recordings where the speaker moves and lip cues are degraded or missing. As an alternative, we propose a physics-aware detector for dynamic speaking videos that leverages an acoustic constraint: in real recordings, speech energy varies predictably with speaker-to-camera distance, whereas deepfake generation can break this coupling. Our method combines distance estimates from video with distance-dependent acoustic measures from speech to detect deepfakes. Experiments on in-the-wild benchmarks show that the proposed physical cue is effective in dynamic scenarios, and that it complements lip-sync-based detectors, with a simple ensemble achieving consistent gains across datasets. Codes are available at https://byulharang.github.io/PADD/.

Sources

Related papers