Papers for

media verification services

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Improved deepfake detection with shared and private audio visual features

Shared-Private Cross-Modal Discrepancy Learning for Imbalanced Multi-Source Audio-Visual Deepfake Detection

Abstract: Audio-visual deepfake detectors are often trained under a single dataset or manipulation regime, but multi-source training collections may contain heterogeneous attacks and uneven source distributions. Training separate detectors for each source is inefficient, while a single shared detector may be biased toward dominant source-specific patterns. We study known-source imbalanced multi-source audio-visual deepfake detection using FakeAVCeleb and LAV-DF, where source identity is supplied during training and inference. To address this setting, we build on the Multi-Scale Cross-Modal Transformer Encoder (MSCT) and propose Pre-MSCT Shared-Private Feature Fusion. Our method routes \texttt{[CLS]}-augmented audio and visual tokens into a shared stream and source-specific private streams before the first MSCT block, while retaining its internal multi-scale self-attention (MSSA), differential cross-modal attention (DCA), and feed-forward operations. The shared stream models cross-source reusable evidence, while the private streams retain source-dependent residual variations. A domain-aware gated residual fusion module injects selected private evidence into the shared representation for the main fused prediction. Experiments under two controlled source-composition protocols show improved macro and worst-source AUC compared with the MRDF and MSCT baselines. These results support shared-private cross-modal discrepancy learning in the evaluated two-source setting with known source identity.

Sun 18 OctSoundArtificial Intelligence
The gist
Detecting fake videos or audio is harder when the data comes from many different sources with different tricks. The authors created a method that looks at shared clues across all sources as well as unique clues from each source to better spot fakes. They tested their approach on two collections of deepfakes and found it catches tricky cases more reliably than earlier methods. This helps make deepfake detection more fair and accurate even when training examples come from mixed origins.
Open → 2610.25301v1

AI generated videos detected by tracking motion consistency patterns

TRACE: Trajectory Representation and Consistency Estimation for AI-Generated Video Detection

Abstract: Recent advances in generative video models have enabled the synthesis of visually realistic content, posing significant challenges to synthetic video detection. Existing detectors often rely on appearance artifacts, semantic inconsistencies, and temporal patterns that may be generator-specific, limitating generalization to unseen synthesis models. We investigate whether responses to a pretrained generative model provide more transferable forensic cues. Our key observation is that real and AI-generated videos exhibit distinct \emph{velocity responses} under a pretrained Flow Matching video model. This distinction persists when different pretrained video-generation backbones are used as probes, suggesting that velocity responses offer transferable forensic signals beyond visual artificts. Motivated by this observation, we propose \textbf{TRACE} (\emph{\underline{T}rajectory \underline{R}epresentation \underline{a}nd \underline{C}onsistency \underline{E}stimation}), a generation-process-aware framework for AI-generated video detection. TRACE leverages a pretrained video DiT as a velocity-field probe to extract representations at multiple flow time points, and models cross-frame consistency through velocity differences between adjacent frames. We further introduce a \emph{Real-Centered Trajectory Optimization} objective that encourages generator-invariant representation learning. Extensive experiments on AIGVDBench demonstrate that TRACE generalizes effectively across diverse generators, substantially outperforming prior state-of-the-art methods on unseen open- and closed-source video generation models.

Tue 22 SeptComputer Vision and Pattern Recognition
The gist
Detecting videos made by AI is hard because fake videos often look very real and use different tricks. The authors found that real and AI videos behave differently when analyzed through a special tool that looks at their motion patterns, not just how they look. They created a method called TRACE that studies how movements change between video frames, which helps tell real videos apart from AI-generated ones, even if the AI used is new or unseen before. This makes the detection more reliable across many types of synthetic videos.
Open → 2609.25775v1

AI generated videos become almost impossible to detect by humans or tools

DF26: We Cannot Tell Fake From Real Anymore

Abstract: We introduce DF26, a novel benchmark for detecting AI-generated videos containing fully synthetic clips produced by recent text-to-video and image-to-video models. The videos capture single-person public-speaking scenarios, spanning direct-to-camera recordings, official statements, and studio interviews - 271 real and 2,420 synthetic videos generated by seven modern video models. The study on DF26 shows that human performance in detecting AI-generated videos, as well as state-of-the-art deepfake detectors, is close to random chance. Our results highlight the limitations of current evaluation protocols and motivate the need for benchmarks that explicitly measure robustness to modern generative model distribution shifts.

Mon 7 SeptComputer Vision and Pattern Recognition
The gist
People find it nearly impossible to tell if certain videos of someone speaking on camera are real or made by AI. The authors created DF26, a set of videos including hundreds of real clips and thousands made by different AI models, to test detection skills. Both humans and the latest fake video detectors performed no better than guessing. This shows current methods to find fake videos are not reliable anymore with newer AI-generated media.
Open → 2609.07369v1