Papers for

video content moderators

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Execution logs influence vision language judges on robot progress

Execution Logs Sway VLM Judges of Robot Progress

Abstract: Vision-language models now grade robot videos, and text placed beside the frames can change their verdicts. On clips where the robot is losing progress, we add one log line saying the robot is making progress. Across Gemini, Qwen and GPT judges, this flips correct verdicts to progress 10 to 35 percentage points more often than a neutral line does. A one-line warning that the log may be wrong removes most of this effect. Selected fake "task complete" claims flip half of Qwen's correct verdicts, against a tenth for unrelated log lines. They have no detectable effect on Gemini.

Sun 25 OctMachine LearningRobotics
The gist
Judges powered by vision-language models watch robot videos to decide if the robot is making progress. The researchers found that adding a single sentence from the robot’s log, saying it is making progress, can change these judges’ opinions even when the robot is not actually improving. Some models are especially easy to trick with fake claims, while others are more skeptical. Adding a warning that the log could be wrong makes the judges more cautious.
Open → 2610.34151v1

Illumination prior does not improve face swap detection accuracy

Does an Illumination Prior Help Face-Swap Detection? A Controlled Study of Temporal Self-Blended Images

Abstract: Self-blended images are widely used to train face-swap detectors, but primarily capture blending artifacts. We investigate whether adding illumination inconsistencies improves detection. Temporal Self-Blended Images (T-SBI) transfer lighting statistics between frames of the same video, with the mismatch controlled by luminance difference (ΔL). Using five training regimes and a three-seed comparison of high- and low-ΔL training, we find no evidence of illumination-specific improvements. AUC differences remain within seed variability across four datasets, and an analysis of 506,328 attribute-binned samples shows no preferential reduction in errors under harsh lighting. Instead, T-SBI shifts prediction scores, changing optimal thresholds by approximately 0.34 on FaceForensics++ and 0.30 on Celeb-DF, making comparisons at a fixed threshold misleading. However, T-SBI improves robustness to heavy JPEG compression on DFDC (AUC 0.780 versus 0.696), potentially reflecting greater reliance on low-frequency cues. These findings highlight the importance of evaluating training methods against their intended targets and accounting for threshold effects.

Thu 8 OctMachine Learning
The gist
Detecting face-swaps in videos often relies on spotting blending errors where two images are joined. The authors tested if adding differences in lighting between frames helps detect these swaps better. Their study found that changing lighting doesn’t actually improve detection accuracy but does shift detection thresholds, which can affect result interpretation. However, these lighting changes made the detectors more robust to heavy image compression.
Open → 2610.11706v1

Deepfake detection improves by using detailed face shape data

MOTIF: Person-of-Interest Deepfake Detection Beyond 3DMM Coefficients

Abstract: Video deepfakes targeting a specific individual, the Person-of-Interest (POI), are the most harmful ones, and, since a public figure is abundantly recorded, a detector can be built from genuine footage of that individual. Such detectors commonly describe a subject through a 3D Morphable Model (3DMM) and adopt its coefficients as a whole, so which part of that description carries the signal has never been measured. We dissect it, holding the encoder, the training corpus and the enrollment protocol fixed and varying only what the encoder observes. The groups of coefficients prove largely redundant, since the shape block alone recovers almost all the accuracy of the full vector, and their temporal evolution contributes a real but bounded amount. We further show that the dense surface the same fit returns, which these detectors discard, carries identity information that the coefficients do not, and that it helps precisely where they are weakest. We assemble the best configuration into MOTIF, a visual-only detector trained on real videos only, with no manipulated video and no POI-specific data. It improves on both state-of-the-art POI detectors in every dataset and manipulation of our benchmark and at two quality levels. Our experimental code will be released at https://github.com/polimi-ispl/MOTIF.

Wed 7 OctComputer Vision and Pattern Recognition
The gist
Deepfake videos that mimic a specific person are a big problem. Many detectors try to spot fakes by looking at a simplified 3D face model, but it wasn’t clear which parts work best. The authors found that just the shape info in the model is enough to catch most fakes, and using the full detailed face surface adds even more accuracy. They combined these insights into a new detector called MOTIF, which works better than previous methods without needing fake videos or person-specific training.
Open → 2610.09830v1

Transcript compression reduces accuracy of detecting medical fake videos

Effects of Transcript Compression on LLM-based Medical Misinformation Detection in Japanese YouTube Videos

Abstract: Large language models (LLMs) are increasingly used to assess long-form medical videos, but their effectiveness may depend on whether transcripts are provided in full or compressed through summarization, retrieval, or claim screening. This study examines how such transcript compression affects LLM-based veracity classification of Japanese medical YouTube videos. We compare four transcript input designs: full transcripts, LLM-generated summaries, RAPTOR-based retrievalaugmented generation (RAG), and Screening, which extracts candidate medical and health-related sentences. Using 74 long-form videos labeled as Real or Fake, we evaluate classification performance and analyze linguistic changes using J-LIWC, hedge expressions, and institutional or technical terms. The full-transcript Baseline achieved the best performance, whereas all compressed inputs increased false negatives, meaning that Fake videos were more likely to be misclassified as Real. Summary caused the largest performance drop, while Screening performed best among the compressed inputs but still omitted many medically relevant sentences. Linguistic analyses showed that these errors were not explained by a simple increase in certainty. Instead, Summary reduced affective, social, temporal, cognitive, and conversational cues, while Summary and RAG made institutional and technical terms more salient. These findings suggest that transcript compression can represent Fake videos as more coherent and authoritative inputs, thereby weakening cues needed for misinformation detection

Fri 25 SeptComputation and Language
The gist
Detecting misinformation in long medical videos is important but challenging. This study found that using full transcripts of Japanese medical YouTube videos helps language models better identify fake content. When transcripts are shortened by summarizing or selecting parts, models make more mistakes, especially missing fake videos. The shortened versions also change the language signals, making fake videos seem more believable and harder to catch.
Open → 2609.30882v1