Papers for

social media platform security teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Detecting coordinated social media activity requires careful statistical modeling

Statistical Detectability of Coordination

Abstract: Information operations exploit coordinated activity on social media to amplify messages and manipulate public discourse. A common approach to coordination detection is to project account-entity interactions into account similarity networks based on temporal proximity, action counts, or behavioural similarity, and identify dense subgraphs or behavioural clusters. However, the current methodology finds groups of co-activated accounts or partitions all users into most similarly acting clusters, even when the accounts are acting independently of each other or the co-activity is due to some expected source. We formulate coordination detection based on hypothesis testing of account pairs and compare different null models. We connect the resulting pairwise scores to the planted-submatrix detection problem and derive statistical and computational limits as functions of group size, population size, and signal strength. We estimate the signal for 7 modalities of coordination over 26 labelled information-operation datasets, and compare the predicted regime with the performance of recovery heuristics. Our method achieves higher agreement with the labelled ground truth than previously reported, but the choice of null model is important and it changes the regime of most modalities. While it is always possible to extract a set of significantly densely co-acting accounts across nearly all modalities regardless of regime, density alone is uninformative of detection performance, rendering anomalous cluster discovery a poor proxy for recovering an information operation. Detectability boundaries establish whether an operation of a given size and signal can be recovered at all, and how much confidence a flagged group warrants.

Tue 27 OctSocial and Information Networks
The gist
Coordinated activity on social media is often used to promote messages or manipulate public opinion. The authors analyze how to detect when groups of accounts are working together rather than acting independently. They show that simply finding clusters of similar or closely timed activity is not enough to reliably identify coordination. By using statistical tests and comparing different baseline models, they establish when coordinated groups can truly be detected and how confident we can be about those findings. Their method better matches known examples of coordinated campaigns than earlier approaches.
Open → 2610.37970v1

Human accuracy varies by deepfake model and improves with targeted training

From GAN-Based Models to GPT-5: A Taxonomy-Guided Study of Human Performance in Detecting Deepfake Face Images

Abstract: Generative models for deepfakes have rapidly evolved from GAN-based architectures to diffusion models and multimodal large language models (MLLMs). However, empirical research on human performance in detecting deepfake face images has not kept pace. It remains unclear if (and how) detection performance varies across generative models and whether model-specific training improves detection more effectively than general-purpose training. In this paper, we propose the \emph{Deepfake Face Artifact Taxonomy} (DFAT), a cross-model taxonomy of human-recognizable visual artifacts in deepfake face images, based on which we build both general-purpose and model-specific training materials. Through an online experiment ($n = 524$), we examined human performance in detecting deepfake face images and evaluated training efficacy across five representative generative models: three GAN-based, one diffusion-based, and one MLLM (GPT-5). Our results show that participants' detection accuracy was strongly model-dependent and that images generated by more recent and advanced models were not necessarily harder to detect. After training, participants achieved significant performance gains across most conditions, and their improvement varied by model. Notably, model-specific training generally yielded greater numerical gains than general-purpose training. In a five-month follow-up test ($n = 342$), we observed no significant decline in detection accuracy and no significant increase in perceived stress. Overall, our findings provide actionable insights for designing effective, sustainable, and targeted training programs to counter the growing threat posed by deepfakes.

Fri 16 OctComputer Vision and Pattern RecognitionCryptography and SecurityHuman-Computer Interaction
The gist
Detecting fake face images made by AI can be hard, and people find it easier or harder depending on how the images were made. The authors studied how well people spot fake faces created by different AI methods, like older GANs and newer models such as GPT-5. They found that training people to recognize specific model mistakes helped them get better at detecting fakes than general training. The improved detection lasted at least five months without making people feel more stressed. This study helps design better ways to train people against deepfake images.
Open → 2610.23144v1

Distance and speech energy reveal fake talking head videos

Physics-Aware Deepfake Detection via Distance-Speech Consistency

Abstract: Recent progress in generative models has made talking-head deepfakes highly realistic and easy to create, jeopardizing public trust. However, most audio-visual deepfake detectors rely on lip-speech synchronization and are designed for static, frontal videos, limiting their reliability in dynamic, in-the-wild recordings where the speaker moves and lip cues are degraded or missing. As an alternative, we propose a physics-aware detector for dynamic speaking videos that leverages an acoustic constraint: in real recordings, speech energy varies predictably with speaker-to-camera distance, whereas deepfake generation can break this coupling. Our method combines distance estimates from video with distance-dependent acoustic measures from speech to detect deepfakes. Experiments on in-the-wild benchmarks show that the proposed physical cue is effective in dynamic scenarios, and that it complements lip-sync-based detectors, with a simple ensemble achieving consistent gains across datasets. Codes are available at https://byulharang.github.io/PADD/.

Tue 13 OctComputer Vision and Pattern Recognition
The gist
Deepfake videos can make people appear to talk realistically, but they often miss some natural physics. This paper shows that real speakers sound louder or quieter depending on how far they are from the camera, which deepfakes usually don't match correctly. The authors create a tool that checks if the speech loudness fits with the estimated distance to detect fakes, even when the speaker moves around. They tested this approach on real videos and found it works well alongside traditional lip-sync checks.
Open → 2610.18485v1

Statistical model improves detection of coordinated online accounts

A null model to detect coordinated online behavior integrating evidence from multiple indicators

Abstract: Coordinated online accounts can amplify messages and manipulate attention, but detecting such behavior is challenging due to confounding factors like account activity and item popularity. We propose a statistical null-model framework that assesses behavioral similarity between accounts by comparing observed coordination indicators against activity- and popularity-conditioned reference distributions. By combining evidence across multiple indicators and partners, our method can identify suspicious coordination links more accurately. Evaluations on nine labeled information-operation datasets involving over 152 thousand accounts show that aggregating p-values multiplicatively across indicators and partners yields improved detection performance. While results vary across information operations, this approach offers a generalizable and statistically principled tool for uncovering coordinated online behavior.

Tue 13 OctSocial and Information NetworksComputers and Society
The gist
Coordinated online accounts try to work together to spread messages and attract attention, but it’s hard to spot them because some accounts are naturally more active or popular. The authors created a statistical method that compares how similar accounts behave against what would be expected based on their activity and popularity. By combining different signs of coordination and looking at many account pairs, their method finds suspicious connections more accurately. They tested this on large datasets with known coordinated accounts and showed that combining evidence carefully improves detection.
Open → 2610.17533v1

Deepfake detectors struggle as generative images become harder to verify

Certification of Real Images through Calibrated Content Authentication

Abstract: Generative models can synthesize high-quality inauthentic multimedia content that is already being misused at scale. We evaluate twenty deepfake detectors against ten generators released in the last four years and find accuracy decreasing over time, from near-perfect 99.5% to 76%. Adversarial perturbations further reduce every baseline detector to below 2% accuracy, effectively inverting the detector's assigned label. We argue that this unreliability reflects a fundamental ambiguity: generators can reproduce authentic content exactly (e.g., through memorization), so content alone cannot reveal the true provenance label.For this reason, content produced by a generator must admit a faithful reconstruction by that same generator, and finding such a reconstruction makes synthetic provenance plausible and authenticity plausibly deniable.We therefore propose and evaluate a detection paradigm that outputs a calibrated prediction of whether authenticity is plausibly deniable: a faithful reconstruction by any known generator establishes plausible deniability, while calibration bounds how often content from known generators fails to be reproduced. Our evaluation shows that (i) our detector can be calibrated so that at most 1% of generated content is wrongly certified, an operating point at which most baseline detectors reach near-zero recall, including the strongest with 93% accuracy; (ii) calibrating a stricter security threshold on attacked samples preserves this bound against adaptive adversaries within the evaluated bounded-perturbation attack space, whose perturbations break every baseline, but does not cover arbitrary adversarial transformations; and (iii) post-hoc verifiability is eroding, as 1,116 of 3,000 Reddit images resist reproduction by a 2022 generator, but only 55 to 79 resist reproduction by 2024 generators.

Mon 5 OctComputer Vision and Pattern Recognition
The gist
Deepfake images made by AI models are becoming harder to detect accurately as the technology improves and new tricks can fool detectors. The authors show that existing detectors perform worse over time and can be easily tricked by small changes to images. They propose a new way to check if an image could have been created by a known AI model by seeing if the model can recreate the image, helping decide if its source is uncertain. This approach is more reliable and can be adjusted to limit wrong certifications, even against some tricky attacks.
Open → 2610.05870v1

Deepfake detectors improve by preserving diverse forgery clues

Revisiting Cross-Reconstruction for Generalizable Deepfake Detection

Abstract: Existing image forgery detectors often suffer from generalization to unseen manipulation methods due to the limited ability to capture transferable forensic cues. Recent cross-reconstruction based methods attempt to improve generalization through semantic-artifact disentanglement, but typically align heterogeneous artifacts across generators and exclude artifact representations during reconstruction, which may overlook the inherent diversity and visual cues of manipulation artifacts. In this work, we revisit cross-reconstruction and introduce an artifact-oriented disentanglement framework for robust image forgery detection. We argue that \textbf{artifact diversity}, i.e., the intrinsic variations of manipulation artifacts introduced by different generation processes, contains complementary forensic cues rather than undesirable domain variations. Instead of enforcing explicit artifact alignment, our framework preserves diverse artifact characteristics through semantically aligned cross-generator reconstruction. Furthermore, we incorporate artifact representations into the reconstruction process and introduce a masked frequency-aware reconstruction strategy to emphasize manipulation-related residuals while reducing semantic interference. This design enables the model to learn transferable forensic representations from diverse artifacts. Extensive experiments on multiple benchmark datasets demonstrate improvements under both cross-dataset and cross-generator evaluation settings. Further analysis and ablation studies validate the effectiveness of artifact diversity preservation and artifact-aware cross-reconstruction.

Thu 1 OctComputer Vision and Pattern Recognition
The gist
Detecting fake images made by AI can be tricky because different fake image creators leave different kinds of clues. Previous methods tried to find common patterns by forcing these clues to look the same, but this paper shows it’s better to keep those differences. The authors propose a new way that pays attention to the unique details of each fake image and uses them to better spot forgeries. Their approach helps detectors work well even on new types of fake images they've never seen before.
Open → 2610.01544v1

Agentic ai improves open world fake image detection by better evidence handling

Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection

Abstract: Image forensics is increasingly an open-world problem: manipulations range from fully synthetic images to localized edits, splicing and swapping, while most forensic detectors remain specialized to a single manipulation family. Agentic AI has recently emerged as a promising solution. In principle, such systems can assess the reliability of individual detectors, identify out-of-scope evidence, and arbitrate conflicting reports. However, it remains unclear which components actually drive performance and whether their benefits persist under distribution shift. To answer these questions, we study a training-free agentic framework built around specialist detectors, per-detector triage, and conflict-aware evidence arbitration. Using six configurations and three multimodal large language model backbones, we dissect the role of triage, prompting, and reasoning quality on both in-distribution and out-of-distribution data. Our results show that naive detector fusion suffers from severe false-positive rates on authentic images. Triage and prompting consistently improve performance by filtering unreliable evidence and exposing detector limitations. However, the dominant factor is represented by reasoning itself: A stronger judge substantially outperforms a weaker one, particularly under distribution shift. Most notably, manipulation recall is nearly saturated across all configurations, indicating that the main challenge of open-world image forensics is not detecting manipulations, but calibrating trust in specialized forensic tools and arbitrating conflicting evidence.

Mon 21 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceCryptography and Security
The gist
Detecting fake or edited images is tricky because many tools only look for specific types of changes. The authors study a system that uses several specialist detectors and an AI 'judge' to decide which parts of the evidence to trust and how to resolve conflicts. They found that simply combining many detectors leads to many false alarms on real images. The key to better detection is the AI’s reasoning ability to filter unreliable clues and decide which detector is more trustworthy, especially when facing new kinds of image forgeries.
Open → 2609.24359v1

Instruction based multi face forgery detector improves detection accuracy

IMFD: End-to-end Multi-Face Forgery Detection through Instruction-based Large Vision-Language Models

Abstract: The rapid increase of deepfakes has raised significant concerns due to their spread on social media. Traditional multi-face forgery detectors crop and verify each face independently, ignoring background context and inter-face relationships, which often yields suboptimal performance. To overcome these limitations, we leverage instruction-based Large Vision-Language Models (LVLMs), which can interpret entire images and follow complex textual instructions. We propose a simple yet effective single-stage multi-face forgery detector, called IMFD (Instruction-based Multi-face Forgery Detector), which is trained end-to-end to jointly localize faces and predict per-face forgery labels. Rather than treating face box prediction only as a joint objective, IMFD explicitly integrates predicted face bounding boxes into the instruction as visual cues that enhance instruction grounding and forgery detection. To support the training and evaluation of IMFD, we convert existing multi-face forgery datasets into an instruction-based format. Experimental results and analyses show that IMFD improves multi-face forgery detection by integrating face bounding boxes into the instruction, and consistently outperforms various state-of-the-art methods.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Deepfakes—fake images or videos made by computers—can trick people especially when multiple faces appear at once. Traditional methods check each face alone, missing important clues from the background or nearby faces. The authors created IMFD, a system that teaches a large AI model to look at the whole picture using instructions, finding and checking many faces together. By including info about where faces are in the instructions, IMFD spots fake faces better than earlier tools.
Open → 2609.19693v1