Papers for

content moderation platforms

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multilevel analysis improves fake news detection across image text conflicts

Decoupling Consistency and Conflict across MLLM Layers for Fake News Detection

Abstract: The trustworthiness of Web content faces a growing threat from multimodal fake news. Real news usually shows aligned image-text semantics, while fake news often contains a few conflicts at varying levels, such as mismatches in objects, scenes, events, and claims. However, existing methods usually treat consistency and conflict in a coarse and static way, limiting their ability to capture sparse conflicts and adapt to varying conflict levels. Inspired by the distinct knowledge encoded across layers in large language models, we propose Multi-Level Consistency and Conflict Decoupling (MLCCD), which captures conflicts at different levels from different layers of multimodal large language models (MLLMs). Specifically, we first use the MLLM's final decision representation to select visual and textual tokens relevant to the task, preventing irrelevant content from diluting sparse conflicts. Then, we preserve tokens whose representations change sharply between adjacent layers, capturing the knowledge each layer adds. Finally, we decouple this knowledge into consistency and conflict evidence and aggregate each across layers with its own router, adapting to varying conflict levels. Experiments on three benchmarks show that MLCCD outperforms existing methods.

Tue 27 OctComputer Vision and Pattern RecognitionComputation and Language
The gist
Fake news often has mismatches between images and text that don’t line up, like wrong objects or claims. The authors propose a new way to spot these conflicts by looking at different layers inside a big language model used for both images and text. They pick out important parts and track how understanding changes through the layers, separating signs of truth and conflict. This lets their method better detect fake news than older approaches.
Open → 2610.36569v1

Synthetic corpus offers detailed phases of online grooming conversations

LURE: a Phase-Labelled Synthetic Corpus of Online-Grooming Exchanges

Abstract: Phase-annotated conversational data is essential for studying the progression of online grooming of minors and for developing early warning tools. However, the only publicly available source (i.e., Perverted-Justice archive, which contains a subset coded using ChatCoder) is small, outdated, and frozen. We present a synthetic corpus of groomer-victim exchanges, generated using a retrieval-augmented pipeline running on institutional hardware. This pipeline uses an openly available, eight-billion-parameter, refusal-ablated language model. The corpus was created using the five stages of the responsible-generation protocol for synthetic datasets: ontology-driven design based on the ChatCoder luring-communication scheme (eight communicative tags mapped onto four grooming phases); multi-model prompt testing; human-in-the-loop supervision; semantic and feature-level validation; and modality-aware documentation. The released corpus contains 2,121 unique exchanges across seven tags and four phases, each accompanied by a Plutchik emotion field. Validation quantifies the integrity and lexical profile of the corpus, as well as the reproduction of real seed lines, in-domain label recoverability (tag accuracy: 0.85; phase accuracy: 0.93) and its transfer to real ChatCoder offender lines, which were coded automatically at the eight-tag level (31,640 lines) and by human coders at the three-construct level (10,876 posts). Accuracy was measured for lexical and sentence-embedding features, while a real-versus-synthetic discriminator was able to separate the two domains with 91% accuracy. The scope of the corpus includes controlled, phase-conditioned experimentation, pipeline development and augmentation alongside real data and awareness material. The corpus, its datasheet and the audit code are released with vetted access.

Sun 11 OctArtificial Intelligence
The gist
Online grooming, where adults try to manipulate minors, happens through conversations that change over time in clear stages. The authors created a large set of fake but realistic conversations showing these stages, using a special language-processing method combined with human review. This dataset helps understand how grooming builds up and can train tools to spot it early. It matches many features of real conversations and includes emotional tags to better capture how the exchanges feel. The dataset and its code are available to support research and tool development.
Open → 2610.15908v1

Agents use base models to bypass AI text detection tools

Agents Can Use Base Models to Evade AI Detection

Abstract: We show that coding agents equipped with a base language model can successfully assemble responses from its samples to evade detection. Base models have been shown to evade commercial detectors, however, prior "humanization" techniques rely on using these models to paraphrase AI outputs over several iterations, which invariably results in semantic drift. In contrast, equipping coding agents to directly orchestrate the writing process by stitching text samples from a base model allows it to produce outputs that are coherent, task-specific and generally high quality. We find that Claude Opus 5 operating in a Claude Code harness effectively orchestrates a local 32B parameter OLMo-2 base LM and sacrifices little task accuracy across benchmarks spanning creative writing, factual grounding, health QA and instruction following, while using up to 90% base LM tokens. Responses constructed in this manner reduce the effectiveness of both post-hoc detectors (Pangram v4 detection rate drops from 77% to 24%) and soft watermarking applied a priori to the agent's generations (down to a simulated 10% detection at low FPR). While effective, this evasion requires a significantly larger number of input and output tokens from the agent, increasing the dollar cost per query up to 30x at API-pricing. Overall, this work demonstrates the effectiveness of a new class of adversarial attacks against AI text detection, and urges post-hoc detection providers to include outputs of base models in their training.

Fri 25 SeptComputation and Language
The gist
Detecting AI-generated text is important to know if a computer or a human wrote something. The authors found that AI agents can cleverly combine pieces generated by simpler base models to make text that is harder for detectors to identify as machine-made. Unlike previous methods, this stitching method keeps the meaning clear and relevant. This shows that some current AI detection tools might miss these cleverly created texts, urging improvements in detection.
Open → 2609.31876v1

New method improves watermark detection in language model outputs

Predictive Likelihood Ratios for Language Model Watermark Detection

Abstract: Keyed watermark detection tests dependence between observed tokens and pseudorandom variables reconstructed from a secret key. Building on the pivotal framework of Li et al. (2025), we construct predictive likelihood ratios that average over uncertain probability deficits and residual-tail distributions. The aim is robust detection power across alternative specifications without requiring a single signal-strength tuning. A mixture prior combines tail shape and effective width; hierarchical extensions allow within-document variation in deficit or width. The test maximizes prior-averaged power at a fixed size, but is not generally uniformly most powerful or minimax. Under the exact conditional pivot null, normalized predictive alternatives selected before each observation yield a Bayes factor that is also a test martingale: Type I error control is unaffected by alternative misspecification and remains valid under optional stopping. This guarantee does not cover violations of the conditional null, and the interpolated implementation has no certified anytime guarantee. Gumbel marginal likelihoods are evaluated by fixed quadrature. Across the evaluated tail-shape and tail-width alternatives and three horizons, the union-tail mixture has maximum observed Type II error regret .0080, compared with .0962 for the equal-tail mixture, relative to the best tested rule. On temperature-matched outputs from two open models, it improves AUC over the equal-tail baseline in all eight non-saturated model-temperature cells, although the leading reference score generally has higher AUC. Supplementary experiments show retained power under independent null-like replacement and smaller changes from hierarchical dependence modeling. The evidence supports robustness across the evaluated alternatives, not uniform power guarantees or resistance to arbitrary text edits.

Mon 14 SeptArtificial IntelligenceMachine Learning
The gist
Detecting hidden watermarks in text generated by AI language models can be tricky, especially when details about the watermark are uncertain. The authors developed a new approach that combines multiple assumptions about these uncertainties to better detect watermarks without needing exact tuning. Their method controls false alarms even when tests are stopped early and works well across different scenarios. Although it’s not perfect in all cases, tests show it generally improves accuracy over previous methods.
Open → 2609.15657v1

WAVIE improves deepfake detection by combining spatial and frequency cues

Lightweight Generalized DeepFake Face Detection with WAVIE: Wavelet Augmented Vision Intermediate Embeddings

Abstract: Deepfake detection systems often exhibit significant performance degradation when deployed on unseen manipulation methods, limiting their reliability in real-world multimedia environments. This lack of generalization poses critical challenges for misinformation mitigation, digital forensics, and human-centric AI systems. Existing detectors perform well on the forgery methods they are trained on, but their accuracy drops sharply on unseen pipelines. To bridge this generalization gap, we propose WAVIE (Wavelet Augmented Vision Intermediate Embeddings), an end-to-end architecture that combines complementary spatial and frequency cues on top of a frozen CLIP backbone. WAVIE projects intermediate transformer embeddings through a lightweight learnable module, applies a three-level Daubechies-6 (db6) discrete wavelet transform (DWT), refines the low-frequency branch while preserving the high-frequency branch, reconstructs the feature via inverse DWT, and performs classification. Trained only on FaceForensics++, WAVIE achieves AUROC = 0.852 on Celeb-DF-v1, 0.852 on Celeb-DF-v2 and 0.831 on WildDeepFake (WDF) at the frame level, outperforming several state-of-the-art generalization baselines. Extensive ablation studies confirm the importance of both the wavelet module and the intermediate-feature aggregation for cross-dataset performance, highlighting the necessity of jointly leveraging spatial and frequency domains. These results position WAVIE as a strong baseline for deepfake detection in the wild.

Sun 13 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Detecting fake videos called deepfakes is hard because systems often fail when they see new types of fakes they weren’t trained on. The authors present WAVIE, a new method that looks at video images using both their visual details and hidden frequency patterns. By using a special wavelet transformation on features extracted from a powerful image model, WAVIE better spots fake videos it hasn’t seen before. It works well on several challenging test sets, showing promise for more reliable deepfake detection.
Open → 2609.14437v1