Papers for

social media platforms

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Copying reference images limits harmful photo edits in AI tools

Copying As Defense: Protecting Images from Editing By Eliciting Model Copying

Abstract: Image editors built on diffusion transformers (DiTs), such as Flux Kontext, make it possible to turn a single photograph into a convincing manipulated image, including harmful and non-consensual edits. Proactive defenses aim to prevent such manipulations by adding an imperceptible perturbation before an image is shared. Existing defenses for DiT-based in-context editors make the output attend less to the protected reference image. But this leaves the model free to follow the edit instruction using the text and its own generated tokens, often producing a new, weakly grounded image rather than preventing the edit. We find that the opposite strategy is more effective: instead of leading the model to ignore the reference, we encourage it to copy it. Through controlled attention interventions, we show that concentrating target-token attention on the reference image in only a few early blocks is sufficient to collapse the editing behavior, causing the model to reproduce its input, often as a lossy copy, rather than execute the requested transformation. Based on this insight, we introduce Copying-as-Defense (CaD), which maximizes per-token target-to-reference attention mass in early transformer blocks. Since attention rows are normalized, increasing reference attention suppresses the attention allocated to the text and generated canvas. Restricting the objective to early blocks also lets us truncate the backpropagation path, keeping optimization cheap. Across editors and benchmarks, CaD reduces average edit success from 81.4% on unprotected images to 24.0%, a 70.6% relative reduction, and by a further 44.3% relative to DeContext, the strongest baseline (43.0%). CaD is also roughly 1.8-2.0x faster per optimization step than comparable methods.

Mon 26 OctComputer Vision and Pattern Recognition
The gist
AI image editors can change photos in realistic but sometimes harmful ways. The authors found that making the AI focus more on copying the original image, rather than following edit instructions, stops most unwanted edits. They created a method that gently nudges the AI to copy early on, which reduces successful manipulations by over 70%. This defense also works faster and better than previous techniques.
Open → 2610.35566v1

Fake news detectors improve with multi-style worst-case training

MANTIS: Multi-Axis News Transformations for Instance-Wise Stress Testing and Worst-Case Training in Fake News Detection

Abstract: Automated fake news detection is vital on social media, where fake news is easily rewritten to fool detectors. However, existing approaches typically rely on superficial writing cues or single-style text rewrites, resulting in poor robustness under diverse cosmetic modifications. We construct MANTIS-Bench, a multi-axis presentation-attack benchmark that pairs original news with rewritten views across writing style, emotional expression, and dissemination framing. We further propose MANTIS, an instance-adaptive adversarial framework enabling dynamic worst-case training tailored to each news article with zero inference-time overhead. This reframes fake news defense from heuristic format smoothing into targeted, fact-invariant credibility assessment. Experiments on MANTIS-Bench show that MANTIS reduces the Union Attack Success Rate (UASR) by 3.55 percentage points relative to SheepDog on GossipCop and consistently outperforms prior single-axis defenses on Macro-F1 while maintaining competitive clean accuracy, demonstrating the effectiveness of multi-axis and instance-adaptive worst-case training.

Mon 26 OctComputation and Language
The gist
Fake news on social media can be tricky to detect because people rewrite it in many ways to avoid being caught. The paper introduces a new way to test fake news detectors by changing news stories across several styles, emotions, and framing methods. The authors also created a system called MANTIS that adapts training specifically to each news article, helping detectors focus on the facts rather than superficial writing styles. Their tests show this method makes detectors stronger against different rewriting tricks while still accurately spotting real news.
Open → 2610.35475v1

Expert benchmark measures AI news quality in sourcing and fairness

NewsBench: Expert-Grounded Evaluation of Epistemic Quality in AI News Reporting

Abstract: As frontier AI systems increasingly serve as sources of political and current-events information, evaluating the epistemic quality of their responses is now especially consequential. Existing evaluations often focus narrowly on ideological alignment, rely on measures not validated for this setting, or depend on reference labels derived from public opinion or non-expert annotation, potentially producing misleading or miscalibrated results. To address these limitations, we introduce NewsBench, an expert-grounded benchmark that reframes evaluation around editorial standards developed by senior practitioners in journalism, policy, and intelligence analysis. NewsBench operationalizes quality across three dimensions, source quality, factuality, and neutrality, using a two-phase pipeline in which domain experts first define and calibrate evaluation guidelines, which are then transferred to automated AI judges validated against expert-adjudicated gold labels. The benchmark includes approximately $3,000$ evaluation prompts, with roughly $500$ refreshed monthly to capture emerging current events, roughly $2,500$ human expert-annotated items for calibration and validation, and a suite of AI judges designed to enable scalable evaluation. To validate our methodology, we report both inter-rater reliability among human experts and AI judge--human agreement across all three dimensions. Finally, we apply NewsBench to four frontier models, revealing distinct and non-overlapping failure profiles in sourcing, factuality, and neutrality.

Fri 23 OctArtificial Intelligence
The gist
As AI increasingly provides news and political information, it’s important to check how accurate, unbiased, and reliable it is. The authors created NewsBench, a new way to test AI news outputs based on standards made by experienced journalists and analysts. Experts first set detailed rules and labeled thousands of examples, then AI tools were trained to judge these qualities so testing could scale. This system helps people see how well different AI models do when reporting facts, naming sources, and staying neutral.
Open → 2610.33240v1

Multimodal model finds misleading captions mismatched with real images

MiD-VLM: Detecting and Grounding Global Semantic Misinformation in Image-Caption Pairs

Abstract: Semantic misinformation can arise when an authentic image is paired with a caption that changes or distorts its narrative. Because the image itself may contain no visible signs of manipulation, methods designed to detect pixel-level artifacts can miss these misleading image-caption pairs. We study this problem using DGM4+, a dataset designed to evaluate the detection of global scene and semantic inconsistencies. We propose a multimodal model that combines image-text representations from SigLIP with visual scene features from DINOv2 through a projection MLP, and adapts Qwen2-VL-7B using LoRA. The model jointly predicts whether an image-caption pair is authentic, identifies the manipulation type, and grounds the misleading caption tokens. On the DGM4+ validation split, the model achieves an F1 score of $0.9679$ for binary authenticity classification. These results suggest that parameter-efficient adaptation of vision-language models is promising for detecting semantic inconsistencies, while also motivating further work on precise token-level grounding.

Fri 23 OctComputer Vision and Pattern Recognition
The gist
Sometimes an image is real, but a caption next to it changes the story and misleads people. The authors focus on detecting this kind of semantic misinformation where the picture itself isn't altered, only the caption is misleading. They built a computer program that looks at both the image and caption together to decide if they fit or if the caption is false. Their program also finds which words in the caption are misleading. Tests on a special dataset showed their program works very well to spot these mismatches.
Open → 2610.32967v1

Health influencer videos assessed for credibility using linked arguments

GRID: Modeling Health Influencer Discourse as Argument Networks for Credibility Assessment

Abstract: Health-related discussions on social media are increasingly shaped by influencers who offer diverse, and often competing perspectives on the same issue. Yet, such content is typically evaluated in isolation, without considering the broader discourse in which it appears. We introduce GRID (Grounded Reasoning over Interconnected Discourse), a framework for evaluating influencer content through collective inference over the surrounding discourse. GRID represents each video as an argumentation graph connecting claims to its central message, or takeaway, links related claims and takeaways across videos, grounds claims in scientific evidence, and jointly infers credibility over the resulting network. We evaluate GRID on an end-to-end health-related content validation task using 569 influencer videos grounded in expert assessments. Our results show that accounting for the broader discourse improves influencer content validation. Finally, we use GRID-inferred credibility to demonstrate how argumentative strategies and moral framing differ between low- and high-credibility content.

Mon 19 OctComputation and Language
The gist
Social media health discussions often include influencers sharing different opinions on the same topic. The authors developed GRID, a system that connects claims made in influencer videos with scientific evidence and other related claims across videos to judge how trustworthy the content is. They tested GRID on hundreds of videos checked by experts and found that looking at the bigger conversation helps decide credibility better. They also used GRID to see how credible and less credible influencers use different argument styles.
Open → 2610.27149v1

EvisStress improves face forgery detection with clearer explanations

EviStress: Evidence Stress Learning for Generalizable Face Forgery Detection with Textual Explanations

Abstract: The rapid spread of face forgeries on the Web challenges the credibility of visual content. In practical Web environments, manipulated media originate from evolving generation pipelines and undergo diverse processing during dissemination, making reliable authenticity assessment under unseen manipulations and visual changes a critical challenge. We observe that a standard LoRA-adapted CLIP detector exhibits uneven patch-level decision dependence, concen trating a disproportionate share of class-specific relevance on a small fraction of visual patches. To improve robustness to variations in such highly dependent evidence, we propose EviStress, a two-stage framework for generalizable face forgery detection with textual explanations. In the first stage, Evidence-Targeted Patch Perturbation (ETPP) estimates patch dependence from global, relational, and semantic cues and assigns positively correlated perturbation probabilities, explicitly stress-testing highly dependent visual evidence during training. We further introduce Discriminative Variation Preservation (DVP), which constrains the residual between clean and perturbed representations to retain authenticity discriminative information. In the second stage, Intrinsic Evidence Instruction Tuning (IEIT) transfers the adapted CLIP encoder into LLaVA as its vision tower and performs parameter-efficient multimodal instruction tuning, enabling authenticity prediction and textual explanation directly from the learned forgery-sensitive representation without an external detector. Experiments demonstrate improved cross-dataset and cross-method generalization and corruption robustness, with the multimodal model providing authenticity predictions and human-readable explanations.

Mon 12 OctComputer Vision and Pattern Recognition
The gist
Fake face images are spreading quickly online, making it hard to know what is real or fake. The authors found that typical detectors rely too much on only a few small parts of an image, which makes them less reliable with new types of fakes or changes in images. They created a method called EviStress that stresses the parts the detector depends on and teaches it to still recognize fakes robustly. Their system can also explain why it thinks an image is fake in simple text, helping users understand the decision.
Open → 2610.16879v1

Models identify American satire more accurately than Australian satire

Unreliable Narrator Framing as a Cost-effective Mechanism for Satire Explanation of Australian and American Satirical News

Abstract: Satirical news is a unique form of misinformation: it is intended to be humorous by the original publication source but can be misinterpreted. Explanation of satirical news articles is challenging because recent and local context needs to be incorporated. This is a pilot study that explores explanation generation for satirical news articles from Australia and compares them alongside those from USA. The paper demonstrates that framing explanations on unreliable narrator theory on open-weights models can be a feasible, cost-effective alternative to frontier models. We find that models identify the satirical tropes more accurately on the American source than the Australian one. This work results in a novel dataset and an evaluation benchmark for satirical explanation.

Fri 9 OctComputation and Language
The gist
Satirical news is meant to be funny but can sometimes confuse readers who don't get the joke. The authors explored a way to explain why satire works using a theory about unreliable narrators, which are storytellers who can't be fully trusted. They tested this idea on satirical news from Australia and the USA using affordable language models. Their study found that the models were better at recognizing satire in American articles than Australian ones. They also created a new collection of data and a way to measure how well satire explanations work.
Open → 2610.12863v1

Detecting fake lip sync videos by spotting lip and head movement mismatches

Ariadne's Thread of LipSync: Unraveling Forgeries via Inconsistency between Lip Motions and Head Poses

Abstract: Recent advances in LipSync generation technology have led to the creation of highly realistic videos, posing severe societal risks. However, existing defense strategies struggle against LipSync forgeries, as advanced LipSync generation methods not only achieve better lip synchronization but also eliminate visual artifacts. An important reason is that they overlook an inherent biological coupling between lip movements and head poses in natural speech videos. In this paper, we propose LipDA, a novel framework for joint LipSync Detection and Attribution, which takes advantage of the inconsistency between head and lip. For detection, the framework learns to quantify this discrepancy by contrasting lip and pose features from authentic versus forged videos. For attribution, our method is designed to capture the unique temporal dynamics and audio-visual synchronization patterns that act as the fingerprint of models, enabling source tracing. We conduct extensive experiments on two challenging LipSync datasets as well as our own proposed large-scale and multi-generator dataset. LipDA achieves over 97\% AUC in detection and 97.5\% accuracy in model attribution, significantly outperforming existing methods. Code and the proposed LipSync-A dataset are available at https://github.com/AnsonShe/LipDA.

Tue 6 OctComputer Vision and Pattern RecognitionCryptography and Security
The gist
Videos that fake lip movements to match speech are getting very realistic, which can cause problems because it’s hard to tell what’s real. The authors found that real videos naturally link lip movements with head motion, but fake videos miss this connection. They created a method called LipDA that looks for mismatches between lips and head movements to spot fakes and identify which model made them. Their approach works very well on big datasets and can tell fake videos apart with high accuracy.
Open → 2610.08417v1

Artificial intelligence reveals how culture shapes human thought and society

Artificial Intelligence and the New Science of Culture

Abstract: Cognition and culture have long been treated as parallel objects of study, joined more by metaphor than by mechanism. We argue they are co-constituted in a manner now empirically tractable: subjectivities can be measured as local trajectories through a high-dimensional cultural field, and the field is itself the aggregate of those trajectories. Recent advances in machine learning, including embedding methods and large generative models, provide the first general framework for measuring this co-constitution from micro-cognition to macro-social structure. Vector geometry recovers individual conceptual structure, organizational communication, and large-scale ideologies; captures multimodal cultural content beyond text; and generates testable predictions about cultural emergence, including the simultaneous arrival of independent discoveries across distant minds. We treat this predictability of simultaneous innovation as evidence for the co- constitutive view: when the geometry of the cultural field is measurable, trajectories of cognitive search through it become predictable. We then examine generative AI agents as simulators of human subjectivity and as a qualitatively new coordinating substrate whose insertion into social life introduces evolutionary dynamics unprecedented in human cultural history. We formalize this reflexive condition as a Heisenberg-like Uncertainty Principle for generative AI: as instruments for fixing a culture's position grow more precise, our capacity to predict its trajectory degrades, because the machinery of cultural description and cultural action have merged. We close with ethical questions raised by AI-mediated cultural drift, recursive synthetic culture, and the limits of human cultural agency, offering guidelines for safe, equitable, and privacy-preserving research on AI and culture.

Mon 5 OctComputers and SocietyArtificial Intelligence
The gist
Cognition (how people think) and culture (shared ideas and customs) have been studied separately for a long time. The authors show that thinking and culture shape each other and can now be measured together using advanced AI techniques. They use mathematical spaces called vector geometry to understand individual ideas, groups, and society-wide beliefs. Their work suggests AI can predict cultural changes and helps explain why unrelated people sometimes have similar discoveries. They also discuss how AI itself changes culture in new ways and raise important ethical questions about this impact.
Open → 2610.06240v1

Relation-aware graph network improves harm-aware fake news detection

RAEGNet: Relation-Aware Evidence Graph Network for Harm-Aware Multimodal Fake News Detection

Abstract: Existing multimodal fake news detection methods often introduce external information to assist detection. However, most of them rely on entity-level retrieval and are therefore prone to introducing event-irrelevant noise. Meanwhile, existing methods mainly focus on improving overall performance and do not account for differences in the degree of harm posed by different instances of fake news. To address these limitations, we design an Event-Level Evidence Retrieval Framework (ELERF) and propose a Relation-Aware Evidence Graph Network (RAEGNet). ELERF retrieves external evidence based on the complete event semantics of a news item. RAEGNet constructs a directed graph that incorporates news-evidence stance relations and evidence-evidence interaction relations, and introduces a conditional-harm branch to jointly model authenticity and potential harm. Experimental results demonstrate that RAEGNet outperforms multiple baseline methods across all evaluated metrics on Weibo-21, Fakeddit, and our self-constructed SSS dataset.

Tue 29 SeptComputation and LanguageComputer Vision and Pattern RecognitionMultimedia
The gist
Detecting fake news often uses extra related information, but existing methods focus too much on individual entities, which can cause irrelevant distractions. The authors designed a way to retrieve evidence at the event level, meaning they look at the whole news story for clues. They then use a special graph network that understands how pieces of evidence relate to each other and to the news, also estimating how harmful the fake news could be. Tests on multiple datasets show their method works better than earlier ones.
Open → 2609.36902v1

Event context improves emotion recognition beyond visual cues

AffectReveal: Event-Grounded Emotion Recognition Beyond Visual Appearances

Abstract: Visual emotion recognition commonly assumes that all evidence required for prediction is contained in the observed image or video. Yet the same visible reaction can convey different emotions depending on events beyond the input: tears, for example, may indicate grief or joy. We formulate Event-Grounded Emotion Recognition (EGER), where emotion recognition requires recovering the affect-determining event. We construct EGER-Bench, comprising 10,052 videos and 10,734 images across 11 emotions, two source domains, and four visual settings. A study with six annotators shows that event context raises human recognition accuracy from 33.96% to 72.08%, confirming that visual evidence alone is often insufficient. Semantic relevance alone does not solve EGER: a plausible event may imply the wrong emotion if its identity, focal-person role, relationship, or outcome is misinterpreted. We therefore propose AffectReveal, a tuning-free framework that first constructs and independently verifies evidence-grounded alternatives over these affect-critical factors. It then cross-checks the recovered event against face-masked in-media facts through bidirectional atomic evidence support, while retaining the original unmasked input for final prediction. Across three downstream models and four input settings, AffectReveal yields average UAR gains of 5.26--10.53 points. For three fine-tunable models, it also enables untuned models to outperform their fine-tuned visual-only counterparts in all 12 accuracy comparisons, without updating downstream parameters.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Understanding emotions just by looking at someone's face or reaction can be tricky because the same expression might mean different feelings depending on what happened. The authors created a way to recognize emotions by also figuring out the event that caused them, not just relying on visual clues. They found that knowing the event almost doubled human accuracy in guessing emotions. Their method, AffectReveal, checks multiple pieces of evidence about the event and combines that with the original image or video to better predict emotions without extra training.
Open → 2609.36563v1

Benchmark measures verification difficulty of AI-generated misinformation

VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformation

Abstract: Large language models (LLMs) have made misinformation inexpensive to produce but not to verify, creating a growing asymmetry in the information ecosystem. Under tight time, labor, and budget constraints, media organizations, platforms, and fact-checkers rely on screening to prioritize which content to verify. We introduce VEX-Bench, a unified benchmark for evaluating the verification complexity of LLM-generated misinformation, as perceived during screening, across models and generation methods. Verification complexity is assessed along multiple dimensions derived from journalistic and fact-checking practices, capturing checkability, harm potential, source credibility signals, imposter legitimacy, and expected verification effort. We define the VEX score as an integrated measure combining elicitation yield and verification complexity to quantify how generated content consumes limited verification capacity. We construct a benchmark spanning two misinformation categories, 6 high-stakes domains, and 60 real-world topics, and evaluate 7 frontier LLMs and 7 generation methods, yielding 5{,}880 articles. We employ an LLM-as-judge for scalable evaluation and validate it using content-analysis methodology, including ordinal Krippendorff $α$ for inter-annotator reliability, complemented by fact-checking agents for verification. Our findings show that no single method dominates all dimensions, underscoring the need for multi-dimensional evaluation. LLMs can generate high-VEX misinformation at 3$\times$ to 169$\times$ lower cost than agent-based verification. Such content is often prioritized during screening, consuming scarce verification resources and introducing a systematic risk of misallocation in resource-constrained verification systems. The code is publicly available in our \href{https://github.com/HanxunH/VEX-Bench}{GitHub repository}.

Mon 28 SeptMachine LearningArtificial IntelligenceComputation and Language
The gist
Misinformation created by AI is cheap and quick to make but hard and time-consuming to verify. The authors created VEX-Bench, a tool that scores how difficult it is to check whether AI-generated misinformation is true, considering factors like how believable the source is or how much harm it could cause. They tested many AI models and methods, showing how verification effort varies widely and that some misinformation can use up verification resources quickly. This helps fact-checkers understand what kinds of AI content are harder to review and allocate their limited resources better.
Open → 2609.35028v1

Language models judge facts less well outside english and this closes the gap

Fair Fact-Checking: Closing the Cross-Lingual Gap in LLM Factual Judgement with RoSh

Abstract: Misinformation on social media remains a critical problem, and more and more people settle it by asking a language model instead of a fact checker. Whether models judge such claims reliably is debated; whether they judge them equally well in every language people ask in has gone almost unasked. We test eight models from five families, 3B to 70B, on 1,500 encyclopedic factual claims that exist in identical form in eight languages. English is judged better than every other language on every model, and the gap is widest on the smallest ones, where Llama-3B on Arabic is no better than guessing. Existing remedies retrain on more multilingual data or fit an unconstrained map between language representations, and neither asks whether the model already holds the answer and simply fails to say it. It largely does: a linear probe recovers the truth from the very activations the model fails to express. We propose RoSh, a per-language shift and rotation of the residual stream, computed in closed form at three layers, with no training and no weight modified. It improves every model and closes 75% of the gap on average, helping most where the model was worst: Arabic on Llama-3B goes from chance to nearly the English level, and a fifth fewer of the claims answered correctly in English are lost in translation. What remains is no longer a read-out failure: afterwards the head recovers as much of what is encoded outside English as it does in English. An unconstrained map fitted on the same pairs falls below the untouched baseline, so the orthogonality constraint is doing the work, and every model clears a scrambled-correspondence control and ten further controls. On the two benchmarks of the closest inference-time method, latent-space intervention, run with its own data and metric code, RoSh's gains are five to thirteen times larger.

Mon 28 SeptComputation and LanguageArtificial Intelligence
The gist
Fact-checking with AI models is less reliable in languages other than English, especially for smaller models and languages like Arabic. The authors found that while models often know the correct answer, they fail to express it properly in many languages. They propose RoSh, a method that adjusts the model’s internal processing without retraining, greatly improving fact-checking accuracy in multiple languages. This method closes most of the performance gap between English and other languages, making fact-checking fairer across languages.
Open → 2609.34678v1

Multimodal misinformation detection improves with tool guided learning

MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning

Abstract: Real-world multimodal misinformation often involves mixed forgery sources, requiring sample-specific detection strategies. Existing tool-augmented methods rely on predefined workflows or inference-time planning, limiting adaptability or increasing inference cost. To address this issue, we introduce \textbf{MM-VeriAgent}, which learns to verify mixed-source multimodal misinformation with tools. We first build \textbf{MM-VeriTools}, a specialized toolkit for misinformation detection agents. By benchmarking various candidate models and methods on the sub-tasks required by mixed-source detection, we select the strongest for textual, visual, and cross-modal forgery analysis and encapsulate them as callable tools with a unified interface. On top of this toolkit, we train the LVLM agent with reinforcement learning to teach it how to use these tools to better solve mixed-source detection. Since many of the tools are specialized models whose online execution at every rollout severely limits RL efficiency, we further introduce \textbf{Tool-Execution Cache}, which pre-executes candidate tool calls and reuses their cached outputs during training. This preserves multi-step rollouts while reducing online tool execution, largely improving the training efficiency.Experiments on MMFakeBench demonstrate substantial accuracy gains over the base model without explicit tool search at inference time. Ablation and efficiency analyses further validate the learned tool-use policy and show that Tool-Execution Cache reduces online tool executions during training.

Fri 25 SeptComputer Vision and Pattern Recognition
The gist
Detecting false information that mixes text and images is tricky because it can come from multiple kinds of fakes. The authors created a toolkit of specialized models for checking text, images, and their combinations. They then trained an AI agent to learn how to use these tools together efficiently, improving its ability to spot mixed-source misinformation. A smart caching system also sped up training by reusing previous results instead of running all checks repeatedly.
Open → 2609.30698v1

Multimodal sentiment analysis improves reliability with noise and missing data

Reliability-aware Cross-sample Enhancement for Robust Multimodal Sentiment Analysis

Abstract: Multimodal Sentiment Analysis (MSA) aims to infer human emotions from multiple modalities such as text, audio, and vision. In practice, inputs are often corrupted by noise and missing modalities, which degrades performance. Existing methods typically address these challenges in isolation, limiting their effectiveness in realistic settings. To address this limitation, we propose a Reliability-aware Cross-sample Enhancement (RCE) framework. Specifically, RCE first introduces an adaptive variational information bottleneck to model modality-wise uncertainty and perform quality-aware information compression, thereby suppressing redundant noise in unreliable modalities. Furthermore, we design a reliability-aware cross-sample enhancement strategy that retrieves high-confidence, semantically consistent neighbors from a large candidate pool to enrich and calibrate current representations, effectively alleviating information deficiency caused by missing modalities. Building upon this, RCE integrates cross-modal interactions with a multilevel reliability-aware fusion mechanism to adaptively aggregate information across modalities and enhancement stages, leading to more robust multimodal representations. Extensive experiments demonstrate that RCE consistently outperforms state-of-the-art methods across full, noisy, and missing-modality settings.

Thu 24 SeptMachine Learning
The gist
Understanding emotions from text, speech, and images is tough when some information is missing or noisy. The authors propose a method that can tell which parts of the data are unreliable and reduce their impact. They also use similar, high-quality examples to fill in gaps and improve emotion recognition. Their approach combines information from all sources more effectively, leading to better results even with imperfect data.
Open → 2609.30470v1

Entropy guided method improves AI generated image detection accuracy

EIB-Net: Entropy-Guided Information Bottleneck for Generalizable AI-Generated Image Detection

Abstract: The proliferation of photorealistic AI-generated images demands robust detection methods that generalize across diverse generative models. While existing approaches target manipulation-based forgeries with local artifacts, generation-based images (e.g., from diffusion models) lack such traces, posing a fundamental challenge. We observe that generative models prioritize global semantics at the expense of local texture fidelity, making low-texture regions key indicators of synthetic origin. To exploit this, we propose EIB-Net, an Entropy-guided Information Bottleneck Network. EIB-Net introduces a novel Image Entropy (IE) metric to automatically select the most informative (lowest-entropy) patch, then processes it with a Variational Information Bottleneck (VIB) to learn compact, generalizable features. Extensive experiments on DIFF, DiffusionForensics, and GenImage benchmarks demonstrate state-of-the-art performance: EIB-Net achieves 85.7\% accuracy using only 2\% of training data, outperforming full-image baselines by over 15\%, and maintains robust cross-generator generalization (83.5\% average accuracy on GenImage). Furthermore, our entropy-guided patch selection (EGPL) consistently enhances diverse backbones (CNNs and Transformers), proving its practical value for data-efficient detection.

Thu 24 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Detecting images made by artificial intelligence is hard because they often don’t have obvious fake parts. The authors found that AI images usually have smooth or less detailed areas that can help spot them. They created a technique called EIB-Net that picks out these smooth parts using a new measurement and focuses on them to learn better clues for detection. Their method works well even with little training data and works on images from different AI sources.
Open → 2609.29064v1

Multilingual raw video dataset supports event search and summary

MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos

Abstract: Online information is increasingly consumed in video format. Much of this comes in the form of *raw video*: continuous footage taken on a cell phone, with a hand-held camera, or via CCTV, which is then directly uploaded to social media platforms and content sharing services. Whereas professional or even amateur-edited footage tends to feature scripted speech, chyrons, graphics, and metadata that help contextualize its subject matter, raw video typically contains none of these things, making it a much more challenging medium for information retrieval and machine understanding. To facilitate progress in this domain, we release MultiVENT-Raw, a multilingual collection of nearly 120,000 primarily raw videos (over 5,300 total hours), paired with 130 events and 222 event-centric queries, along with human-annotated video relevance judgments and human-extracted key facts for relevant videos. MultiVENT-Raw supports both a retrieval task---to identify videos in the collection relevant to a query event---and a generation task---to summarize event-related videos into a coherent report for a target user. We benchmark strong baselines on MultiVENT-Raw, showing both tasks to be challenging even for some of the latest multimodal models.

Wed 23 SeptComputer Vision and Pattern RecognitionInformation Retrieval
The gist
Videos taken directly from phones or security cameras often lack helpful titles or captions, making it hard for computers to understand or find key info. The authors created MultiVENT-Raw, a large collection of raw videos paired with specific event descriptions and questions about those events. They included human reviews of which videos are relevant and key facts from those videos to help train and test computer models. Their tests show that even advanced AI systems find it difficult to accurately retrieve and summarize videos in this raw format.
Open → 2609.28437v1

MemePIVOT improves detection of harmful cues in multimodal memes

Small Cues, Big Consequences: Learning Pivotal Cues for Multimodal Meme Classification

Abstract: Memes often derive their harmful, hateful, or sarcastic meaning from small but decisive visual, textual, or cross-modal cues. Existing multimodal classifiers can miss such evidence when relying mainly on global image-text representations. We introduce MemeCF, a cue-focused benchmark of 9,895 memes across harm, hate, and sarcasm, with annotations identifying the modality and rationale of the pivotal evidence. We also propose MemePIVOT, a local-global architecture for meme classification. MemePIVOT uses frozen CLIP features, unbalanced optimal transport to align words with image patches while allowing irrelevant evidence to remain unmatched, and an evidential fusion head to combine local grounding with global meme context under uncertainty. Experiments on HarMeme, PrideMM, and MemeCF show consistent gains over strong text-only, image-only, multimodal, and vision-language baselines. Cross-dataset and ablation results further show that explicit pivotal-evidence modeling improves robustness and contributes meaningfully beyond global multimodal representations. Our code and dataset are publicly available at https://github.com/AkshitSharma1/MemePIVOT

Tue 22 SeptMultimediaComputation and LanguageMachine Learning
The gist
Memes often rely on small details in their images or text to carry harmful, hateful, or sarcastic messages. The authors created a new dataset that labels these important details to help computers learn what to look for. They also designed a new method, MemePIVOT, which focuses on these key parts by linking specific words to parts of the image while also considering the overall meme context. Their approach performs better than previous methods in detecting harmful content in memes. This shows that paying attention to small but crucial clues helps computers understand memes more accurately.
Open → 2609.26907v1

MemeTAG improves classification of harmful internet memes using keywords

MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction

Abstract: The proliferation of harmful internet memes poses a significant societal threat, yet their automated classification remains a formidable algorithmic challenge due to the nuanced, multimodal nature of their content. To address this, we introduce MemeTAG, a novel dual-objective framework that pioneers a keyword-aware approach to meme classification. Our core innovation is a two-part semantic guidance mechanism: first, we leverage a pretrained Vision-Language Model to generate a set of descriptive keywords, that capture the high-level semantics. Second, we introduce the Aggregated Tag Inference Network (ATIN), an attention-based module that distills these keywords into a single, rich semantic embedding. This embedding serves as a target for a novel auxiliary reconstruction loss, which compels the model to learn deeply aligned visual and textual features. This approach, combined with an efficient three-stage training strategy, establishes a new state-of-the-art on the HarMeme, Hateful Memes Challenge (HMC), and PrideMM datasets, decisively outperforming existing state-of-the-art methods.

Thu 17 SeptComputer Vision and Pattern RecognitionMultimedia
The gist
Internet memes can sometimes spread harmful messages, and automatically detecting these is hard because memes combine pictures and words in complex ways. The authors created MemeTAG, a method that first finds descriptive keywords from memes using a model trained on pictures and language together. Then, they use a special network to combine these keywords into a summary that helps the system better connect the visual and text parts of memes. This method works better than previous ones on several meme datasets that focus on hate and harm.
Open → 2609.20962v1

Digital twins simulate realistic opinion changes in social networks

Digital Twins for Opinion Dynamics: A Generative LLM Framework for Social Networks

Abstract: The study of opinion dynamics in social networks is one of the key challenges in computational social science with direct relevance to understanding political polarization, misinformation, and health responses. Current approaches focus on simplified mathematical models that ignore linguistic and contextual factors related to belief updates or use Large Language Model (LLM)-based simulations that have not been validated against real data. We present a framework based on the concept of a digital twin to simulate opinion dynamics in social networks. The approach fills the gap by cloning a real-world Twitter network, assigns a set of attributes for agents (such as persona, emotions, centrality, stubbornness, and influence), and employs Mistral-7B to perform opinion update based on memory and social exposure. To evaluate the proposed approach, we validate it against two real Twitter datasets (COVID-19 discourse and U.S elections 2020). The results show that the capability of the proposed framework reproduces opinion trajectories and reduces individual prediction error by more than 50% compared to the best-performing classical baseline (Mistral-7B achieves Mean Absolute Error (MAE) = 0.150 and 0.121 on the COVID-19 and US Election 2020 datasets, respectively). We observe similar improvements in structural alignment (Delta_r = 0.120 and 0.180) and polarization dynamics (Delta_Var = 0.106 and 0.115) on the two datasets, respectively. Additionally, the ablation studies confirm that agent attributes, memory, and social exposure all contribute to the framework's predictive fidelity in reproducing opinion trajectories, with agent attributes being the most critical contributor. Overall, our results demonstrate that grounding Mistral-7B within empirically cloned interaction networks produces a realistic simulation framework capable of reproducing complex social dynamics.

Thu 17 SeptMachine Learning
The gist
Understanding how people's opinions change over time on social media helps tackle issues like political division and misinformation. The authors created a digital copy of a real Twitter network, where virtual people have traits like emotions and stubbornness. They used a language model called Mistral-7B to simulate how these virtual people update their opinions based on what they remember and what their friends say. Their simulations matched real Twitter data better than traditional methods, showing the approach can recreate complex social behaviors.
Open → 2609.19913v1

Deepfake detectors improve accuracy using new visual model and experts

Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics

Abstract: The unchecked proliferation of manipulated images on social media platforms has increased the spread of misinformation, posing a severe threat to public trust and information integrity. Modern deepfake detectors typically rely on Vision Transformers (ViTs) to capture the low-level inconsistencies that characterize fully synthetic or locally tampered images. However, the global understanding of such foundation models is not enough to discriminate alone between real and fake multimedia content, especially in challenging scenarios where images are compressed or transmitted through social media. In this paper we pioneer the application of Joint-Embedding Predictive Architecture (JEPA) models to deepfake detection, taking advantage of the generalized representation of visual reality that such World Models have exhibited. We hypothesize, and empirically demonstrate, that the intrinsic world understanding of JEPA models can be used as a strong prior for a deepfake detector. To fully exploit JEPA capabilities, we propose MoE-JEPA, a dual-stream architecture for deepfake detection. By enhancing a V-JEPA 2 backbone with a Residual Mixture-of-Experts (MoE) mechanism, along with a noise stream branch, our model dynamically internalizes forensic knowledge. Furthermore, a Gated Attention Multiple Instance Learning (MIL) module is employed to ensure precise spatial semantic understanding. Evaluated on the SID-Set benchmark, comprising 300K AI-generated, tampered and authentic images, MoE-JEPA establishes a new state-of-the-art with an accuracy of 95.54%, successfully outperforming vastly larger models.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Fakes images on social media can spread false information, so detecting them is important. The paper shows that a type of AI model called JEPA helps recognize real versus fake images better by understanding how the world typically looks. The authors built a new system, MoE-JEPA, which uses multiple expert parts and attention techniques to better spot fake details, even in tricky cases like compressed images. Their method tested on a large benchmark and beat bigger existing models in accuracy.
Open → 2609.16778v1

Generative AI models show varied political issue biases in Sweden

Issue Bias in Generative AI Writing Assistance: Political Issues and LLMs in the Swedish 2026 Election

Abstract: Generative AI writing assistants and the Large Language Models (LLMs) that power them are increasingly part of how voters gather information before elections. With growing evidence that they influence users' opinions, it is increasingly important to understand the views and positions of these tools. To better understand these views, we examine the stances supplied by six LLMs on a variety of Swedish-language writing tasks ahead of the 2026 Swedish parliamentary election. We cross 107 policy propositions with 77 writing templates and neutral, positive, and negative prompt framings, producing 24,717 prompts per model and 148,302 responses. To study these, we look at the models' default stance tendencies, compare how they respond to similar issues, and compare their responses with those of each of Sweden's eight parliamentary parties on the same issue. We find that Claude, DeepSeek, Gemini, and Mistral have similar profiles; ChatGPT more often supplies neutral or ambivalent text; and Grok differs most on topics such as migration, crime, and gender. When comparing the political parties, we find that the Social Democrats are closest to all six models. Still, after correcting for multiple comparisons, none of the within-model differences in party distances remains significant. Overall, we find that no model has a clear preference, nor a clear preference for a party, but that this depends on the specific issue or task the user asks about.

Mon 14 SeptArtificial IntelligenceComputers and Society
The gist
Generative AI tools used to write text before elections can influence what people think. The authors tested six AI models by asking them about many political issues in Sweden and compared their answers with those of political parties. They found that the models didn’t strongly prefer any single party but had different stances depending on the topic. This means these AI tools don’t all share the same political views, and their opinions depend on the question asked.
Open → 2609.15207v1

AI image detection improves by tracking continuous authenticity signals

Learning Continuous Source Responses For Generalizable AI-Generated Image Detection

Abstract: Advances in image generation have made synthetic images increasingly difficult to distinguish from real photographs, raising concerns about the trustworthiness of visual media. Existing AI-generated image detectors often perform well on in-domain data, but their robustness and cross-generator generalization remain limited. These limitations are commonly attributed to overfitting to shortcut cues. Although many methods seek to suppress shortcut learning, most retain binary classification as the training task without reconsidering how the task itself shapes the learned representations. We introduce CuRe, a framework for learning Continuous Source Responses that revisits authenticity detection from the perspective of the training task. CuRe reformulates backbone adaptation as regression of real-generated mixing ratios, providing finer supervision that encourages the model to capture authenticity-related variation beyond binary endpoint separation. We further select a compact source-response subspace to suppress nuisance variation and limit the final classifier's access to potential shortcut cues. Across ten public benchmarks, CuRe achieves an average balanced accuracy of 89.7%, exceeding the second-best method by 5.2 percentage points. Further experiments demonstrate consistent generalization gains across visual backbones and strong robustness to common image degradations. Code is available at https://github.com/manic-cui/CuRe

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
It is becoming very hard to tell AI-made images apart from real photos. The authors propose a new method called CuRe that detects AI-generated images by not just labeling images as real or fake but by measuring how much an image looks like each source. This approach helps the system learn more detailed clues about image authenticity beyond a simple yes-or-no decision. Their method works better than others across many tests and stays accurate even when images are degraded or altered.
Open → 2609.14316v1

Detecting fake news videos using keyframes and evidence fusion

Detecting and Explaining Fake News Short Videos with Multimodal Content and Real-World Evidence

Abstract: Short-video platforms have become a primary news source for the public, which has also enabled the widespread dissemination of fake news videos. We study the task of fake news video detection and explanation (FNVDE). Existing methods face two critical limitations. First, commonly used frame selection strategies may omit veracity-relevant cues or provide insufficient temporal context for understanding news videos. Second, prior methods neglect either multimodal understanding or evidence retrieval. To address these limitations, we propose NVKE-CEI, a unified system that integrates a news video keyframes extraction method (NVKE) and an FNVDE framework leveraging both content and evidence information (CEI). NVKE selects keyframes based on chronological changes in combined visual and OCR-text similarity. CEI employs two specialized LLM-based fact checkers (content-based and evidence-based) whose outputs are fused by a lightweight judge model. Extensive experiments show that NVKE-CEI outperforms state-of-the-art baselines while generating high-quality content-grounded explanations.

Fri 11 SeptComputer Vision and Pattern RecognitionMultimedia
The gist
Short videos online can spread fake news quickly, and it can be hard to spot which videos are false. The authors developed a new way to pick important video frames by looking at changes in both pictures and text seen in the video. They then use two separate computer checkers, one that looks at the video content and another that finds real-world proof, to decide if the video is fake. Their system combines these checkers’ opinions to detect fake news videos better and explain why.
Open → 2609.12678v1