Large language models accurately detect covid19 fake news on twitter
A Large Language Model LLM Approach to COVID-19 Fake News Detection
Computers and Society
Summary
Misinformation about COVID-19 spreads quickly on social media, so spotting fake news automatically is important. The authors tested several advanced language models on a dataset of English tweets labeled as real or fake. They found that GPT-2 was the most accurate for identifying fake COVID-19 news tweets. They also improved results by combining model predictions using several fusion techniques. This shows that large language models can help filter misinformation during a pandemic.
What this means in practice
- •For social media platform engineers: Automatically flag COVID-19 misinformation in tweets using GPT-2 based models for timely content moderation.
- •For fact-checking teams: Prioritize and classify COVID-19 related news claims by applying transformer-based classifiers to speed review processes.
Tested on one dataset.
Authors
Muhammad Arif, Samah Fodeh-Jarad, Elyas Irankhah, Uroosa Fatima, Lama Ayash, Sreeraj Ramachandran
Abstract
Text classification is a widely studied problem in information retrieval and data mining, with applications ranging from healthcare diagnosis to the detection of COVID-19-related fake news. Social media platforms generate vast volumes of user-generated text, and the rapid spread of misinformation during the pandemic has made automated fake news detection an important task. In this study, we apply pretrained transformer-based transfer learning (TL) models and large language models (LLMs), namely BERT-base, ALBERT-base, XLM-RoBERTa-base, DistilBERT, GPT-2, XLNet, and T5, to the COVID-19 English Tweets dataset, which contains 6,420 tweets labeled as real or fake. To further improve performance, we apply six late-fusion optimization techniques: weighted fusion, particle swarm optimization (PSO) fusion, the Nelder-Mead algorithm, Powell's method, the Broyden-Fletcher-Goldfarb-Shanno (BFGS) algorithm, and trust-region constrained optimization. Models are evaluated using accuracy, precision, recall, and F1-score, and confusion-matrix heatmaps are used to visualize the predictions of each model. GPT-2 achieved the best performance, with an accuracy of 0.9631, precision of 0.9612, recall of 0.9610, and F1-score of 0.9600, while Nelder-Mead fusion achieved the best result among the fusion methods with an accuracy of 0.9610. These results highlight the value of LLMs for COVID-19 fake news detection. We conclude by outlining future directions, including multiclass classification, multilingual datasets, and real-time social media streams.