Large language models struggle to undo news framing changes
Recognizing Is Not Reversing: A Controlled Inversion Test of Fact-Preserving News Framing
Computation and LanguageArtificial Intelligence
Summary
It is possible for language programs to recognize how news articles are framed, but this study shows they cannot easily reverse those framing changes without altering facts. The researchers tested three types of common framing changes on 60 news stories, creating pairs of articles where the facts stayed the same but the framing shifted. While the programs kept the facts mostly intact, they were very poor at undoing the changes in framing. This means just understanding a bias or frame in text does not mean the program can remove it cleanly.
What this means in practice
- •For news platform developers: Improve tools that detect framing in articles by distinguishing fact preservation from frame changes for clearer content transformations.
- •For content moderation teams: Enhance moderation processes by understanding the limits of reversing biased framing while preserving facts in news rewriting.
Authors
Yi Liu
Abstract
Large language models (LLMs) are increasingly used to analyze and rewrite news, yet current framing studies mainly evaluate generation, detection, or whether rewritten text appears more neutral. They do not directly show whether a model can undo a known framing transformation while keeping the facts fixed. We introduce a controlled inversion test over three established textual realizations of framing: evaluative lexis, agency realization, and information salience. Across 60 news articles and three intervention strengths, this yields 540 paired variants with preserved atomic facts and recorded edits. Across Qwen, DeepSeek, and Kimi, factual preservation remains near 0.84, whereas intervention reversal is 0.044--0.068. Even when both framing type and direction are recognized correctly, pooled reversal reaches 0.071. These results reveal a clear separation between factual fidelity, framing recognition, and framing inversion: recognizing how an article is framed does not imply that the framing can be undone.