Papers for

journal editors

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Scientific writing changes speed and style after ChatGPT launch

Accelerated Drift of Scientific Prose in the LLM Era: Evidence from an Interrupted Time-Series Analysis

Abstract: Every scientific text is embedded in the writing norms of its time: it reflects earlier publications while also shaping the texts that follow. The growing use of LLM-based writing tools introduces a new factor in this evolving system, but the linguistic changes coinciding with their emergence remain insufficiently understood. We investigate whether the trajectories of scientific-preprint writing changed in rate or direction after conversational LLMs became publicly accessible, using the release of ChatGPT in November 2022 as the observational breakpoint. We compare pre- and post-2022 trajectories across vocabulary, punctuation, readability, and syntax in abstracts from arXiv's artificial intelligence, statistics, and quantitative biology categories and from medRxiv. Using interrupted time-series regression, we find substantial post-2022 changes across multiple feature families and research domains, including increases in average word length, reduced formula-based readability, and declines in maximum dependency-tree depth and sentence-level depth variation. Individual features follow different dynamics: some lexical markers accelerate persistently, while others rise and then recede. Our findings show that isolated marker frequencies capture only part of the shift: changes in the rate, direction, and structure of linguistic trajectories provide complementary evidence of broader post-2022 change in scientific-preprint writing. More broadly, these findings motivate monitoring scientific writing as a multidimensional, evolving system rather than through a fixed set of LLM-associated markers.

Mon 19 OctComputation and LanguageArtificial Intelligence
The gist
Scientific papers follow writing trends that change slowly over time. This paper looks at how the release of ChatGPT in late 2022 sped up or altered those trends in scientific preprint abstracts. The authors found changes like longer words, less formula-like readability, and simpler sentence structures across several scientific fields. These shifts are complex and happen in different ways for different writing features, suggesting that scientific writing is evolving as a system beyond just the influence of large language models.
Open → 2610.26008v1

Fraudulent science papers use more confusing language than genuine ones

Retractions Revisited: A Replication, Extension, and Mechanistic Evaluation of Linguistic Obfuscation Effects in Fraudulent Science

Abstract: Prior work suggests fraudulent scientists write their articles with higher rates of linguistic obfuscation than genuine scientists, with a possible mechanism suggesting obfuscation makes research more costly for a reader to analyze. This result has not undergone additional empirical scrutiny in the open science era, nor have other psychological mechanisms been evaluated. The current replication and extension addressed this opportunity by comparing 800 fraudulent and 800 genuine control papers (2013-2025). The results supported the linguistic obfuscation hypothesis, suggesting fraudulent papers were more obfuscated than genuine ones. A parallel mediation model evaluated three competing mechanisms, finding that reality monitoring, as measured through decreased rates of adjectives, best explained the link between fraudulent science and linguistic obfuscation. Cross-validated detection accuracy using obfuscation features (60.7%) and an elastic net of over 100 language dimensions (71.6%) were significantly greater than chance. Implications for scientific fraud and psychology of language research are discussed.

Fri 9 OctComputation and Language
The gist
Some scientific papers are written to hide fraud using complicated language. The authors checked 800 fake papers and 800 real ones from recent years and found that fake papers are harder to understand. They also found that the use of fewer descriptive words might explain why fake papers are more confusing. This work helps identify features that could detect fake scientific work automatically.
Open → 2610.13678v1

Large language model changes weaken ai writing detection in science

Large Language Model Turnover Undermines Screening for Artificial Intelligence-Assisted Scientific Writing

Abstract: Journals and conferences have begun to screen submitted manuscripts for text written using large language models (LLMs). The reliability of this screening rests on benchmark evaluations against a fixed set of LLM versions, while the versions in actual use keep changing. Here we quantify how this LLM turnover affects the screening of scientific manuscripts. We paired 4,000 pre-ChatGPT abstracts from the Proceedings of the National Academy of Sciences with their rewrites by 23 LLM versions from three vendors, released between June 2023 and August 2026. We then trained detectors under maintenance scenarios ranging from a detector retrained on every new version to one trained once and never updated. Detectors trained only on a vendor's past versions can collapse at the boundaries between model generations: calibrated to falsely flag 1% of human-written abstracts, they catch above 99% of rewrites just before the sharpest boundary and 3.8% just after it. Detectors trained on later versions can also miss rewrites of earlier ones. Vocabulary differences between versions largely track where detection transfers and where it fails. In the two screening scenarios we simulated, screens covering all 23 versions either flagged one in eight human-written abstracts or missed one in three rewrites of the newest version. Indeed, a commercial detector missed most rewrites of the version just after the sharpest boundary while flagging almost no human-written abstracts. Research-integrity policy should therefore treat the benchmark accuracy of a detector as provisional, to be re-verified with every LLM release, including earlier versions.

Thu 8 OctComputation and LanguageArtificial IntelligenceComputers and Society
The gist
Detecting scientific papers partly written by AI relies on recognizing patterns from specific AI versions. The authors show that as AI language models get updated, detectors trained on older versions struggle to catch new AI writing or may falsely flag normal human writing. They tested 23 versions of AI models rewriting scientific abstracts and found that detectors can miss many AI rewrites or wrongly accuse humans depending on how often the detector updates. This means checking for AI use in papers must be updated regularly to stay accurate.
Open → 2610.11599v1

AI use can blur human responsibility in decisions and creations

When No One Owns the Judgment: Accountability Under Contribution Dissolution in Human-AI Collaboration

Abstract: Communities often respond to potentially AI-assisted work by asking three questions: Was AI used? Was that use disclosed? Can hidden use be detected? These questions place AI use itself at the center of accountability while overlooking a deeper problem: unowned judgment. Evaluations, claims, decisions, and creative directions can be shaped by AI with no accountable human or institution prepared to stand behind them. We develop this argument through two illustrative cases: AI-assisted peer review and concealed AI use in creative work. The first shows how contribution dissolution can weaken responsibility while the second shows how the fear of losing credit can discourage honest disclosure. The cases expose the limits of disclosure rules and provenance records as responses to AI-mediated collaboration. We offer three directions for discussion: distinguishing the roles AI plays, identifying judgments that require clear human ownership, and creating conditions in which AI involvement can be disclosed without default penalty. The broader aim is to make AI-shaped contributions discussable, creditable, contestable, and repairable.

Thu 24 SeptArtificial IntelligenceHuman-Computer Interaction
The gist
Sometimes AI tools help people make decisions, review work, or create things. This can lead to a problem where it’s unclear who is responsible for the final judgment when AI plays a big role. The authors show two examples: peer review aided by AI and creative work where AI use is hidden. They suggest clearer ways to identify when humans must take responsibility and how to share AI involvement openly without penalties.
Open → 2609.29312v1