Measuring human input in AI writing is unreliable using likelihood scores

Likelihood Is Not Authorship: Can We Reliably Measure Human Contribution in AI-Assisted Writing?

Computation and Language

Summary

As AI tools become common in writing, it’s important to know how much of a text a human actually wrote. The authors find that current ways of measuring this, which look at how well a person’s prompt predicts the final text, can be tricked easily. They show that adding random strings to a prompt can fool the measurement into thinking a mostly AI-written text is mostly human. This means that just looking at how likely the text is from the prompt can’t reliably tell how much a human contributed.

What this means in practice

  • For content moderators: Identify limits of current AI detection tools by understanding how likelihood-based methods can misclassify human and AI text contributions.
  • For ai writing tool developers: Design better metrics for human contribution that go beyond prompt likelihood and account for what was actually added by the user.

Authors

Hasan Amin, Zhuoran Lu, Ming Yin

Abstract

AI-text detection generally asks whether a machine wrote a text. As AI becomes an increasingly integral and accepted part of writing, the more relevant question is no longer whether AI was used, but how much of the text reflects human contribution. A prominent line of work estimates this by measuring how predictive a person's prompt is of the final text. We show that this measure can be easily manipulated. We introduce SPECIFICITY PADDING that simply asks the model to copy a few random IDs from the prompt, and that alone makes a title-only request look more human than one that supplies the article's key ideas. A context-swap audit then holds each document fixed, and only shows or hides the IDs to the evaluator. The score of the unchanged text swings by a third to half of its scale, and it rises for every document we test, on news and scientific abstracts, across varied LLMs from 3.8B to 753B parameters. The same articles can average 85\% human or 15\% human depending only on which prompt is on record, and even with no prompt at all, the output-only variant rewards the random strings themselves. An exact identity, the credit ledger, explains why. The score is a surprisal-weighted average over the text, so rare strings that the context makes copyable collect the credit, whatever they mean. A two-point bound marks a deeper limit. If the prompt could have been machine-written, every transcript-only method must, in the worst case, miss by half the contribution at stake. Likelihood-based scores alone cannot reliably establish human contribution without evidence of what the person added and how the text was produced.