AI changes how students show what they really know during assignments

Same Performance, Different Process: Epistemic Ownership in AI-Mediated Education

Computers and Society

Summary

Using AI tools in schoolwork means that the final grade might not tell the whole story about how much a student actually understood or thought through the assignment. The authors studied 150 conversations between students and AI helpers to see how students worked with AI. They found that even if two students got similar grades, their way of thinking and engaging with the AI could be very different. This means teachers might need to look beyond just the final score to understand a student’s learning process.

What this means in practice

  • For assessment designers: Develop assessment methods that include evidence of how students use AI during assignments, not just their final answers.
  • For edtech developers: Create AI tools that track and report different patterns of student cognitive participation to provide richer feedback.

Authors

Jorge Fábrega

Abstract

Generative AI weakens the link between assessed performance and the cognitive processes that educational work is expected to reflect. This paper examines observable traces of those processes in a sample of 150 student-AI conversations. The analysis uses the concept of epistemic ownership as an interpretive framework, focusing on three dimensions that can become visible in interaction: Direction, Integration, and Evaluation. The results show that similar assessed performance can coexist with substantially different observable patterns of cognitive participation. Assignment scores therefore provide information about assessed outcomes but do not recover how cognitive work was distributed between student and AI during the interaction. The study provides an empirical basis for asking how assessment should incorporate evidence about cognitive process, rather than relying exclusively on the quality of the resulting product.