Developers’ cognitive load varies with genAI use and task context

Beyond Productivity: Measuring Developers' Cognitive Load During GenAI-Supported Software Development

Software EngineeringHuman-Computer Interaction

Summary

Understanding how using generative AI affects software developers’ mental effort is important as AI tools become common. The authors studied 21 developers over four days, tracking their tasks, use of AI, and how hard they felt their work was. They also measured physical signals with wristbands but found these added little extra insight. The study shows that how demanding a developer’s work feels depends mainly on the kind of task and whether AI is used, with physical data serving only as a small extra clue. This helps focus on the real work context when assessing AI’s impact on developers.

What this means in practice

  • For software development managers: Adjust task assignments and AI tool introduction by monitoring developer cognitive load related to specific work contexts and AI use.
  • For workplace health specialists: Use developers’ reported cognitive load alongside limited physiological data to better assess mental workload during AI-supported tasks.

Authors

Charlotte Brandebusemeyer, Daniela Gasser, Tobias Schimmer, Bert Arnrich

Abstract

Generative AI (GenAI) is changing software development workflows and how developers work. Industry evaluations of GenAI adoption often monitor productivity gains, usage, and output quality, but limited attention is paid to the interaction experience and cognitive load of the actual adopters and drivers of GenAI technology - the software developers. Understanding whether GenAI changes or shifts developers' cognitive demands during everyday development is important for a developer-centered evaluation of GenAI-supported software development. It can inform organizations in designing and evaluating effective AI-supported workflows. In this work, we study how GenAI use and task context relate to professional developers' perceived cognitive load and whether wearable-derived physiological characteristics provide additional information beyond this context. In a four-day industrial field study at two SAP sites, 21 developers documented their tasks, task duration, GenAI use, and perceived cognitive load while wearing an EmbracePlus wristband. The results show that perceived cognitive load is associated with both GenAI use and task context, while physiological measures provide only limited additional information. These findings suggest that developers' perceived cognitive load during GenAI-supported software development should be evaluated in relation to the concrete work context, with wearable physiological data used as complementary rather than standalone information.