User interface design affects challenges in AI oversight work
What UI Design Can Do For "Good" Oversight Work: A Three-Month Action Research Study
Human-Computer Interaction
Summary
When people oversee AI systems doing important tasks, the oversight work can be hard and repetitive. The authors studied tutors who supervised an AI assistant over three months to learn about their daily struggles. They found the work felt boring, unclear in impact, and isolating, which made it tough to stay motivated. The authors tried changing the user interface to help, but it only partly improved the experience. Their study shows how interface design can support some parts of oversight but not all the challenges.
What this means in practice
- •For interface designers: Create user interfaces that address specific motivational challenges faced by people overseeing AI systems, such as reducing repetitiveness and clarifying task impact.
- •For education technology teams: Improve the design of AI-supported learning tools to better support tutors' oversight roles through targeted UI changes informed by real user feedback.
Authors
Cedric Faas, Lisa Dargasz, Julius Gabelmann, Felix Jahn, Markus Langer, Kevin Baum, Anna Maria Feit
Abstract
With AI automating consequential tasks, human oversight is required for ethical, legal, and practical reasons. Yet these oversight tasks can be demanding and often make for poor work. Empirical evidence on overseers' lived work experiences remains underexplored, yet critical for designing ``good'' oversight. We provide longitudinal, in-the-wild insights through action research accompanying (N=8) tutors who oversaw an AI-supported learning assistant over three months. Our thematic analysis combines insights from twelve weekly meetings and two workshop iterations and was enriched by four repeated questionnaires. We identified stimulation, mastery, and relatedness as key challenges, stemming from the task's repetitiveness, unclear impact of interventions, and limited connections with students and peers. Informed by our initial findings, we deployed targeted UI modifications with mixed success. This paper documents the long-term evolution of the work characteristics of a real-world oversight task and discusses which oversight work characteristics can and cannot be supported by interface design.