Clinical trials human AI interactions mapped with new multidimensional framework
Defining and Categorising Human-AI Interactions in Clinical Trials: A Multidimensional Human-AI Classification Approach
Artificial Intelligence
Summary
Understanding how humans work with AI in clinical trials can be confusing and inconsistent. This paper presents a new system that organizes these human-AI interactions by looking at the tasks AI does, how humans and AI relate, how they communicate, and who is involved. The authors tested their system on 15 clinical trials using human reviewers and AI models, showing it helps compare and understand these interactions better. Their work also shows AI can assist in categorizing trials, but human judgment remains important when records are unclear.
What this means in practice
- •For clinical trial designers: Use the framework to consistently characterize and compare human-AI interactions during trial planning and reporting.
- •For medical ai deployment teams: Apply the categorisation method to clarify human roles and AI functions for safer integration of AI tools in clinical environments.
Authors
Sandra Woolley, Tim Collins, Khalid Khattak, Illia Chernomorets, Ariane Arevalo, Chris Richardson
Abstract
This paper examines human-AI interactions (HAIIs) in clinical trials and presents a multidimensional categorisation framework that classifies interactions according to AI tasks, human-AI relationships, interaction configurations and interacting human groups. We define HAII, examine existing taxonomies and extend existing categorisation approaches through this novel multidimensional framework. We purposively sampled 15 clinical trials from a previously reported dataset. Each trial was independently categorised by two human reviewers and six large language model (LLM) classifiers. The proposed categorisation provides a structured method for the consistent identification, comparison and synthesis of human-AI interactions across clinical-trial records. The framework is intended to support more consistent comparison and synthesis of AI-related clinical trials and to make explicit the different forms of human involvement associated with AI interventions. The results demonstrate the potential for LLM-assisted categorisation while indicating the continuing importance of human judgement where trial records are incomplete or ambiguous. The principal contribution is a proposed multidimensional framework that brings together AI tasks, human-AI relationships, interaction configurations and interacting human groups within a single approach designed for clinical-trial records. Its significance lies in its potential to support more systematic identification, comparison and synthesis of how humans and AI interact in clinical trials.