Towards Autonomous and Auditable Medical Imaging Model Development
2026-07-12 • Computer Vision and Pattern Recognition
Computer Vision and Pattern RecognitionArtificial Intelligence
AI summaryⓘ
The authors developed AMID, a system that uses multiple AI agents to help create medical imaging models automatically. AMID breaks down tasks by analyzing specific medical data and then tests many different approaches carefully to find the best one, making sure all results are properly checked. When tested on 20 different medical imaging challenges, AMID did better than general AI systems and sometimes as well as expert humans. This suggests AMID could help automate the complex and careful work needed to build reliable medical imaging models.
Large Language ModelsMedical ImagingMachine Learning EngineeringModel ValidationEmpirical FeedbackParallel ComputingOptimizationVerification ProtocolsPrediction ArtifactsAutonomous Agents
Authors
Shengyuan Liu, Jia-Xuan Jiang, Boyun Zheng, Cheng Wang, Zipei Wang, Wentao Pan, Hongtao Wu, Houwen Peng, Yu Gu, Lichao Sun, Yixuan Yuan
Abstract
Large language model (LLM) agents are beginning to automate machine learning engineering (MLE) by coupling planning, code execution, debugging, and empirical feedback. Translating this capability to medical imaging remains difficult because each task imposes modality-specific experimentation and strict requirements for validation protocols and prediction artifacts. Here we introduce AMID, an autonomous multi-agent framework for medical imaging model development. AMID first proposes Data-Conditioned Method Planning, which refines coarse task-level search spaces into executable, parallelizable method lanes grounded in task-specific data analysis and runnable medical-imaging resources. It then develops Verification-Guided Two-Stage Optimization, moving from broad early exploration of diverse method lanes to selective exploitation of promising candidates while enforcing strict verification of validation protocols, metric computation, and prediction artifacts throughout the optimization. Across 20 medical imaging challenge tasks spanning diverse modalities and prediction types, AMID outperformed evaluated general-purpose MLE systems and, on several tasks, approached or matched strong human-designed challenge solutions. These results suggest that AMID can turn task-specific medical imaging model development from bespoke manual engineering into an agentic workflow for producing high-performing and auditable model artifacts across heterogeneous tasks.