Papers for

medical training centers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

StenoVLA-3D improves robotic endoscopy navigation through narrow passages

StenoVLA-3D: 3D-Aware Reasoning VLA for Navigation Through Gastrointestinal Stenoses

Abstract: Autonomous endoscopic navigation requires the policy model to predict actions from texture-poor monocular observations, make safe control decisions, and retain evidence of lesions after they leave the field of view. Existing vision-language-action (VLA) models primarily rely on visual appearance and short-term context, limiting geometric grounding and episode-level reporting. We introduce StenoVLA-3D, a 3D-aware VLA framework for navigating through stenotic regions. We integrate point-maps into the Cosmos-Reason 2 backbone through learned geometry-gated fusion, and also propose a temporal state branch to model traversal progress. Our reasoning-and-action backbone predicts grounded reasoning with actions, while dedicated heads estimate stenosis shape and generate the final lesion report. We further introduce EndoCausal, an episode-level dataset with lesion annotations, actions, and temporally grounded reasoning. On 40 held-out recorded test episodes, StenoVLA-3D reaches 95.2\% semantic accuracy and 83.4\% action accuracy. On the physical 3-DoF endoscope, it attains 88.9\% and 77.8\% task success in esophageal and colonic phantoms (36 trials each), substantially outperforming the evaluated baselines.

Mon 21 SeptRoboticsComputer Vision and Pattern Recognition
The gist
Navigating tiny, narrow areas inside the body with a camera on a robot is very hard because the images often lack clear detail. The authors created a computer model called StenoVLA-3D that uses 3D information and remembers what it has seen over time to safely guide the robot and identify problematic spots. They also made a new dataset to train and test this approach. Their method performed better than existing ones both on recorded videos and physical robot tests in realistic models of the esophagus and colon.
Open 2609.24187v1

Multi agent ai improves clinical interview training outcomes

Evaluating Scaffolding-Oriented Multi-Agent Large Language Model System for Clinical Interview Training

Abstract: Clinical education must prepare medical students to conduct safe and coherent patient interviews under conditions of uncertainty. Traditional standardized patient (SP) training is resource-intensive and difficult to scale. We developed a scaffolding-oriented multi-agent Large Language Model (LLM) AI Standardized Patient (AI-SP) training platform1. The system includes a patient agent for simulated dialog, a tutor agent providing Socratic prompts without disclosing diagnostic information, and a turn-level evaluator agent that monitors clinical progress without revealing summative scores. In a randomized controlled study (N = 100 medical students), participants were assigned to either a multi-agent (MA) scaffolding condition or a control condition. All students completed two learning sessions under their assigned condition followed by an examination conducted in a patient only environment. Performance was assessed using a standardized Objective Structured Clinical Examination (OSCE) based rubric. While no significant difference was observed in final diagnostic accuracy between groups, the multi-agent AI standardized patient system improved final examination scores compared to the control group utilizing structured progressive information disclosure; the most substantial and consistent improvements were observed in communication, the expression of empathy, and specific history-taking behaviors. These findings suggest that specialized LLM agents enhance the process quality of simulated clinical interviews without artificially inflating examination outcomes. To support future research, we release a multi-expert annotated dataset comprising transcripts, checklist annotations, turn-level evaluations, and OSCE-aligned scoring outcomes. This resource aims to facilitate the development of pedagogically grounded AI-SP systems and advance research on AI-supported clinical reasoning training.

Thu 10 SeptMultiagent SystemsArtificial IntelligenceHuman-Computer Interaction
The gist
Medical students need practice conducting patient interviews, which is often costly and hard to scale. The authors created an AI system with multiple agents that simulate a patient, tutor, and evaluator to help train students. In a study, this system helped students communicate better and show more empathy without increasing diagnostic mistakes. The authors also shared a detailed dataset to support future research on AI in clinical training.
Open 2609.10939v1