Papers for

radiology departments

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Guideline decision graph boosts radiology case accuracy and speed

Radiology Guideline-derived Decision Graph for Efficient Clinical Decision Support

Abstract: Radiological risk stratification and management planning are essential downstream tasks in medical imaging. Automating these tasks is challenging because clinical guideline criteria are distributed across prose, tables, and cross-referenced definitions. We present Guideline-derived Decision Graph (GDGraph), a framework that decouples guideline compilation from case evaluation. During compilation, a large language model partitions guidelines into section-based chunks, extracts local decision subgraphs with linked definitions, and aggregates related branches into an executable decision graph. During inference, a fast System One model answers localized clinical questions while deterministic traversal resolves Boolean logic, turning opaque single-pass predictions into a traceable decision path without task-specific training. Across 347 cases spanning renal cyst, adnexal mass, and thyroid nodule guidelines, GDGraph improves System One accuracy from 57.3% to 90.8%, outperforming retrieval-augmented GPT-4o (80.1%) and graph-guided GPT-4o with chain-of-thought (82.7%) at substantially lower latency and cost. The source code will be available.

Thu 29 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Medical guidelines for interpreting imaging tests can be complicated and scattered across many sections and tables. The authors created a system called GDGraph that breaks down these guidelines into clear decision steps. This system helps computers follow the guidelines when making recommendations, making their answers more accurate and easier to understand. Tests showed GDGraph outperforms other AI methods in interpreting kidney, ovary, and thyroid imaging cases quickly and correctly.
Open → 2610.40327v1

Deep learning measures pancreatic duct width from 3d scans

Uncertainty-aware Coarse-to-Fine Main Pancreatic Duct Segmentation for Width Measurement in 3D MRCP

Abstract: Assessment of the main pancreatic duct (MPD) from volumetric magnetic resonance cholangiopancreatography (MRCP) scans is an essential task for ductal dilatation diagnosis and pancreatic cancer analysis. However, manual assessment is affected by reader variability in which automated analysis may assist. Nevertheless, fully automated and uncertainty-aware MPD analysis from volumetric MRCP remains underexplored area of research. In this study, we propose an automatic and uncertainty-aware deep learning-based pipeline for MPD segmentation and maximum-width analysis from MRCP scans. A coarse localisation model first identifies the ductal region-of-interest, followed by a fine model that segments the MPD within the region. The dataset consists of 256 MPD-segmented MRCP scans from 69 patients. A randomly selected holdout test subset of 14 patients with 55 MRCP volumes was used for evaluation. We employed a five-model cross-validation ensemble for improved performance and uncertainty estimation. The best MPD segmentation performance was 0.634 DSC, 0.744 precision, and 0.593 recall. The mean absolute error for maximum MPD width prediction was 0.355~mm and dilated MPD ($\geq 5$~mm) was detected with 75.0\% sensitivity and 74.4\% specificity. These novel results suggest that automated MPD segmentation can be used to aid MRCP-based duct measurements.

Thu 29 OctComputer Vision and Pattern Recognition
The gist
Measuring the main pancreatic duct's size in 3D scans helps doctors spot problems like cancer or blockages. The authors developed a computer method that first finds the duct roughly, then zooms in to trace its shape more carefully. Their method can also estimate how confident it is about the measurements. Tested on real patient scans, it found duct width with good accuracy and detected dilated ducts reasonably well. This could help doctors get consistent measurements without needing to do everything by hand.
Open → 2610.40073v1

Multimodal AI predicts benign breast tumors to reduce biopsies

Explainable Multimodal AI Approach to Reduce Unnecessary Breast Biopsies

Abstract: Recently, there has been rise in multimodal vision-language models for computer-aided diagnosis (CAD), yet their application in breast diagnosis, particularly for predicting biopsy outcomes remains limited. This study presents a multimodal vision-language approach, incorporating Grad-CAM as an Explainable AI (XAI) technique, to predict benign tumors in patients recommended for biopsy, especially those classified as BI-RADS 4 and 5. A novel multimodal framework was devel- oped using Vision Transformer (ViT) for imaging feature extraction and DeBERTa-V3-Large for textual embeddings. The model was trained and evaluated on a comprehensive in-house dataset comprising 1,632 patients, each with four mammography views and a corresponding radiology report. The features of both modalities were extracted independently and fused by late fusion before classification. Grad-CAM was used to generate visual explanations highlighting key regions influencing model predictions. The proposed model demonstrated high sensitivity 90%, 95%, 99%, and 100% with corresponding specificities of 40%, 36%, 18%, and 11%, respectively. The best AUC achieved was 0.72 by multimodal approach on the test set, outperforming the image only (0.66) and text-only (0.68) baselines. The proposed multimodal architecture, enhanced with Grad-CAM, demonstrates a strong potential to identify benign tumors among high-risk patients, offering interpretable insights and thereby helping reduce unnecessary biopsies, patient anxiety, and healthcare costs.

Mon 26 OctArtificial Intelligence
The gist
Breast biopsies can be stressful and sometimes unnecessary if a tumor isn’t cancerous. The authors created an AI system that looks at mammograms and doctor’s notes to better predict which tumors are harmless. Their system uses special techniques to also show doctors why it made those predictions. This could help doctors avoid unneeded biopsies and lower patient worry and costs.
Open → 2610.35704v1

Agentic AI links liver scans with detailed radiology reports

An Agentic AI Workflow for Liver Lesion Segmentation and Structured Radiology Reporting

Abstract: Despite advances in automated liver lesion segmentation, a gap remains between image-derived predictions and clinically interpretable radiology reports. Bridging this gap requires quantitative measurements that are both reproducible and traceable. We present an evidence-grounded agentic AI framework that connects liver and lesion segmentation with deterministic quantification and structured reporting. TotalSegmentator-based nnU-Net models delineate the liver, Couinaud segments, and lesions, while computational tools extract volumes, dimensions, counts, and anatomical locations. A large language model (LLM) organizes these measurements into a predefined reporting schema, with numerical consistency checks against source measurements. On 51 LiTS cases, the segmentation stage achieved a liver Dice score of 0.947, lesion sensitivity of 75.6%, and positive predictive value of 68.9%. Exploratory screening of 25,494 MERLIN reports identified 10,208 (40.0%) with liver-related abnormalities. By connecting quantitative imaging evidence with agentic report generation, this work takes a step toward human-centered medical AI that prioritizes traceability and clinical relevance.

Sun 25 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Doctors use images of the liver to find and describe unusual spots called lesions, but turning these images into easy-to-understand reports is tricky. The authors created a step-by-step AI system that first outlines the liver and spots on scans, then measures their size and location, and finally writes structured reports people can trust. The AI double-checks numbers to make sure everything matches the original images. This helps connect detailed image analysis with clear reports that doctors can rely on.
Open → 2610.34599v1

Interpretable ai matches experts in early liver cancer ct diagnosis

An interpretable deep learning method for early hepatocellular carcinoma diagnosis on multiphase CT

Abstract: Early diagnosis of hepatocellular carcinoma is critical to preserve access to curative treatment options. The Liver Imaging Reporting and Data System (LI-RADS) provides a standardized framework for non-invasive diagnosis on multiphase computed tomography, based on major visual imaging features. However, these features may be difficult to assess consistently, particularly in small liver lesions. We developed dLI-RADS, an interpretable artificial intelligence method designed to estimate the probability of hepatocellular carcinoma from multiphase computed tomography images of manually segmented liver lesions, while remaining aligned with LI-RADS-related imaging concepts. dLI-RADS combines neural network-derived predictions with handcrafted quantitative imaging measurements reflecting LI-RADS major features and integrates these inputs using logistic regression. In this multicenter retrospective study, patients with multiphase computed tomography and at least one liver lesion were included, while lesions larger than 40 mm were excluded. Histology served as the reference standard for hepatocellular carcinoma, and a composite reference standard was used for non-hepatocellular carcinoma lesions. The lesion-level accuracy of dLI-RADS and LI-RADS were compared on the internal evaluation set using 10,000-repetition bootstrap non-inferiority tests, with 5% margins and significance levels. On the external test set, sensitivities were similarly compared. dLI-RADS was non-inferior to LI-RADS for lesion-level accuracy in the internal evaluation set, achieving 80% accuracy compared with 74% for LI-RADS (p = 0.04)...

Wed 21 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Early detection of liver cancer is very important to enable effective treatment. The authors created an artificial intelligence method called dLI-RADS that analyzes specialized liver CT scans to estimate the chance a lesion is cancerous. This method combines neural networks with known imaging features doctors use for diagnosis, making it easier to understand. Their tests show dLI-RADS performs at least as well as the existing expert system LI-RADS in identifying small liver tumors.
Open → 2610.29616v1

Breast MRI segmentation with automatic BI-RADS rationale explanation

Reading the Mask: Descriptor-Grounded BI-RADS Rationale Generation for Breast MRI Segmentation

Abstract: Deep learning based models accurately delineate tumours on dynamic contrast-enhanced MRI (DCE-MRI), but segmentation masks alone do not provide the rationales or reasoning used by radiologists to assess the lesion suspicion. This limits the explainability as well the clinical integration. We investigate whether clinically relevant descriptors can instead be derived from the segmentation masks and their dynamic contrast-enhancement series. We have used Breast Imaging Reporting and Data System (BI-RADS) guidelines as a structured framework. Using these guidelines we designed a BI-RADS decision tree with eight quantitative measurements using radiomics, together with the lesion size and component count, that determine the descriptors at eight nodes. Using these descriptors we generate natural-language rationale using a large language model. The model was constrained to express only the derived records from the decision tree. After applying this framework to the expert and automatic masks of each of the 1,506 cases in the MAMA-MIA dataset, we generated a reproducible corpus of 3,012 BI-RADS grounded rationales. We obtained a faithfulness score of 99.98% and a counterfactual accuracy of 99.3%, indicating that the generated rationales faithfully verbalises the measured descriptors and correctly reflects changes in the underlying record. Agreement between the descriptors from expert and automatic masks falls from 0.832 to 0.549 as mask quality falls from Good to Missed. The generated rationales are intended as draft representations for radiologist review and final sign-off rather than autonomous clinical reports.

Wed 21 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Segmenting tumors in breast MRI scans helps doctors find cancer, but the raw outlines don’t explain why a tumor looks suspicious. The authors developed a way to turn these outlines and extra scan details into clear explanations using standard medical rules called BI-RADS. They then created natural-language summaries that explain the tumor features like size and shape. These summaries match what the scans show very closely and are meant to help radiologists review and finalize reports, not replace them.
Open → 2610.29358v1

Caps improves MRI scans to help brain tumor diagnosis and treatment

CAPS: Clinically-Verifiable Anatomy-Prioritized Synthesis for Missing MRI Imputation in Brain Tumor Segmentation

Abstract: Multi-parametric MRI is the gold standard for neuro-oncology, yet acquiring complete 4-modality protocols may be unfeasible in real-world clinical practice. When handling missing modalities, existing automated systems force a critical compromise: robust segmenters operate as uninterpretable "black boxes" that bypass image generation, while standard synthesis models often produce blurry reconstructions lacking diagnostic reliability. To address this issue, we propose CAPS, a Clinically-Verifiable Anatomy-Prioritized Synthesis framework that reconciles computational precision with clinical transparency. Our multi-modal generative architecture is driven by a hybrid objective function (L_1 + L_AFP + L_DualDice) that explicitly enforces the preservation of deep anatomical features and strict topological boundaries, rather than relying solely on pixel-wise optimization. Evaluated comprehensively on the BraTS Adult Glioma dataset, the framework achieves superior synthesis fidelity across intensity-based metrics, and demonstrates robust downstream segmentation performance (82.38% mean Dice), successfully restoring verifiable visual context. Furthermore, the framework exhibits exceptional zero-shot cross-domain generalization, maintaining high structural fidelity across completely unseen Meningioma, Pediatric, and Sub-Saharan African cohorts without domain-specific adaptation. Finally, a blinded radiological assessment confirms that our anatomy-aware approach significantly enhances both perceived image quality and clinical utility, providing clinicians with the reliable visual evidence required to trust downstream automated workflows.

Tue 20 OctComputer Vision and Pattern Recognition
The gist
Brain tumor diagnosis often relies on MRI scans with multiple types of images, but sometimes some images are missing. The authors propose CAPS, a method that creates realistic and reliable missing MRI images by focusing on preserving important brain anatomy features. Their method not only produces clearer images but also helps brain tumor detection tools work better, even across different patient groups. Doctors who reviewed the images found them more trustworthy for clinical use compared to earlier methods.
Open → 2610.28179v1

MRI super-resolution model reconstructs varied image resolutions quickly

Arbitrary-Scale Anisotropic 3D MRI Super-Resolution with Gaussian Prototypes

Abstract: Reducing MRI acquisition time improves patient comfort, reduces motion artefacts, and increases scanner throughput. Clinical protocols often shorten acquisitions by sacrificing spatial resolution, particularly along the slice axis. Super-resolution can recover higher-resolution images, but existing methods are typically specialised to one scale or acquisition geometry, limiting their use across heterogeneous clinical protocols. We present GSMR3D, a continuous volumetric model that reconstructs arbitrary isotropic and anisotropic resolutions with a single checkpoint per MRI contrast. It combines a learned dictionary of anisotropic 3D Gaussian prototypes with scale-conditioned frequency encoding and an exact measurement-consistency projection, keeping reconstructions consistent with the acquired low-resolution data. We train separate models on 3,731 contrast-enhanced T1-weighted and 30,254 T1-weighted brain MRI volumes from clinical and population-based cohorts. We evaluate GSMR3D against geometry-specific specialists for isotropic, in-plane, and through-plane super-resolution using reconstruction quality and downstream tasks: brain tumour segmentation, brain-metastasis detection, and brain parcellation. GSMR3D outperforms specialists at isotropic $2\times$ and achieves better LPIPS, DISTS, and FID across all geometries, although specialists retain higher PSNR in anisotropic settings. It more faithfully preserves glioma segmentations across all geometries, achieves the highest lesion sensitivity on an independent brain-metastasis cohort, and the highest brain-parcellation agreement for isotropic and in-plane reconstruction. Reconstruction takes about 6s per volume, adding little overhead relative to acquisition-time savings. GSMR3D offers a flexible approach to MRI scan-time reduction with one model per contrast across geometries while preserving information relevant to downstream tasks.

Sat 17 OctComputer Vision and Pattern Recognition
The gist
MRI scans often take a long time, so doctors reduce image detail to speed things up. The authors introduce a model called GSMR3D that can improve MRI images to higher resolution, no matter how the original scan was done. This model works well across different scanning styles and helps keep important medical details visible. It does this quickly, potentially allowing shorter scans without losing critical information.
Open → 2610.24858v1

Knee3DVLM improves knee MRI diagnosis using dual-sequence imaging

Knee3DVLM: Dual-Sequence Full-Volume Vision-Language Modeling for Comprehensive Knee MRI Assessment

Abstract: Vision-language models (VLMs) are increasingly being applied to three-dimensional medical imaging, but their application to knee MRI remains limited, particularly for interpreting the complementary sequences used in clinical practice. We introduce Knee3DVLM, a sequence-aware VLM that uses full-volume DESS and fluid-sensitive TSE MRI to predict 57 anatomically resolved binary diagnostic targets derived from the MRI Osteoarthritis Knee Score (MOAKS) for structured reporting. We evaluated DESS-only, TSE-only, and paired DESS-TSE configurations using subject-disjoint Osteoarthritis Initiative partitions. In a held-out cohort of 1,074 examinations, the fused model achieved 72.98% average accuracy, 71.17% balanced accuracy, 78.96% mean ROC-AUC, and 78.74% macro ROC-AUC, the highest values among the three configurations. In a secondary multiclass analysis aligned with the released 3DReasonKnee cohort, Knee3DVLM was numerically higher than the strongest reported 3DReasonKnee configuration across five pathology categories. These findings support dual-sequence full-volume modeling for comprehensive knee MRI assessment.

Tue 6 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Doctors use MRI scans to check knees for problems like arthritis, but these scans come in different types that show different details. The authors created a new computer model called Knee3DVLM that looks at two types of knee MRI scans together, improving its ability to spot 57 different knee issues. This model was tested on over a thousand knee exams and outperformed versions that used just one type of scan. This approach could help provide more accurate reports about knee health.
Open → 2610.08482v1

NeuroCBIR enables fast accurate retrieval of brain MRI scans

NeuroCBIR: A Fast and Accurate Image Retrieval System for Whole-Brain and Region-Specific MRI

Abstract: Content-based image retrieval (CBIR) in neuroimaging enables the identification of structurally similar brain scans, supporting diagnosis, prognosis, and treatment planning; however, existing methods are often limited to small datasets, single brain regions, or coarse class labels, thereby restricting their clinical utility and generalizability. Here, we present NeuroCBIR, a framework for fast and flexible retrieval of both whole-brain and region-specific 3D T1w MRI scans. A total of 103 cortical and subcortical regions are extracted to enable both whole-brain and region-level queries. NeuroCBIR leverages latent representations learned by a variational autoencoder (VAE) combined with contrastive learning, producing scan-specific embeddings that capture anatomical patterns. These embeddings were evaluated for subject re-identification, zero-shot age prediction, and zero-shot multi-class pathology stratification. Re-identification performance was high across both whole-brain and brain-region levels (mean average precision across the top-5 retrieved images (mAP@5) >= 98.4%), with robust generalization across datasets and acquisition conditions. While NeuroCBIR is not trained for age prediction or pathology stratification, zero-shot evaluations for these two tasks demonstrate that the embeddings encode meaningful information for downstream tasks. Embedding extraction on a 4-core CPU required approximately 18.7 s per scan, whereas similarity search was effectively instantaneous (less than 0.01 s). NeuroCBIR is publicly available for brain MRI with more than 26,000 precomputed T1w MRI embeddings. It supports reproducible research, region-specific flexibility, and clinically meaningful personalized diagnostic support. The software is available at https://github.com/minnelab/NeuroCBIR.

Mon 5 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Finding similar brain MRI scans helps doctors with diagnosis and treatment, but current methods often work only on small datasets or specific brain areas. The authors created NeuroCBIR, a system that quickly searches both whole-brain and specific brain region MRI images to find ones that look alike. It uses a smart way of turning scans into numbers summarizing key anatomy, and it can recognize subjects and detect patterns related to age or diseases without being explicitly trained for those tasks. NeuroCBIR works fast on normal computers and is openly available for others to use.
Open → 2610.06502v1

Human guided glioma segmentation improves surgical accuracy and safety

Uncertainty-Guided Handshake: Efficient Human-in-the-Loop Refinement for Surgical-Grade Glioma Segmentation

Abstract: While state-of-the-art automated models for medical image segmentation achieve high mean performance, they frequently suffer from localized, catastrophic failures that preclude safe clinical deployment, particularly in neuro-oncology. Interactive segmentation frameworks mitigate this by incorporating human oversight, but traditionally impose prohibitive cognitive and temporal workloads by requiring clinicians to manually search for errors. In this project, we present an efficient, Hybrid Structural-Aleatoric Human-in-the-Loop framework for glioma segmentation that bridges the gap between automated baseline performance and surgical-grade precision, achieving sub-2.0 mm HD95 on curated benchmarks while providing safety-net routing for structural failures across real-world clinical data. By extracting voxel-wise Test-Time Augmentation (TTA) uncertainty and applying hierarchical topological filtering, our method proactively isolates high-risk structural anomalies. We comprehensively evaluated our approach on a challenging out-of-distribution clinical stress-test cohort (N = 362). Operating under a simulated Human Oracle, the framework improved the Whole Tumor (WT) Dice score from 0.891 to 0.914 and reduced the 95th percentile Hausdorff Distance (HD95) from 5.82 mm to 4.76 mm. Critically for surgical safety, the system rescued severe boundary failures in the Tumor Core, reducing mean HD95 from 17.96 mm to 14.83 mm (improving absolute TC Dice to 0.356). These spatial rescues were achieved while demanding a median interactive workload of just 11.3% of the target volume. Acknowledging this as a simulated upper bound lacking real-world cognitive friction, the framework nevertheless demonstrates a highly Pareto-efficient pathway for safely deploying clinical AI.

Thu 1 OctComputer Vision and Pattern Recognition
The gist
Medical imaging models can miss important details in brain tumor scans, which is risky for surgery. The authors developed a system where a computer works with humans to find and fix these errors more efficiently. Their method uses uncertainty measurements to highlight areas needing attention, reducing the workload on clinicians. Tests show it improves the accuracy of tumor boundaries, helping to make brain surgery safer.
Open → 2610.01452v1

Improved shape analysis method predicts breast cancer lymph node spread

An integrated geometric quantification and shape analysis framework for axillary lymph node metastasis in breast cancer patients

Abstract: Quantitative characterization of lymph node morphology is important for assessing axillary lymph node metastasis in breast cancer. However, surfaces reconstructed from computed tomography (CT) segmentation may contain geometric and topological defects that compromise subsequent analysis, while conventional shape descriptors predominantly characterize global morphology. To address these issues, we developed an integrated framework combining topology-aware surface processing with multi-resolution spherical harmonic (SH) analysis of CT-derived axillary lymph nodes. The processing pipeline produced topology-valid genus-0 surfaces with improved mesh quality, which were then represented at multiple SH degrees and characterized using 20 predefined geometric feature families. Geometric fidelity increased with SH degree, whereas predictive performance peaked at intermediate resolutions. Preferred SH degree also differed across feature families. A family-specific mixed-resolution model achieved an AUC of 0.918, compared with 0.884 for the conventional PyRadiomics Shape14 baseline, corresponding to an improvement of 0.0344. Controlled perturbation experiments showed that higher SH degrees transmitted more fine-scale geometric variation and yielded lower stability of curvature-based predictions. Representative geometric descriptors provided interpretable characterization of metastasis-associated surface morphology. Independent validation further supported the framework's transportability: label-free replication in a multicenter lymph node cohort reproduced the family-specific resolution effects, while a labeled LIDC-IDRI lung-nodule experiment reproduced the resolution-dependent relationship between SH degree and predictive performance. Altogether, the framework provides a topology-valid basis for quantitative characterization of lymph node morphology and metastasis-associated imaging phenotypes.

Mon 28 SeptComputer Vision and Pattern Recognition
The gist
Assessing whether breast cancer has spread to lymph nodes helps guide treatment, but existing imaging techniques sometimes miss important details. The authors created a new way to clean up and analyze 3D images of lymph nodes from CT scans, capturing both large and small shape features more accurately. Their method better predicts cancer spread by combining multiple levels of shape detail, and it was confirmed to work on different patient data. This approach could help doctors evaluate lymph nodes more reliably using medical images.
Open → 2609.35437v1

Dual-input AI improves bone tumor diagnosis from X-ray images

Integrating Local Detail and Global Context: A Dual-Input Multi-Task Learning Framework for Bone Tumor Diagnosis

Abstract: Primary bone tumors are rare but clinically aggressive neoplasms whose diagnosis from radiographs is challenged by heterogeneous morphology, subtle lesion margins, and overlapping bone structures. To address the limitations of existing single-view models, we present a dual-input, multi-task learning framework that, to our knowledge, is the first to apply bidirectional cross-modal attention between a lesion crop and the full radiograph for joint segmentation and subtype classification. Using the multi-institutional Bone Tumor X-ray Radiograph Dataset (BTXRD, n=3,746), we employ a YOLO-based detector to generate regions of interest, which are paired with full images as inputs to a dual-stream DenseNet121 architecture. Features are integrated via a novel cross-modal attention fusion strategy, refined by Hierarchical Multi-scale Feature Fusion, effectively balancing fine-grained lesion detail with global anatomical context. Evaluated on a held-out patient-level test split, the model demonstrates superior performance over single-input baselines, achieving an overall Dice Similarity Coefficient of 0.896 and a macro-averaged classification F1-score of 0.928. Notably, the system exhibits exceptional sensitivity for malignant osteosarcoma (AUC 0.999), validating the potential of dual-stream context modeling to support radiologists in accurate, early decision-making.

Wed 23 SeptComputer Vision and Pattern Recognition
The gist
Looking at X-rays to diagnose bone tumors is tricky because tumors can look very different and blend with surrounding bones. The authors created a computer program that looks both closely at the tumor area and at the entire X-ray to better understand what's going on. Their program combines these two views to identify and classify tumors more accurately than older methods. It worked especially well at spotting dangerous types like malignant osteosarcoma, which could help doctors make earlier and more accurate decisions.
Open → 2609.28732v1

Nv-reason-ct combines 3d ct images and language for detailed analysis

NV-Reason-CT: 3D Visual Language Model for CT Analysis

Abstract: We present NV-Reason-CT, a generative vision--language model for chest and abdominal CT combining native 3D visual encoding with radiologist-guided reasoning. The model couples a native 3D vision transformer with a language model, passing all visual tokens and their explicit 3D coordinates into language decoding without further spatial token merging. This retains volumetric spatial information within the vision encoder and through the language model's positional encoding during joint processing with text. We train on a curated corpus of approximately 550,000 multimodal instruction examples from 70,111 unique CT image inputs, combining standardized reports, abnormality-focused and anatomy-specific questions, multi-turn interactions, and radiologist-authored reasoning from recorded and transcribed expert CT interpretations. Expert annotations provide direct supervision and guide additional report-grounded synthetic reasoning. End-to-end supervised fine-tuning (SFT) is followed by Group Relative Policy Optimization (GRPO), with verifiable rewards over chest and abdominal abnormality sets. The model supports abnormality classification, report generation, and interactive reasoning with reviewable observations, differential diagnoses, and uncertainty. Evaluation spans public CT benchmarks and a held-out NIH cohort. On CT-RATE, NV-Reason-CT achieves a macro-F1 of 0.614 and macro-AUROC of 0.871 without a task-specific classification head; generated reports achieve a report-derived macro-F1 of 0.592. In a preliminary study with expert radiologists, AI-assisted review received favorable confidence ratings and was associated with a 50% reduction in average reported interpretation and reporting time. We release the model and training code to support reproducible research on explainable AI for volumetric medical imaging.

Wed 23 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Analyzing 3D CT scans (detailed X-ray images of the chest and abdomen) is complex and time-consuming for doctors. The authors designed a computer model, NV-Reason-CT, that uses both the 3D images and expert-written text to better understand and explain scan findings. This model keeps the full 3D spatial information and links it with medical language to classify abnormalities, generate reports, and provide reasoning. It was tested on multiple datasets and helped radiologists reduce their review time while increasing confidence.
Open → 2609.27511v1

Anatomy aware AI creates post contrast breast MRI from pre contrast scans

Anatomy-Aware Synthesis of Post-Contrast Breast MRI from Pre-Contrast Images

Abstract: We developed an anatomy-aware deep learning framework to synthesize post-contrast breast MRI from pre-contrast images, emphasizing tumor and background parenchymal enhancement (BPE) regions. This retrospective study included 649 patients with 6,251 paired pre-contrast and post-contrast images. The framework integrates breast mask consistency, lesion-region supervision, and BPE-region supervision into an image-to-image translation model. Evaluation included quantitative image quality metrics, a reader study with two breast radiologists, and downstream Ki-67 classification. The proposed method outperformed Pix2Pix, Pix2PixHD, diffusion-based synthesis, and mask-supervised baselines in whole-image and regional evaluations. Ki-67 classification showed no statistically significant performance differences across real- and synthetic-image training and testing settings, although this does not establish equivalence. These findings suggest that anatomy-aware supervision improves synthesis fidelity and support further investigation of synthetic post-contrast MRI for contrast-free imaging workflows.

Tue 22 SeptComputer Vision and Pattern Recognition
The gist
Getting detailed breast images often requires injecting a contrast dye, which can be inconvenient or risky. The authors developed a smart computer program that learns to create these detailed dye-enhanced images from the regular images taken before the dye is used. Their program pays special attention to important areas like tumors and breast tissue, making the generated images more accurate. They tested their approach on many patients and found it works better than other methods and could support tasks like estimating tumor growth activity. However, they note that more studies are needed before replacing real contrast-based scans.
Open → 2609.27015v1

FleXray enables whole-body anatomy segmentation in X-ray images

FleXray: Universal Clinical X-ray Segmentation

Abstract: X-ray is medicine's most widely used imaging modality, yet remains among its least quantitative. Unlike volumetric modalities like CT or MRI, X-ray collapses 3D anatomy into a 2D projection, causing structures to overlap and anatomical boundaries to be ambiguous, even to experts. As a result, labeling X-ray databases for training general-purpose segmentation systems is impractical, leaving morphometric and functional X-ray analysis confined to narrow anatomical regions and applications. To this end, we present FleXray, a generalist model for anatomical segmentation across the entire body in clinical X-rays. Instead of curating large, manually annotated X-ray datasets, we build a scalable, physics-based generative X-ray data engine. Using existing 3D whole-body CT segmentation datasets and generative image-editing models, we simulate fully-annotated 2D X-rays with diverse appearances, physiological properties, and imaging geometries. Trained on these simulations, FleXray accurately segments 60 anatomical structures across unseen research datasets and in-the-wild X-rays. We further show that FleXray makes X-rays directly amenable to quantitative analysis, enabling automated measurements for disease grading, robust navigation during X-ray-guided interventions, and data-efficient learning of pathological targets. We release the model, code, a full-body X-ray segmentation dataset, and a local, easy-to-use browser-based tool at https://flexray.csail.mit.edu .

Tue 22 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
X-rays are very common in medicine but hard to analyze precisely because they show all body parts superimposed in one flat image. The authors created FleXray, a computer program that can identify and label many different body parts in any X-ray picture. They trained FleXray using computer-generated X-rays made from 3D CT scans, so it did not need lots of manual labeling. This approach helps doctors measure things in X-rays more accurately and supports new uses like guiding procedures or detecting diseases more easily.
Open → 2609.26756v1

Mammo-LIFE predicts post-radiotherapy breast outcomes using paired mammograms

Mammo-LIFE: Longitudinal Mammographic Imaging and Clinical Feature Enrichment for Post-Radiotherapy Outcome Prediction

Abstract: Recent advances in Artificial Intelligence (AI)-powered Computer-Aided Diagnosis (CAD) systems have substantially improved breast cancer screening, diagnosis, and prognosis. Comparatively, postradiotherapy outcome prediction using paired longitudinal mammograms has received considerably less attention. This is largely due to the limited availability of well-annotated longitudinal datasets. Longitudinal mammograms, coupled with paired pre- and post-treatment information, provide a unique opportunity to characterize treatment-induced breast tissue changes following radiotherapy. The resulting learned representations can serve as a valuable asset for advancing personalized radiotherapy planning and post-treatment management. In this context, we propose Mammo-LIFE, a patient-level multimodal framework for post-radiotherapy outcome prediction that combines longitudinal mammographic features with patient-level clinical variables. The imaging branch processes paired pre- and post-treatment mammograms acquired from the four standard views using a mammography-specific encoder adapted via Low-Rank Adaptation (LoRA). Within each view, preand post-treatment representations are explicitly compared through a longitudinal comparison module to capture treatment-related changes. The resulting view-level embeddings are then aggregated using learned view-attention pooling to form a unified patient-level mammographic representation. Selected clinical variables are subsequently combined with the image-derived prediction probability through a late-fusion strategy. To evaluate the effectiveness of combining paired longitudinal mammograms with clinical information, experiments were conducted on an in-house clinical cohort using patient-level stratified five-fold cross-validation.

Tue 22 SeptComputer Vision and Pattern Recognition
The gist
It can be hard to predict how breast tissue will respond after radiotherapy for cancer using regular mammograms. The authors developed Mammo-LIFE, a system that compares mammograms taken before and after treatment to spot changes and predicts patient outcomes. It also includes key clinical information about the patient to improve predictions. This approach helps provide a more personalized understanding of treatment effects.
Open → 2609.26443v1

Deep learning segments ischemic stroke on CT scans across hospitals

Ischemic Stroke Segmentation and Net Water Uptake Quantification on Multicenter Non-Contrast CT Using Supervised Target-Domain Adaptation

Abstract: Objectives: Quantitative assessment of infarct hypodensity on non-contrast computed tomography (NCCT), including net water uptake (NWU), requires manual or semi-manual lesion delineation, often guided by CT perfusion or diffusion-weighted MRI, limiting clinical applicability. Automated segmentation on NCCT could enable efficient biomarker extraction such as NWU but remains challenging across heterogeneous multicenter data. This study aimed to develop and externally test a domain-aware deep learning framework for ischemic stroke segmentation on NCCT and assess its suitability for NWU quantification. Materials & Methods: In this retrospective multicenter study of 801 patients from four datasets, an nnU-Net-based model was trained on NCCT scans from the University Medical Center Hamburg-Eppendorf and the Acute Ischemic Stroke Dataset. To adapt to new domains, the model was fine-tuned on target-domain subsets from Boston (n=11) and ISLES (n=75), with evaluation on held-out cases not used for fine-tuning. Automated segmentations and NWU values were compared with expert references. Results: For lesions $\geq$ 30 mL, median Dice was 0.68 (Boston) and 0.56 (ISLES). Including smaller lesions, which predominated in ISLES, median Dice was 0.54 (interquartile range [IQR] 0.30-0.70) for acute lesion segmentation (Boston dataset) and 0.20 (IQR 0.03-0.41) for NCCT lesion segmentations when compared to post-treatment infarct (primary target of the ISLES challenge). Automated NWU mean absolute error was 1.37 percentage points (SD 1.61, Boston). Conclusion: Target-domain adaptation supported NCCT-only infarct segmentation across heterogeneous external cohorts, although performance varied across domains. The approach enabled low-error NWU quantification from baseline NCCT without advanced imaging, supporting further prospective clinical evaluation.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Identifying damaged brain areas after a stroke on standard CT scans is usually done by experts and can be slow. This paper shows a new computer program that learns to find stroke damage automatically on CT images from different hospitals. The program also measures how much water has entered the damaged brain tissue, a sign of stroke severity, without needing advanced scans. The results varied depending on the hospital’s data but showed promise for helping doctors assess stroke patients faster.
Open → 2609.20151v1

Mammography models predict heart attack risk from breast scans

Mammography Foundation Models for Opportunistic Prediction of Major Adverse Cardiovascular Events

Abstract: Cardiovascular disease (CVD) remains the leading cause of death among women, yet cardiovascular risk assessment often relies on clinical variables that may be missing, outdated, or unavailable in routine care. Screening mammography offers an opportunity for opportunistic cardiovascular risk stratification because it is routinely acquired and contains vascular features, including breast arterial calcifications (BAC), that are associated with cardiovascular risk and events. We evaluate whether mammography specific foundation models, originally pretrained for breast cancer-related tasks, can transfer to cardiovascular risk prediction without cardiovascular specific supervision or explicit BAC annotation. We constructed a 5-year major adverse cardiovascular event (MACE) cohort of 22,497 women linked to electronic health record outcomes, including 500 events (2.22% prevalence). The foundation models achieved AUROCs of 0.823 and 0.822 substantially exceeding an age-only model (AUROC 0.765), despite using only the screening mammogram as input, with no clinical variables. Both foundation models evaluated assigned substantially higher predicted risk to patients with radiologist-documented BAC, despite BAC never being used as a training label, and showed activation patterns consistent with vascular findings. Together, these findings suggest that mammography foundation models can recover clinically relevant cardiovascular risk information directly from mammographic pixels and suggest that screening mammography may provide an opportunistic source of cardiovascular risk information to complement conventional clinical assessment without additional imaging. Code is available in https://github.com/PauFeld/MammoCVD

Wed 16 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Heart disease is the top cause of death in women, but doctors often lack complete information to assess risk. The authors used computer models originally made to find breast cancer to look for signs of heart problems in mammogram images. These models could predict major heart problems within five years better than just using age, even without extra health data. The models noticed patterns related to calcium in breast arteries, which are linked to heart risks, without being told to look for them. This suggests mammograms might help spot women at risk for heart disease without needing extra tests.
Open → 2609.19385v1

Deep learning system segments and grades liver cirrhosis from MRI images

CirrGuide: A Deep Cascaded Framework for Liver Cirrhosis Segmentation and Severity Classification from T2-Weighted MRI

Abstract: We present CirrGuide, a deep cascaded framework for cirrhotic liver segmentation and severity classification. Cirrhosis causes progressive structural changes in the liver and can lead to serious clinical complications, making severity assessment important for disease monitoring and treatment planning. However, severity classification is challenging because imaging patterns are often subtle, spatially variable, and similar across adjacent stages. CirrGuide addresses this by explicitly linking localization with classification. A ResNet50 encoder with an Attention U-Net decoder first predicts a soft cirrhotic liver mask, which is then used as an anatomical prior in a ResNet50-based classification branch. This branch combines global multi-scale features with mask-guided attention-pooled regional features to classify Mild, Moderate, and Severe cirrhosis. On the official CirrMRI600+ T2-weighted (T2W) 2D split, CirrGuide achieves 89.83% Dice and 84.14% mIoU for segmentation, 69.58% accuracy and 61.55% macro F1-score for severity classification. Compared with segmentation-only, classification-only, and multi-task baselines, CirrGuide improves both localization and severity classification, demonstrating the benefit of using predicted cirrhotic liver masks as anatomical priors for cirrhosis analysis.

Sat 12 SeptComputer Vision and Pattern Recognition
The gist
Liver cirrhosis causes the liver to change shape and function over time, making it important to track how severe it is. The authors developed CirrGuide, a computer program that looks at MRI scans to find the cirrhotic liver area and then figures out how bad the cirrhosis is. It uses two linked parts—the first finds the liver region affected by cirrhosis, and the second uses this information to classify severity as mild, moderate, or severe. Their method works better than others tested on a standard MRI dataset.
Open → 2609.14010v1

TotalSynth generates synthetic CT scans from MRI and CBCT images

TotalSynth: Robust Whole-Body Synthetic CT from MRI and CBCT

Abstract: Purpose: To develop and evaluate TotalSynth, a reusable pretrained framework for whole-body synthetic CT (sCT) generation from MRI and cone-beam CT (CBCT) images. Materials and Methods: In this retrospective technical study, the dataset was assembled between 2020 and 2026 from SynthRAD challenge data, four prostate cohorts, and BIC-MAC. After registration quality control, 1450 of 1800 public challenge pairs were retained; 350 were excluded for insufficient registration quality or major source/CT mismatch. The corpus also included 84 additional prostate MRI/CT and 60 external BIC-MAC MRI/CT cases. Three 5-fold model families were evaluated with image-domain, anatomy-aware, registration-based, and uncertainty metrics. Age and sex were not consistently available across public datasets. Results: The released MRI-to-CT model achieved an overall MAE of 67.49 HU, SSIM of 0.920, and PSNR of 29.28 dB. The CBCT-to-CT model achieved an overall MAE of 53.55 HU, SSIM of 0.939, and PSNR of 32.09 dB. The unified model maintained similar performance on MRI inputs (MAE, 67.68 HU) and CBCT inputs (MAE, 54.22 HU). On external BIC-MAC data, MRI-to-CT MAE was 100.91 HU without fine-tuning and 62.21 HU after fine-tuning. Conclusion: TotalSynth provides reusable MRI- and CBCT-based CT synthesis models with broad anatomical coverage, while external evaluation highlights the need for local validation and optional fine-tuning under domain shift.

Sat 12 SeptComputer Vision and Pattern Recognition
The gist
Medical imaging often uses CT scans, but these expose patients to radiation, while MRI and CBCT scans do not provide the same detail. The authors developed TotalSynth, a tool that can create synthetic CT images from MRI and CBCT scans, helping doctors get CT-like images without extra radiation. They tested it on thousands of cases, showing it works well across many body parts. The study also found that adapting the tool for new data sources can improve accuracy.
Open → 2609.13838v1

Enhanced chest X-ray detection with fractal pixel transformation technique

Exponential Pixelating Integral transform with dual fractal features for enhanced chest X-ray abnormality detection

Abstract: The heightened prevalence of respiratory disorders, particularly exacerbated by a significant upswing in fatalities due to the novel coronavirus, underscores the critical need for early detection and timely intervention. This imperative is paramount, possessing the potential to profoundly impact and safeguard numerous lives. Medically, chest radiography stands out as an essential and economically viable medical imaging approach for diagnosing and assessing the severity of diverse Respiratory Disorders. However, their detection in Chest X-Rays is a cumbersome task even for well-trained radiologists owing to low contrast issues, overlapping of the tissue structures, subjective variability, and the presence of noise. To address these issues, a novel analytical model termed Exponential Pixelating Integral is introduced for the automatic detection of infections in Chest X-Rays in this work. Initially, the presented Exponential Pixelating Integral enhances the pixel intensities to overcome the low-contrast issues that are then polar-transformed followed by their representation using the locally invariant Mandelbrot and Julia fractal geometries for effective distinction of structural features. The collated features labeled Exponential Pixelating Integral with dually characterized fractal features are then classified by the non-parametric multivariate adaptive regression splines to establish an ensemble model between each pair of classes for effective diagnosis of diverse diseases. Rigorous analysis of the proposed classification framework on large medical benchmarked datasets showcases its superiority over its peers by registering a higher classification accuracy and F1 scores ranging from 98.46 to 99.45% and 96.53-98.10% respectively, making it a precise and interpretable automated system for diagnosing respiratory disorders.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
Detecting lung diseases from chest X-rays is hard because images can be unclear and noisy. The authors created a new method that brightens the important parts of the image and uses special fractal math shapes to highlight lung features. Then, a smart computer system sorts the images to identify different lung illnesses accurately. Their tests showed this method works better than previous approaches in spotting problems in chest X-rays.
Open → 2609.10988v1

High-fidelity volumetric CT generated from standard chest X-rays

Multi-Pass, Multi-View Blended Learning for High-Fidelity Volumetric CT Synthesis from Chest X-Rays

Abstract: Reconstructing volumetric Computed Tomography (CT) from a single 2D chest radiograph (CXR) is an ill-posed inverse problem, further complicated by the scarcity of paired CXR-CT training data. Prior approaches address this by training on Digitally Reconstructed Radiographs (DRRs), which are synthetic projections derived from CT volumes. However, the domain gap between DRRs and real CXRs limits generalization, often resulting in coarse or anatomically inconsistent reconstructions when applied to clinical images. To address this challenging problem, this study introduces a Multi-Pass Multi-View Blended Learning framework for synthesizing high-fidelity volumetric CT directly from real chest X-ray (CXR) images. The proposed approach progressively decomposes the synthesis task into two distinct, complementary learning stages. Stage 1 is an unsupervised CXR-to-DRR Domain Adaptation, while Stage 2 includes three passes, namely, (a) supervised DRR-to-CT Transformation, (b) unsupervised Multi-View Slice Refinement, followed by (c) Progressive Transfer Learning (PTL). With such a blended learning paradigm, the proposed approach mitigates the synthetic-to-real domain gap while enhancing both the structural integrity and anatomical detail of the final output. On the LIDC-IDRI dataset, where paired DRR-CT ground truth is available for quantitative evaluation, the proposed method improves upon prior methods by up to 14% in PSNR and 7.6% in SSIM. The framework successfully generates structurally consistent and anatomically realistic high-fidelity CT volumes from real CXRs, marking a significant advancement toward clinical viability of CT reconstruction from standard radiographic images.

Wed 9 SeptMachine Learning
The gist
Creating a full 3D CT scan from a single 2D chest X-ray is very difficult because the 2D image gives limited information. The authors developed a new method that learns in multiple steps to convert real chest X-rays directly into detailed 3D CT images. They use a special training process to reduce differences between synthetic and real images, improving accuracy and anatomical consistency. Their approach works better than previous methods on a common medical imaging dataset, producing sharper and more realistic CT volumes.
Open → 2609.09920v1

Large language models improve chest CT protocol selection accuracy

Automated Chest CT Protocol Selection via Large Language Model Derived Text Embeddings from Imaging Request Text

Abstract: Purpose: Accurate CT protocol selection is critical for diagnostic quality and patient safety, yet the current process is manual, time-consuming, and prone to inconsistencies. Prior Machine Learning methods using keywords or bag-of-words lack contextual understanding and perform poorly on rare protocols. We propose a decision support system using large language model (LLM) features to recommend protocols from free-text clinical indications, capturing clinical nuance and phrasing variation for more consistent, efficient selection. Methods: In this REB-approved retrospective study, 285,123 chest CT imaging requests from a large academic medical center (2017-2024) were split into training (228,099, 80%) and held-out test (57,024, 20%) sets. Each request included procedure names, clinical indication, HIS comments, and the selected protocol. Clinical text was embedded using a fine-tuned LLM, Meta's LLaMA-3.1-70B; these features input a logistic regression classifier predicting 18 protocol labels (e.g., PE, LDCT). Results: The pipeline achieved a weighted precision of 0.84, weighted F1-score of 0.81, and overall accuracy of 79% across 18 CT protocols. On 300 independent cases with expert consensus, the LLM reached an overall accuracy of 80% versus 83% for radiologists, with no significant difference (p = 0.263). Performance was comparable across most classes, with the LLM exceeding radiologists for some challenging categories, and entropy analyses indicated more balanced protocol use, suggesting reduced variability. Conclusion: An LLM-based recommendation system can leverage general knowledge from a large natural-text corpus to accurately assign chest CT protocols from free-text imaging requests, and may serve as a viable foundation for protocol recommendation tools where inputs require language understanding.

Mon 7 SeptMachine Learning
The gist
Choosing the right CT scan settings is important for clear images and patient safety, but doing this by hand can be slow and inconsistent. The authors used a large language model to understand doctors' written requests more deeply and suggest the correct CT scanning protocols. Their system matched radiologists' accuracy on sample cases and worked well across many different scan types, sometimes even outperforming experts. This approach could help speed up and standardize how CT scans are prepared.
Open → 2609.07986v1

MedDream improves chest X-ray diagnosis and evidence generation

A radiographic world model for clinical reasoning and evidence generation

Abstract: Medical imaging artificial intelligence (AI) is commonly developed as separate mappings from radiographs to diagnostic outputs or from clinical descriptions to generated images, although both arise from the same underlying radiographic state. A world-model formulation instead seeks to learn an internal representation of this state that can support both clinical readout and conditional simulation of radiographic observations. Here we introduce MedDream, a radiographic world model that learns a shared continuous latent state from paired chest radiograph-text observations for diagnostic reasoning and report-conditioned evidence generation. MedDream was pretrained on 2.65 million leakage-controlled chest radiograph-text pairs curated from 4.40 million candidates. Across eight clinical datasets and two independent reader cohorts, MedDream outperformed leading diagnostic and generative comparators. For diagnostic reasoning, MedDream showed strong generalization across disease recognition, label-scarce adaptation, severity assessment, and localization, while MedDream-supported review increased mean resident concordance with independent radiologist consensus from 56.3% to 63.0%. For evidence generation, MedDream produced radiographs that preserved clinically relevant pathology and improved downstream performance on held-out real data, with synthetic augmentation increasing external VinDr-CXR macro-AUROC from 76.4% to 81.4%. More importantly, conditioning generation on prespecified subgroup performance gaps enabled targeted evidence construction, increasing weighted F1 by 3.1 percentage points in Asian patients, whereas matched-volume unguided augmentation decreased it by 2.3 points. These findings establish radiographic world models as a path toward medical AI that learns clinically meaningful internal states for interpreting, simulating, and constructing evidence for clinical use.

Mon 7 SeptArtificial Intelligence
The gist
Medical AI often treats X-rays and their reports separately, but MedDream learns a shared understanding of both together. This helps the AI better recognize diseases, assess severity, and create realistic X-ray images from text reports. The model was trained on millions of chest X-rays with their corresponding reports and outperformed other AI methods in tests. It can also create synthetic images that help improve diagnosis, especially for patient groups that need more focused study.
Open → 2609.07719v1