Papers for

medical imaging teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Miga improves speed and quality in 3d multi-echo mri scans

MIGA:Shared-Geometry Gaussian Representation with Implicit Amplitude Modeling for Accelerated 3D Multi-Echo MRI

Abstract: Three-dimensional multi-echo MRI provides rich anatomical and quantitative information, but repeated volumetric encoding prolongs acquisition and motivates k-space undersampling. Reconstructing undersampled multi-echo data requires exploiting shared anatomy while preserving echo-dependent signal variation; full-volume modeling also introduces substantial computational and memory demands. We propose MIGA, a scan-specific framework comprising shared anisotropic Gaussian geometry, a coordinate-conditioned multi-output amplitude network, and explicit echo-specific phase variables. The Gaussian geometry provides common spatial support across echoes, the implicit network models spatially structured amplitude variations, and the phase variables retain echo-specific complex signal information. All components are jointly optimized using only the acquired multi-coil k-space, requiring no fully sampled training data. Experiments showed that MIGA consistently outperformed the comparison methods across imaging tasks and acceleration factors, with larger improvements under stronger undersampling. MIGA also achieved a favorable quality-cost balance among the evaluated full-volume multi-echo methods. These results support the effectiveness of combining shared Gaussian geometry with implicit echo-dependent amplitude modeling for accelerated 3D multi-echo MRI reconstruction.

Mon 21 SeptComputer Vision and Pattern Recognition
The gist
3D multi-echo MRI scans take a long time because they collect lots of detailed data, which can be hard to speed up without losing quality. The authors developed MIGA, a new method that uses shared spatial models and smart signal processing to reconstruct faster scans from incomplete data. MIGA learns the common shapes and echo-specific details together from the scan itself, without needing extra training data. Tests showed MIGA made faster MRI scans possible while keeping or improving image quality, especially when the data was very incomplete.
Open → 2609.24468v1

Diffusion segmentation often matches image based prediction without clear benefit

Rethinking Diffusion Segmentation: When Does It Rely on Its Noisy State, and Does Diffusion Matter?

Abstract: Diffusion models are increasingly adapted from generation to conditional prediction, where a conditioning signal is combined with an evolving noisy representation of the target. In fully supervised segmentation, however, the conditioning image can already support direct target prediction, so endpoint performance alone establishes neither reliance on the added diffusion state nor a deterministic advantage over image-only prediction. For state reliance, we disrupt target-derived state content or correct image-state pairing during retraining of twelve published methods across three datasets, with ten matched seeds per setting. All 40 original-method comparisons whose evaluated-mask routes remained downstream of noised-quantity reconstruction exhibited state reliance, whereas all 30 comparisons with a segmentation-supervised bypass preserved reference performance. Rerouting five originally bypass-capable methods by forcing segmentation supervision through noise-to-mask reconstruction converted all 30 corresponding comparisons from preserved performance to state reliance. For deterministic utility, matched image-only counterparts achieved similar or better performance in 28 of 35 settings overall, including 16 of 20 whose native methods relied on both audited state properties. These results identify supervision path as a determinant of state reliance in the audited methods. Separately, matched image-only counterparts show that diffusion-specific computation often provides no deterministic endpoint advantage, including in methods that rely on the audited state properties. More generally, when conditioning already supports strong target prediction, diffusion-specific claims require additional evidence that the added state is used and that diffusion-specific computation improves the claimed capability beyond a matched condition-only counterpart.

Mon 21 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Diffusion models are popular for tasks like image segmentation, where they gradually add and remove noise to find target areas. The authors studied whether these models really depend on the noisy intermediate steps or if just looking at the image is enough. They tested many techniques and found that diffusion sometimes makes no real difference compared to directly using the image. This means some claims about diffusion models improving segmentation might be overstated unless more proof is shown.
Open → 2609.23967v1

Realistic 3D fetal brain ultrasound images synthesized from anatomy maps

AWR-Net: Decoupling Anatomy and Appearance for 3D Fetal Brain Ultrasound Synthesis

Abstract: Three-dimensional fetal brain ultrasound offers non-ionizing, cost-effective imaging with rich spatial information for comprehensive anatomical assessment, yet its development remains limited by scarce data and annotations. In contrast, fetal brain magnetic resonance imaging has advanced further, supported by larger datasets and mature analysis methods. To leverage these resources, anatomical label maps provide a promising modality-invariant bridge for transferring knowledge from fetal brain magnetic resonance imaging to ultrasound. However, generating ultrasound images from label maps remains challenging because anatomy is tightly entangled with ultrasound appearance. To address this challenge, we separate anatomical correspondence learning from ultrasound appearance adaptation at both the data and model levels. Specifically, we propose the anatomy wavelet residual network, a two-stage framework combining wavelet diffusion and residual refinement. The first stage learns to generate volumes from label maps using atlas pairs in the wavelet domain, while the second stage learns bounded residual corrections from real clinical ultrasound in the image domain. This separation enables realistic synthesis with consistent preservation of normal and abnormal anatomy. Experiments on real fetal brain ultrasound show that our method outperforms representative synthesis methods, with normalized cross correlation of 0.518 versus 0.482 and Fréchet Inception Distance of 8.905 versus 13.319 for the strongest baseline. Beyond synthesis quality, volumes generated from fetal brain magnetic resonance imaging label maps also improve downstream segmentation, particularly for severe abnormal cases. Overall, these results highlight the potential of the proposed framework to leverage rich fetal brain magnetic resonance imaging resources for advancing three-dimensional ultrasound analysis.

Fri 18 SeptComputer Vision and Pattern Recognition
The gist
Getting good 3D ultrasound pictures of a baby's brain before birth is hard because there isn’t enough data. Magnetic resonance imaging (MRI) has more data but looks very different from ultrasound. The authors created a two-step method that first makes a rough ultrasound image from a brain anatomy map, then improves it using real ultrasound details. This approach makes clearer and more accurate ultrasound images from MRI data, helping doctors better understand fetal brain anatomy and abnormalities.
Open → 2609.22635v1

Adaptive rules improve stopping decisions in uncertain classifications

How Many Posterior Samples? Calibrated Stopping for Adaptive Sensing

Abstract: In classification-oriented adaptive sensing, posterior samples characterize uncertainty at the current measurement state and can serve two roles: they may guide the next sensing direction, while their class labels provide votes for the candidate classes and determine whether sensing should continue. We focus on the stopping layer that turns these votes into a declaration, without modifying the posterior sampler or sensing directions. A natural plug-in rule declares when the observed vote share exceeds a threshold. We show that this threshold is not itself a confidence guarantee: when the underlying vote mass equals the threshold, the plug-in rule declares about half the time. As alternatives, we calibrate a fixed-sample rule and a finite-horizon sequential rule to a prescribed false-declaration probability, and study exact curtailment, which stops a fixed-pool rule once its final verdict is forced. We then derive how one-round declaration probabilities determine posterior-sample cost and classification accuracy along a sensing path. On MNIST with DDRM and a fixed PCA-guided probe sequence, curtailment saves up to 62% of posterior samples. Among the evaluated rules at matched operating points, sequential stopping reduces the cost the most. At a high accuracy, that same sequential rule can trade more posterior samples for fewer measurements.

Fri 18 SeptComputer Vision and Pattern Recognition
The gist
When computers try to decide what something is by looking at data piece by piece, they guess and update their confidence as they go. The authors explore better ways to decide when the computer should stop looking for more data and make a final choice. They found that simple rules sometimes stop too soon or too late, so they introduced ways to carefully balance how often mistakes happen. By testing on handwriting images, they show their approach can save lots of effort while keeping decisions accurate.
Open → 2609.21813v1

Classification driven adaptive sensing improves measurement efficiency in image tasks

Classification-oriented adaptive sensing via posterior sampling

Abstract: Recent advances in diffusion models have enabled high-performance, instance-adaptive compressed sensing through posterior sampling, without task-specific policy training. Existing methods select sensing probes by maximizing total posterior signal variance and are therefore primarily reconstruction-driven. We introduce a classification-driven extension motivated by the closed-form posterior covariance of a class-conditional Gaussian mixture model, which decomposes into within-class and between-class uncertainty. Using calibrated soft classifier outputs, we estimate these uncertainty terms from diffusion posterior samples and propose a classification-oriented criterion for selecting the dominant sensing direction in the unmeasured subspace. Experiments on MNIST and CIFAR-10 compare the resulting classification accuracy, measurement cost, and reconstruction quality with those of reconstruction-oriented counterparts. The results identify regimes in which semantic posterior uncertainty yields a more favorable classification--measurement trade-off and quantify the associated reconstruction cost.

Fri 18 SeptComputer Vision and Pattern Recognition
The gist
Getting the right data efficiently is important for making smart decisions from images. The authors studied how to choose what parts of an image to measure next, focusing on helping a computer classify the image rather than just reconstruct it perfectly. They used a new method that looks at uncertainty related to different categories, improving classification accuracy while reducing the amount of data needed. Their tests on popular image datasets show this method can save measurements with a small cost to how well the image itself can be rebuilt.
Open → 2609.21812v1

Balanced prompt method improves binary image segmentation tests

Balanced Prompt Adaptation against Entropy-Induced Collapse for Test-Time Binary Segmentation

Abstract: Entropy minimization is a standard objective for test-time adaptation (TTA), but it can fail in imbalanced binary segmentation. Unlike image classification, dense segmentation aggregates thousands of pixel predictions, allowing the larger predicted class to dominate the update, pull minority predictions toward itself, and produce a degenerate mask as predictions saturate and their entropy gradients vanish. We theoretically establish this collapse in a shared-shift model. This analysis motivates Balanced-Anchor Prompt Adaptation (BAPA), which combines two complementary modules. The Class-Balanced Anchors (CBA) module selects high-confidence anchors separately from each predicted class and gives foreground and background equal total loss weight, preventing the larger region from dominating the update. Dynamic Prompt Adaptation (DPA) refreshes these anchors after each prediction update and optimizes only text-side prompt residuals while keeping the vision-language encoders frozen. This prompt-only update refines the foreground-background decision boundary without altering the pretrained dense visual representation. Across experiments from four domains, BAPA achieves the highest mean Dice among the evaluated methods. Factorized ablations further validate the complementary roles of CBA and DPA, supporting balanced prompt adaptation as an effective alternative to entropy minimization for test-time binary segmentation.

Fri 18 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
When computers try to divide images into two parts, they sometimes get stuck on the large part and miss the smaller one. This problem is because the usual way to adjust the computer’s guesses favors the bigger area too much. The authors found this issue and designed a new method that treats both parts fairly while updating only certain parts of the program. Their approach works better across different image types without changing the main image-understanding system.
Open → 2609.21743v1

Prediction fragmentation guides safe test-time adaptation in medical imaging

Should This Case Be Adapted? Prediction Fragmentation Controls Test-Time Adaptation

Abstract: Episodic test-time adaptation resets a frozen segmenter to source weights $M_0$ on each case and adapts for a fixed step count. A fixed horizon conflates a cohort-level question, how far to adapt, with an irreducibly per-case one, whether this case should be adapted at all. Cohort means hide that decision: on cross-vendor cardiac MRI the mean $Δ$Dice from adaptation is statistically indistinguishable from zero while 58.7% of cases are individually made worse. We quantify this harm as harmful accepted area (HA), the harmful fraction of the edited area a controller deploys. Held-out tuning gives a stronger baseline than a fixed horizon, but the budget it selects transfers on neither of the two main medical benchmarks, and no global budget can condition on the case. We show that prediction fragmentation---the disagreement geometry between $M_0$ and the adapted mask $M_k$---predicts HA with no labels or extra backward passes at decision time, comparably on three benchmarks (Spearman $ρ$ 0.50--0.60), at a quarter of gradient-norm's latency. A case-level router built on it cuts HA from 0.228 to 0.139 on a benchmark that took no part in its design, with the design frozen and only cut-points recalibrated there. On the cardiac benchmark the design was selected on, the router cuts HA from 0.129 to 0.013 at matched Dice and 1.10 deployed updates, against the retrospective-best budget found post hoc on evaluation labels, and reduces that 58.7% to 20.0%, an upper bound we quantify. Where the retained cases are not net-helped (as on prostate), the router still cuts HA but concedes accuracy, a boundary we report. Thresholds are fit once on a labeled split disjoint from evaluation; decisions use no labels or gradients. The template ports across architecture and domain (nnU-Net$\to$SegFormer, Cityscapes$\to$ACDC) with coordinate, thresholds and per-bucket actions instantiated per domain.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
When AI models adapt themselves during testing, sometimes the adaptation helps but sometimes it harms the results, especially in medical scans from different machines or sites. The authors found a new way to tell, without extra data labels or heavy computation, whether adapting on a particular case will be harmful. Their method measures how much the new prediction disagrees with the original, called prediction fragmentation, and uses this to decide when to adapt. This approach reduces harmful changes while keeping accuracy, making test-time adaptation safer and more reliable across different medical imaging tasks.
Open → 2609.20700v1

Single model translates brain MRI across field strengths fast

Fast Cross-Strength Multi-Contrast Brain MRI Translation using Latent Bridge Matching

Abstract: Magnetic Resonance Imaging (MRI) acquired at different field strengths exhibits pronounced variation in noise, resolution, homogeneity, and contrast, which limits comparability across acquisition settings and complicates downstream analysis. We address this with a unified conditional model for controllable field-to-field synthesis, built on the framework of conditional latent bridge matching. Our single model achieves highly competitive results across the validation phase for all three tasks of the MRIxFields2026 challenge without task-specific architectures or training. We achieve fast generation with only a single inference step, producing all modality and field-strength combinations for $30$ axial slices in under $90$ seconds, as well as cross-modality-strength translation for a full volume in under $70$ seconds, on a single NVIDIA A5000 GPU. We further provide extensive ablations regarding different components of our solution. Code: https://gitlab.com/siddharthsrivastava/mrixfields-2026

Thu 17 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
MRI scans look different depending on the machine's magnetic strength, which makes comparing them hard. The authors created one computer program that quickly changes MRI scans from one magnetic strength to another in many combinations. It works fast and well without needing special setups for each task. This helps doctors and researchers work with MRI images from different machines more easily.
Open → 2609.20341v1

Transformer model layers merged to cut computing needs in half

A Smaller Transformer in Your Transformer

Abstract: Recent findings indicate that Vision Transformers settle into locally similar computational phases, implying a level of depthwise computational redundancy. However, existing methods to exploit this redundancy either fail to reduce inference compute or severely degrade model expressivity. In this work, we formalise a unified view of block redundancy that decouples the geometry from specific surrogate interventions. We then introduce Transformer-Within-Transformer (TWT), a post-hoc method that fuses contiguous groups of redundant layers into a single learned surrogate layer. TWT reduces parameter count and inference compute while remaining competitive with original models using half the depth on natural images, and in several downstream histopathology settings, TWT matches or even improves on the original baseline.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Some AI models that look at images use many layers that often do similar work, which can waste computer power. The authors found a way to combine these layers into fewer ones without losing much ability to understand images. Their method, called Transformer-Within-Transformer (TWT), makes the model simpler and faster while keeping it accurate. In tests on natural images and medical pictures, TWT worked as well or even better than the original models with twice as many layers.
Open → 2609.20100v1

Probabilistic model improves medical image alignment and uncertainty measure

BINDER: A Latent Variable Model for Probabilistic Medical Image Registration

Abstract: We propose a new probabilistic model for general-purpose medical image registration that builds upon the mutual information registration criterion. It centers around a spatial interpolation technique that assumes latent voxel-wise correspondences between the images being registered. By exploiting these latent variables, we derive dedicated optimization and MCMC sampling techniques that only involve closed-form iterative updates. When applied to nonlinear registration, an efficient demons-like optimization algorithm is obtained that shows robust out-of-the-box performance across a variety of monomodal and multimodal registration tasks. We also demonstrate a corresponding sampler that can quantify, for the first time, uncertainty in multimodal registration scenarios with very high-dimensional 3D deformations. Our code, which we call BINDER (Bayesian INference for DEformable Registration), is freely available at https://github.com/ste93ste/BINDER.

Thu 17 SeptComputer Vision and Pattern Recognition
The gist
Matching medical images taken in different ways or at different times is challenging because doctors need to know which parts correspond to each other. This paper presents a new method that treats the matching process as a guessing game, where hidden connections between tiny parts of the images are estimated. The authors developed fast techniques to find these connections and to measure how confident the method is about the matches, even in complex three-dimensional cases. Their approach works well on many kinds of images without needing extra tuning and is freely available for anyone to use.
Open → 2609.19875v1

Deep learning improves brain disorder diagnosis from MRI data

HyperAMS-Net: Adaptive Multi-Scale Spatial Hypergraph Network for Brain Disorder Classification

Abstract: Accurate classification of brain disorders from neuroimaging data remains challenging because of substantial inter-subject heterogeneity and the complex multi-scale patterns present in functional connectivity and morphological representations. To address these challenges, we propose HyperAMS-Net, a deep learning framework for brain disorder classification using neuroimaging representations derived from resting-state functional MRI or structural MRI. HyperAMS-Net integrates adaptive multi-scale convolution, hypergraph attention, spatial-channel attention, and adaptive feature fusion. Specifically, adaptive multi-scale convolution learns data-driven weights over multiple receptive fields to capture complementary patterns at different scales. Hypergraph attention models higher-order dependencies among learned feature representations through node--hyperedge--node message passing, while spatial-channel attention enhances discriminative feature learning. Adaptive feature fusion further aggregates complementary information across parallel network branches. HyperAMS-Net is evaluated on three benchmark datasets spanning distinct brain disorders: ABIDE for autism spectrum disorder, REST-meta-MDD for major depressive disorder, and ADNI for Alzheimer's disease, using 5-fold stratified cross-validation. HyperAMS-Net achieves state-of-the-art performance across all evaluated datasets, attaining the highest accuracy and AUC among the compared methods. Ablation studies further demonstrate the contribution of each proposed component, with the largest performance degradation observed when hypergraph attention is removed.

Thu 17 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Classifying brain disorders like autism, depression, and Alzheimer’s from brain scans is difficult because people’s brains differ a lot and the brain patterns happen at many scales. The authors developed HyperAMS-Net, a new deep learning system that looks at these complex, multi-scale brain patterns more effectively. It uses different specialized methods to capture detailed brain information and how parts connect in complex ways. Tests on multiple brain disorder datasets showed it outperforms existing methods, especially thanks to its way of modeling connections with hypergraphs.
Open → 2609.19755v1

Federated learning detects kidney stones while protecting patient data

Federated Learning Framework for Privacy-Preserving Kidney Stone Detection

Abstract: Recent innovations in deep learning have significantly enhanced the diagnosis of medical images, although they are based on the use of centralized data storage that pose severe threats to patient privacy and medical data security. To address this issue, this research proposes a Federated Learning (FL) model that is coupled with an optimized YOLOv8 network to detect the kidney stones on a computed tomography (CT) image and at the same time, protect privacy of the patients. The suggested system can help various medical organizations to jointly train a common model without exchanging the information about the patients. This is to ensure that data protection laws like GDPR and HIPAA are adhered to. The residual feature fusion and DropBlock regularization among other architectural improvements are also included in YOLOv8 to enhance detection robustness and minimize overfitting. Experimental analysis carried out on a distributed CT dataset demonstrated that the federated YOLOv8 model has a mAP at 50 of 0.733 and is able to keep the data confidential. Moreover, its lean design facilitates fast edge deployment and real-time inference across a clinical setting. Altogether, these findings indicate that Federated Learning is a safe and efficient solution to AI-assisted diagnosis in contemporary healthcare when combined with the use of sophisticated object detection models.

Thu 17 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Deep learning methods can help identify kidney stones from CT scans but usually require collecting sensitive patient data in one place, which risks privacy. The authors propose a federated learning approach that allows multiple medical centers to train a detection model together without sharing patient details. They improved the detection model to be more accurate and less prone to errors. Their tests show this method can detect kidney stones well while keeping data private and working efficiently in clinical settings.
Open → 2609.19740v1

Vision transformers learn where to look in pathology images

Learning Where to Focus: Self-Supervised Multi-Scale ViTs for Histopathology

Abstract: Pathologists diagnose diseases by first locating suspicious tissue and then examining it at higher magnification, whereas self-supervised vision transformers (ViTs) allocate the same spatial resolution to every image region despite diagnostic evidence being sparse and spanning multiple biological scales. Recent pathology foundation models have substantially improved representation quality by scaling training data and model capacity, but largely retain uniform tokenization. We instead investigate whether pathology representations can be improved by learning where to allocate spatial resolution during self-supervised learning. To this end, we propose CRAFT (Coarse-to-fine Region-Adaptive Feature Tokenization), a DINO-based framework that learns image-dependent mixed-scale representations by using self-supervised attention to selectively refine informative regions while preserving coarse context, together with a symmetric cross-scale regularization objective that encourages complementary coarse and fine representations. Across CAMELYON16, TCGA-Lung subtype classification, and TCGA-LUAD survival prediction, CRAFT consistently outperforms comparable-scale self-supervised methods while requiring lower inference computation. Despite using only a compact 22M parameter backbone trained on comparatively small pathology datasets, CRAFT remains competitive with, and often surpasses, substantially larger pathology foundation models.

Wed 16 SeptComputer Vision and Pattern Recognition
The gist
Pathologists examine tissue samples by first spotting suspicious areas and then zooming in for a closer look. The authors found that existing computer models evenly analyze all parts of an image, ignoring that important clues are spread unevenly. They created a new method called CRAFT that teaches the model to focus more on interesting regions while keeping a broad overview. This approach improves disease diagnosis tasks and uses less computing power, working well even with smaller datasets and models.
Open → 2609.18578v1

Collision aware method boosts image fitting with fewer parameters

CARA: Collision-Aware Resolution Adaptation for Multiresolution Hash Encoding Based Image Fitting

Abstract: Multiresolution hash encodings have recently enabled fast and high-fidelity implicit neural representations by storing multi-scale features in fixed-size hash tables along a geometric resolution schedule. However, the standard design is data-agnostic: different resolution levels receive identical hash-table capacity despite large differences in image frequency content. As a result, some levels experience severe hash collisions while others underutilize parameters, leading to inefficient capacity allocation. To address this issue, we propose Collision-Aware Resolution Adaptation (CARA), a method that assigns per-level resolutions by balancing the effective information load across hash levels. This adaptive allocation reduces capacity bottlenecks and improves parameter efficiency. In addition, we introduce an invertible pixel-shuffle transform that reduces hash load factors by redistributing spatial information, thereby mitigating collision-induced information loss without enlarging the hash tables. To support evaluation on extremely high-resolution data, we also curate, to the best of our knowledge, the first uncompressed whole-slide image dataset for academic research. Experiments on Kodak images, gigapixel natural images, and raw whole-slide images demonstrate that CARA consistently improves the fidelity-parameter trade-off. Our method matches state-of-the-art performance while using only $27.76%$ of the parameters, and achieves up to $6.11$ dB PSNR improvement at comparable parameter counts. Code is provided in the supplementary.

Wed 16 SeptComputer Vision and Pattern RecognitionGraphics
The gist
Fitting images with neural networks can be inefficient because certain parts of the data get overloaded while others are underused. The authors describe a new way to adjust how these image details are stored by balancing the amount of information at each level, reducing conflicts in memory. They also introduce a technique to rearrange pixels to spread out data more evenly and prevent losses without needing bigger memory tables. Their method works well on very large images and achieves better quality using fewer memory resources.
Open → 2609.18554v1

Nonlinear neuron model detects single isolated pixels in images

A Non-Linear Neuron Based Detection of Isolated Pixels in Binary and Grayscale Images using Contrast Sensitive Receptive Fields

Abstract: Identifying isolated points is important in image processing applications such as medical imaging, astronomy and quality control management. Other domains, such as cybersecurity, also present challenges that can be framed as image processing problems. One example of particular interest is the identification of anomalous single nodes in spatially organised networks where groups of nodes in different regions share similar feature values. This task can involve both binary and more complex grayscale images. However, existing methods face limitations: template matching is infeasible for grayscale images, while 2nd order derivative based methods are highly sensitive to noise and require user-specified thresholds. To overcome these issues, a novel method is proposed for detecting meaningful single-pixel deviations in images. This approach modifies and extends a neuron model, originally designed for anomaly detection, to operate on spatially diameter limited receptive fields that incorporate excitatory and inhibitory regions. The result is a method that is free from user-specified thresholds and parameters, and can be applied to both binary and grayscale images, providing an effective, robust and efficient solution.

Wed 16 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Spotting single isolated pixels that differ from their surroundings is important in many fields like medical imaging and network security. The authors introduced a new method inspired by how neurons detect unusual points using local neighborhoods with excitation and inhibition. This approach doesn’t require tricky settings like thresholds and works well on both black-and-white and grayscale images. It helps find meaningful single pixels that stand out without being fooled by noise.
Open → 2609.18399v1

SetPlanner automates point-based tool segmentation in surgical images

SetPlanner: A Lightweight Plug-in Point-Set Planner for Frozen SAM

Abstract: Segment Anything Models provide reusable priors, yet they require user prompts and cannot support fully automatic instrument segmentation. Automatic prompting is difficult for thin, articulated, reflective, and partly occluded tools, where several configurations can be valid. We formulate automatic prompting as lightweight point-set planning and isolate the point source under a frozen pathway. To this end, we present SetPlanner, a 1.52M-parameter plug-in point-set planner for frozen SAM. The plug-in preserves SAM's point-prompt interface and enables reuse across backbones. SetPlanner plans complete unordered K-point sets from geometry-aware targets with a permutation-aware conditional flow. SAM decodes eight candidates; their consensus readout yields a ground-truth-free prediction. Across three endoscopic datasets, SetPlanner wins all six transfer routes over a LoRA-adapted system. Under our frozen-pathway protocol, SetPlanner reaches 0.934 Dice on Kvasir-Instrument and recovers 96% of a 44.4-point localization gap, while candidate disagreement ranks low-Dice cases at AUROC 0.969.

Wed 16 SeptComputer Vision and Pattern Recognition
The gist
Segment Anything Models (SAM) need user input to identify instruments in images, which is hard for tricky tools that are thin, shiny, or partly hidden. The authors developed SetPlanner, a small add-on that plans where to place points automatically without changing SAM’s main setup. This helps SAM guess the tool locations more accurately by generating multiple candidate point sets and picking the best consensus. The system works well on several medical image datasets and improves automatic instrument segmentation without needing ground-truth labels.
Open → 2609.18037v1

Uncertainty mapping improves understanding of ambiguous medical image scores

Beyond Performance Metrics: Uncertainty Mapping of Label Ambiguity in Fazekas Score Prediction

Abstract: Reference labels used to train medical image classification models are not always as certain as they may appear, and this uncertainty has implications on performance metrics. In this study, we propose a framework to analyze model performance for periventricular Fazekas score prediction that goes beyond conventional metrics. The Fazekas score is an ordinal visual rating scale used to assess the severity of white matter hyperintensities and is known to be affected by inter-rater variability. While the best Fazekas score prediction model achieved a Matthews correlation coefficient (MCC) of 0.70, performance varied across data splits and loss functions, making interpretation of model capabilities difficult. Rather than interpreting epistemic uncertainty of a model's prediction as an isolated scalar value, our approach of uncertainty mapping relates uncertainty to its position within the learned feature representation. This highlights regions of class-boundary transitions where cases appear more ambiguous and misclassifications are more likely. It also identifies potential label disagreement, including low-uncertainty misclassified cases that expert review found to be inconsistent with the original reference Fazekas score. Therefore, uncertainty mapping allows model behaviour to be examined in relation to class separation and potential model-label disagreement. Loss function choice also influenced the uncertainty profile, with some models showing clearer class separation and more localized uncertainty in ambiguous regions than others. These findings suggest that uncertainty mapping for Fazekas score predictions can support model interpretation and targeted dataset review when reference labels are affected by ambiguity/ inter-rater variability.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Medical images are often labeled by experts, but sometimes these labels can be uncertain or inconsistent, especially when different experts disagree. The authors developed a new way to look at where a machine learning model is unsure about predicting a Fazekas score, a rating for brain damage seen on scans. Instead of just giving a number for confidence, their method shows where the model finds it hard to tell classes apart and where mistakes are likely. This helps spot when labels might be wrong and guides better review of challenging cases.
Open → 2609.17753v1

Medical image model predicts anatomy changes with uncertainty

MUMINS: Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis

Abstract: Forecasting anatomical changes such as tumor growth and neurodegeneration is a challenging generative vision task. Morphological evolution is subtle relative to static anatomy, highly patient-specific, and inherently stochastic. Existing methods struggle with several issues: deterministic networks ignore biological stochasticity, while standard diffusion models require computationally prohibitive multi-pass sampling to quantify uncertainty. We propose MUMINS (Metadata-conditioned Uncertainty-aware Medical Image Next-state Synthesis), an efficient diffusion framework that jointly diffuses a baseline scan and its follow-up residual, summed to synthesize the follow-up scan, while concurrently predicting a spatial uncertainty map, in a single reverse diffusion process. Conditioned on the time interval and relevant metadata, it preserves fine-grained anatomy by dynamically re-injecting the baseline as a soft anchor at every denoising step, and a negative-log-likelihood head learns the uncertainty map to explicitly flag error-prone regions. Designed without organ-specific heuristics, the same architecture is reused across anatomies via separate, dataset-specific retraining. Extensive evaluations demonstrate that dataset-specific retraining of MUMINS matches or outperforms dedicated, domain-specific state-of-the-art methods on lung CT (PNG) and brain MRI (OASIS-3). Project page: https://github.com/aolivtous/MUMINS.

Tue 15 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Medical images can show how parts of the body might change over time, like a tumor growing or brain shrinking. This is hard to predict because changes are small, vary a lot between people, and have some randomness. The authors created a new computer method called MUMINS that makes these predictions better by guessing the next scan from a starting one and showing where it might be wrong, all in one go. It works on different body parts without needing special adjustments and beats or matches other top methods in tests.
Open → 2609.17169v1

Heart disease segmentation methods perform differently on new patient data

Beyond In-Distribution Metrics: A Systematic Out-of-Distribution Evaluation of Congenital Heart Disease Segmentation

Abstract: Congenital heart disease (CHD) diagnosis and surgical planning often require patient-specific 3D anatomical models, but manual segmentation is labor-intensive, particularly in complex anatomies. Although deep-learning methods can automate this process, they are typically evaluated in-distribution, despite clinically relevant shifts in scanner, protocol, institution, population, and imaging modality. We present, to our knowledge, the first systematic evaluation of out-of-distribution (OOD) generalization in CHD segmentation, using ImageCHD as a held-out target cohort. We compare representative segmentation architectures under combined CT and CMR training, CT-only training, self-supervised pretraining, and limited target-domain adaptation. In-distribution performance proves to be a poor indicator of cross-cohort robustness: nnU-Net achieves the highest validation Dice (0.77) but falls to 0.51 on ImageCHD, while SwinUNETR generalizes substantially better, reaching 0.67 Dice. MAE and JEPA pretraining provide only modest additional benefit, suggesting that architecture contributes more to robustness than the tested pretraining strategies in this setting. When limited target-domain supervision is introduced, all SwinUNETR variants exceed 0.76 Dice with only 11 labeled ImageCHD cases. These findings demonstrate that conventional in-distribution evaluation can obscure clinically important generalization failures and support explicit cross-dataset testing as a key component of CHD segmentation evaluation.

Tue 15 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Segmenting images of hearts for congenital heart disease helps doctors plan surgeries but usually requires lots of manual work. The authors found that popular computer programs perform well on familiar data but struggle on new data from different hospitals or scanners. One newer method generalized better to new patient images, and giving it a few new examples from the target hospital improved results a lot. This study suggests evaluating medical image methods on new data, not just on familiar images, to better understand how well they work in real clinics.
Open → 2609.17068v1

PiPS explains image segmentation models without retraining or loss

PiPS: Post-Hoc Prototypical Explanations for Interpretable Semantic Segmentation

Abstract: With the increasing deployment of deep neural networks in critical systems, such as medical diagnostics and autonomous vehicles, ensuring their interpretability is crucial to building trust in decision-making systems. In the field of explainable artificial intelligence, prototype-based reasoning has gained particular popularity, as it mimics human cognitive processes by explaining model decisions based on visual similarity under the looks like this paradigm. While this paradigm has been thoroughly investigated in the context of global image classification, the interpretability of dense predictions, particularly semantic segmentation, remains largely unexplored despite its immense importance in tasks requiring precise object localization. Existing prototype-based interpretable segmentation models rely on ante-hoc architectures, which entails significant limitations because they require costly training from scratch and modifications to the network structure, ultimately leading to a noticeable drop in predictive performance compared to standard black-box models. To address this issue, we propose PiPS (Post-hoc interpretable Prototypical Segmentation), the first fully post-hoc solution for generating prototypical explanations for semantic segmentation models. Our method enables the extraction of intuitive, spatially localized explanations from any pre-trained network without modification or fine-tuning, thereby preserving 100% of the model's original predictive performance. This approach opens a new avenue for the safe and cost-effective deployment of transparent systems in advanced computer vision tasks. Codebase available at https://github.com/gmum/PIPS.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Understanding why a computer program labels each pixel in a picture can be hard, especially when using complex neural networks. The authors present PiPS, a method that explains these decisions by showing parts of the image that look like prototypes, without needing to retrain or change the original model. This keeps the model's accuracy intact while making its reasoning easier to understand. PiPS works with any existing segmentation model, helping build safer and more trustworthy applications.
Open → 2609.16909v1

Improving vessel graph matching in longitudinal angiographic images

Temporally Consistent Graph Extraction and Matching for Longitudinal Angiographic Images

Abstract: Recent advances in angiographic imaging have enabled longitudinal visualization of the microvasculature. Image processing pipelines based on vessel graphs are able to resolve subtle temporal changes at the level of individual blood vessels. However, current strategies for graph extraction, refinement, and matching are highly sensitive, with even minuscule differences in the underlying segmentation map resulting in substantially different vessel graphs. These artifacts severely inhibit the ability to accurately match sequential vessel graphs of the same subject over time. To address this problem, we propose a strategy that matches graphs before jointly refining them. Specifically, we perform an early matching after basic graph extraction before removing spurious bulges and merging junctions in both graphs using joint information. In experiments with complex retinal vessel graphs, we demonstrate that this strategy results in a higher matched area without graph fragmentation compared to separate or no refinement, respectively.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Images of blood vessels help doctors see how vessels change over time, but tiny differences in image processing can make it hard to match the same vessels in different pictures. The authors propose a new method that matches vessel graphs early, before cleaning them up, using information from both images together. This approach better matches large vessel areas without breaking the graphs into pieces. They tested their method on detailed eye vessel images and found it works better than previous ways.
Open → 2609.16889v1

NeuroTS-Net improves brain tumor segmentation in pediatric MRI scans

NeuroTS-Net: Multi-Class Semantic Segmentation of Pediatric Brain Tumors in Multi-Modal MRI

Abstract: Pediatric brain tumors are a leading cause of cancer-related mortality in children, and their small, rare, and often low-contrast subregions make accurate manual delineation challenging. Reliable automated segmentation is therefore needed to support diagnosis, treatment planning, and response assessment. Accordingly, we introduce NeuroTS-Net, a three-dimensional encoder-decoder convolutional neural network architecture for multi-class semantic segmentation that incorporates a dual-scale raw-detail stream, adaptive low-resolution context selection, and detail-preserving multipath downsampling. These components preserve fine intensity and boundary information while efficiently modeling broader tumor context. NeuroTS-Net was trained on the BraTS 2026 pediatric dataset without external data or pretrained weights and evaluated against nnU-Net and MedNeXt under the same experimental protocol. NeuroTS-Net outperformed the baseline methods, achieving whole-tumor and tumor-core Dice scores of 0.938 and 0.937 on the internal validation set and 0.927 and 0.926 on the official challenge validation set. The code is open-sourced at: https://github.com/maenstru56/NeuroTS.

Tue 15 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Brain tumors in children are hard to outline accurately because their affected areas are small and not easy to see clearly in MRI images. The authors developed NeuroTS-Net, a special AI system that can automatically find and label different parts of brain tumors in 3D MRI scans from children. NeuroTS-Net keeps important details while understanding the bigger picture, helping it perform better than other popular methods. This tool could help doctors diagnose and plan treatments more accurately and quickly.
Open → 2609.16873v1

Dynamic tuned GAN improves brain tumor segmentation accuracy

De-GAN - Dynamic Parameter Tuned GAN for 3D Medical Image Segmentation: A Step Towards Generalisation

Abstract: Brain tumor segmentation remains difficult because enhancing tumor (ET) has low contrast and overlaps surrounding tissue, while scanner and site variation causes domain shift. We propose DE-GAN, a contrast-enhancing conditional GAN that combines input-adaptive dynamic convolutions, style-aware feature mixing, and coordinate encoding to synthesize slice-adaptive FLAIR images. A label-guided, class-conditional target separates tumor-core (TC) and ET intensities while preserving anatomy. The generated FLAIR is concatenated with the original MR modalities and used to train a 3D U-Net. Across BraTS 2015, 2018, and 2019, DE-GAN improves segmentation over the baseline and static EnhGAN replacement on most reported TC/ET metrics, with the largest gains from retaining both original and enhanced FLAIR. Code and pretrained models are available at https://github.com/zkhansuri-ui/DE-GAN.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
Brain tumor segmentation, especially for parts of the tumor that look very similar to nearby tissue, is difficult because medical images vary a lot. The authors propose DE-GAN, a special AI tool that creates enhanced MRI images by adjusting itself dynamically based on the input. These improved images help a 3D brain scan analysis tool better identify and separate tumor parts. Testing on several tumor image collections showed DE-GAN generally improved tumor detection compared to previous methods.
Open → 2609.16755v1

Score based models solve physics constrained image reconstruction problems

Backward SDEs-based Diffusion for Physics-Constrained Generation

Abstract: Pretrained score-based diffusion models provide strong unconditional priors, yet enforcing measurement or physics consistency in inverse problems is often handled by heuristic guidance, intermittent projections, or task-specific conditional training, with limited guarantees of feasibility at the end of inference. We propose terminal-conditioned inversion for score-based SDE priors. Given a frozen Score-SDE prior and a task-defined terminal feasibility specification, we construct an associated backward stochastic differential equation whose adapted solution defines a principled inverse map from the terminal requirement to a prior state at a chosen noise level. Under standard regularity conditions, we establish existence and uniqueness of the adapted solution and obtain terminal consistency by construction. We further develop a practical neural BSDE solver that composes arbitrary pretrained diffusion priors with domain constraints without modifying the score-defined coefficients, producing an anchored prior state that enables neighborhood sampling for uncertainty characterization. Experiments on toy datasets validate stable terminal-conditioned inversion and distributionally consistent neighborhood sampling. As a real-world case study, we apply the framework to sparse-view CT reconstruction and achieve improved reconstruction quality over representative training-free baselines while satisfying strict measurement feasibility under the prescribed terminal specification. Project is available in: \href{https://laplacelab.github.io/BSDEDiffusion/}{https://laplace.center/icmlbsdeI/}

Mon 14 SeptMachine Learning
The gist
Some computer programs can generate images by learning patterns from many examples, but making sure these generated images fit physical rules or measurements is tricky. The authors propose a new way to adjust these image-generating models so that their outputs always respect the required physical constraints, like matching a real measurement exactly. They do this by solving a special kind of math problem (called a backward stochastic differential equation) that links the measurement rules to the image-generating process. They tested their method on simple examples and in a practical medical imaging problem, showing better results and consistent accuracy.
Open → 2609.15702v1

MedDiME speeds up medical image editing for clearer AI diagnoses

MedDiME: Efficient Latent Diffusion with Adaptive Masking for Medical Counterfactual Generation

Abstract: Medical counterfactual generation modifies images to change model predictions for interpretability. However, existing diffusion-based approaches are often prohibitively slow and memory-intensive, making them difficult to apply in high-resolution settings. Moreover, existing masking strategies are tightly coupled with pixel-space representations, making them incompatible with latent-space diffusion editing. To address these challenges, we propose MedDiME, a latent-space classifier-guided diffusion framework that reduces computational and memory overhead while introducing a latent-compatible, gradient-driven adaptive masking mechanism for spatially precise medical counterfactual generation. Extensive experiments demonstrate that MedDiME achieves high-quality counterfactual generation with significant efficiency gains compared to prior classifier-guided diffusion baselines, achieving up to 40 times faster inference and 13 times lower peak GPU memory usage.

Mon 14 SeptComputer Vision and Pattern Recognition
The gist
Medical AI models sometimes make mistakes on images, and changing parts of these images can help explain why. However, current methods to edit medical images to understand AI predictions are slow and use a lot of computer memory. The authors created MedDiME, a faster and more memory-efficient system that edits in a compressed image space using smart masking, making medical image explanations clearer and quicker to produce. Their tests show it can work up to 40 times faster and uses much less memory than older methods.
Open → 2609.15647v1

Unified AI model improves prostate cancer PET CT reports and analysis

A Unified Vision-Language Model for PSMA PET/CT Report Generation, Visual Question Answering, and Lesion Segmentation

Abstract: Accurate PSMA PET/CT interpretation is central to prostate cancer management, yet existing PET/CT AI models typically address isolated tasks. We propose a unified PSMA PET/CT vision-language model for report generation, visual question answering, and lesion segmentation. The framework adopts an LLaVA-style architecture, comprising a PET/CT vision encoder, an MLP-Mixer projection module, a LoRA-tuned large language model, and a 3D segmentation branch. Training followed a four-stage strategy: vision encoder pretraining, projection-layer alignment, VLM fine-tuning, and final multitask tuning. Language tasks used 5,747 PSMA PET/CT datasets with paired reports, while segmentation used the PSMA subset of AutoPET. The model outperformed PET2REP and a CT-based baseline across standard report-generation metrics, improved performance across VQA question types, and achieved higher Dice and lesion-level overlap F1 than SegAnyPET and nnUNet. These results support the feasibility of a unified framework for structured, interactive, interpretable PSMA PET/CT analysis with voxel-level grounding within a single multitask model architecture.

Mon 14 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Reading and understanding special medical images called PSMA PET/CT scans is important for treating prostate cancer. Most existing AI tools focus on just one job, like writing a report or finding cancer spots. The authors created one AI model that can write reports, answer questions about the scans, and mark cancer areas all at once. Their model worked better than other tools in making reports, answering questions, and identifying lesions accurately. This shows one AI can handle several tasks to help doctors better interpret these scans.
Open → 2609.15603v1

Bsc net improves small branch detection in coronary vessel images

BSC-Net: A Small-Branch-Sensitive Structural Continuity Network for Coronary Vessel Segmentation and Quantitative Angiographic Analysis

Abstract: Vessel segmentation in X-ray coronary angiography (XCA) is a fundamental step for quantitative coronary analysis and subsequent assessment of coronary artery disease. However, accurate vessel segmentation remains challenging because of imaging noise, complex bifurcations, and the overlap of vessels and background structures, which can lead to disrupted vascular connectivity and missed small branches. In this work, we propose BSC-Net, a ResNet-U-Net-based framework tailored to improve small-vessel representation and repair vascular structural continuity. BSC-Net enhances small-vessel representation through targeted sampling and improves vascular structural continuity by integrating long-range contextual modeling and Edge-Informed Loss (EIL). BSC-Net was validated on two public XCA datasets, demonstrating state-of-the-art (SOTA) performance in coronary vessel segmentation with Dice and IoU scores of 77.8%/90.6% and 64.5%/83.0%, respectively. Furthermore, based on the obtained vessel segmentation, we performed automated quantitative coronary analysis and derived clinically relevant morphological and hemodynamic parameters, including stenosis ratio, time-to-peak, and relative propagation velocity. These results demonstrate that BSC-Net produces accurate vessel segmentation results with preserved vascular continuity for quantitative coronary assessment, enabling reliable downstream analysis and clinical evaluation of coronary artery disease.

Mon 14 SeptComputer Vision and Pattern Recognition
The gist
Detecting small blood vessels in heart X-ray images is hard because of blurry pictures and overlapping structures. The authors created BSC-Net, a special computer program that better finds tiny vessel branches and keeps vessel shapes connected. They tested BSC-Net on public datasets and showed it works better than earlier methods. This tool helps doctors measure heart vessel properties more accurately to assess heart disease.
Open → 2609.15400v1

End-to-end method improves cell detection by combining images and cell relationships

End-to-End Cell Detection via Instance-aware Graph Modeling

Abstract: Accurate cell detection and classification are crucial for pathological analysis, directly affecting diagnostic accuracy and treatment planning. To capture complex cellular interactions beyond visual appearance within the tumor microenvironment, several approaches have employed graph neural networks to model spatial and relational patterns among cell nuclei, yielding promising results. However, these methods typically adopt a two-stage paradigm of visual extraction followed by relational modeling, which necessitates separate tuning for each stage, thereby increasing pipeline complexity and hindering end-to-end joint optimization. In this paper, we propose an end-to-end framework for cell detection and classification that jointly models patch-level visual representations and instance-level interactions, which incorporates a dynamic graph construction module and an instance-aware graph network. Specifically, the graph construction module dynamically builds the graph structure using learnable queries derived from patch-level features as cell instance representations, with adjacency defined by integrating feature similarity and spatial distances. The instance-aware graph network performs adaptive instance filtering and feature reorganization, aggregating them over the cell graph into a topological latent state for a selective state-space transition driven by visual cues, fusing appearance and relational evidence. When evaluated on multiple datasets with different staining protocols for cell and nucleus detection, our method significantly outperforms existing approaches in both detection and classification performance. The code will be released at https://github.com/RuochenLiu23/IGM.

Mon 14 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Detecting and identifying different types of cells in medical images is important for diagnosing diseases and planning treatments. The authors created a new approach that looks not only at how cells appear but also how they relate to each other in the tissue. Their method builds a graph that links cells based on their features and positions, then uses this graph to improve detection and classification in one integrated step. Tests on several kinds of medical images showed their method works better than previous ones.
Open → 2609.15354v1

MedVA system improves medical volume visualization with neuro-symbolic reasoning

MedVA: An End-to-End Neuro-Symbolic Agentic System for Medical Volume Visualization

Abstract: Medical volume visualization requires selecting regions of interest (ROIs) and carefully controlling their relative visual emphasis according to a given clinical intent. Implementing these decisions in conventional workflows demands substantial clinical and visualization expertise and often involves trial-and-error optimization. Recent agentic systems have introduced natural-language interaction and autonomous visualization operations but largely rely on MLLM-based inference throughout the workflow. Although MLLMs encode broad medical knowledge and provide strong reasoning capabilities, such inference may be suboptimal for medical volume visualization, potentially leading to clinically incomplete interpretations of user requests and unreliable ROI identification and visualization optimization. In this work, we present MedVA, an end-to-end neuro-symbolic agentic system for medical volume visualization that addresses these limitations through three complementary agents. The neuro-symbolic intent formulation agent refines MLLM-based interpretations of natural-language requests through symbolic reasoning over established clinical knowledge, which provides more complete, clinically grounded ROI specifications than MLLM-only reasoning. The multi-model ROI identification agent directly identifies semantically specified ROIs in the original volume by leveraging complementary large-scale pretrained medical segmentation models. The objective-driven visualization optimization agent explicitly evaluates ROI visibility and occlusion in the original volume using a volume-based visibility objective. Extensive agent-level and system-level evaluations across diverse medical datasets and interaction scenarios support the effectiveness of the individual agents. A formative user study further indicates high usability and practical value among users with different levels of expertise.

Mon 14 SeptGraphicsComputer Vision and Pattern RecognitionHuman-Computer Interaction
The gist
Medical images often contain complex 3D data that doctors need to explore by focusing on important parts. Traditional methods need experts to guess the best way to show these parts, which takes time and skill. The researchers created MedVA, a system that understands doctor instructions better by combining language models with medical rules, finds important regions using specialized models, and shows them clearly in 3D. This helps users, even those less experienced, get meaningful and reliable visualizations faster.
Open → 2609.14874v1

Federated learning method improves eye disease detection despite noisy labels

OCT-FedSIR: Toward Trustworthy Federated Ophthalmic Learning under Annotation Noise

Abstract: Federated learning enables collaborative model development without centralizing patient data, but annotation reliability at participating institutions cannot always be assumed. In ophthalmic imaging, differences in disease prevalence and class composition can resemble changes caused by corrupted supervision. We introduce OCT-FedSIR, a reliability-aware spectral framework for federated OCT classification under client-dependent annotation noise and heterogeneous data distributions. OCT-FedSIR combines class-balanced spectral estimation, Stage-I logit adjustment, complementary spectral descriptors, selective spectral relabeling, and noise-aware federated optimization. We evaluated the framework on the Kermany, University of Illinois Chicago, and Wake Forest datasets under symmetric and structured asymmetric noise and three levels of non-IID heterogeneity. Across 117 experimental conditions, OCT-FedSIR achieved a mean accuracy of 86.73%, compared with 79.94% for RoFL and 78.75% for FedCorr. It correctly separated clients with original and corrupted annotations across all evaluated conditions, while the original FedSIR identification procedure was less robust, particularly under asymmetric noise. Spectral relabeling recovered 77.2% of corrupted annotations with 91.3% correction precision and a 3.5% false-correction rate. Retaining corrected clients outperformed spectral pruning by 9.30 percentage points on average. These findings show that annotation noise can often be identified and corrected without discarding informative client data.

Sun 13 SeptMachine LearningArtificial IntelligenceDistributed, Parallel, and Cluster Computing
The gist
When many clinics work together to train eye disease detection models without sharing patient data, some may have errors in their labels, which makes training harder. The authors created OCT-FedSIR, a system that can spot and fix these labeling errors even when different clinics have different kinds of patients. This approach improves accuracy and keeps useful data rather than throwing it away. It was tested on multiple eye imaging datasets, showing better performance than other methods under various challenging conditions.
Open → 2609.14734v1

Radiologists outperform AI in breast cancer imaging but AI aids malignancy risk estimates

From Density to Biopsy Decisions and Malignancy Prediction: A Benchmark Study of Multimodal Large Language Models Against Radiologists in Digital and Contrast-Enhanced Mammography

Abstract: Purpose: To compare four multimodal large language models (MLLMs) with radiologists of varying expertise in breast density assessment, BI-RADS assessment, biopsy candidacy determination, and continuous malignancy probability estimation using digital mammography (DM) and contrast-enhanced mammography (CEM). Methods: This study included 179 women with paired DM/CEM examinations and reference standards. Four MLLMs (ChatGPT-5.2, Gemini-3.1 Pro, Sonnet-4.6, Muse Spark) interpreted images with and without masks; three radiologists interpreted non-masked images. Results: For binary density classification on DM, radiologist accuracies ranged from 55.81% to 78.60%, exceeding most MLLM values (62.33%-71.63%), while masks added limited benefit. Five-category BI-RADS accuracies were higher for radiologists on DM (56.74-67.44%) and CEM (62.33-82.79%) compared with MLLMs (DM 31.16-45.12%; CEM 40.00-55.81%). Binary biopsy-candidacy accuracies were likewise higher for radiologists (DM 85.12-89.77%; CEM 86.98-92.09%) than for MLLMs (DM 61.39-75.35%; CEM 69.30-82.79%), although CEM improved performance across all readers. Lesion masks substantially improved MLLM continuous malignancy-probability accuracies from 64.65%-71.63% to 72.56-78.60% on DM and from 67.91%-77.21% to 72.56%-81.86% on CEM, approaching radiologist ranges (DM 63.72-82.79%; CEM 81.86-88.84%). The corresponding AUCs for the top masked models overlapped those of the human readers. Overall, Muse Spark, followed by Sonnet-4.6, demonstrated the strongest performance among the MLLMs across domains. Conclusion: Radiologists generally outperformed MLLMs in categorical tasks, while selected masked models approached human performance for continuous malignancy probability estimation, suggesting a potential adjunctive role.

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
Mammogram images help doctors find and judge breast cancer risk by looking at breast density, cancer likelihood, and whether a biopsy is needed. This study compared four computer models that read mammograms with real radiologists. Doctors generally did better at sorting categories like density and biopsy decisions, but some AI models came close when estimating the exact cancer risk, especially when given extra image details. This shows AI could assist doctors by providing additional risk estimates during diagnosis.
Open → 2609.14676v1

Direct method speeds up solving inverse problems using diffusion models

Direct Conditional Transition Sampling for Diffusion Inverse Problems

Abstract: Training-free diffusion inverse solvers typically choose between local measurement guidance and costly clean-space posterior updates. Independent posterior refresh can improve global correction by sampling a clean conditional and re-noising it, but its practical realization requires probability-flow ODE integration and clean-space Markov chain Monte Carlo (MCMC). We propose Direct Conditional Transition Sampling (DCTS), a direct stochastic-flow approximation to the same ideal refresh target. Rather than explicitly drawing a clean sample, DCTS estimates the measurement-conditioned clean mean along a short inner path and transports Gaussian source noise directly to the next noisy state. A denoiser-compatible sufficient statistic and a covariance-scaled operator update enable this conditional-mean estimation. Experiments on four inverse problems demonstrate that DCTS achieves competitive reconstruction quality with up to $16.8\times$ speedups over competing methods.

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
Solving inverse problems means figuring out the original data from noisy or partial measurements, which is often slow and complex. The authors found a way to speed up this process by directly estimating certain statistics without having to do expensive intermediate calculations. Their method, called Direct Conditional Transition Sampling (DCTS), works faster while maintaining good accuracy. They tested it on several different problems and saw up to nearly 17 times faster results compared to existing approaches.
Open → 2609.14596v1

Model predicts earlier healthy brain states from later disease scans

Reverse Spatio-Temporal Disease Progression Modelling

Abstract: Deep learning-based spatio-temporal disease progression models commonly overlook the incubation period of progressive diseases, limiting the use of those models in early interventions, which are vital for not easily reversible diseases such as Alzheimer's. This is because, the existing deep learning based longitudinal disease-progression models are almost always run forward: from an observed baseline they predict future decline. In many clinical settings, however, imaging begins only after pathology is suspected or already visible, the earlier, healthier patient-specific reference was never acquired. To address this, we propose to study reverse disease progression prediction: given later diseased anatomy, reconstruct the unobserved healthier anatomy that preceded it. We use a two-stage model in which a frozen 3D vector-quantised autoencoder defines a compact discrete latent space, while a Neural Ordinary Differential Equation (ODE) learns continuous-time dynamics in that space. A recurrent encoder reads late observations in reverse temporal order, initialises the latent state, and the ODE is integrated backwards across the trajectory. On a controlled Morpho-MNIST benchmark with a sinusoidal perturbation, our model successfully recovered the unseen previous states from later observations of the non-monotonic trajectory. On longitudinal brain MRIs from Alzheimer's Disease Neuroimaging Initiative, at the task to recover the previous unseen trajectory towards healthy states of the patients from observed later diseased states, our model outperforms the baselines that uses copy-nearest and mean-observed, with positive disease-reversal scores in every diagnostic stratum. We hope that our work can provide insights and tools towards discovering the incubation periods from single-shot scans, and developing early interventions of diseases based on imaging.

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
Many brain diseases like Alzheimer's develop gradually before symptoms appear, but scans usually only start after the disease is visible. This makes it hard to understand early changes and intervene sooner. The authors created a new AI model that can take brain scans showing disease and work backwards to estimate what the healthier brain state looked like earlier. Their approach outperforms simple guesswork methods and could help find early signs of disease from routine scans.
Open → 2609.14590v1

PixCrypt speeds up secure pixel-level data analysis by 35 times

PixCrypt: Fast Fine-Grained FHE with Range-Aware Caching

Abstract: Many analytics tasks require secure computation over encrypted data. In particular, fine-grained data such as pixel-level images require higher precision, as every pixel can directly affect outcomes in tasks like tumor segmentation and anomaly detection. While Multi-Party Computation (MPC) is interactive, Differential Privacy (DP) protects only aggregate values, and Partially Homomorphic Encryption (PHE) lacks multiplicative support, none of them can efficiently handle fine-grained data analytics. Fully Homomorphic Encryption (FHE) uniquely enables arbitrary operations on encrypted pixels but remains computationally expensive, posing significant challenges for both software and hardware accelerators. We present PixCrypt, a caching-based acceleration mechanism for fine-grained fully homomorphic encryption. PixCrypt replaces expensive fresh ciphertext generation with cache retrieval and coefficient-level operations across CKKS, BFV, and BGV, while randomized reconstruction ensures that ciphertexts do not repeat. Its linear noise growth reduces the need for bootstrapping and lowers NTT load, improving hardware accelerator efficiency. This design yields up to 35x faster fine-grained encryption and maintains IND-CPA (Indistinguishability under Chosen Plaintext Attack) security. Experiments on five real-world pixel-level image processing tasks show that PixCrypt significantly improves the practicality of FHE for privacy-preserving analytics.

Sat 12 SeptCryptography and Security
The gist
Analyzing secret data one pixel at a time can be very slow when using fully secure encryption methods. The authors created PixCrypt, a technique that speeds this up by storing and reusing parts of the encrypted data instead of always making brand new encrypted pieces. This makes it much faster to analyze detailed images securely, like detecting tumors, without exposing sensitive information. Their method also keeps the encrypted data secure and works well with current hardware.
Open → 2609.14137v1

Efficient fine-tuning methods improve liver tumor mapping from CT scans

Parameter-Efficient Fine-Tuning of Foundation Models for Liver Tumor Segmentation in CT

Abstract: We evaluated parameter-efficient fine-tuning (PEFT) of the Segment Anything Model (SAM) for liver tumor segmentation in abdominal CT of colorectal liver metastases. We compared Low-Rank Adaptation (LoRA), 4-bit Quantized LoRA (QLoRA), a convolutional adapter (Conv-Adapter), and our Directional Spectral Top-K adapter (DiSCo), training only adapters while freezing the SAM backbone. DiSCo derives spectral bases from singular value decomposition of row-normalized weights and learns rank-gated spectral coefficients, per-output magnitude offsets, and a spectral gain, with optional Top-K rank selection at inference and 0.14 M trainable parameters. We benchmarked five prompting regimes: no prompt, single-point, multi-point, and bounding boxes at intersection over union 0.50 and 0.75. Conv-Adapter and LoRA achieved the highest accuracy (overall Dice 0.793 and 0.792; single-point Dice 0.795 and 0.792; 95th-percentile Hausdorff distance (HD95) 32 mm). QLoRA was close (overall Dice 0.766; single-point Dice 0.768; HD95 36.41 mm), with 0.91 M trainable parameters, 120 ms latency, and 4.9 GB peak memory. DiSCo achieved the highest Dice per million trainable parameters (4.66), with overall Dice 0.653, single-point Dice 0.698, and HD95 49.53 mm. These results show an accuracy-efficiency trade-off and support PEFT for liver tumor segmentation with reduced adaptation costs when compute and labeled data are limited. Code: https://github.com/Ramtin-Mojtahedi/PEFT-SAM-Liver-CT

Sat 12 SeptComputer Vision and Pattern Recognition
The gist
Liver tumors need to be accurately found in CT images to help doctors plan treatments. The authors studied ways to adjust a large AI model called SAM to do this better without needing to change all its settings. They tested several techniques that only update small parts of the model, making the process faster and using less computer memory. Their results show that certain methods balance accuracy and efficiency well, which is helpful when computing power or labeled data is limited.
Open → 2609.14106v1

Sonar improves sparse view CT scans with better structure and accuracy

SONAR: A Structure-Consistent Neural Operator for Null-Space-Aware Sparse View CT Reconstruction

Abstract: Sparse-view computed tomography (CT) reduces radiation dose and acquisition time but remains severely ill-posed because incomplete projections poorly constrain null-space information. Existing learning-based methods often estimate this information in high-dimensional image space, conflate physical measurement errors with prediction errors, and depend on fixed discretizations. We propose SONAR, a Structure-Consistent Neural Operator for Null-Space-Aware Reconstruction. Instead of recovering the full null-space component, SONAR predicts a low-dimensional null-space-aware representation from the acquired projections as pseudo-measurements. It separates measurement and pseudo-measurement residuals, lifts them into the image domain through physics operators, and applies independent neural operators to constrain their structural effects, thereby accommodating admissible errors while suppressing unsupported structures. To support cross-discretization reconstruction, an anisotropic U-shaped neural operator models the periodic angular and nonperiodic detector dimensions using direction-dependent continuous supports, while image-domain neural operators re-discretize continuous kernels on target grids. These components form an optimization-inspired unrolled network. Experiments on simulated AAPM and clinical MARS photon-counting CT data demonstrate consistent improvements across seen and unseen view settings and unseen image resolutions. On AAPM dataset, SONAR improves PSNR by 1.87~dB at 62 views and by 7.63~dB under zero-shot transfer to a $512\times512$ grid over the strongest competing methods. SONAR also achieves the best overall performance in all clinical settings evaluated, demonstrating accurate, structurally reliable, and discretization-robust sparse-view CT reconstruction.

Sat 12 SeptComputer Vision and Pattern Recognition
The gist
Taking CT scans with fewer X-ray views helps reduce radiation but makes it hard to get clear images. The authors designed SONAR, a machine learning method that better fills in missing information while keeping the image’s structure accurate. Unlike past methods that struggle with errors and fixed formats, SONAR works across different settings and improves image quality significantly. It has been tested on both simulated and real clinical data, showing more reliable and sharper CT reconstructions.
Open → 2609.13688v1

Phase unwrapping method improves noise handling in imaging tiles

Translation-Invariant Tile-Based Phase Unwrapping with Residual-Weighted Multipath Averaging

Abstract: Phase unwrapping is a key step in interferometric and coherent imaging, where the physical quantity of interest is carried by a phase that the instrument delivers only modulo 2*pi. The difficulty in two dimensions is to separate the jumps caused by wrapping from those produced by noise, by true discontinuities, by under-sampling or by decorrelation. Spatial-domain and frequency-domain methods have both been studied extensively, each with advantages the other lacks; hybrid schemes combining the two remain scarce. We propose a semi-global tile-based strategy in which every tile is unwrapped in the frequency domain, through the Discrete Cosine Transform (DCT) and the least squares (LS) formalism of Ghiglia et al., the tiles being merged spatially. Unwrapping and noise filtering are performed jointly, which regularizes an otherwise ill-posed inverse problem. An error stays confined to the tile in which it arose; the tiling artifacts are removed by averaging over every shift of the grid and over the symmetries of the square; and that average is weighted by the Poisson residual each pass leaves behind, so that a pass whose tile boundaries fell on a discontinuity does not impose its seam on the result. Experiments on synthetic and real data, against four reference algorithms from four distinct families and under six complementary metrics, show that the proposed method matches or improves on the state of the art. One of these metrics, a corrected cyclic re-wrap residual introduced here, needs no ground truth and therefore remains available on real acquisitions.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
Phase unwrapping is like trying to figure out the full shape of a wave when you only see parts of it wrapped around in circles. This is important in imaging techniques that use wave patterns, but it is tricky because noise and real breaks in the image can confuse the process. The authors created a method that unwraps small sections (tiles) of the image using a frequency technique, then carefully combines them by averaging over shifted grids and weighting by error measures to avoid seams. Their method helps reduce errors caused by noise or edges and matches or beats existing approaches on tests.
Open → 2609.13409v1

Conditional flow matching improves image recovery from noisy measurements

Fast and Faithful: Principled Conditional Flow Matching for Inverse Problems

Abstract: Flow matching approaches to imaging inverse problems commonly incorporate measurements in two ways. Conditioning-based approaches supply measurement-derived information as a network input, often through concatenation, while inference-guided approaches combine an unconditional velocity field with a separate data-consistency update. In these common formulations, the forward model is not explicitly enforced within the learned conditional velocity field. We propose a principled parametrization of the measurement-conditional velocity field to solve inverse problems. Under linear interpolation, we express the conditional velocity $v(x_t,t,y)$ in terms of the posterior mean $E[x_1 | x_t,y]$, and characterize that mean as the unique minimizer of a variational objective whose data-consistency term is explicit. We further prove that the velocity field defines a probability flow from the source distribution to the measurement-conditioned posterior. Splitting the variational objective yields a conditional velocity parameterization with operator-dependent data-consistency updates, which we train end-to-end under the flow-matching objective, with no additional guidance at inference. Our method achieves state-of-the-art PSNR with $50\times$ fewer function evaluations than the strongest flow baseline. Varying the sampling steps provides test-time control over the distortion-perception trade-off without retraining.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
Imaging inverse problems involve figuring out the original image from partial or noisy measurements. The authors propose a new approach that uses a mathematical idea called conditional flow matching to better reconstruct images by integrating measurement information directly into the recovery process. Their method is faster and produces higher-quality images than previous flow-based techniques. It also lets users balance the trade-off between image sharpness and distortion at test time without retraining the model.
Open → 2609.12953v1

Self-supervised pre-training improves eye disease models with little data

Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce

Abstract: Modelling how a disease progresses over time requires longitudinal imaging cohorts, which are scarce and small, whereas cross-sectional data -- one image per participant -- is abundant. Self-supervised pre-training on such data offers a way to bridge this gap, but it is unclear which strategy best supports progression modelling, or how that answer depends on the amount of labelled longitudinal data. We study this for age-related macular degeneration (AMD), pre-training encoders on the large cross-sectional NAKO cohort and predicting time to late AMD on the longitudinal AREDS dataset. We compare in-house self-supervised encoders against a general-purpose (DINOv2) and a domain-specific (RETFound) foundation model, across contrastive, masked-autoencoding, and self-distillation objectives, under frozen and fine-tuned protocols, and across labelled training sets from 100 to 32,250 examples. Which model performs best depends on how the encoder is used. When the encoder is frozen and labels are few -- the regime typical of longitudinal cohorts -- pre-trained representations reach clinically reasonable discrimination from a few hundred labelled samples, while models trained from scratch do not; this advantage fades under fine-tuning. Transfer is governed by the self-supervision objective rather than corpus scale or domain match, so that an encoder pre-trained on a modest cross-sectional cohort matches or exceeds a far larger in-domain foundation model. Together, these results offer a practical recipe for building progression models where longitudinal data is scarce: a frozen self-supervised encoder with a lightweight survival head.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
It's hard to study how eye diseases like age-related macular degeneration (AMD) get worse over time because the right kinds of patient images are rare. The authors found that training a computer program first on many single images taken at one time (instead of changes over time) can help it learn useful information. When there isn’t much data showing disease progression, this pre-training helps the model predict AMD worsening better than starting from scratch. This improvement depends more on how the model is trained beforehand, rather than on the size or similarity of the training images.
Open → 2609.12834v1

Ultra-widefield octa dataset and network improve retinal vessel segmentation

An Ultra-Widefield Swept-Source OCTA Dataset and a Polar-Gated Mamba Network for Retinal Vessel Segmentation

Abstract: Ultra-widefield (UWF) swept-source optical coherence tomography angiography (SS-OCTA) enables large-area retinal vascular imaging, yet vessel segmentation at this scale lacks dedicated public benchmarks and comprehensive evaluation for quantitative vascular analysis. We introduce WOIVES, to our knowledge the first publicly available UWF SS-OCTA vessel-segmentation dataset, comprising 206 eyes from 152 participants with a 24x20mm^2 field of view. WOIVES spans emmetropia to high myopia and provides soft probability vessel annotations. We further propose PG-Mamba, a visual state space model that enhances conventional directional scans with two complementary polar-coordinate scan orders. An auxiliary Dynamic FOV Gating module performs spatial modulation at the bottleneck. PG-Mamba outperformed seven competitive approaches on broad segmentation metrics under cross-validation. It achieved the lowest median absolute errors for vessel density, fractal dimension, and vessel length density. WOIVES is publicly available on Zenodo (DOI: 10.5281/zenodo.21904672), and the PG-Mamba code is available at https://github.com/syb1234567/PG-Mamba.

Fri 11 SeptComputer Vision and Pattern Recognition
The gist
Retinal scans cover large areas but lack good public data for analyzing blood vessels accurately. The authors created WOIVES, a new large set of retinal images with detailed vessel markings to help this problem. They also developed PG-Mamba, a model that looks at the images from different angles to better find blood vessels. This model worked better than others in measuring blood vessel features precisely.
Open → 2609.12574v1

Glioma tumor changes forecasted using MRI anchored model updates

Observation-Anchored Selective Assimilation for Longitudinal Tumor-State Proxy Forecasting in Post-Treatment Glioma

Abstract: Post-treatment MRI in patients with glioma provides serial observations for updating patient-specific tumor-state proxy estimates, but variable appearances and trajectories complicate forecasting. We formulate forecasting as an observation-aware digital-twin update in which an intermediate observation anchors the patient-specific state. Among 203 patients and 594 follow-up time points, a predefined no-new-treatment criterion retained 120 of 236 candidate triplets, split into 81/24/15 training/validation/test triplets at the patient level. Each time point was represented by a continuous voxel-wise tumor-state proxy map in [0,1] derived from MRI lesion labels. A SegMamba-based single-step forecaster predicted update proposals from multimodal source-state tensors. Observation-Anchored Selective Assimilation (OASA) retained the observed intermediate proxy as the state anchor and selectively applied updates through a validation-selected tiered case-level rule and voxel-wise soft gate. We compared initial-scan forecasting, rollout without assimilation, latest-observation persistence, direct prediction, OASA, OASA + calibration, and morphological dilation. Checkpoints, OASA rules, and calibration thresholds were selected using validation data only. Across three seeds on 15 held-out test triplets, OASA maintained Dice at $τ$ = 0.2 comparable to persistence (0.6071 $\pm$ 0.0025 vs. 0.6070) while yielding numerically higher Dice at $τ$ = 0.5 (0.4269 $\pm$ 0.0079 vs. 0.3981), with a small RMSE increase. Calibration increased Dice at $τ$ = 0.2 to 0.6178 $\pm$ 0.0025, increased false-positive (FP) support (11,836$\rightarrow$18,663), and reduced false-negative (FN) support (22,107$\rightarrow$17,536). This reflects near-threshold support calibration rather than improved biological predictive capability. Code is publicly available at https://github.com/jsudg436/longitudinal-proxy-forecasting.

Fri 11 SeptMachine LearningArtificial Intelligence
The gist
Doctors use MRI scans over time to track brain tumors after treatment, but it’s hard to predict how the tumor will change. The authors created a method that updates tumor predictions by carefully combining new MRI data with previous estimates. Their approach keeps observed tumor details as anchors and selectively adjusts other areas, which helps maintain prediction accuracy compared to simpler methods. This technique may support better monitoring of tumor changes over time using MRI images.
Open → 2609.12435v1

Spectral adapters improve liver tumor segmentation from CT scans

Spectral Adapters for Segment Anything Model-based Segmentation of Colorectal Liver Metastases in Computed Tomography

Abstract: Accurate segmentation of colorectal liver metastases (CRLM) in contrast-enhanced computed tomography (CT) is important for response assessment, surgical planning, and follow-up. We propose two parameter-efficient spectral adapters for the Segment Anything Model (SAM): the Directional Spectral Adapter (DiSECT) and Spectral Instance-Guided Adapter (SiGA). DiSECT uses singular value decomposition of frozen weights to constrain residual updates to leading spectral directions, while SiGA adds global and input-conditioned gating through a multilayer perceptron. We evaluate these methods on 446 contrast-enhanced CT volumes (355 training, 91 testing) and compare them with LoRA, QLoRA, convolutional adapters (CAD), and a 3D nnU-Net baseline. Experiments consider single-point, three-point, bounding-box, and no-prompt regimes. SiGA achieves the best single-point performance with a Dice score of 0.77, IoU of 0.69, and HD95 of 35.39 mm. Under no-prompt inference, SiGA reaches 0.76 Dice, 0.68 IoU, and 46.76 mm HD95, comparable to the nnU-Net baseline (0.758 Dice). DiSECT uses only 0.14 million trainable parameters. These results show that spectral adapters can efficiently adapt SAM for CRLM segmentation while retaining strong accuracy with limited trainable parameters.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
Segmenting cancer spots in liver CT scans helps doctors plan treatments and track progress. The paper introduces two lightweight add-ons to a powerful image model that improve how well it finds liver tumors. These add-ons make the model better at this task while only needing to adjust a small number of settings. Tests on hundreds of scans show these methods perform close to fully trained traditional models but with fewer training demands.
Open → 2609.11703v1

Brain metastases segmentation improved with enhanced neural network and post-processing

Pre- and Post-Treatment Brain Metastases Segmentation Using nnU-Net with Post-Processing for BraTS 2026

Abstract: Brain metastases exhibit high inter-lesion variability in size, enhancement pattern, and post-treatment appearance, making volumetric segmentation of both pre- and post-treatment cases the central challenge of the BraTS 2026 Task 1 (Brain Metastases). We build a pragmatic pipeline on a 5-fold nnU-Net ResEnc-L ensemble, in which each fold is trained independently for 1,000 epochs with the standard Dice + cross-entropy loss on 1,296 four-modality training cases. This ensemble is followed by a rule-based post-processing cascade tuned for the lesion-wise Dice similarity coefficient (LW-DSC), a detection-oriented metric that behaves very differently from the traditional global Dice. The final pipeline reaches an LW-DSC of 0.733 / 0.751 / 0.713 / 0.549 on the enhancing tumour (ET), tumour core (TC), whole tumour (WT), and resection cavity (RC) sub-regions on the official validation leaderboard. Rather than trusting these leaderboard gains, we audit every post-processing stage with a five-fold out-of-fold (OOF) analysis with no model-training leakage over all 1,296 training cases, scored with the official BraTS evaluation code (BraTS_evaluation): it confirms two stages as robust, per-fold-consistent improvements while the third improves only the leaderboard and does not reproduce out-of-fold. We further provide a mechanistic analysis of the LW-DSC metric that explains why recall-recovering post-processing carries low risk whereas component deletion does not, and we report thirteen negative results spanning loss engineering, alternative backbones, and inference-time settings, several of which run counter to widely held intuitions. Source code is released under Apache-2.0 at https://github.com/hornbeamliu/brats2026-met.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
Segmenting brain metastases before and after treatment is hard because the lesions look very different in size and appearance. The authors built a system using a specialized neural network called nnU-Net with added rule-based steps that help detect lesions more accurately. They carefully tested their method to make sure improvements were real and not just luck on the leaderboard scores. This work also explains why some kinds of post-processing help more than others and reports many unsuccessful experiments to guide future research.
Open → 2609.11477v1

Conditional transport boosts 3d deformable point cloud matching accuracy

BridgeMatch: Conditional Transport Bridges in Matching Matrix Space for 3D Deformable Registration

Abstract: Reliable non-rigid point cloud correspondences are important for deformable anatomical registration, embodied perception and manipulation, and dynamic 3D reconstruction. Coarse-to-fine methods reduce computational cost by selecting the top-\(K\) coarse regions. However, this pruning may remove weak but correct hypotheses and restrict fine matching to an incomplete search space. We present \paper, a two-stage generative solver that maintains the complete soft matching matrix at both coarse and high resolutions. Stage~I uses denoising diffusion to estimate a global matching matrix in the compact coarse-resolution space. We then lift this matrix to high resolution while preserving its hierarchy. The lifted matrix is rank-bounded and block-constant. Stage~II refines it through a conditional transport bridge. We implement the bridge with two types of dynamics: a deterministic endpoint-parameterized conditional Flow Matching (CFM) ODE and a stochastic Brownian-bridge SDE inspired by Schrödinger bridges. Both variants share the lifted source, a time-conditioned transformer, and a matching-matrix endpoint predictor. Experiments on 4DMatch and 4DLoMatch show that both variants produce more accurate correspondences than the compared methods and improve downstream registration, with larger gains in low-overlap cases. They also improve cross-dataset generalization on CAPE and DeepDeform without target-domain adaptation while using the same deformation solver.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
Matching points between two 3D shapes that deform is tricky, especially when the shapes only partially overlap. The authors introduce BridgeMatch, a new two-step method that first finds a rough global match and then refines it carefully without losing any possible correct matches. This approach uses advanced math tools called diffusion models and transport bridges to better guess which points correspond, even in challenging cases. Their experiments show it works better than previous methods and adapts well across different datasets.
Open → 2609.11472v1

DINOv3 model improves liver fibrosis staging using medical image patches

DINO-Med: A Unified Patch-Based Adaptation Framework for Multi-Modal Medical Image Analysis Applied to Liver Fibrosis Staging

Abstract: Adapting natural-image foundation models like DINOv3 to multi-modal medical imaging is challenging due to the significant domain gap between natural color images and multi-channel medical scans. We present a unified, patch-based framework that processes raw multimodal imaging through training-free registration, automated localization, and mask-filtered patch extraction. This architecture culminates in a hierarchical strategy that aggregates patch-level insights into subject-level diagnostics. Using liver fibrosis staging as a case study, we evaluate four patch-level feature representations: handcrafted Radiomics features, learned ResNet features, pre-trained foundation model SAM-Med2D features, and frozen DINOv3 features. To ensure a controlled comparison, all models utilize the same lightweight MLP head and are evaluated across both rigid and deformable registration settings. Our training protocol focuses on mild fibrosis (S1) and cirrhosis (S4) classes only, enabling a single classifier to address both substantial fibrosis detection and cirrhosis staging. Evaluated via 10 random train (90%)/ test (10%) splits on 360 subjects from the CARE 2025 Liver Track 4 cohort, our DINOv3-based framework significantly outperforms all baselines, achieving the best classification accuracy of 78.4% for S1 and 75.8% for S4.

Thu 10 SeptComputer Vision and Pattern Recognition
The gist
It is hard to use AI models made for everyday photos on medical images because medical scans look very different. The authors created a system that breaks medical images into small pieces and analyzes them to detect liver fibrosis stages. They compared different ways of representing image parts and found that a model called DINOv3 worked best. Their system was tested on 360 patients and showed more accurate detection of mild fibrosis and cirrhosis than other methods.
Open → 2609.11380v1

Meta learning predicts best image classifier for diverse datasets

Meta-Learning for Classifier Selection in Image Datasets: A Feature-Driven Framework for Accuracy Prediction

Abstract: No Free Lunch theorem implies that any performance gains achieved by a classifier on a particular image distribution are necessarily offset by a loss of performance over the set of all possible problems; thus, no single model is universally optimal. Selecting the most suitable classifier for image datasets is a critical yet challenging task due to the intrinsic complexity and diversity of images. This paper proposes a meta-learning framework that leverages a comprehensive set of meta-features capturing dataset complexity to predict classifier performance without exhaustive training. By extracting and selecting features using methods such as autoencoders, pre-trained networks, and dimensionality reduction techniques, we train regression models to efficiently estimate classifier accuracies. Additionally, clustering techniques are employed to group classifiers with similar performance patterns, simplifying the recommendation process. The datasets used span a wide range of concepts, including nature, animals, numbers, motorcycles, medical images, and human bodies, to ensure broad generalization. Evaluated on 56 diverse image datasets, our approach achieves an average ranking prediction accuracy exceeding 86%, demonstrating its effectiveness in guiding model selection. This scalable and interpretable framework provides a practical solution to improve classification performance while reducing computational costs.

Thu 10 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Choosing the right image recognition program can be tricky because no one model works best for every kind of picture. The authors created a system that looks at the characteristics of an image dataset to predict how well different classifiers will perform without having to try each one fully. They use smart feature extraction and grouping methods to make fast and accurate recommendations. Testing on many kinds of image collections showed their method correctly ranks classifiers over 86% of the time. This helps save time and computing power when picking tools to identify images.
Open → 2609.11041v1

Learning continuous-time maps improves medical image alignment accuracy

Two-Parameter Flow Map Learning for Continuous-Time Diffeomorphic Image Registration

Abstract: Diffeomorphic image registration is central to medical image analysis, enabling anatomically consistent alignment across subjects. Most learning-based diffeomorphic methods model autonomous ODEs(ordinary differential equations) by parameterizing a stationary velocity field and recovering deformations via scaling-and-squaring. While non-autonomous ODEs with time-dependent velocities increase expressiveness, existing approaches rely on numerical integration to implicitly enforce flow structure that entangles model expressiveness with discretization accuracy. We propose a framework to directly learn the continuous-time solution of a non-autonomous ODE formulated as a two-parameterflow map. By enforcing cocycle consistency, a fundamental structural property of time-varying flows, we learn the flow maps without time discretization and velocity integration during training. The framework recovers diffeomorphic mappings at inference using a small number of compositions. Our proposed framework seamlessly incorporates standard registration backbones and improves alignment accuracy consistently across nine datasets while preserving diffeomorphic structure. Notably, the proposed method achieves an average Dice improvement of 2.1% on brain MRI benchmarks, a 12% TRE reduction on lung CT, and a 2.6% Dice gain on cardiac MRI and ultrasound datasets.

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
Aligning medical images from different people helps doctors compare anatomy accurately. Most existing methods use simpler models that assume constant changes over time, which can limit accuracy. The authors introduce a new way to learn how images change over time using a two-parameter map that captures more detailed deformations without relying on slow computations during training. Their method improves alignment accuracy on brain, lung, heart, and ultrasound images while keeping the important mathematical properties of smooth deformations.
Open → 2609.10789v1

Braintaskonomy improves brain scan learning by organizing task transfers

BrainTaskonomy: Learning How to Pretrain and What to Transfer in fMRI Foundation Models

Abstract: fMRI foundation models increasingly aggregate heterogeneous data across brain states, cohorts, and acquisition settings, yet pretraining domains are commonly treated as a flat mixture and downstream tasks are adapted independently. We study whether measured learning relations can organize both stages without modifying the backbone. During pretraining, a lightweight Brain-DiT proxy estimates difficulty and directed facilitation across ten fMRI domains, yielding a priority-guided cumulative domain curriculum combined with high-to-low-noise timestep scheduling and joint consolidation. During adaptation, controlled first- and higher-order transfer across fifteen tasks constructs a directed taskonomy, from which budgeted integer programming (BIP) selects directly supervised source tasks and target-specific routes. The joint priority-domain and high-to-low-timestep curriculum reduces v-NMSE, PSD-NMSE, and FC-MSE by 6.5%, 16.3%, and 10.5%, respectively, relative to uniform sampling over both dimensions, and shows strong downstream performance across six in- and out-of-domain tasks. The taskonomy reveals asymmetric, target-dependent transfer, while exploratory sealed-test evaluation shows larger descriptive gains for BIP policies when higher-order route spaces are available than for matched random controls. Together, these findings support organizing fMRI pretraining and adaptation by measured learning relations rather than treating domains and tasks as independent flat sets.

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
Brain scans called fMRI come from many different situations, and training computers to understand them usually treats all data the same. The authors show that measuring how different brain scan tasks and data types help each other can guide smarter learning steps. Their method organizes training and adaptation in a way that improves accuracy on brain data by choosing what to learn first and how to transfer knowledge between tasks. This helps computers better analyze brain functions across diverse scanning conditions.
Open → 2609.10518v1

Shape guidance improves 3D X-ray reconstruction with few views

Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction

Abstract: Sparse-view X-ray 3D reconstruction is essential for reducing radiation exposure, but recovering a density field from a handful of X-ray projections is severely ill-posed. Recently, 3D Gaussian Splatting has achieved state-of-the-art performance in sparse-view reconstruction by representing the volume using explicit, optimized primitives, but it requires dozens of projected views. With fewer views, reconstruction quality degrades severely since the explicit primitives are optimized freely without any anatomical information. Anatomical structures, in contrast, share similar geometry and density across a population. Their variations are bounded within a limited range that statistical shape models can capture. This paper proposes a shape-guided Gaussian splatting framework for sparse-view X-ray 3D reconstructions. Our contribution lies in driving Gaussian positions toward anatomically valid configurations, alongside atlas-based density regularization. Our method ensures anatomically consistent reconstruction and improves PSNR by 2.83 dB over a state-of-the-art Gaussian splatting baseline with as few as 5 views. Code Available: https://github.com/polyshape-lab/ShapeGuidedGaussian

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
It is hard to create detailed 3D X-ray images when only a few X-ray pictures are taken, because the computer guesses many unknown details. The authors improved this by using prior knowledge about typical body shapes to guide the reconstruction. This makes the 3D images more accurate and realistic, even with as few as five X-ray views. Their method beats previous techniques by making the results more consistent with human anatomy.
Open → 2609.10376v1

Cancer segmentation AI signals errors through internal patterns

Medical AI Encodes a "Feeling of Error": Verifying Cancer Segmentation via Internal Concepts

Abstract: Cancer segmentation models can fail silently, generating plausible but incorrect masks that risk missed findings or unnecessary biopsies. A critical question arises: Do AI models "know" when they are wrong, and if so, can we use the signal to predict their own failures? Humans do have a "Feeling of Error" (FOE): a spontaneous sense of unease that flags a potential error during thinking. We investigate whether cancer segmentation models exhibit an analogous internal signal. Unlike output-level cues (e.g., prediction confidence or uncertainty), which offer no insight into why a failure occurs and suffer from a sensitivity-quality tradeoff where high detection sensitivity could degrade overall segmentation quality. We instead propose to capture the model's FOE from its inner workings. Using mechanistic interpretability tools, specifically Sparse Autoencoders, we decompose internal neural activations into a dictionary of human-interpretable concepts and show that failure cases exhibit a distinct latent signature: fewer active concepts with lower activation magnitudes compared to successful segmentation. By training a classifier on these concept activations, we achieve accurate failure detection along with explanations for the model's mistakes. Experiments on prostate, pancreatic, and brain cancer segmentation demonstrate that our approach outperforms output-based methods in failure detection while preserving segmentation quality.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Cancer detection AI can sometimes make mistakes that look convincing but are wrong, which can cause harm. The authors studied whether these AI systems have an internal 'feeling' that tells them when they might be wrong. They found that by looking inside the AI’s inner workings and spotting certain patterns, they could tell when the AI was likely to fail. This method works better than just looking at the AI’s confidence scores and also explains why the mistake happened. They tested this on models for prostate, pancreatic, and brain cancer images.
Open → 2609.08879v1

Better brain scan alignment improves nerve and blood vessel views

Evaluation Principles for MRI-MRA Registration in Trigeminal Neuralgia: An ROI-Centered Neurovascular Benchmark

Abstract: Preoperative evaluation of trigeminal neuralgia (TN) often requires joint interpretation of structural MRI, which depicts the trigeminal nerve and surrounding cisternal anatomy, and time-of-flight MRA, which highlights vascular structures. Although MRI-MRA fusion is clinically attractive for visualizing neurovascular compression, this task is poorly captured by conventional whole-brain registration evaluation because the clinically relevant target is a small trigeminal ROI, vessel annotations are partial and clinically focused, local TOF-MRA contrast is variable, and field-of-view mismatch can limit deformable alignment. We formulate TN MRI-MRA fusion as an ROI-centered neurovascular registration-evaluation problem and construct a benchmark from 149 patients with clinician-annotated bilateral trigeminal ROIs. Six representative registration pipelines were evaluated using local image-based metrics, segmentation-derived vessel-localization metrics, prediction-volume analysis, and contrast- and FOV-stratified comparisons. Conventional evaluation summaries were often misleading: local image similarity, vessel-background separability, and downstream vessel localization did not co-rank methods; one-sided vessel distances were strongly affected by predicted vessel extent under partial annotations; and local MRA contrast determined when vessel-separability metrics were informative. Deformable refinement provided only a small, FOV-dependent benefit over affine alignment, while reader review showed that locally favorable vessel distances could coexist with globally implausible registrations. These findings indicate that TN MRI-MRA registration should be evaluated as a local, vessel-aware, contrast-sensitive, and FOV-aware visualization task rather than as generic multimodal brain registration. Our code is publicly available at https://github.com/jhuldr/TN-Reg-Benchmark.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Trigeminal neuralgia is a painful nerve condition that doctors often study using two types of brain scans to see nerves and blood vessels. The researchers found that usual ways to align these scans don't work well because they focus on the whole brain instead of the tiny nerve area that matters most. They created a special test and showed that alignment methods need to focus on nerve regions, blood vessels, and scan details to be useful. Their work helps make better combined images for doctors studying this pain disorder.
Open → 2609.08805v1

CoordFormer enables accurate segmentation on huge images with less computing

CoordFormer: Give Me Any Coordinates and I Will Give You Labels

Abstract: Semantic segmentation on very-high-resolution images remains challenging due to the high computational cost and the difficulty of capturing fine-grained details. We propose CoordFormer, a novel coordinate-based architecture for semantic segmentation that predicts labels at arbitrary spatial locations through a Coordinate Decoder equipped with a Localized Cross-Attention mechanism. The decoder combines coordinate embeddings with high-resolution local patch features and interacts with global tokens extracted from a downsampled image processed by a ViT foundation encoder, enabling rich semantic context while preserving pixel-level precision. This design enables flexible inference at arbitrary resolutions while keeping memory low on very-high-resolution inputs, and supports an efficient semantic-edge-focused strategy that concentrates computation along boundaries, maintaining fine-grained accuracy while reducing latency and computational cost. CoordFormer achieves state-of-the-art performance on MaSS13K and outperforms comparably sized and higher-parameter methods on DIS5K and KPIs, demonstrating its effectiveness for high-quality, very-high-resolution semantic segmentation.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Looking at very large, detailed images and labeling every part is hard because it needs a lot of computer power and can miss tiny details. The authors designed CoordFormer, a method that can label any exact spot in these images by combining detailed local features with a broad view of the whole image. This approach keeps the image sharp and detailed while using less memory and computing power. It also smartly focuses effort on edges where details matter most, speeding up the process without losing accuracy.
Open → 2609.08660v1

Pancreatic tumor segmentation improved by lightweight TRIUNE-Net model

TRIUNE-Net: Harmonizing Scale, Shape, and Efficiency in Pancreatic Tumor Segmentation

Abstract: Pancreatic tumor segmentation in 3D CT volumes is challenged by extreme scale variability across both the pancreas and tumor, and highly irregular tumor morphology. While recent advances have pushed segmentation performance, existing methods do not explicitly address these challenges and come at the cost of excessive computational complexity, limiting their practicality in resource-constrained clinical environments. We propose TRIUNE-Net, a lightweight unified architecture that harmonizes scale, shape, and efficiency through three synergistic innovations. A multi-scale context aggregation module with stage-adaptive dilated convolutions enables the model to reason across the broad range of anatomical scales present in both organs. A serial linear-deformable attention mechanism combines large effective receptive fields with shapeadaptive deformable convolutions to capture irregular, non-convex tumor morphologies. Finally, an information-preserving downsampling module replaces conventional max pooling entirely, retaining all spatial information while adding negligible parameters, preventing small tumors from being discarded before they can be recognized. On both the MSD Pancreas and NVD Pancreas datasets, TRIUNE-Net achieves state-of-theart results with only 5.86 M parameters and no external pre-training, outperforming all baselines across all key tumor metrics. Specifically, it surpasses the next-best model by 0.45% in tumor Dice, 6.0 points in F1 score, 6.6 points in sensitivity, and 3.4 points in precision, simultaneously reflecting its ability to suppress both missed tumors and false alarms in clinically realistic conditions. Our code is available at: https://github.com/abdora-ai/TRIUNE-Net

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Pancreatic tumors are tricky to spot and outline in 3D CT scans because both the pancreas and tumors vary greatly in size and shape. The authors created TRIUNE-Net, a new computer model that adapts to these wide ranges by looking at different scales and focusing on irregular tumor shapes. It also keeps all spatial details during image processing stages to avoid missing tiny tumors. Tests show TRIUNE-Net is better and more efficient than previous methods, helping reduce false positives and missed tumors without needing extra data to learn from.
Open → 2609.08303v1

Geodesic-informed model ensures shape consistency in image video generation

Geodesic-informed Generative Diffusion Model For Topology-preserved Image Video Generation

Abstract: Generative diffusion models have emerged as a class of powerful techniques for various imaging applications, including but not limited to synthesis, reconstruction, and segmentation. Despite their success, current generative models pose two key limitations. First, they primarily rely on image intensity and texture information, with limited attention to underlying object geometry. As a result, they do not guarantee geometric or topological consistency during the generation process, which is a crucial requirement for high-stakes domains such as computational anatomy, biology, and robotics, where preserving object structure is critical. Second, existing models fail to explicitly learn or represent shape changes in the generative process. Such deformation dynamics remain occluded within network parameters; hence leaving the transformation process uninterpretable and physically uninformed. To address these challenges, we introduce IGG (Image Generation informed by Geodesic dynamics), a novel framework that integrates topology-preserving geodesic principles into the diffusion-based generative process. In contrast to conventional methods that operate in image intensity space, IGG learns and synthesizes diverse samples within geodesic deformation spaces, where geometric object changes are learned as smooth and invertible smooth mappings from a given template/source image. Our code is publicly available at https://github.com/nellie689/IGG.

Tue 8 SeptMachine LearningComputer Vision and Pattern RecognitionGraphics
The gist
Creating new images or videos often changes important object shapes and structures in unpredictable ways. The authors developed a model that keeps the shape and structure consistent when generating image videos, by learning smooth transformations from a source image. This makes the generation process easier to understand and more reliable, especially for fields where preserving object shape is crucial, like biology or robotics.
Open → 2609.08153v1

MRI method improves 3D heart shape reconstruction from limited image slices

MRI-Guided Reslice-Refined Cross-Slice SDF Reconstruction of the Left Ventricle from Cardiac MRI with Sparse Axial Supervision

Abstract: Reconstructing a three-dimensional left-ventricular (LV) endocardial surface from cardiac magnetic resonance (CMR) data is challenging when supervision is available on only a small number of axial slices. Through-plane geometry is weakly constrained, and automatically generated two-dimensional masks can propagate segmentation errors into the recovered shape. We present MR-RS-SDFR, a per-case implicit signed distance field (SDF) framework that reconstructs a continuous LV surface from a CMR volume and sparse axial weak masks. The method first builds a cross-slice SDF initialization from axial and longitudinal geometric cues and then refines the field using two complementary signals: MRI edge-field normal alignment, which provides an image-derived boundary cue independent of the weak masks, and differentiable reslice Dice and contour consistency, which preserve agreement with the observed planes. We evaluate three weak-mask generators -- LOO TransUNet, LOO nnU-Net, and an off-the-shelf Medical SAM3 model used without MM-WHS-specific training or fine-tuning -- and five sparsity levels from 4 to 64 axial planes. In the sparse-16 setting, final MR-RS-SDFR reconstruction reaches 0.928 Dice and 3.80mm HD95 with Medical SAM3 masks. The upstream generators do not exhibit a single common ranking across 2D and dense 3D segmentation, and nnU-Net- and Medical-SAM3-driven sparse reconstruction achieve the same mean final Dice despite different upstream error profiles. Across all three sparse-16 mask sources, MR-RS-SDFR is numerically better than protocol-matched full GHD+DVS in both Dice and HD95. Final Dice improves markedly from sparse-4 to sparse-16 and then saturates at the reported precision through sparse-64. These results support MRI-guided per-case SDF refinement as a reconstruction strategy that remains effective across weak-mask generators and supervision densities.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Rebuilding a detailed 3D model of the heart’s left ventricle from MRI scans is hard when only a few cross-sectional images are clear. The authors developed a method that starts with rough guesses from the available images, then refines the heart’s shape using image boundaries and consistency checks, even when segmentation boundaries are imperfect. Their approach works well across different segmentation tools and various amounts of data, producing more accurate heart models from sparse information. This could help make heart imaging more reliable without needing many image slices.
Open → 2609.08148v1

Calibration improves shortcut learning in medical image classifiers

Prevalence calibration as shortcut mitigation

Abstract: Shortcut learning denotes the widespread situation in which a classifier exploits spurious correlations rather than diagnostic features. Existing mitigation strategies mostly aim to learn shortcut-invariant representations; their empirical success is limited and they cannot be applied to classifiers using frozen foundation model encoders. We propose to reframe shortcut learning as fundamentally a calibration problem: unconstrained learning implicitly calibrates each shortcut group to its training set disease prevalence, rendering the resulting classifier necessarily over-confident in one group and under-confident in the other. Building on this insight, we prevalence-equalize calibration between shortcut groups through two encoder-agnostic methods, an in-processing regularizer and a post-hoc prevalence-equalized recalibration step. Across chest-drain-pneumothorax benchmarks on CheXpert and SIIM-ACR, spanning fine-tuned CNNs and frozen foundation-model backbones, both methods substantially outperform all baselines. Post-hoc recalibration of a standard ERM-trained DenseNet raises misaligned-group AUROC from 0.23 to 0.73, indicating that shortcut reliance degrades the classification head rather than the underlying representation. Besides two new state-of-the-art shortcut mitigation approaches, our findings more fundamentally connect shortcut learning to calibration theory and algorithmic fairness.

Mon 7 SeptMachine LearningComputer Vision and Pattern Recognition
The gist
Sometimes computer programs that classify medical images learn to rely on shortcuts—like patterns that are not truly related to the disease but happen to appear in certain groups of images. This leads to mistakes when the program sees new types of images. The paper shows that these shortcuts are linked to how confident the program feels about these groups, which is called calibration. The authors propose ways to fix this calibration so the program treats all groups more fairly, which improves its ability to correctly detect diseases.
Open → 2609.07922v1

Latent to latent flow boosts efficiency in 3d medical image segmentation

Latent-to-Latent Flow for Volumetric Stochastic Segmentation

Abstract: Uncertainty arising from inter-observer variability in medical image segmentation plays an important role in developing treatment plans. Research in this area is inhibited by the lack of multiple annotations for large-scale medical datasets, especially for volumetric data, which suffers from additional scaling and computational complexity challenges. Flow matching has emerged as a powerful framework for generative modelling and has also been demonstrated to maintain strong performance when working with latent representations of images. In this work, we introduce a latent-to-latent flow technique for stochastic segmentation of medical volumes via encoded representations of both the image and label space. We evaluate our method on two challenging applications covering delineation uncertainty for radiotherapy planning and multiple organ structure segmentation, improving efficiency up to 14x compared with full resolution models while maintaining clinically relevant performance.

Mon 7 SeptComputer Vision and Pattern RecognitionArtificial IntelligenceMachine Learning
The gist
Medical images often have differences in how experts mark important areas, and this uncertainty affects treatment decisions. The authors present a new technique that works with simpler, encoded versions of these images to predict different possible segmentations efficiently. Their method speeds up the processing by up to fourteen times without losing important accuracy, helping with tasks like planning radiation therapy and identifying organs. This approach makes handling complex 3D medical images more practical.
Open → 2609.07460v1

Kidney tumor detection improves with weak labels and anatomy filtering

Weakly-supervised Kidney Tumor Classification from CT Scans with Multi-Instance Learning and Anatomical Filtering

Abstract: Deep learning models for CT scan analysis are often limited by the scarcity of precise pixel-level annotations, which require significant radiologist effort to produce. Training on scan-level labels alone reduces annotation requirements but introduces challenges: low supervision ratios and large input volumes make models prone to overfitting and shortcut learning. In this work, we investigate two complementary methods to address these challenges: multi-instance learning (MIL) and anatomical filtering. MIL divides CT volumes into 2D slice instances, enabling efficient 2D architectures with ImageNet pretraining rather than computationally demanding 3D models. Anatomical filtering uses Compass, our self-supervised body part regression model, to crop scans to pathology-relevant subregions without requiring segmentation masks. We evaluate two MIL frameworks - Attention-based MIL (ABMIL) and FocusMIL - on kidney tumor classification across one internal dataset (TUH) and two external datasets (KiTS23 and TCGA-KiRC). Our best models achieve F1 = 0.83 on the internal test set using only scan-level labels. We further show that anatomical filtering with the Compass model is critical for the out-of-distribution generalization of embedding-based ABMIL, while instance-based FocusMIL demonstrates greater inherent robustness to distribution shift. While evaluated on kidney tumors, we consider this a proof-of-concept for a broader weakly supervised CT classification pipeline applicable to other organs and pathologies.

Mon 7 SeptComputer Vision and Pattern Recognition
The gist
Getting detailed labels for CT scans is hard and takes a lot of effort from doctors. The authors show that using only broad labels about a whole scan, combined with smart methods that look at parts of the scan individually and use knowledge about body regions, can still successfully identify kidney tumors. They tested these methods on multiple datasets and found they work well even when scans come from different sources. This approach might also work for detecting problems in other organs.
Open → 2609.07178v1

Quantum walk simulates X-ray scattering for better imaging

QCxSimulation: Scatter-Aware X-Ray Projection Radiography via Discrete-Time Quantum Walks

Abstract: X-ray projection radiography is a non-invasive imaging technique used in medical diagnostics and industrial inspection. The simulation of X-ray projections is commonly used to optimise acquisition protocols and improve image quality before performing costly scans. Classical photon transport simulations that include realistic X-ray scattering physics are computationally expensive because they require the sampling of a large number of distinct scattering paths. This limits the practical exploration of parameter spaces such as beam energy. Quantum computing offers the potential to solve high-dimensional problems faster by making use of quantum properties such as superposition. This work introduces a discrete-time quantum walk algorithm that simulates the transport of X-ray photons through heterogeneous volumes. It approximates the physics of X-ray projection radiography, including processes such as photoelectric absorption and higher-order scattering, including Compton and Rayleigh scattering. The quantum walk encodes all admissible photon paths into a single quantum state, enabling all scattering histories to be propagated simultaneously via the superposition principle. This quantum state representation enables flexible readout of various imaging modalities, including the primary, i.e., unscattered, image, or images exclusively containing Rayleigh and Compton scattering of specified orders. A quantitative comparison with classically computed reference simulations shows that the proposed quantum walk accurately reproduces radiographic projections, given the limitations of the underlying physical model. These results indicate that quantum circuits for X-ray transport can produce accurate radiographic images and imply that, as quantum hardware scales up, these algorithms could outperform classical Monte Carlo-based approaches in large-scale, scatter-aware virtual imaging studies.

Mon 7 SeptEmerging Technologies
The gist
Simulating how X-ray photons move and scatter inside objects is usually slow and expensive on regular computers. The authors develop a special quantum computing algorithm that can represent many possible photon paths at once, speeding up the simulation. Their method can mimic different types of X-ray interactions important for producing medical and industrial images. Tests show their quantum approach creates images that closely match classical simulations, hinting that future quantum hardware could do this faster and more efficiently.
Open → 2609.07089v1

Concept guided model improves lung lesion segmentation accuracy

CGSM: Concept-Guided Segmentation Model for Precise Pulmonary Lesion Delineation

Abstract: Accurate segmentation of pulmonary lesions is essential for effective clinical diagnosis and treatment strategies. Existing segmentation approaches often lack task-specific semantic guidance, as text-based annotations typically offer coarse localization of lesions, leading to inadequate delineation of lesion boundaries and poor performance on small-scale lesions. To address this, we propose CGSM, a Concept-Guided Segmentation Model that integrates LLM-generated and clinically reviewed concepts into the segmentation process. Specifically, we design a Concept-Visual Alignment Module (CVAM) to activate relevant tokens within the concepts that align with visual features, enhancing the interaction between textual and visual information. In addition, we introduce a Concept Modulated Decoder (CM-Decoder), which uses concepts from CVAM as modulation signals to facilitate the adaptive fusion of image and text features, improving the segmentation accuracy. Extensive experiments on two public datasets show that CGSM achieves state-of-the-art performance, with results of 91.59% Dice and 84.49% mIoU on the QaTa-COV19 dataset, demonstrating its effectiveness in pulmonary lesion segmentation.

Mon 7 SeptComputer Vision and Pattern Recognition
The gist
Identifying lung lesions accurately in medical images is important for diagnosis and treatment, but existing methods often miss fine details or struggle with small lesions. The authors propose a new approach called CGSM that uses concepts generated by large language models and reviewed by experts to guide the segmentation process. This method combines text and image information more effectively to outline lesions precisely. Tests on public datasets show CGSM performs better than previous models in detecting lung lesions.
Open → 2609.07004v1