Papers for

medical imaging researchers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Volumetric model improves abdominal tumor segmentation using reports

RepConTUR: A Report-Conditioned Volumetric Multimodal Model for Abdominal Tumor Segmentation

Abstract: Tumor delineation is required for radiotherapy planning, yet automatic segmentation is limited by errors, predominantly false positives, that distort dose and increase editing time. The radiology report accompanies the scan and localizes disease at the suborgan level, but existing text-promptable models condition on short referring phrases, and most operate in 2D. We present RepConTUR, a single native-3D early-fusion multimodal model that conditions volumetric abdominal tumor segmentation on the narrative report. We extend AbdomenAtlas 3.0 to a suborgan-level promptable segmentation dataset and generate report-based VQA pairs, yielding four report-derived tasks on the same annotations: referring segmentation (RES), report-grounded segmentation (GSEG), report generation (RRG), and visual question answering (VQA). We train RepConTUR, comprising a 3D CT encoder, an early-fusion language model, and a native-3D segmentation module, jointly on the four tasks. Across liver, kidney and pancreas, RepConTUR attains the highest Dice similarity coefficient (DSC), instance-wise precision, and detection F1 among the text-promptable baselines, and adding the report raises mean precision while leaving recall comparable. Against two vision-only specialists, nnU-Net and the report-supervised R-Super, RepConTUR attains the highest value on every in-domain metric for liver and pancreas and the highest mean DSC, recall, precision, and detection F1 over the four out-of-distribution public cohorts. Ablations indicate that conditioning on the narrative report raises detection F1 from 0.499 to 0.528 within the same model, that joint GSEG training raises RES F1 from 0.450 to 0.482, and that the native-3D segmentation module raises GSEG F1 from 0.139 to 0.528 over its 2D counterpart. Code is available at https://github.com/Oncosoft-Research/RepConTUR.

Thu 29 OctComputer Vision and Pattern Recognition
The gist
Correctly outlining tumors in scans is important for planning treatments but automatic tools often make mistakes by marking wrong areas. The authors developed a new 3D computer model called RepConTUR that uses the text written by doctors about the scan to better find tumors in organs like the liver, kidney, and pancreas. Their approach combines the detailed CT scan images with the narrative reports to segment tumors more accurately compared to existing methods. They also created new tasks and data that help train and measure this combined image-and-text understanding.
Open → 2610.40094v1

Hypergraph learning improves particle event reconstruction accuracy

Comprehensive reconstruction of collider events with hypergraph representation learning and graph-conditioned diffusion

Abstract: In particle collider experiments, event reconstruction is the task of inferring the kinematics of short-lived particles produced in the hard scatter from the stable final states recorded by detectors. We decompose event reconstruction into two primary tasks: assigning measured jets and charged leptons to parent particles, and predicting unmeasured neutrino kinematics. We present VyPER, a novel geometric learning framework that represents collider events as hypergraphs with a physics-inspired topology. VyPER combines the supervised classification of hyperedges for particle assignment with a diffusion model for predicting neutrino kinematics, leveraging a joint loss function to optimize both reconstruction tasks within a unified framework. We showcase VyPER across several proton-proton collision processes, comparing its performance to existing analytical and machine-learning-based reconstruction techniques. In doing so, we demonstrate that accurate event reconstruction is achievable across a diverse range of Standard Model physics processes, opening new avenues for precision measurements in the Higgs boson, electroweak, and top-quark sectors.

Wed 16 SeptMachine Learning
The gist
Reconstructing particle collisions means figuring out how particles created in high-energy experiments behaved before they disappeared. The authors break this task into two parts: matching detected particle signals to their original particles and guessing unseen neutrino behaviors. They introduce VyPER, which uses a special kind of network model called a hypergraph combined with a diffusion method to do both tasks together better than previous approaches. This improves understanding of events in proton collisions and helps with precise measurements in important physics areas.
Open → 2609.18928v1

Deep learning model segments and classifies particle decays efficiently

ResoSeg: Resonance Tagger using Transformer and Segment Model

Abstract: Deep learning has been widely applied across many areas of experimental high-energy physics, yet existing models address only event-level classification or object tagging and therefore still require reconstruction algorithms tailored to each decay channel. We present the first application of segmentation to resonance tagging at BESIII and introduce ResoSeg, a deep learning model that jointly performs particle-level segmentation and event-level classification, enabling a one-pass analysis of resonance to anything decays while precisely reconstructing the relevant resonance properties. We demonstrate the reconstruction of $η_c$ with $e^+e^-\toπ^+π^-h_c$, $h_c\toγη_c$, $η_c\to\text{anything}$. The model is trained on BESIII-$η_c$ dataset, which is constructed with per-track true labels obtained via a Truth-Matching Algorithm. Experimental results show that the average combined efficiency of ResoSeg is more than double that of the conventional 16-channel approach across energy points from 4.19 to 4.60\,GeV. The model generalizes to unseen energy points, adapts to other $η_c$ production modes through transfer learning, and remains robust against variations in the $η_c$ mass, width, and branching fractions, providing a general, resonance-aware model applicable beyond $η_c$ and BESIII. The source code is available at https://github.com/oashen/ResoSeg.

Fri 11 SeptArtificial Intelligence
The gist
The paper addresses a challenge in particle physics where scientists study particles that decay into many different things. The authors present ResoSeg, a deep learning model that can look at all the pieces from a particle collision and both separate each particle's tracks and recognize which particle resonance they came from. This approach works faster and more accurately than previous methods that needed multiple steps and specific setups for each type of decay. The model also adapts well to different energy conditions and particle types, making it broadly useful in particle experiments.
Open → 2609.12610v1