Papers for

clinical data scientists

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Explainable deep models reveal when patient data shapes survival predictions

DynSHAP: Towards Explainable Dynamic Survival Analysis

Abstract: Deep learning models for dynamic survival analysis (DSA) achieve strong predictive performance by incorporating longitudinal patient data, but their black box nature limits clinical trust and adoption. Existing explainability methods cannot handle longitudinal, irregular inputs and functional survival outputs simultaneously, which limits their usability in DSA. We propose DynSHAP, a SHAP framework suited specifically for dynamic survival analysis. It extends common marginal SHAP estimators to this setting by treating time--feature pairs as players in the Shapley game. We further introduce Temporal DynSHAP, which learns linear dependencies in features over time and uses conditional sampling to address them in explanations. When applied to synthetic data with known ground-truth attributions, Temporal DynSHAP recovers temporally dependent features more accurately than marginal estimators for a given state-of-the-art model. Applied to two real-world clinical datasets and two DSA architectures, DynSHAP produces attributions faithful to model learning, allowing medical experts to see which patient information drove the prediction and when.

Fri 11 SeptMachine LearningArtificial Intelligence
The gist
Predicting how long patients will survive based on medical data is important but can be hard to understand because models are complex. The authors created DynSHAP to explain which parts of patient records influence these predictions over time. Their approach works better than earlier methods in showing how different patient features at different times matter. This helps doctors see why a model made a specific prediction and when, improving trust in these tools.
Open 2609.13042v1

Training models for clinical decisions improves some but not all predictions

Optimizing for the decision not the prediction: an exploration of Smooth Net Benefit as a training objective

Abstract: Objective Prediction models are commonly trained using objectives such as Bernoulli negative log-likelihood (NLL), although downstream clinical decisions may depend on specific risk thresholds. We introduce Smooth Net Benefit ($σ$NB), a differentiable approximation of Net Benefit designed to align model training with threshold-specific clinical utility. Materials and Methods We evaluated $σ$NB as a training objective for logistic regression, generalized additive models (GAMs), and XGBoost with three Hessian implementations. Experiments used the Framingham cardiovascular risk dataset and 44 TabZilla datasets comprising 72 dataset-threshold combinations. Results $σ$NB training did not consistently improve Net Benefit in Framingham. Across the TabZilla benchmark, mean standardized Net Benefit for logistic regression increased from 0.5669 with NLL to 0.5765 with $σ$NB (mean difference 0.0096, 95% CI -0.0001 to 0.0193). For GAMs, mean standardized Net Benefit decreased from 0.5921 to 0.5625 (mean difference -0.0296, 95% CI -0.0721 to 0.0129). For XGBoost, NLL achieved 0.6745 compared with 0.6723--0.6735 across $σ$NB implementations. In logistic regression, $σ$NB gains were positively associated with the performance advantage of XGBoost over NLL-trained logistic regression. Discussion The effect of $σ$NB was context dependent, with modest gains concentrated in logistic regression and little benefit for more flexible model classes. This suggests that decision-focused optimization may be most useful when limited model flexibility leaves greater scope for improvement. Conclusion Our results do not support $σ$NB as a general replacement for NLL training, but support further investigation of decision-focused objectives in settings where conventional likelihood-based training may not adequately capture decision-relevant structure.

Fri 11 SeptMachine Learning
The gist
Prediction models in healthcare are usually trained to guess risks accurately, but decisions often depend on specific risk cutoffs. The authors created a new way to train models that focuses on these decision points instead of just prediction accuracy. They tested it with different models and found modest improvements mainly for simpler models, but no consistent benefits for more flexible ones. This suggests the new approach might help when models are limited in how well they can fit data.
Open 2609.12752v1

LLMs help clinicians judge equations from symbolic regression

LLMs as Post-hoc Auditors of Physiological Plausibility in Symbolic Regression: A Clinician-Evaluated Case Study

Abstract: Genetic Programming and its variants, such as grammatical evolution, are widely used in Symbolic Regression to derive mathematical expressions from multivariate data. In addition to predictive accuracy, models are appreciated for their potential to provide interpretability, offering explicit equations that relate input variables to outcomes. However, achieving interpretability and plausibility remains challenging, as evolved models may be complex or scientifically inconsistent. In this study, we explore whether Large Language Models, can assist in improving the explainability of Symbolic Regression models generated by evolutionary computation methods. Building upon our previous work on estimating body fat percentage using grammar-based Genetic Programming , we investigate the use of LLMs as post-processing tools to analyze and rank evolved expressions according to their interpretability and medical plausibility. Four symbolic expressions are analysed by three LLMs over three repeated runs, and the resulting interpretations and rankings are assessed by a panel of three clinicians. Across the three LLMs, comparative model-ranking outputs received more favorable clinician assessments than isolated term-level interpretations. However, the LLMs also produced physiologically and mathematically questionable explanations, indicating that they are better suited to comparative auditing under expert oversight than to autonomous validation.\blfootnote{The present work is an extended version of a paper submitted into a journal.

Thu 10 SeptArtificial Intelligence
The gist
Finding simple, understandable formulas from complex health data is very useful but can be tricky because some formulas can be too complicated or not make sense medically. The authors studied if language AI models can help doctors by reviewing and comparing these formulas to see which ones make more sense for predicting body fat. They found that AI models are better at comparing different formulas than explaining each part perfectly. However, doctors still need to check the AI’s work because it can sometimes give wrong or confusing ideas.
Open 2609.11431v1

Deep learning predicts patient drug responses from single cell data

scDEFT: A deep learning framework for drug-effect prediction and counterfactual reasoning

Abstract: Longitudinal single cell atlases now capture matched pre treatment and post treatment states from responders and non responders, presenting an opportunity to mechanistically explain why two patients on the same drug diverge. We introduce scDEFT (single cell Drug EFfect Transducer), which treats a drug as a conditioning operator on cell representations, enabling prediction and explanation. In scDEFT, feature wise linear modulation produces drug conditioned cell latents, learned under abundant per cell supervision and then frozen. Two independent heads aggregate those latents over shared transcriptional neighborhoods to predict drug induced state change and responder status. A backward stage ranks the latent dimensions by how strongly they separate responders from non responders and maps them to genes under a cell composition control. On a harmonized inflammatory bowel disease atlas of 1.16 million cells, three cohorts and two drug classes, scDEFT predicts state change at 45% of the baseline to reproducibility ceiling headroom and stratifies responders before treatment at AUROC 0.70, where standard predictors remain at chance. These predictions and the drivers behind them support target and co target nomination, patient stratification, and counterfactual prediction of unseen drug cohort effects.

Wed 9 SeptMachine Learning
The gist
Treatments can affect patients differently, and understanding why is important for better medicine. The authors introduce scDEFT, a deep learning tool that learns how drugs change individual cells, helping predict how patients will respond before treatment. It uses large datasets of millions of cells and recognizes patterns that standard methods miss. This helps suggest which treatments or targets might work best for different patients and can even imagine effects from new drug combinations.
Open 2609.10831v1

Language aligned model improves gait severity estimates across clinical sites

3rd Place Solution to Human Motion Challenges in Real-World and Clinical Settings (MoCha) @ECCV2026: Language-Aligned Motion Representations for Domain-Generalizable UPDRS-Gait Severity Estimation

Abstract: In this work, we introduce language-aligned motion representations for domain-generalizable UPDRS-Gait severity estimation, aiming to learn semantically structured motion features that generalize across heterogeneous clinical domains. We first learn motion representations using a Bi-GRU backbone that captures the temporal dynamics of SMPL sequences. Prior to model training, motion captions are generated offline using Qwen2.5-7B-Instruct. The backbone is then trained with both classification and text-alignment objectives to learn discriminative and semantically structured motion representations while accounting for the class imbalance present in the training data. We subsequently adapt the learned backbone independently to each source domain so that the model can capture domain-specific motion characteristics. The resulting source-specific models are then merged at the parameter level to consolidate complementary knowledge across source domains into a single domain-generalized model. To further mitigate class imbalance, we perform GPT-5.5-based pseudo labeling, and our final merged models for each site do not use any class-prior correction during inference. The resulting model is evaluated under the unseen-site setting of the MoCha Challenge, using Macro F1 as the primary evaluation metric. Our method achieves a macro-F1 of 0.57 on the hidden test set with only 637K active parameters at inference, ranking 3rd among 58 leaderboard entries in the MoCha 2026 Challenge. The challenge attracted 1,669 submissions from 112 participants and offered monetary prizes sponsored by Machine Medicine Technologies.

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
Measuring how severe a person's gait problems are, especially for diseases like Parkinson's, is important but hard to do well in many different clinics. The authors created a new method that uses computer analysis of motion combined with language descriptions to better understand and compare walking patterns. They trained a model that learns from text descriptions of movements and adapts to different clinic settings, improving its accuracy across sites it hasn't seen before. This approach ranked third in a major challenge focused on real-world clinical gait assessment.
Open 2609.10187v1

Estimating sample size for machine learning using local linear models

A Statistical Approach to Estimating Sample Size of Machine Learning Models

Abstract: Sample size determination for machine learning (ML) prediction models is challenging because conventional power analysis typically requires the predictor-outcome relationship and effect structure to be specified a priori. Nonlinear ML models learn complex prediction surfaces that do not admit straightforward analytical power calculations. We propose a framework that approximates nonlinear ML models with localized linear representations and estimates sample size requirements by evaluating statistical power across these local regions.

Wed 9 SeptMachine LearningArtificial Intelligence
The gist
Figuring out how much data is needed to train machine learning models is tricky because traditional methods require knowing details about how inputs relate to outcomes beforehand. Many machine learning models are complex and don’t fit simple formulas, making those methods unusable. The authors offer a new way to estimate sample size by breaking down complex models into simpler pieces that look like straight lines in small areas. This lets them check how much data is needed in each piece and combine the results to get an overall estimate.
Open 2609.09547v1

Attributing disease effects in age prediction models to training data samples

Attributing Cohen's d: Training Data Attribution for Disease-Related Effects in Normative Age Biomarkers

Abstract: Normative age models are trained to predict chronological age in a nominally healthy cohort. Applied to patients, they deviate, and the gap between predicted and chronological age is read as disease risk. Here, we attribute the disease-related effect size of the age gap directly to individual training samples, rather than using a prediction-level loss as the attribution target. For Cohen's $d$, the resulting closed-form influence functional, validated against leave-one-out retraining, ranks training samples by their effect on held-out case-control separation. Across four diseases and two biomarker modalities in UK Biobank, removing the 10% most influential training samples raises held-out disease-related effect size in every seed. It more than doubles the metabolomic-age effect for type-2 diabetes and raises the brain-age effect for multiple sclerosis by roughly a third. Random removal leaves effect size flat even at 50% removal, confirming the gain comes from which samples are removed, not how many. Flagged subjects carry subclinical cardiometabolic burden that diagnosis-based exclusion misses, on markers the model never sees. For type-2 diabetes, where the method gains most, the marker recovered is HbA1c, the standard measure of blood sugar control. We release pyinfluence, our influence-function package, for reproducibility and reuse.

Mon 7 SeptMachine Learning
The gist
Age prediction models learn to estimate a person’s age based on healthy people’s data. When these models are used on patients, the difference between predicted and actual age hints at disease effects. The authors develop a way to find which specific training data samples influence this disease-related age difference the most. Removing the most influential samples surprisingly increases the model’s ability to detect disease effects. They also provide software so others can apply their method.
Open 2609.07729v1