Multimodal approach improves Alzheimer's diagnosis with missing data handling

CoPoE: Multimodal Fusion via Decomposable Disease-Coordinate Product-of-Experts for Missing-Modality Alzheimer's Diagnosis

Machine LearningComputer Vision and Pattern Recognition

Summary

Diagnosing Alzheimer's disease can use different types of medical data, like brain scans, genetics, and clinical tests. However, often some of this data is missing for patients, which makes diagnosis harder. The authors created CoPoE, a method that can combine whatever data is available without trying to guess the missing parts. This new way better predicts Alzheimer's and gives clearer insights into different biological processes involved in the disease.

What this means in practice

  • For hospital data teams: Improve Alzheimer's diagnostic systems by integrating various patient data types robustly even when some inputs are missing.
  • For medical imaging analysts: Enhance interpretation of complex imaging and biological signals by mapping them into distinct disease-related factors.

Authors

Chihun An, Ikbeom Jang

Abstract

Multimodal Alzheimer's disease (AD) diagnosis benefits from integrating heterogeneous clinical, imaging, genomic, and biomarker evidence, but clinical cohorts frequently suffer from irregular modality missingness. Existing fusion methods often synthesize absent inputs, risking the introduction of artificial surrogates, or pool available signals into uninterpretable latent spaces. We present CoPoE (Disease-Coordinate Product-of-Experts), a disease-coordinate framework that maps multimodal evidence into a structured latent space partitioned into four distinct biological and clinical axes: genetic Risk, molecular Pathology, Neurodegeneration, and clinical Stage (R/P/N/S). Each observed modality parameterizes a diagonal Gaussian expert over the full RPNS vector, and a masked Product-of-Experts architecture fuses only the available modalities. Consequently, absent modalities add no factor to the fusion path, allowing the network to preserve a robust, decomposable posterior for any non-empty modality subset without synthetic imputation in the RPNS path. Through extensive missing-modality experiments on the ADNI dataset, CoPoE achieves the best all-modality performance and the highest mean AUROC across all 15 observed-subset evaluations among standardized missing-modality fusion baselines under a shared non-PET ADNI embedding benchmark, while substantially improving raw-probability ECE, Brier score, and NLL. Furthermore, PET-supervised probing shows evidence enrichment within the pathology (P) block under full modalities, with tau-related signal retained even when direct fluid biospecimen inputs are withheld. Our code is available at https://github.com/labhai/CoPoE.