Improving classification accuracy with combined missing data imputation

Integrated Imputation-Classification for Supervised Learning with Missing Data

Machine Learning

Summary

When some information is missing from data used to teach computers to recognize things, it's hard for the computer to make good guesses. The researchers came up with a new way for the computer to fill in missing details and decide what the data represents at the same time. They trained two parts together so that one fills in gaps while the other guesses the right answer, helping them both improve. Their method works better than older ways on various image and table data with missing pieces.

What this means in practice

  • For data science teams: Build classifiers that handle missing features more accurately by integrating imputation during model training for real-world datasets.
  • For medical data analysts: Improve diagnosis predictions from incomplete health records by jointly modeling missing data imputation and classification.

Authors

Yue Liu, Ben Liang, Ali Tizghadam, Ilijc Albanese

Abstract

We study supervised classification problems with missing feature values. Existing approaches often decouple imputation from classification, producing imputations that may be plausible but uninformative for prediction. Instead, we propose the Integrated Imputation and Classification Network (IICN), which jointly trains an imputer and an ${(n{+}1)}$-classdiscriminator adversarially with a single class supervised classification objective, where the discriminator learns to distinguish among the $n$ true classes and an additional ``imputed" class. We prove that at the global optimum, the imputer and discriminator together implement marginalization over missing coordinates and yield a Bayes-optimal classifier. We evaluate IICN on FashionMNIST, CIFAR-10, and tabular datasets with naturally occurring missingness. IICN outperforms classical impute-then-classify pipelines and recent generative baselines, showing strong robustness and accuracy in challenging settings.