Fisher contrastive learning improves leukemia diagnosis image analysis
Fisher Contrastive Learning to Mitigate Feature Suppression: A Case Study in Acute Promyelocytic Leukemia Diagnosis
Machine Learning
Summary
Machine learning can struggle when some features dominate and hide others important for identifying diseases. The authors introduce Fisher Contrastive Learning, a technique that helps the model focus on the right signals by balancing features better. They show this method works well on test data and improves diagnosis of acute promyelocytic leukemia from microscope images. This approach produces clearer and more useful representations of complex data.
What this means in practice
- •For medical image analysts: Develop more accurate leukemia diagnostic tools by pretraining on large blood cell image datasets to improve feature detection.
- •For machine learning engineers: Improve self-supervised learning models for complex high-dimensional data by mitigating feature suppression effects during training.
Authors
Shushan Wu, Yongkai Chen, Xilin Gong, Yufang Liu, Wenxuan Zhong, Ping Ma
Abstract
Self-supervised contrastive learning (SSCL) learns representations by contrasting augmented views of the same sample, but it can exhibit feature suppression, where dominant or easy-to-learn factors suppress other class-relevant signals, degrading the performance of representations, particularly in high-dimensional data with heterogeneous features. We introduce Fisher Contrastive Learning (FCL), which uses a regularized Fisher trace criterion to address feature suppression. FCL learns embeddings by maximizing the discriminative strength of Fisher discriminant functions, producing representations that preserve class-relevant information implied by the augmentation process. We prove that the representations learned by FCL could alleviate the feature suppression effects. We demonstrate FCL on simulated benchmarks designed to induce feature suppression and on a real-world biomedical application, pretraining on large white blood cell microscopy image dataset and transfer learning for diagnosis of acute promyelocytic leukemia in an external cohort. In all experiments, FCL outperforms the self-supervised baselines and yields more robust and discriminative representations.