Clinical concept embeddings improve hospital outcome predictions
HCOE: Hyperbolic Clinical Ontology Embeddings from Biomedical Language Models
Artificial IntelligenceMachine Learning
Summary
Medical codes used in health records are organized in hierarchies, but many computer models do not use these relationships explicitly. The authors created a method called HCOE that combines medical language understanding with mathematical shapes that better reflect these hierarchies. This approach helps computers better predict patient outcomes like mortality and readmission, as well as recommend medications. The research shows that including code hierarchies makes clinical predictions more accurate.
What this means in practice
- •For hospital data teams: Improve patient risk prediction models by integrating clinical code hierarchies with language embeddings for better outcome forecasting.
- •For clinical decision support developers: Enhance medication recommendation systems using hierarchy-aware concept embeddings informed by biomedical classifications and language models.
Authors
Yixuan Li, Weihao Li, Ziyang Song
Abstract
Biomedical language models (LMs) encode textual semantics but do not explicitly preserve medical code hierarchies. We present Hyperbolic Clinical Ontology Embeddings (HCOE) for hierarchy-aware clinical concept representation. HCOE maps frozen BioBERT embeddings into a Poincare ball, combining parent-side and child-side ontology-guided contrastive learning with coarse-to-fine ontology-path aggregation. It uses International Classification of Diseases (ICD) codes organized by Clinical Classifications Software (CCS) and Anatomical Therapeutic Chemical (ATC) medication hierarchies. Evaluations show that HCOE performs best on ICD/ATC clinical relation prediction and CCS-to-PheCode hierarchy transfer. On the MIMIC-IV dataset, HCOE also achieves the best performance on mortality prediction, readmission prediction, medication recommendation, and rare drug prediction.