Summary
Understanding detailed patient information in medical articles is hard because many patients and complex descriptions appear together. The authors organized a challenge called CHIP 2026 to improve how computers find and link phenotype information to specific patients in full biomedical texts. They used a dataset with many articles, patients, and noted phenotype details. Many teams joined and tried different approaches using advanced language models, and the best systems were notably better than the baseline. The results show progress but also highlight there are still challenges in accurately linking phenotypes to the right patients in long medical texts.
What this means in practice
- •For healthcare informatics teams: Improve diagnosis tools by automatically identifying detailed patient symptoms from full-text medical articles linking symptoms to specific patients.
- •For biomedical data engineers: Enhance biomedical databases with automated extraction and linking of phenotype information to patients from complex full-text documents.
Authors
Xuanlyu Zhu, Feng Tian, Yang Zhong, Pengqi Zheng, Xiwen Bi, Ling Luo, Yuanyuan Sun, Jian Wang, Lingfei Lin
Abstract
Automatic phenotype information extraction plays an important role in rare disease diagnosis, genotype-phenotype analysis, and precision medicine. However, accurately identifying phenotype concepts and determining their associations with specific patients remain challenging, particularly in full-text biomedical articles involving multiple patients and complex clinical descriptions. This paper presents an overview of CHIP 2026 Shared Task 1, which aims to promote the development of methods for patient-specific phenotype concept recognition from full-text biomedical literature. The task consists of two subtasks: full-text phenotype concept recognition and patient-specific phenotype association. For this evaluation, we used 200 annotated full-text biomedical articles from the PatientPheX dataset, containing 506 patients, 15,193 phenotype mentions, and 5,656 patient-phenotype associations. A total of 455 teams registered for the competition, with 189 and 103 valid submissions received on the Phase A and Phase B leaderboards, respectively. The best-performing system achieved an overall score of 0.7389 on the final test set, outperforming the baseline by 8.37 percentage points. The top-performing teams explored diverse approaches combining biomedical language models, large language models (LLMs), and ensemble strategies. The evaluation results highlight both the potential of these approaches and the remaining challenges in patient attribution and phenotype normalization from full-text biomedical literature. The post-evaluation phase remains open at https://tianchi.aliyun.com/competition/entrance/532512.