Tissue-aware deep learning improves nuclei segmentation in cancer images
TCINet: Tissue-Conditioned Adaptive Cross-Branch Interaction Network for Nuclei Instance Segmentation
Computer Vision and Pattern Recognition
Summary
Distinguishing touching cell nuclei and identifying their types in microscope images is tricky because it needs both detailed edges and broader cell shape information, which also change depending on the tissue. The authors created a new AI model called TCINet that adapts its tasks based on the tissue type and handles these challenges simultaneously. Their approach improves accuracy in segmenting and classifying nuclei on a large dataset and even works well when tested on images it was not trained on. This model uses special components to share and adapt information between different prediction tasks based on tissue conditions.
What this means in practice
- •For medical image analysis teams: Improve automated segmentation and classification of cell nuclei in histology images tailored to specific tissue environments.
- •For digital pathology platform developers: Integrate tissue-conditioned multi-task models to enhance diagnostic tools by providing more accurate cell segmentation and typing.$Commercial implications: Enables development of advanced pathology software that offers better automated cell analysis for clinical and research laboratories.
Authors
Zhenghang Qian, Yang Liu, Yanzhi Yu, Peiwu Qin, Yibing Shen, Joongwon Chae, Lihui Luo, Zhongde Zhang, Jianwen Guo, Lianshun Jin
Abstract
Separating touching nuclei requires local boundary detail, while cell type classification requires broader morphological context. These requirements also vary with the surrounding tissue environment. We propose the Tissue-Conditioned Adaptive Cross-Branch Interaction Network (TCINet), a single-stage model with Task-Specific Feature Adapters (TSFA) and Tissue-Conditioned Task-Aware Cross-Branch Interaction (TC-TACBI). TSFA produces branch-specific features at skip connections, and TC-TACBI controls three asymmetric paths among nucleus-presence (NP), horizontal-vertical (HV), and nucleus-type (NT) branches using predicted tissue probabilities. On PanNuke under standard three-fold cross-validation, TCINet achieves multiclass and binary panoptic quality scores of 0.519 and 0.692, respectively. Zero-shot tests on MoNuSeg yield a detection F1 score of 0.876. On PanNuke fold 0, adding TC-TACBI increases mPQ from 0.505 to 0.525. Code is available at https://github.com/celestial1321/TCINet.