Framework improves pathology image quality filtering and segmentation accuracy

Agent-Driven Generative Priors for Pathology Image Synthesis and Segmentation

Computer Vision and Pattern Recognition

Summary

Pathology images, which help doctors understand diseases, are hard to label in detail because it takes a lot of expert work. The authors built a system that first selects high-quality pathology image patches from a large public database, then trains a model to both generate similar images and learn useful features. Finally, they adapt this model to identify and label different types of cells in images, achieving very good results. They also created a large dataset with expert-marked cell types for this purpose.

What this means in practice

  • For medical image analysts: Use a framework to filter large histopathology image collections and improve cell segmentation models for disease research.
  • For digital pathology platform developers: Integrate a generative backbone pretrained on high-quality pathology data to enhance cell detection features in diagnostic tools.$Commercial implications: Enables more accurate and scalable automated pathology diagnostics software by leveraging pretrained image priors.

Authors

Sicheng Yang, Rui Tang, Haipeng Zhou, Hongqiu Wang, Zhaohu Xing, Jianda Ma, Lie Dai, Guang Yang, Lei Zhu

Abstract

Deep learning methods for pathology are constrained by the limited availability and high cost of large-scale pixel-level annotations. Synthetic data can alleviate this limitation, but existing pipelines often lack reliable quality control and remain weakly connected to downstream analysis. To address these issues, we propose a three-stage framework that integrates automated data screening, generative representation learning, and efficient adaptation to downstream tasks. First, we develop a pathology agent system to assess image quality and filter samples, resulting in TCGA-200K, a dataset containing 217,030 pathology patches selected from the public TCGA repository. Second, we train a generative model on the screened data. In addition to image synthesis, its backbone learns structural and semantic representations that can be transferred to downstream tasks. Third, we adapt the pretrained generative backbone to semantic segmentation using a lightweight task-specific head. We further introduce PathSeg-380K, a semantic segmentation dataset with expert annotations for approximately 380,000 cells across 12 cell types. Experiments on multiple pathology datasets show that the proposed framework achieves state-of-the-art segmentation performance. Our code is publicly available at https://github.com/script-Yang/Agent-GenPath.