Papers for

biotech imaging teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

MicroCLIP matches text with microscopy images for cell analysis

MicroCLIP: Connecting Text and Microscopy Images via Contrastive Language--Image Pretraining

Abstract: Understanding fluorescence microscopy images is fundamental to automating biological research. However, existing methods typically learn predefined concepts from closed-set data, limiting transfer across tasks and biological contexts. In this work, we introduce MicroCLIP, a vision-language model that learns generalizable cellular and subcellular representations from natural language supervision for open-set image classification and retrieval. To pretrain MicroCLIP, we construct MicroPool-2M, a dataset of approximately 2.5 million fluorescence microscopy image-text pairs spanning diverse cellular structures, cell lines, and imaging conditions. Aligning microscopy images with biological concepts in natural language is challenging because most images lack descriptive captions and biological knowledge annotations. We therefore progressively establish image-text associations at three levels to provide MicroCLIP with richer semantic supervision: (1) category-level alignment links images to standardized labels defined by subcellular structure-cell-line combinations; (2) knowledge-level alignment incorporates biological priors derived from these labels to capture relationships across species and cell types; and (3) detail-level alignment uses a multimodal large language model to recaption and verify image-text pairs at scale, emphasizing fine-grained visual characteristics. Extensive experiments demonstrate that MicroCLIP achieves leading performance in zero-shot classification and text-image retrieval on microscopy images. It retrieves images with specific cellular characteristics from thousands of candidates and generalizes to unseen biological concepts without additional supervision. These results highlight MicroCLIP's potential as a foundation model for fluorescence microscopy.

Tue 13 OctComputer Vision and Pattern Recognition
The gist
Analyzing fluorescence microscopy images is important for biology but current tools only recognize fixed sets of cell types or features. The authors created MicroCLIP, a model that learns to connect microscopy images with natural language descriptions. They built a large dataset of 2.5 million image-text pairs and used multiple strategies to teach the model relationships between images and biological concepts. MicroCLIP can identify cell structures and retrieve images based on detailed text descriptions, even for cell types it hasn't seen before.
Open → 2610.17866v1

Synthetic data adaptation improves few-shot cryo-ET classification accuracy

Bridging the Synthetic-to-Real Gap for Few-Shot Cryo-ET Classification

Abstract: Subtomogram classification in cryo-electron tomography (cryo-ET) is a challenging problem due to the scarcity of labeled examples. While cryo-ET simulators can be adopted to generate unlimited synthetic data, the substantial domain gap between synthetic and real subtomograms hinders its practical utilization. In this work, we propose a novel synthetic-to-real adaptation framework with a learnable transformation module, bridging this gap at both the input and feature levels. Extensive experiments demonstrate that our method consistently outperforms existing transfer learning baselines in few-shot settings.

Sat 12 SeptComputer Vision and Pattern RecognitionMachine Learning
The gist
Classifying tiny 3D images from cryo-electron tomography is hard because there aren’t many labeled examples to learn from. The authors show that while computer-generated synthetic images could help, they usually look different from real ones, causing mistakes. They created a new method that transforms synthetic data to look more like real data and adjusts features to close this gap. This approach helps computers learn better from very few real examples and improves classification performance.
Open → 2609.14097v1