Papers for

bioimage analysis engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Evaluation suite reveals trade-offs in virtual 3d cell staining

The DynaCell Evaluation Suite for Dynamic 3D Virtual Staining of Live Cells

Abstract: Understanding how cells respond to perturbations over time is central to cell biology and drug discovery. Live-cell imaging captures the dynamics of perturbation-induced phenotypes in individual cells. While fluorescence imaging can visualize specific molecular phenotypes, labeling and repeated illumination often affect cell health. Virtual staining offers an alternative by predicting these fluorescence images from images acquired without fluorescent labels. Although many virtual staining models have been developed, their performance on volumetric time-lapse data remains poorly characterized. We address this gap with an evaluation suite for 3D time-lapse virtual staining of live cells. The suite combines paired 3D time-lapse images acquired with and without fluorescent labels, a set of baseline models, and three metric tiers measuring pixel-level fidelity, organelle segmentation performance, and single-cell phenotype similarity. Using this evaluation suite, we study metric and model behavior across 3 cell types, 2 microscopes, 4 organelles, and 3 perturbation states. We find that regression baselines better predict the spatial localization of target organelles, whereas the generative baseline better captures the distribution of phenotypes across cells. These differences expose trade-offs between structural and phenotypic fidelity that are obscured by single-metric evaluation and suggest how virtual staining models can be developed for diverse downstream tasks such as localization, segmentation, tracking, and phenotypic profiling. We release the curated datasets, baseline checkpoints, and evaluation code as part of DynaCell, a broader framework for image-based profiling of cell-state dynamics.

Mon 2 NovComputer Vision and Pattern Recognition
The gist
Studying how cells change over time is important, but traditional staining methods can harm cells. The authors created a new evaluation suite called DynaCell to test computer models that predict stained cell images from unstained ones in 3D over time. They found that different models have strengths in either showing exact cell structures or capturing overall cell behaviors. This helps developers choose and improve models based on their needs for understanding cells better without harming them.
Open → 2611.02324v1

Benchmark evaluates AI agents on real-world bioimage analysis

BIABench: Evaluating AI agents on real-world bioimage analysis tasks

Abstract: Artificial-intelligence (AI) agents hold promise for automating bioimage analysis, yet no benchmark evaluates whether they can carry out real-world analyses end to end. Such analyses are hard for agents because 2D images, 3D volumes and time-lapse sequences are often too large to read as context, so an agent must choose and run an analysis through code, specialized software and rendered views. Published studies make this capability testable, because each pairs raw images with a peer-reviewed result. We introduce BIABench, a benchmark of 16 tasks reconstructed from published biological studies that retain their scientific questions, imaging data and ground truth. The tasks span eleven analysis subtasks and modalities from H&E histology to single-molecule localization microscopy. Each submission receives an outcome score, which compares the output files with the ground truth using field-standard metrics, and a process score, in which a vision-language model judges method choice and quality control against an expert-written rubric. We evaluated general-purpose and biology-specific agents across several language models, with repeated runs of every task. Routine two-dimensional tasks were solved well, but on some tasks that added a third dimension or a time axis no agent scored above 0.19. Neither biological specialization, stronger models nor detailed expert instructions closed this gap. The agents were also unreliable, with scores varying more between repeated runs of one agent than between different agents, and without ground truth a correct run could not be told from a wrong one by its process score or by the time spent. Released openly with its data and code, BIABench provides a verifiable framework for evaluating, and eventually training, agents for reliable long-horizon bioimage analysis.

Mon 28 SeptArtificial IntelligenceComputation and Language
The gist
Analyzing biological images is hard for AI because the images are often large and complex, including 2D, 3D, and video data. The authors created BIABench, a test with 16 tasks taken from real biological studies, where AI agents must analyze data and produce reliable results. They found that AI can handle simple 2D tasks well, but struggles with complex 3D and time-based images. The benchmark also shows AI methods are often inconsistent, and it provides a way to measure and improve AI performance on these problems.
Open → 2609.34274v1