Histology models need less geometric test-time augmentation over time
When Do Histology Foundation Models Need Geometric Test-Time Augmentation?
Summary
When looking at tissue images, computers often rotate and flip images multiple ways at test time to improve predictions, because these images don’t have a standard orientation. The authors studied whether this trick is still needed for newer, self-supervised models that already understand rotation well. They found that although rotating and flipping images still helps, the improvement is much smaller for these modern models and especially tiny for the biggest ones. They also showed that running these rotations only on uncertain cases can save time while keeping most of the advantage. However, this approach didn’t help when analyzing whole slide images using a common method called multiple instance learning.
What this means in practice
- •For computational pathology teams: Reduce test-time computation by applying geometric augmentations selectively during uncertain histology image predictions.
- •For medical imaging software developers: Improve model efficiency by understanding when geometric test-time augmentation adds little value for modern histology foundation models.