Papers for

biodiversity monitoring teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Class-conditioned modeling improves recognition of unknown insect species

CUBE: Class-conditioned Unknown Boundary Evidence for Open-Set Insect Species Recognition

Abstract: Open-set insect species recognition faces significant challenges when deployed in real-world biodiversity scenarios, particularly when encountering unknown species that are visually close to known training classes. Unlike generic out-of-distribution samples, fine-grained unknown insects are often not visually anomalous. They instead tend to appear near the decision boundary of specific known species, leading to unreliable closed-set predictions. To address these challenges, we propose \textbf{Class-conditioned Unknown Boundary Evidence (CUBE)}, a novel evidence-based framework that models unknownness around each known species rather than as a single global unknown class. Our key idea is to evaluate a test sample relative to the known species it most closely resembles, enabling local rejection for visually confusable unknown insects. CUBE learns class-conditioned boundary evidence from auxiliary species, preserves auxiliary species as shadow references during inference, and incorporates taxonomic candidate calibration to verify biological plausibility. When ecological metadata is available, we further introduce CUBE-E, which adds a lightweight location-consistency term without modifying the visual backbone. Experiments on the Open-Insect C-America benchmark show that CUBE achieves superior performance, outperforming state-of-the-art baselines with 95.8\%, 98.7\%, and 99.1\% AUROC on local, non-local, and non-moth unknown splits, respectively, while maintaining 94.9\% closed-set accuracy. With ecological metadata, CUBE-E further improves the results to 96.0\%, 99.7\%, and 99.5\% AUROC with 95.2\% closed-set accuracy.

Fri 9 OctComputer Vision and Pattern Recognition
The gist
Identifying insect species can be tricky when some species look very similar and new species appear. The authors propose a method called CUBE that checks how likely an insect is to belong to a known species by comparing it locally against similar species rather than treating all unknowns as one group. This way, it better spots insects that are unknown but look close to known types. If additional data like location is available, their method CUBE-E uses it to improve accuracy further.
Open → 2610.13610v1

Label-free clustering reveals limits of image-based species identification

InfoTaxa: Information-Calibrated Label-Free Clustering for Fine-Grained Visual Taxonomy

Abstract: Label-free clustering of frozen pretrained visual embeddings offers a scalable route to biodiversity monitoring, but image-only fine-grained taxonomy exhibits a consistent coarse-to-fine failure mode: clusters recover broad taxonomic structure yet plateau at species level. We study this behaviour on BIOSCAN-5M through an information-calibrated clustering analysis. BioCLIP~2 features with UMAP and HDBSCAN reach $0.79$ AMI at family and $0.67$ at genus, substantially improving over the prior image baseline and remaining competitive with oracle-$K$, graph-based, and learned clustering heads on the same frozen features. To diagnose whether the remaining plateau is method-limited or information-limited, we introduce InfoTaxa, which combines clustering efficiency---the fraction of probe-estimated image information recovered by an unsupervised partition---with paired DNA as an audit signal only, not an inference input. The density pipeline recovers approximately $0.90$ and $0.81$ of the image-available information at order and family, respectively. Held-out late-fusion probes show that adding DNA to the image embedding reduces species-level prediction error by approximately two bits. Robustness analyses cover multiple image encoders, described-species and rare-class subsets, probe diagnostics, and held-out-species coarse-rank generalisation and same-species retrieval. Thus, in the tested setting, species-level label-free clustering is both clustering-limited and representation-limited: improved clustering may recover additional image-exposed structure, but cannot close the DNA-audited information gap alone.

Tue 15 SeptComputer Vision and Pattern Recognition
The gist
The paper studies how well computers can group animal and plant pictures into species without using labels. The authors found that current methods can group images into broad categories like families and genera fairly well, but struggle to distinguish closely related species. They show that adding DNA information helps improve species-level identification, but image data alone is not enough. Their new method, InfoTaxa, measures how much information is captured by clustering and uses DNA data as a way to check the accuracy without guiding the clustering itself.
Open → 2609.17218v1