Papers for

image classification engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Hierarchical utility calibration improves multiclass decision accuracy in label trees

Hierarchical Utility Calibration for Structured Multiclass Decisions

Abstract: In multiclass probabilistic prediction, Utility Calibration (UC), which focuses auditing on specified utilities, has recently received attention as a way to guarantee downstream decisions while controlling computational and sample requirements. At the same time, some multiclass problems have meaningful label hierarchies that play important roles in medicine and image classification, yet how UC evaluates utility within a hierarchy remains insufficiently understood. We show that the difference between realized utility and predicted mean utility admits an exact decomposition into a sum of contributions from the internal nodes of the label tree. This decomposition shows that positive and negative contributions from different nodes can cancel, and that even when UC is small, the utility errors remaining in parts of the hierarchy need not be small. To address this problem, we propose Hierarchical Utility Calibration (HUC), which evaluates each node contribution before summation while retaining the same target utility, subgroup, and predicted-utility interval. We further provide finite-sample evaluation over all predicted-utility intervals and propose HUC-Boost, which updates only violated internal nodes, with theoretical guarantees for both.

Tue 29 SeptMachine Learning
The gist
When computers make predictions in categories organized like a tree (for example, medical diagnoses or image types), errors in some parts of the tree might cancel out errors in others. This can hide problems in specific branches even if overall predictions seem good. The authors show how to break down these errors by each part of the hierarchy, making it clearer where mistakes happen. They then propose a way to check and fix these errors at each level, improving the reliability of decisions based on these predictions.
Open → 2609.36532v1