Conformal Coverage Guarantees for Any Video Temporal Grounder
2026-08-07 • Computer Vision and Pattern Recognition
Computer Vision and Pattern RecognitionInformation Retrieval
AI summaryⓘ
The authors point out that different people often disagree on the exact start and end of events in videos, making it hard to say a single 'correct' moment for something to happen. They propose COVER, a tool that can wrap around any existing video-time prediction system and produce a time interval that likely includes the true event with a specified confidence level. COVER works without needing to retrain the model or know its inner workings by adjusting the predicted interval based on past data. Their approach provides guarantees that hold even with limited data and works well across multiple tests, showing when a prediction is reliable or not.
temporal groundingevent boundariescalibrationexchangeabilitynonconformity scorequantilevideo-language modelconfidence intervalfinite-sample guarantee
Authors
Aseel Mohamed, Rasul Khanbayov, Erchin Serpedin, Hasan Kurban
Abstract
Event boundaries in continuous video are ambiguous: re-annotate the same query-video pair and independent annotators mark moments that overlap by less than half on a large fraction of samples. The ground truth for video temporal grounding is therefore a distribution over intervals, yet every grounder returns a single interval with no statement of reliability, so at deployment a wrong interval is indistinguishable from a right one. COVER changes the output object: a post-hoc, model-agnostic wrapper that turns any grounder, a trained localizer or a black-box video--language model, into one that emits a temporal region containing the true moment with probability at least $1-α$, by calibrating the quantile of a temporal nonconformity score on held-out labels and widening the base prediction by that amount. The guarantee is finite-sample and distribution-free under exchangeability, and requires neither retraining nor white-box access. We give two score families, a two-sided boundary-widening score for grounders that emit an interval and a super-level-set score for grounders that emit a relevance signal, and develop theory specific to grounding that bounds how large the certified region becomes, when coverage survives conditioning on event length, and how it degrades when moments from one video break exchangeability. Across three benchmarks and five grounders, realized coverage tracks the target, and calibration exposes what point metrics hide.