Outdoor low-light video dataset advances enhancement and segmentation
OLiVES: An Outdoor Low-Light Video Benchmark for Enhancement and Segmentation
Computer Vision and Pattern Recognition
Summary
Processing videos taken in very dark outdoor settings is hard because good examples to learn from are missing. The authors created a new collection of videos filmed with high-quality cameras showing real scenes in low light, along with matching normal-light videos and detailed object outlines. This dataset helps improve computer programs that make dark videos clearer and identify moving objects in them. They also tested leading methods on this dataset and found that training with it makes these tasks work better.
What this means in practice
- •For video software developers: Use the dataset to train and improve algorithms for enhancing dark outdoor videos and detecting objects within them.
- •For automotive vision teams: Improve vehicle camera systems by training on realistic low-light outdoor scenes to better see objects at night.
Authors
Yini Li, Joanne Lin, David Blackham, David Bull, Nantheera Anantrasirichai
Abstract
Low-light video processing remains an underexplored problem in computer vision, primarily due to the scarcity of high-quality ground-truth data. Existing public datasets exhibit several limitations, including restricted motion diversity, limited scene coverage, weak degradations, reliance on auxiliary modalities such as event data, and misalignment between low-light inputs and ground truth. Furthermore, current datasets typically address either low-light enhancement or scene understanding, whereas these tasks should be considered jointly. We introduce \textbf{OLiVES}, a benchmark dataset for outdoor low-light videos with dynamic scenes, designed to support both low-light video enhancement (LLVE) and video object segmentation (VOS). The dataset addresses key content gaps by incorporating a diverse range of natural textures, animals, occlusions, dynamic activities, and close-up scenes. To the best of our knowledge, OLiVES is the first outdoor low-light video dataset captured using professional cinema-grade cameras. It provides over 25,000 aligned normal- and low-light frame pairs, along with over 46,000 VOS annotations. We benchmark state-of-the-art LLVE and VOS methods on OLiVES and show that training on it improves performance on both tasks. The OLiVES project page is available at: https://anonymous-OLiVES.github.io/.