Papers for

mobile camera developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Event cameras reconstruct color from monochrome brightness changes

EventSeeColor: Learning to Reconstruct Color from Monochrome Events

Abstract: Event cameras capture visual brightness changes under challenging lighting conditions. However, traditional event-based image reconstruction targets grayscale intensity and produces images without scene color. Color distinguishes surfaces with similar intensity. Reconstructing color from events can reveal appearance differences that reconstructed grayscale images cannot express. Although monochrome event cameras do not directly measure color, their event-triggering patterns depend on surface reflectance, illumination, and the sensor's spectral response. These patterns may contain cues that support color reconstruction. In this paper, we present EventSeeColor, which uses event-reconstructed grayscale and aligned events to jointly guide a diffusion colorizer. Grayscale-derived semantic context supports color inference, while region-balanced chroma supervision and local RGB refinement improve color distribution, brightness, and texture. In the combined evaluation on two real event datasets, EventSeeColor achieves the best structural similarity, learned perceptual scores, and chromatic-region color difference among the external methods.

Thu 29 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Traditional event cameras only capture changes in brightness, so they produce black-and-white images. The authors show a method to guess what the colors are from these black-and-white event signals. Their method uses both the grayscale images and the original event data together to colorize scenes more accurately. This helps reveal differences in appearance that black-and-white images miss, useful for seeing details in tricky lighting.
Open → 2610.40166v1

Dual-stream method improves hdr video with alternating exposures

Double-stream registration with pyramid fusion for HDR video with alternating exposures

Abstract: High dynamic range (HDR) video reconstruction from al\-ter\-na\-ting-exposure sequences remains challenging, especially in regions with extreme luminance variation. We propose a novel HDR reconstruction framework based on dual-stream registration and accurate pyramid fusion. Given three consecutive frames, our method computes optical flow directly with the central frame, while introducing a complementary midpoint displacement strategy to handle cases with severe overexposition. A pyramid fusion stage then merges the resulting radiance and LDR images into a final HDR output. Experimental results demonstrate that our approach consistently outperforms state-of-the-art methods.

Fri 25 SeptComputer Vision and Pattern Recognition
The gist
Capturing videos with very bright and very dark areas is hard because normal cameras can’t see all lighting details at once. The authors propose a new way to combine video frames taken with different brightness settings to create clearer, high dynamic range (HDR) videos. Their method aligns video frames more accurately and merges the information using a pyramid fusion technique, handling even very bright spots well. Tests show their approach works better than existing methods.
Open → 2609.31108v1

Single-exposure raw video improves highlight and shadow details

High Dynamic Range Video Reconstruction from Single-Exposure Raw Sequences

Abstract: Due to the limited dynamic range of conventional image sensors, captured low dynamic range (LDR) video often suffers from highlight clipping and shadow detail loss, making high-quality high dynamic range (HDR) reconstruction from single-exposure sequences highly challenging without alternating exposures or extra hardware. Alternating-exposure HDR methods sacrifice frame rate and struggle with motion alignment, making them impractical for real-world capture. To address this, we propose RawHDRV, an end-to-end framework for single-exposure Raw video HDR reconstruction, that fundamentally exploits the linear response and channel-specific characteristics of Bayer data. Specifically, it features a channel-decomposition temporal alignment and fusion strategy that processes Bayer channels separately to exploit their distinct exposure characteristics, together with exposure-aware weighted fusion. It further incorporates an exposure complementarity mask-guided restoration module that leverages inter-frame exposure redundancy to adaptively fuse reliable information and suppress saturation artifacts, and introduces a mask-guided color loss that combines normalized error constraints with gradient smoothing to enhance highlight recovery. Furthermore, we construct a large-scale mobile Raw-HDR video dataset with per-frame HDR annotations. Experiments show that our method achieves the state-of-the-art results in all metrics, demonstrating superior spatial quality and temporal stability under extreme exposure conditions. The code is available at https://github.com/supeixian/RawHDRV.

Wed 23 SeptComputer Vision and Pattern Recognition
The gist
Cameras usually capture videos with limited brightness range, causing bright spots to be too bright and dark areas to lose detail. The authors introduce RawHDRV, a method that uses the raw sensor data from a single exposure to recover these details better without needing multiple exposures or special hardware. Their approach processes different color channels separately to handle brightness better and uses smart ways to combine multiple frames to improve the image quality. They also created a large dataset to test their method, proving it works well even in challenging bright or dark scenes.
Open → 2609.27274v1