Dual-stream method improves hdr video with alternating exposures
Double-stream registration with pyramid fusion for HDR video with alternating exposures
Computer Vision and Pattern Recognition
Summary
Capturing videos with very bright and very dark areas is hard because normal cameras can’t see all lighting details at once. The authors propose a new way to combine video frames taken with different brightness settings to create clearer, high dynamic range (HDR) videos. Their method aligns video frames more accurately and merges the information using a pyramid fusion technique, handling even very bright spots well. Tests show their approach works better than existing methods.
What this means in practice
- •For video processing engineers: Produce clearer HDR videos from alternating exposure input frames by improving frame alignment and fusion accuracy.
- •For mobile camera developers: Enhance mobile HDR video capabilities under extreme lighting variations by integrating dual-stream registration and fusion techniques.$Commercial implications: Enables improved HDR video recording features in consumer smartphones providing better user experience in challenging lighting.
Authors
Onofre Martorell, Ivan Pereira-Sánchez, Antoni Fuentes, Antoni Buades
Abstract
High dynamic range (HDR) video reconstruction from al\-ter\-na\-ting-exposure sequences remains challenging, especially in regions with extreme luminance variation. We propose a novel HDR reconstruction framework based on dual-stream registration and accurate pyramid fusion. Given three consecutive frames, our method computes optical flow directly with the central frame, while introducing a complementary midpoint displacement strategy to handle cases with severe overexposition. A pyramid fusion stage then merges the resulting radiance and LDR images into a final HDR output. Experimental results demonstrate that our approach consistently outperforms state-of-the-art methods.