Papers for

camera system engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multi-channel sensors improve camera color correction beyond color temperature

Beyond CCT: Multi-channel SPD recovery for per-shot camera color correction

Abstract: Modern cameras correct color via two or three pre-calibrated 3x3 matrices interpolated by Correlated Color Temperature (CCT). This collapses the illuminant SPD to a scalar. LEDs, fluorescents, and mixed sources sit off the Planckian locus, and metameric illuminants with the same chromaticity demand different optimal CCMs that a CCT pipeline cannot distinguish. We recover the illuminant SPD instead using non-negative least squares against a basis dictionary, conditioned on the camera white point and a multi-channel ambient-light sensor (ALS). A closed-form 3x3 CCM is then fit per shot. On a synthetic benchmark of 300 illuminants and 3,100 reflectances, mean angular error drops from 1.89 to 1.20 degrees, with a 1.7x tail reduction on the LED-like off-Planckian group (n=45) where metameric ambiguity is tangible. The gain holds under realistic ALS imperfections and observation noise, and the same off-Planckian advantage carries over to 1,684 real measured SPDs.

Thu 29 OctComputer Vision and Pattern Recognition
The gist
Modern cameras usually adjust colors based on how warm or cool a light looks, but this method can mix up different lights that look similar. The authors show that by measuring more details about the light’s spectrum using extra sensors, cameras can better figure out the exact color of the light. This means color corrections are more accurate, especially for tricky light sources like LEDs and mixed lighting. Their method works well on both synthetic and real examples, even with some sensor noise.
Open → 2610.40175v1

Deep learning improves image clarity for myopic vision

A Gradient-Regularized Deep Learning Method for Restoring Image in Myopic Vision

Abstract: Myopic vision degrades the quality of human vision due to spherical eye defocus aberrations that impair the perception of fine spatial details. To address this limitation, this work proposes a deep learning-based approach to computationally design transformed images that allow individuals with myopia in fixed distance to perceive scenes with enhanced clarity. The method trains a neural network to counteract defocus aberrations modeled using the second-order Zernike polynomial $Z_2^0$. The approach employs a U-Net architecture trained with a loss function combining reconstruction error minimization with spatial difference structural preservation through $\ell_1$ regularization. Training is carried out exclusively on the KITTI dataset, while testing is performed on DIV2K and ImageNet datasets, demonstrating generalization across diverse image distributions. Under myopic conditions modeled by $Z_2^0$, baseline performance shows visual degradation with PSNR values ranging from 19.47 to 27.42 dB across datasets and severity levels. The proposed gradient-regularized method achieves consistent improvements, delivering PSNR gains ranging from 1.48 to 7.34 dB and significantly lower perceptual compared to classical baselines.

Tue 13 OctComputer Vision and Pattern Recognition
The gist
Myopic vision makes it hard to see fine details because of how the eye focuses. The authors developed a deep learning method that changes images so people with myopia see them more clearly without needing to adjust their eyes. They trained a neural network using a special model of how vision blurs images and tested it on different photo collections. Their method improves image sharpness and maintains important details better than standard techniques.
Open → 2610.19218v1

Dual-lens super-resolution improves images by smartly using telephoto photos

DuSRFlow: Dual-Lens Super-Resolution via Parallax-Aware Flow Estimation and Complementary Reference Warping

Abstract: Dual-lens super-resolution (DuSR) aims to enhance a wide-angle low-resolution (LR) image by exploiting a telephoto reference (Ref) image. A central challenge in DuSR is reliable reference utilization under large parallax, occlusion, and cross-camera imaging discrepancies. Existing methods often employ off-the-shelf monocular optical flow models to provide geometric priors. However, their assumptions of photometric consistency and smooth motion are violated in dual-lens scenarios, leading to unreliable alignment and degraded reference-based reconstruction. To address these issues, we propose DuSRFlow, a dual-lens super-resolution framework that improves reference utilization from both correspondence learning and reference aggregation. First, we introduce DuFlowNet, a dedicated dual-lens flow estimator for robust cross-view alignment. To train DuFlowNet without ground-truth flow annotations, we develop a real--synthetic data fusion strategy that composites synthetic foreground objects onto real dual-lens image pairs, generating controllable large-parallax samples while preserving realistic cross-camera imaging characteristics. Second, we observe that reference reliability is highly spatially uneven in DuSR, where unreliable local reference responses may suppress the utilization of reliable cues. We therefore propose a Complementary Reference Warping strategy that coordinates patch-based warping and kernel-free-guided deformable warping according to local reference reliability, producing a more reliable reference representation before LR--Ref fusion. In addition, we construct DuSR-RealV2, a challenging real-world benchmark with complex depth variations, large parallax, and occlusion. Extensive experiments on multiple DuSR benchmarks demonstrate that DuSRFlow achieves state-of-the-art performance in reconstruction quality, perceptual quality, and cross-dataset generalization.

Sat 10 OctComputer Vision and Pattern Recognition
The gist
Taking a clear, detailed photo from a wide-angle camera can be difficult because the image might look blurry or low-resolution. This paper presents a way to improve such photos by using a second camera with a telephoto lens that captures more detail from a distance. The authors designed a special method to carefully match and combine information from both cameras, even when the pictures don’t line up perfectly due to differences in perspective or obstructions. Their approach uses training with mixed real and synthetic images to handle tricky cases and intelligently decides how to blend the data for the best final picture. They also created a challenging new dataset to test their method and showed it works better than previous attempts.
Open → 2610.14630v1