Papers for

digital imaging engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Image scaling operators aligned with camera optics improve digital resizing

A Unified Theory of Image Scaling: Point Spread Functions, Discrete Kernels, and Scale-Spaces

Abstract: We derive the optically aligned system of image-scaling operators $\mathbf{K}_s$ that reproduces optical zoom (exact zoom-out, canonical zoom-in), by identifying a Huygens-like consistency principle in which each pixel acts as a secondary source. The system is determined in closed form by the camera's point spread function (PSF), itself the operator $\mathbf{K}_0$. The operators compose, $\mathbf{K}_{s'} \circ \mathbf{K}_s = \mathbf{K}_{ss'}$ (with band projection for down-up), and account for both upscaling and downscaling, which form a Moore-Penrose pseudoinverse pair, $\mathbf{K}_{1/s} = \mathbf{K}_s^\dagger$. We show that image scaling, as routinely practiced, is neither optically faithful nor internally consistent; for example, common anti-aliasing rules generally correspond to no camera, and two resizes by a factor of $1/2$ generally do not equal one resize by a factor of $1/4$. Gaussian scale-space kernels cannot be exact finite-aperture PSFs. Gaussian scale-space is an idealized special case of what emerges here: a generalized scale-space for sampled images, derived entirely from camera optics, bidirectional, and not limited to Gaussian kernels. The system goes beyond scaling and supports composable and invertible subpixel geometric transformations. We empirically validate its optical predictions with real captures and noisy optics simulations, and demonstrate its practical impact on the stability of tasks such as super-resolution and classification.

Thu 15 OctComputer Vision and Pattern Recognition
The gist
Digital images are often resized, but typical resizing methods don’t match how cameras actually capture images through their lenses and sensors. The authors developed a new mathematical system for resizing images that mirrors how cameras work, preserving consistency and optical accuracy. Their method explains why common resizing techniques can cause inaccuracies and offers a unified way to handle upsizing, downsizing, and precise geometric transformations. This improves the stability and reliability of image-based tasks like enhancing resolution and recognizing objects.
Open → 2610.22472v1

Multi dimensional dataset improves quality assessment of colorized images

MCIQA-2K: A Multi-Dimensional Dataset and No-Reference Quality Assessment Benchmark for Colorized Images

Abstract: Image colorization is an inherently ill-posed task, since a single grayscale image may correspond to multiple plausible colorized results. Consequently, conventional full-reference image quality assessment (IQA) metrics fail to accurately reflect human perceptual preferences for colorized images. In this paper, we present MCIQA-2K, a large-scale multi-dimensional benchmark specifically designed for no-reference quality assessment of colorized images. We construct a dataset containing 2,000 colorized images generated by five representative colorization models, together with human annotations across three perceptual dimensions: color smearing, semantic color misalignment, and global naturalness. Building upon the proposed benchmark, we further introduce MCIQA, a dedicated multi-branch NR-IQA framework for colorized images. Extensive experiments demonstrate that MCIQA significantly outperforms existing full-reference and no-reference IQA methods on the proposed benchmark, while also exhibiting competitive generalization capability on several widely-used IQA datasets. The dataset and code are publicly available at https://github.com/ARBEZ-ZEBRA/MCIQA.

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
Images that are colorized from black and white can look different depending on how they are colored, and there isn’t just one right way. Usual ways to judge the quality of these colorized images don’t match how people actually see them. To solve this, the authors created a large new dataset of 2,000 colorized images and had people rate them based on specific color issues and overall realism. They also built a new tool, called MCIQA, to judge colorized images without needing the original for comparison, and it works better than existing methods on their dataset and others.
Open → 2609.14495v1