Papers for

autonomous vehicle vision teams

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Context-aware mutual learning improves blind image restoration

Context-Aware Mutual Learning for Blind Image Inpainting and Beyond

Abstract: Blind image inpainting, aiming to recover contaminated images in the case of unknown masks, is a challenging task. Motivated by the perspective of human vision and knowledge, blind image inpainting can be decomposed into two stages: mask estimation and image inpainting based on the estimated mask. The two-stage idea exhibits evident advantages in enhancing inpainting quality and augmenting the generalization capability of unknown real-world contamination by explicitly employing the estimated mask for image inpainting compared to one-stage scheme. This two-stage idea has also been intuitively implemented. However, existing two-stage methods excessively emphasize the unilateral relationship of mask estimation to image inpainting, and may overlook the mutual relations between them. Specifically, mask estimation can provide more contextual semantics for image inpainting to strengthen the understanding of semantics, and image inpainting can offer more contextual details (e.g., textures and edges) for mask estimation to improve the learning of details. In this work, we propose a novel Context-Aware Mutual Learning (CAML) framework for blind image inpainting that joints mask estimation and image inpainting to mutually exploit contextual information. In the CAML framework, we design the Inpainting-Guided Context-Mutual (IGCM) learner to acquire the complementary contextual details from image inpainting for assisting mask estimation, and the Estimation-Guided Context-Mutual (EGCM) learner to strengthen the understanding of contextual semantics from mask estimation for assisting image inpainting. Ablation studies validate the efficacy of our CAML. Extensive experiments show that our CAML achieves state-of-the-art performance on both blind image inpainting and additional vision tasks, i.e., snow removal, shadow removal, and watermark removal, indicating its superiority.

Sun 13 SeptComputer Vision and Pattern Recognition
The gist
Fixing images with unknown damage is tough because it needs both finding the damaged parts and filling them in properly. The researchers show that these two steps can help each other: spotting damaged areas can guide better fixing, and fixing details can improve damage detection. They created a system that shares information back and forth, making both steps better together. Their approach works well not only for general damage but also for problems like removing snow, shadows, or watermarks.
Open → 2609.14439v1