Papers for

image retrieval engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Holo nn enables fast private nearest neighbor search with compressive sensing

Holo-NN: Holographic Nearest Neighbor Search via Compressive Sensing

Abstract: In the age of AI, privacy-preserving approximate nearest neighbor (ANN) search over high-dimensional embeddings has emerged as a critical yet frustratingly challenging domain, dominated by tradeoffs between speed, privacy, and accuracy. Traditional tree and graph-based indexing structures (e.g., HNSW, ScaNN) rely fundamentally on non-linear operations that are computationally intractable under Fully Homomorphic Encryption (FHE) or blind server-side constraints. In this paper, we introduce Holo-NN (Holographic Nearest Neighbor Search), an algebraic framework that replaces data-dependent branching with a single linear projection. Our key observation is that while distances across a database are dense, neighborhood membership is inherently sparse: only a handful of points ever lie close to a query. By pairing locality-preserving feature transforms with Compressive Sensing, Holo-NN folds the entire database offline into a compact holographic sensing matrix. At query time, encrypted search reduces to a single, non-interactive matrix-vector multiplication---requiring no FHE bootstrapping, no multi-round interaction, and no client-side index state. This turns private retrieval into an embarrassingly parallel, accuracy-tunable computation that runs out of the box on both CPUs and GPUs, scaling efficiently to production databases. We offer a comparison against other state-of-the-art Private ANN algorithms to help situate the method in the broader context of production-grade private retrieval.

Fri 23 OctCryptography and SecurityDatabasesInformation Retrieval
The gist
Finding similar items quickly while keeping data private is hard because usual methods rely on complex steps that don't work well with encrypted data. The authors introduce Holo-NN, which packs the entire database into a special matrix using mathematics that keeps nearby items easy to find. When searching, it needs just one simple mathematical step on encrypted data, making the process faster, private, and scalable. This new way avoids back-and-forth communication and heavy computations, running efficiently on common computer hardware.
Open → 2610.33224v1

Scalable deep feature encoding boosts scene image retrieval accuracy

Rethinking Fisher Vectors for Second-order Multi-scale Deep Feature Aggregation in Scalable Scene Retrieval

Abstract: Aggregating CNN responses into a compact discriminative vector, given their lack of geometric invariance, is a challenge. To address this challenge, we propose a codebook-free method to encode second-order information of multi-scale CNN features within the Fisher Kernel framework. We use a scalable retrieval pipeline to show the efficacy of the proposed vector. The increased discriminative power is confirmed by experimental evaluation of our method on two difficult benchmarks (INRIA Holidays, UKBench). The significant improvement in retrieval accuracy over state-of-the-art approaches comes with only a slight dimension increase.

Thu 22 OctArtificial Intelligence
The gist
Finding similar photos in large collections is hard because computers struggle with changes in viewpoint and scale. The authors introduce a new way to combine information from multiple scales of deep neural network features, capturing richer details without relying on predefined codebooks. They encode this information using a method related to Fisher Vectors, improving how images are compared and retrieved. Tests on challenging image datasets show their approach outperforms previous methods with only a small increase in data size.
Open → 2610.31146v1

Visual and text cues improve zero-shot image search accuracy

Optimizing VLP-aligned Multimodal Intent Representation with Correct Visual Instantiation for Zero-Shot Composed Image Retrieval

Abstract: ZS-CIR aims to retrieve a target image from a reference image and a modification text without paired supervision, typically by encoding composed queries as text-dominant representations within the image-text matching space of VLPs. However, queries reconstructed by visual pseudo-word learning or MLLM-based target reasoning often deviate from the native VLP representation space due to reference noise and coarse text fusion in the former, and verbose, weakly visually grounded descriptions in the latter. In this paper, we propose a unified ZS-CIR framework (named VMIR-CVI) to reconstruct multimodal composite queries from two complementary perspectives for optimizing VLP-compatible multimodal intent representation. First, it reasons and converts the multimodal intent into a unified textual description, aligning with the native text space of the VLP backbones to produce more retrieval-compatible textual queries. Second, it reconstructs the query representation with correctly decoupled visual instance cues, reducing reference noise while preserving target-relevant content. Specifically, a VLP-aligned Multimodal Intent Reasoning (VMIR) module injects few-shot VLP-style exemplars into chain-of-thought prompts, guiding the MLLM to generate target-consistent intent queries. A Training-free Visual Instance Disentanglement (TVID) module decouples fine-grained visual instances from global reference features without additional optimization. Finally, a lightweight Hybrid-modal Intent Alignment and Fusion (HIAF) module integrates the reasoned textual intent and disentangled visual cues into a unified hybrid-modal representation for robust ZS-CIR. Extensive experiments on three CIR benchmarks, namely CIRR, CIRCO and FashionIQ, show that VMIR-CVI significantly outperforms existing baselines and achieves new state-of-the-art performance. Code and trained models will be publicly released.

Tue 29 SeptInformation Retrieval
The gist
Finding images based on a starting image and a description of what to change is tricky without example pairs to learn from. The authors developed a method that better understands the combined meaning of the starting image and the text by turning them into a clearer description that matches existing language-image models. They also separate important visual details from background noise to keep the search focused. Their approach improved results on several image retrieval tests compared to past methods.
Open → 2609.36946v1