Papers for

e-commerce developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Training free method improves image search with text and image clues

DCR-TSF: Dual-Level Compositional Reasoning with Triadic Spherical Fusion for Training-Free Zero-Shot Composed Image Retrieval

Abstract: Zero-shot composed image retrieval (ZS-CIR) aims to retrieve a target image that reflects an intended textual modification while maintaining semantic consistency with a reference image. Existing training-free ZS-CIR methods typically rely on fine-grained generated target descriptions, which often overemphasize reference-specific visual details and lead to appearance-biased retrieval. Moreover, since these descriptions are generated through multimodal large language models (MLLMs), the direct influence of the original image-text query can be weakened in the final retrieval representation. In this paper, we propose DCR-TSF, a training-free ZS-CIR framework that combines Dual-level Compositional Reasoning (DCR) and Triadic Spherical Fusion (TSF). DCR generates fine- and coarse-grained descriptions from the reference image and modification text, capturing complementary target-side semantics across different granularities. To preserve the original image-text query information, TSF constructs a composed-query anchor by spherically interpolating the reference image feature and modification text feature, and fuses it with the fine- and coarse-grained representations using a weighted Karcher mean on the unit hypersphere. The resulting final query representation balances detailed visual evidence, high-level semantic abstraction, and direct preservation of the original composed query. Extensive experiments on CIRCO, CIRR, and Fashion-IQ demonstrate that our method achieves state-of-the-art performance among training-free methods.

Mon 19 OctComputer Vision and Pattern Recognition
The gist
Finding pictures that match a new description based on an original picture and some words is tricky without extra training. The authors created a method that looks at both detailed and broad information from the original image and modification instructions. They combine these in a special way to keep key parts of the original hints while adding the new details. This leads to better picture searching without needing to train a model. Their tests showed it works well on several image search tasks.
Open → 2610.26078v1

Long conversation shopping agent improves personalized user experience online

Personalization Matters: Long-Horizon Conversation Agent with User-Centric Information in Online Shopping Interactions

Abstract: Personalized conversational shopping requires maintaining preference consistency over multi-turn interactions, where users reveal constraints gradually. Existing approaches often rely on static profiles and do not explicitly control long-horizon interaction behavior. We propose a multi-agent, multimodal Retrieval-Augmented Generation (RAG) framework that decomposes dialogue state tracking, recommendation retrieval, preference-aware reasoning, and response generation, while integrating product metadata, product reviews, image-derived descriptions, and user historical reviews. To evaluate interaction-level quality, we adopt a trajectory-level protocol with four dimensions: Global Preference Consistency, Cumulative Information Synthesis, Interaction Trajectory, and Tone Consistency. On an Amazon Reviews 2023 benchmark, retrieval-enabled variants outperform a no-RAG baseline on automatic trajectory metrics (average 4.82 vs. 3.74). In a small real-user study ($n{=}5$), the Full variant achieves the highest mean overall rating (4.60 vs. 2.20 for Baseline), providing exploratory evidence that role decomposition plus user-centric retrieval improves perceived personalization.\footnote{Code and dataset are available at: https://github.com/RenaGao/Multimodel_RAG_Indexing

Thu 8 OctMultiagent Systems
The gist
Buying things online with a chat assistant can be tricky when you share your preferences bit by bit over many messages. The authors propose a system that splits the task into parts like tracking your preferences, searching products, reasoning based on your history and product info, and then responding to you. Their system uses product details, reviews, images, and what you’ve said before to better understand you. Tests show their method keeps preferences consistent over long chats and users rate it higher for personalization.
Open → 2610.11375v1

Interactive generative recommenders improve multi-turn user conversations

Adapting Generative Recommenders for Multi-Turn Interaction

Abstract: Generative recommenders decode items from a user's interaction history, but offer no way for users to correct a recommendation that misses their current intent. Adding conversation is natural since items and words share same output space, yet training the model to converse may overwrite the history-to-item mapping it relies on. We introduce INTEGER (**INTE**ractive **GE**nerative **R**ecommendation), which extends generative recommendation to multi-turn interaction with a learned routing token that lets the model decide when to recommend, history re-anchoring that conditions each item on both past behavior and the dialogue, and behavioral replay with instruction-data rehearsal that prevents forgetting during adaptation. Users can thus give feedback on recommendations within the dialogue, while recommendations stay grounded in behavioral history and accuracy is not traded for fluency. On Amazon Beauty and Toys, INTEGER matches or exceeds the strongest baselines in accuracy with competitive conversation quality, improving Hit@10 by 13.3% on Amazon Beauty, and significantly outperforms the generative recommender it starts from. Our analyses show that INTEGER learns behaviors that naive adaptation fails to acquire, recommending once the user's intent is clear and staying attentive to behavioral history at the moment of recommendation. INTEGER also learns an intent-agnostic replacement over the item space, which suppresses rejected items but points to attribute-aware feedback as the next step.

Tue 6 OctInformation Retrieval
The gist
Recommender systems suggest items based on what you've looked at before, but they usually can't learn from your feedback during the recommendation process. The authors created a way for these systems to have a conversation with users, letting users correct recommendations as they go. Their method keeps recommendations accurate by remembering past behavior while also understanding ongoing dialogue. Tests on Amazon product data showed this approach is better at suggesting items users want and can handle feedback during conversations.
Open → 2610.08136v1

Composed image retrieval improves by representing target states directly

From Transformation to Target State: Rethinking Query Representation for Zero-Shot Composed Image Retrieval

Abstract: Composed image retrieval (CIR) aims to retrieve a desired target image from a query consisting of a reference image and a modification text. This task exhibits an unusual representational asymmetry: the modification text specifies a transition from the reference state, whereas retrieval candidates depict completed target states. This creates a representation mismatch for zero-shot methods that query pretrained vision-language spaces directly with transformation-oriented language. We study this mismatch and reformulate zero-shot composed image retrieval as target-state reconstruction followed by retrieval. We instantiate this formulation with ASAP-CIR, a training-free framework that reconstructs a static target representation using a frozen multimodal large language model (MLLM). The representation combines multiple holistic descriptions with a variable set of importance-weighted atomic semantics, thereby preserving both overall target identity and fine-grained visual constraints. Retrieval then integrates holistic state alignment, atomic constraint grounding, and calibrated target-state evidence aggregation. A controlled text-only diagnostic shows that target-side static query formulations achieve more reliable retrieval than dynamic composed query formulations, particularly when source-state semantics must be suppressed or transformed. Experiments on FashionIQ, CIRR, and CIRCO further characterize the effectiveness and limitations of this representation principle, with the clearest gains on the multi-target CIRCO benchmark. These results show that how composed intent is represented before retrieval is a consequential design choice, distinct from the choice of retrieval backbone itself.

Mon 5 OctComputer Vision and Pattern Recognition
The gist
This paper looks at how computers find images based on a starting image plus instructions to change it. The problem is that the instructions describe changes, but the images to find are final results, which makes matching tricky. The authors propose a new way to represent the final image state before searching, using a large language model to combine descriptions that capture both the overall look and detailed parts. They show this helps find images more reliably in tests with fashion and other datasets.
Open → 2610.05993v1

SimTrace generates synthetic user clickstreams for better online modeling

SimTrace: Grounded Multimodal User Trajectories Generation for Online User Modeling

Abstract: Virtual clients offer a cost-effective approach to support applications such as A/B testing, recommender system development, and interface evaluation. However, building them requires access to large-scale, semantically faithful, fine-grained online user trajectories. These data are difficult to obtain because proprietary logs are subject to privacy restrictions and small businesses often lack sufficient traffic. Consequently, existing public datasets either abstract away fine-grained user interaction details or preserve rich context but remain platform-specific and small-scale. To address this gap, we propose SimTrace, a framework that generates faithful, fine-grained synthetic multimodal clickstreams through a computer-use client agent that is grounded in real user trajectories and the given web environment. SimTrace anonymizes real interactions and constructs a simulated twin of the given web environment, then uses both to generate synthetic interaction trajectories. Each action is paired with its corresponding web observations and user context, yielding a shareable alternative to confidential logs for developing computer-use agent-style virtual clients. We apply SimTrace to an e-commerce setting and evaluate both its fidelity and downstream utility. SimTrace outperforms competing baselines on 7 out of 8 fidelity metrics. Models trained on synthetic data achieve performance comparable to those trained on real data on downstream tasks such as purchase prediction and recommendation. For next action prediction task, augmenting real data with synthetic data further improves accuracy by 11.0% relative to training on real data alone. We release SimTrace as an open-source package to facilitate research on online user behavior modeling.

Tue 29 SeptArtificial Intelligence
The gist
Many companies need detailed records of how users interact with websites to improve services, but real user data is hard to get due to privacy and limited traffic. The authors created SimTrace, a system that makes realistic fake user activity based on real usage while protecting privacy. This synthetic data helps build models that predict user actions and improve recommendations almost as well as real data. Adding synthetic data to real data can even make predictions more accurate.
Open → 2609.38397v1

YouTube music uses large language models to explain new artist picks

Explainable Recommendations at Scale: LLM Rationales for YouTube Music Artist Discovery

Abstract: Modern music streaming platforms face a persistent tradeoff: exploiting familiar content versus driving the exploration of novel items. While users frequently desire discovery, they hesitate to select unknown artists over proven favorites. Providing transparent, natural language rationales that explain why an unexplored item is recommended lowers this barrier. However, while Large Language Models (LLMs) excel at this nuanced explainability, their real-time deployment is severely bottlenecked by prohibitive inference costs and computational overhead. In this paper, we present an industry case study of a decoupled recommendation architecture that successfully scales exploration without compromising latency. Our system isolates LLM inference asynchronously offline, pre-computing personalized candidate pools of undiscovered artists alongside tailored rationales. Large-scale online A/B experiments validate our design. We demonstrate that combining LLM-backed recommendations with these explanatory rationales significantly reduces the trust barrier for new content, yielding statistically significant improvements in both user exploration and overall engagement on the discovery surfaces.

Sun 20 SeptArtificial IntelligenceInformation Retrieval
The gist
Music streaming services want to help people discover new artists, but listeners often stick to familiar favorites. The authors show how YouTube Music created explanations in everyday language to explain why new artists are recommended. Because running large language models in real-time is too slow and costly, they pre-generate these explanations ahead of time. Tests on millions of users proved this approach encourages people to explore more new music while keeping the service fast and responsive.
Open → 2609.23877v1