Multimodal recommendation improves product suggestions using images and reviews
A Technique to Model Product Information and User Reviews (MPIUR)
Artificial IntelligenceInformation Retrieval
Summary
Online stores show product descriptions, images, and user reviews, but many recommendation tools don’t use all three together. The authors created a method called MPIUR that combines item images, texts, and reviews in a graph model to better suggest products. They tested it on Amazon’s musical instruments and baby product reviews and found it gave better top recommendations, especially for items with fewer past purchases. This shows using all types of product info helps recommend less popular items more effectively.
What this means in practice
- •For e-commerce platform developers: Improve product recommendation quality by combining item images, descriptions, and user reviews in a single unified model.$Commercial implications: Enables ecommerce services to offer more accurate personalized recommendations increasing user satisfaction and sales.
- •For online marketplace managers: Boost recommendations for new or low-traffic products by integrating textual reviews with multimodal content at scale.
Authors
Emna Belguith, Fajrian Yunus, Talel Abdessalem
Abstract
Modern e-commerce platforms naturally provide three complementary modalities: textual item descriptions, item images, and user reviews. However, existing multimodal recommendation methods often omit reviews or do not integrate all three modalities within a unified framework. In this paper, we propose MPIUR, a multimodal graph-based recommendation model that encodes reviews in heterogeneous graphs, aligns image and text representations, and adapts collaborative--semantic alignment to item interaction density. Experiments on the Amazon Reviews 2023 Musical Instruments and Baby categories show that MPIUR achieves the best global nDCG@10 and Recall@10 among the evaluated methods on both datasets. It also obtains the best nDCG@10 and Recall@10 on sparse items, indicating that jointly exploiting reviews and multimodal item content is particularly useful when interaction histories are limited.