Context coupled graph learning improves multimodal recommendations

Rethinking Evidence Modeling: Context-Coupled Graph Learning for Multimodal Recommendation

Information Retrieval

Summary

Recommender systems suggest items like products based on what users like and item details such as images and text. The paper shows that current methods treat user interactions and item content separately, limiting how well preferences are understood. The authors introduce a new method, CC-MGRec, that mixes user behavior and item details in a shared framework, letting the system better combine clues from different data types. This approach leads to better and faster recommendations on real-world datasets.

What this means in practice

  • For ecommerce platform engineers: Enhance product recommendation quality by jointly learning from purchase data and product visuals and descriptions within a unified graph model.
  • For streaming service recommendation teams: Improve content suggestions by integrating user viewing behavior with multimedia features like cover art and summaries using context-coupled graph techniques.

Authors

Mingqiao Zhang, Qiyao Peng, Yumeng Wang, Wenzhe Dong, Hongtao Liu, Jian Yang

Abstract

Multimodal graph recommendation integrates observed interactions with item images and text to learn user preferences. These inputs constitute Semantic-Behavioral Evidence (SBE). Many existing graph methods incorporate collaborative and multimodal semantic relations, yet their aggregation and state updates remain context-separated, limiting the continuous composition of preference evidence across layers and the joint use of multiple sources. To address this limitation, we propose CC-MGRec, a context-coupled graph learning method that organizes SBE within a common graph learning context for cross-relation modeling and compositional propagation. Its context-coupled multimodal graph integrates user-item collaborative relations and item-item semantic relations, coordinating their message scales through joint normalization. Recommendation-grounded semantic calibration uses training behavior to adjust semantic neighbor weights while preserving normalized collaborative propagation coefficients. Collaborative-semantic compositional propagation updates shared node states layer by layer to continuously compose collaborative and multimodal semantic evidence, implicitly forming Preference Evidence Chains (PECs), including collaborative-semantic and visual-textual PECs. Joint execution of relation messages on the same shared node states within each layer preserves propagation outputs while reducing intermediate output processing and fusion overhead. We provide theoretical analysis of the proposed mechanisms. Experiments on three Amazon datasets demonstrate improved recommendation quality and faster inference during graph propagation.