Large language models enhance recommendations with structured decision memory
Beyond Sequences: Distilling Structured Decision Memory for LLM Recommendation
Computation and Language
Summary
Current recommendation systems often look at user actions as simple sequences, missing the reasons behind choices. The authors propose a new method called MARI that keeps a structured memory of users' past decision reasons, like goals and trade-offs between options. This helps the model make better predictions, especially when items are very similar and choices are hard. MARI also explains its recommendations in understandable ways without slowing down the system much.
What this means in practice
- •For ecommerce platform engineers: Improve product recommendation accuracy for customers choosing among similar items by using explicit memory of their past decision rationales.
- •For marketing analytics teams: Gain interpretable insights into customer decision processes to tailor marketing strategies around key trade-offs and constraints.
Authors
Leikun Liang, Guoshuai Wang, Xingsheng He, Yushan Han, Yunyi Xuan, Xiaoxiao Xu, Lin Qu
Abstract
Despite the adoption of large language models (LLMs) in recommendation systems, prevailing approaches mostly model single-type behaviors (e.g., views or purchases). Even when incorporating multiple behaviors, existing methods flatten heterogeneous actions into homogeneous token sequences, ignoring their distinct decision-making roles. This flattening fails to capture semantic hierarchies and contextual nuances in complex decision-making, such as trade-offs between price and quality. Consequently, performance degrades in critical ``difficult-choice'' scenarios involving highly similar items. To bridge this gap, we propose MARI (Memory-Augmented Recommendation with Interpretability), which grounds predictions in explicit, structured decision evidence. MARI maintains a Decision Memory Bank (DMB) that archives users' past rationales as Structured Decision Memories (SDMs): concise records of goals, constraints, and trade-offs. These SDMs are generated offline via Post-Hoc Decision Distillation from heterogeneous behaviors and user-generated content. By retrieving relevant SDMs to augment LLM reasoning, MARI achieves interpretability and scalability without the prohibitive cost of processing long raw sequences. Extensive experiments show MARI significantly outperforms state-of-the-art baselines on standard next-item prediction and a newly introduced Difficult Choice Prediction task, incurring low latency overhead by decoupling memory construction from online inference. Qualitative analyses reveal actionable, human-readable insights into user decision-making, marking a concrete step toward reasoning-aware recommendation systems.