Sequential recommenders improve by personalizing reasoning depth for users
Deliberate Latent Reasoning for Sequential Recommendation
Information Retrieval
Summary
Sequential recommendation systems help suggest items by understanding users' interaction histories. The authors found that using a fixed number of reasoning steps for all users can be inefficient—some users need more steps, others fewer. They proposed a new method called DESRec that customizes the number of reasoning steps for each user's history and breaks down their preferences over time. Experiments show that this personalized approach helps provide better recommendations across different datasets and models.
What this means in practice
- •For ecommerce platform engineers: Enhance user product recommendations by adapting reasoning complexity to each customer's shopping history.
- •For music streaming service developers: Improve playlist suggestions by dynamically segmenting listening history into evolving preference periods.
Authors
Haobo Zhang, Qiannan Zhu, Yutao Zhu, Zhicheng Dou
Abstract
Sequential recommenders are widely applied in real-world scenarios to model user preferences and behavior patterns based on user interactions. Recent advances in sequential recommendation enhance transformer-based models with latent reasoning to refine user representations by autoregressively generating intermediate reasoning vectors. However, exploring the optimal reasoning depth for diverse user histories remains challenging: existing methods typically employ a fixed number of reasoning steps for all users. This ``one-size-fits-all'' strategy often leads to suboptimal representation learning due to over-thinking in simple histories or under-thinking in complex ones. To address this issue, we propose DESRec, a deliberate latent reasoning framework that performs personalized latent reasoning to learn more informative reasoning states and enhance user modeling for sequential recommendation. Specifically, it designs a reasoning step selection module that identifies the optimal reasoning step for each user sequence during the training phase. Through a self-distillation mechanism, it compresses this most informative state into the final reasoning step, which serves as the final user representation for item ranking during inference. Moreover, it introduces a progressive preference extraction mechanism for personalized reasoning, which dynamically segments a user's history into a variable number of periods and summarizes each into a latent milestone representing the user's preference for that period. It will be used as the input of the subsequent reasoning. The number of milestones varies with the users' history, enabling a personalized reasoning over users' evolving interests. Extensive experimental results on six public datasets and four backbone recommenders demonstrate the superiority of DESRec over eight baseline models.