LLM powered personal prompts improve sequential item recommendations
Learning Robust Personalized Prompts for LLM-Driven Sequential Recommendation
Information Retrieval
Summary
Recommender systems use language-based prompts to predict what item a user might want next, but tiny changes in wording can cause big swings in performance. The authors propose a new method called LRPRec that learns personalized prompts for each user while keeping the prompts stable and meaningful. This approach balances adaptation to individual preferences with staying true to the original prompt’s meaning, leading to better recommendations. Their tests on several datasets show improvements without needing manual prompt adjustments.
What this means in practice
- •For ecommerce platform engineers: Build recommendation engines that adapt personalized prompts for users without manual tuning to improve next-item predictions.
- •For streaming service developers: Enhance content recommendation by injecting user preferences into robust language-driven prompt frameworks, reducing performance fluctuations.
Authors
Xiaolin Zheng, Qiyong Zhong, Jiajie Su, Xiang Chen
Abstract
LLM-driven sequential recommendation formulates next-item prediction as autoregressive generation conditioned on natural-language prompts. However, minor wording changes in semantically equivalent prompts can cause substantial performance fluctuations, undermining robustness and requiring costly manual prompt engineering. Continuous prompt learning reduces template dependence but faces two interacting challenges: shared task-level instructions lack user-specific reasoning guidance, while gradient updates can push continuous prompts outside the LLM's effective semantic space. Injecting personalized signals can further amplify this semantic drift. To address these challenges, we propose LRPRec, a learnable prompting framework that initializes continuous instruction prompts from discrete templates and introduces two complementary mechanisms. Personalized prompt injection encodes user behavior into a preference embedding and additively injects it into shared prompts, enabling parameter-efficient user-level adaptation. A semantic drift constraint regularizes the shared prompts within a trust region around their initialization anchors to preserve semantic validity during optimization. By constraining the shared component while allowing additive personalization, LRPRec decouples stability from expressiveness. Extensive experiments on three benchmark datasets demonstrate consistent improvements over strong baselines while eliminating the need for manual tuning of background and task inference templates.