Semantic id based recommendation improves by focusing on one token level
LESSRec: Level-Specific History Modeling for Semantic ID-Based Recommendation
Information Retrieval
Summary
Recommending items in apps often means predicting which item a person will want next, by analyzing the history of items they interacted with. This paper finds that looking at the history of tokens (word-like pieces representing item features) only at the same level as the item being predicted is more helpful than mixing all levels together. The authors propose a method called LESSRec that separately processes token histories by level and uses an additional summary of each item's overall meaning. LESSRec and its variant LESSRec+ show better recommendation quality and faster computation on multiple datasets.
What this means in practice
- •For ecommerce platform developers: Improve product recommendation engines by integrating level-specific token history modeling to increase relevance and reduce noise in suggestions.
- •For streaming service engineers: Enhance content recommendation by separately encoding different semantic levels of user interaction history to focus predictions more effectively.
Authors
Shangxin Yang, Zongwei Wang, Jing Long, Junliang Yu, Min Gao
Abstract
Semantic ID-based recommendation represents each item as a sequence of semantic tokens obtained through residual quantization. This paradigm generates the next item's tokens autoregressively from coarse to fine, entailing each prediction attending to historical tokens at all semantic levels. However, our inference-time analysis reveals that historical tokens at the target-token's semantic level tend to be more informative, whereas other levels can introduce interference. Motivated by these findings, we propose LESSRec that separately encodes the historical token sequence at each semantic level and restricts attention over historical tokens to the sequence at the target token's semantic level during prediction. To complement these level-specific histories, LESSRec explicitly provides an item-level semantic sequence that represents each historical item's overall semantics in chronological order. The decoder accesses the level-aligned token sequence and the item-level semantic sequence through two separate cross-attention branches and fuses their contexts. We further introduce LESSRec+, which uses separate encoders for different semantic-level histories with the same total parameter count to reduce encoder computation. Extensive experiments across three public datasets and three tokenizers demonstrate the recommendation effectiveness of LESSRec and LESSRec+, with efficiency analyses highlighting the computational benefits of LESSRec+.