Simple SimHash tokens match complex methods in item recommendations
Rethinking Semantic ID Construction for Generative Recommendation: SimHash with Parallel Decoding and Semantic Alignment
Information Retrieval
Summary
Recommender systems often represent items using sequences of tokens that capture their meanings. Normally, creating these tokens involves complex training, but this paper shows that a simple hashing technique called SimHash can perform just as well if combined with certain decoding and alignment steps. The authors introduce FLASH, a method that uses SimHash without any training and improves recommendation results, especially when suggesting new or rare items. This challenges the belief that only complex learned methods can work well for such tasks.
What this means in practice
- •For recommendation system engineers: Integrate FLASH to efficiently generate semantic item tokens without training, improving item recommendations and generalization to new items.
- •For e-commerce platform developers: Enhance product suggestion engines by adopting FLASH to reduce computation while maintaining high recommendation quality, especially for rarely seen products.
Authors
Yuqing Liu, Huiyuan Chen, Yibo Wang, Wooseong Yang, Philip S. Yu
Abstract
Semantic ID-based generative recommendation represents each item as a sequence of discrete tokens, enabling structured modeling of item semantics. A critical challenge is constructing semantic IDs that are both semantically expressive and computationally efficient. While recent approaches favor complex learned quantization, simple hashing-based methods such as SimHash are widely regarded as fundamentally inferior. In this work, we challenge this consensus by showing that the apparent performance gap does not stem from inherent limitations of hashing, but rather from a structural mismatch with autoregressive decoding, coupled with the inevitable information loss during rigid discretization. Based on this insight, we propose FLASH, a two-stage framework that revitalizes training-free SimHash tokenization through parallel decoding and explicit semantic alignment. Despite its simplicity, FLASH achieves state-of-the-art performance across multiple datasets without requiring any tokenizer training, while exhibiting stronger generalization in cold-start scenarios. Notably, we demonstrate that semantic alignment acts as a universally effective mechanism across diverse paradigms. Our findings suggest that, with compatible decoding and semantic grounding, simple and efficient tokenizers can achieve performance comparable to complex learned counterparts in generative recommendation. Our code is available at https://github.com/KevinC2015/Flash.