Generative recommendation improves search by reallocating beam budget early

Where Beam Search Loses Top-Ranked Items:First-Step Coverage in Generative Recommendation

Information Retrieval

Summary

When computers suggest items, they look through possible options step-by-step using a method called beam search. This paper finds that many top item suggestions get lost right at the first step of that search process. By shifting more search effort to this initial step, the authors show it's possible to keep better recommendations without using more resources or retraining models. This adjustment speeds up the recommendation process while keeping quality high.

What this means in practice

Authors

Heng Yao, Hanwei Zhu

Abstract

Generative recommendation can reproduce a wider beam's ranked output with roughly half the prefix-capacity budget by reallocating retention capacity across semantic-ID positions. We identify a \emph{first-step coverage bottleneck}: across six full-test settings of the TIGER generative recommender spanning three domains and two identifier constructions, every pruned exact top-10 path is first lost at the initial decoding step. An exact-catalog reference isolates search losses and guides a controlled budget intervention. Moving width to the first step raises Search Recall@10 by 0.96--10.90 percentage points at Beam-50's unchanged budget. Across all 77,373 test users with residual-quantized variational autoencoder (RQ-VAE) tokenization, the reallocated schedule reproduces Beam-100's ordered top-10 at nominal budgets of 151 rather than 301, without retraining or changing identifiers or scores. Matched-output timing saves 6.35--6.39\% of decoder latency; profiling identifies the execution costs that limit the translation from reduced search work to runtime savings. Larger-candidate experiments reveal how output size changes retention requirements. These findings make budget placement an actionable serving decision: locate ranking loss, redirect search capacity, and preserve downstream inputs before increasing uniform beam width.