Ranking bandits improve click prediction using observed browsing depth

Ranking Bandits for Carousel Interfaces with Observable Browsing Depth

Machine Learning

Summary

This paper looks at how to better guess which items people will click on in carousel-style lists, like those you scroll through on shopping or streaming sites. The authors focus on knowing exactly how far a user scrolls, which helps distinguish between items shown but ignored and items never seen at all. They design and test three new algorithms that learn from this browsing-depth information to improve recommendations. Their math proofs show one method works very efficiently, and tests on simulated and real data suggest these methods perform better than some older approaches.

What this means in practice

Authors

Takuma Yasuda, Atsuyoshi Nakamura

Abstract

Carousel interfaces allow a recommender system to directly observe how far a user has browsed. This signal distinguishes displayed but unclicked items from items that were never displayed, whereas conventional ranking-bandit models, including cascade and position-based models, generally treat examination as latent. We formulate a ranking-bandit problem in which a learner presents a list of $L$ items, observes the user's maximum browsing depth, and receives click feedback only for positions up to that depth. The objective is to maximize the expected number of clicks under an unknown item-attractiveness vector and a browsing-depth distribution. We propose three algorithms based on UCB, Thompson Sampling, and DMED, all of which update item statistics only from observed exposures. We derive an instance-dependent logarithmic upper bound for our UCB-based algorithm and an asymptotic upper bound for our DMED-based algorithm that coincides with the lower bound as its parameter $α\downarrow 0$, establishing asymptotic optimality in this limit. Simulations in synthetic shallow- and deep-browsing environments, together with experiments parameterized from RecGaze interaction logs, show that OD-TS attains final mean regret similar to PBM-TS, while the proposed methods achieve lower final mean regret than PBM-UCB.