Papers for

online video platform engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multi-agent system boosts personalized video ads with reinforcement learning

MAPS: A Multi-Agent Personalized Script-Driven Video Advertising System Enhanced by Reinforcement Learning

Abstract: With the rapid growth of online video consumption, video advertising has become a dominant component of digital advertising. Most personalized video advertising systems follow a retrieval-based paradigm, which matches ad content with user preferences in a feature space and recommends the most similar candidates. However, since the candidate creatives are pre-produced, this paradigm limits the granularity of personalization and leads to performance disparities across diverse user groups. To address this limitation, we propose a multi-agent personalized script-driven video advertising system (MAPS). We design four collaborative agents that form a closed-loop pipeline of user profile modeling, script generation, video synthesis, and feedback-driven iterative refinement. To train the Scripter Agent, we develop a reinforcement learning framework equipped with a multi-dimensional reward function, which steers the agent toward producing scripts that simultaneously align with user content preferences and target product information. Extensive offline experiments on representative datasets demonstrate that our approach achieves encouraging performance in generating and integrating personalized creatives. Online A/B experiments in a specific scenario in the Kuaishou advertising system show that MAPS improves CTR by 2.87%, CVR by 2.74%, and ARPU by 9.85% over the generative baseline.

Mon 19 OctInformation RetrievalComputer Vision and Pattern RecognitionMultiagent Systems
The gist
Online video ads often can't be personalized deeply because they use pre-made videos matched to users. The authors designed a system called MAPS with four ‘agents’ that work together to understand user preferences, create custom ad scripts, make videos, and improve them based on feedback. They trained the script-writing agent using reinforcement learning so it balances user taste and product details. Tests show MAPS makes better personalized ads and increases clicks and purchases in real-world ads.
Open → 2610.25748v1

Generative recommenders improve ranking by separating training supervision

Training with Missed Targets in Generative Recommendation: Separating Supervision from Probability Competition

Abstract: Generative recommenders return a limited candidate set and may omit observed targets before reranking. A training strategy appends these missed targets to reranker training lists, although inference still ranks only original candidates. This operation simultaneously changes retrieved-target weight, adds supervision over appended targets, and makes the two groups compete for probability. An append/no-append comparison therefore cannot explain changes in returned-item rankings. We construct three matched losses that hold retrieved-target weight fixed while introducing appended-target supervision and group competition separately. The intermediate loss trains within both groups but normalizes them separately, preventing training-only targets from competing with inference candidates. Experiments with a released OneRec model and locally trained Amazon generators show that this competition can harm returned-item ranking. In four prespecified Amazon Video Games comparisons, removing it improved full-target normalized discounted cumulative gain (FT-NDCG) by 7.8--22.2\%; 95\% intervals over users and three of four intervals over training runs excluded zero. A conservative development-set rule selected appended-target training for two of three generators in one held-out category and rejected it for all three in another, avoiding a 1.7\% loss. Candidate completion should therefore be evaluated for each generator rather than applied automatically.

Wed 7 OctInformation RetrievalMachine Learning
The gist
Generative recommendation systems try to suggest items to users but sometimes miss items they should have recommended. The authors study how adding these missed items during training affects the final ranked suggestions. They find that making missed items compete with original candidates for ranking can actually harm performance. By separating supervision on missed items during training from the ranking competition during inference, recommendation quality improves. This means recommendation systems should carefully choose how they train on missed items rather than always using the same approach.
Open → 2610.10124v1