Papers for

media streaming engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Multimodal approach improves diverse and accurate recommendations

Multimodal Decoupling for Diversified Recommendation through Semantic and Structural Shaping

Abstract: Recommender systems often suffer from over-concentrated results when optimized for accuracy, limiting recommendation diversity. While diversity has become an important objective, existing methods still face fundamental limitations from both semantic and structural perspectives. On the one hand, multimodal recommender systems provide rich semantic signals, yet are often treated as auxiliary to ID embeddings, leading to ineffective semantic utilization for diversity. On the other hand, the accuracy--diversity trade-off persists during training, where accuracy gains often come at the cost of diversity. We show that this phenomenon is fundamentally governed by both the structural properties of learned representations and the dynamics of optimization. To address these challenges, we propose MOSS, a unified framework for multimodal decoupling through semantic and structural shaping. Specifically, we first introduce an MLLM-based Decoupled Feature Extraction module to disentangle multimodal content into informative representations. To enhance semantic utilization, we design a Category-aware Embedding Selection module that extracts compact, category-aware semantic features. To address structural limitations, we propose two complementary modules: Alternating Dual-Graph Propagation, which alleviates representation collapse by integrating collaborative and multimodal propagation, and Entropy-based Diversity Regularization, which mitigates optimization bias by promoting balanced category exposure. Extensive experiments on real-world datasets demonstrate that MOSS consistently achieves a superior accuracy--diversity trade-off over strong baselines.

Mon 19 OctInformation RetrievalArtificial Intelligence
The gist
Recommendation systems often suggest too many similar items when they focus only on what is most likely to be liked, making recommendations less varied. The authors found that using information from multiple types of data (like images and text) is not always done well, and this limits diversity. They created a new method called MOSS that separates and organizes different types of data better and encourages a wider spread of recommendations while keeping accuracy high. Tests on real data show their approach balances accurate and diverse suggestions better than others.
Open → 2610.26024v1

Agent system diagnoses and improves recommendation algorithms at scale

AURA: Agentic Diagnosis and Refinement for Production Recommender Systems at Scale

Abstract: How and why does a recommender system fail the users it serves? Oftentimes, practitioners are left to improve their algorithms based on a combination of feedback from stakeholder teams, domain expertise, and insights from data analyses. Yet the nuances of how and where recommendations perform well or poorly for end users are difficult to discern from aggregate quantitative metrics. Whereas these metrics provide a high-level and incomplete picture, further granularity into the quality of recommendations and their patterns requires reasoning with domain understanding and objectivity, at scale. We contemplate this complex conundrum and describe a method and implementation that uses the latest AI agentic advances to provide actionable diagnoses and improvements for production recommender systems. We present AURA (Agentic Understanding and Refinement of recommender Algorithms), an end-to-end agentic system that performs qualitative evaluation at scale and can then generate improvements to our algorithms at the code level. Specialized agents read production engagement logs, from thousands of sessions to millions, and surface patterns and examples of how the recommender fails real users. The next step uses those diagnoses and context about the recommender's own code, data, and training pipeline to propose and implement refinements grounded in that codebase. We report the system design, initial tests on production data from two large consumer platforms at a major media-streaming company, safeguards, operational learnings, and early results toward a self-improving recommender system. Finally, the diagnostic gap AURA closes is not specific to streaming. The architecture is built to transfer: every domain-specific element enters through the configuration layer that already ported it between our two platforms. We map it concretely to e-commerce and online-retail recommendation.

Tue 15 SeptInformation RetrievalArtificial IntelligenceMachine Learning
The gist
Recommender systems suggest things like movies or products but sometimes fail to give good suggestions. The authors created AURA, an AI tool that looks deeply at how and where these systems make mistakes by checking large amounts of real user data. AURA can then suggest and even change the recommendation algorithms to fix problems in the code. This approach was tested on big real platforms and can be adapted for other areas like online shopping.
Open → 2609.16625v1