Papers for

behavioral analytics engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

User embeddings reveal clear behavioral patterns for better personalization

User Embeddings are Superpositions of Interpretable Behavioral Modes

Abstract: User embeddings are central components of modern recommendation, personalization, and behavioral modeling systems. Though these embeddings can compactly encode rich behavioral information, they are inherently dense and opaque, limiting interpretability. To address this gap, we argue that user embeddings can be understood as sparse superpositions of interpretable behavioral modes. This structure is directly predicted by generative models of user behavior for linear embeddings and extends approximately to deep-learning representations by the superposition hypothesis. Superimposed modes can naturally be recovered by sparse dictionary learning methods, such as sparse autoencoders (SAEs), and recovered modes can be automatically named and queried in natural language. We validate mode recovery against known ground truth on synthetic data, where SAEs recover modes better than classical sparse baselines, including on transformer-encoded embeddings. We then apply the method to classical and transformer-based user embeddings from two real-world datasets. We also show how the corresponding natural-language labels enable zero-shot audience retrieval and characterization over embeddings never trained on text. The framework is post-hoc and model-agnostic, requiring no modification to the upstream embedding system.

Thu 5 NovMachine Learning
The gist
User embeddings are like digital fingerprints that capture how people behave online, but they are usually hard to understand because they mix many behaviors together. The authors show that these embeddings can be broken down into simpler parts that each represent a clear behavior mode, making them easier to interpret. They use special machine learning tools to find these behavior modes and even give them names using natural language. This helps to find and describe groups of users without needing extra text data. Their method works well on both fake and real user data and does not require changing the original embedding system.
Open → 2611.08487v1