Cross-language study reveals how players judge video games differently
Deciphering the Babel of Play: A Human-AI Collaborative Approach for Large-Scale Cross-Language Analysis of Game Reviews
Human-Computer Interaction
Summary
People from different language backgrounds often rate video games differently because they focus on different things like story, game mechanics, or how well the game is translated. The authors looked at hundreds of thousands of game reviews in many languages using a mix of human help and AI language tools. They found both differences and some rare areas where players agree regardless of language. This helps us understand how culture affects opinions about games.
What this means in practice
- •For game developers: Improve game design and marketing by understanding what different language communities value most in reviews.
- •For localization teams: Prioritize translation and cultural adaptation efforts based on language-specific review concerns identified via AI-assisted analysis.
Authors
Zixiaofan Yang, Chang Xiao
Abstract
We present a large-scale cross-language analysis of game reviews using a human-AI collaborative framework that combines quantitative screening with multilingual large language models (LLMs). Starting from 17 million Steam reviews across 30 languages and 2,000 top-selling titles, we select 28 games with notable cross-language rating patterns. We then apply LLM-assisted content analysis to 442,162 reviews spanning 17 languages, with human researchers guiding codebook development and interpreting the results. Our findings reveal differences in both the aspects language communities prioritize and how they evaluate them, highlighting the roles of narrative expectations, game mechanics and stability, localization quality, cultural proximity, and perceptions of developers and publishers. We also identify rare cases of cross-language consensus. This work offers empirical insights into cross-cultural game evaluation and a scalable methodological approach to multilingual content analysis that preserves human interpretation.