Expert users get more team opportunities and success on Kaggle forums

Who Shows Up, Who Benefits, and Who Wins? Expert-Novice Disparities in Team-Seeking Forums and Competition Performance on Kaggle

Computers and SocietyHuman-Computer Interaction

Summary

Finding teammates online can be hard, and this study looks at how people find team members on Kaggle, a data science contest site. Most people seeking teams are newcomers, but experienced users get more replies and more chances to join teams. Just talking in team forums doesn’t predict winning, but being active in contest work does. This suggests that open team-seeking spaces don’t always help everyone equally.

What this means in practice

  • For online platform designers: Design team-seeking forums to highlight productive contributors and reduce barriers for novices to increase fair collaboration opportunities.
  • For community managers: Use indicators of active participation, beyond just discussion presence, to identify users likely to form successful teams.

Authors

Ran Bi, Shiyao Wei

Abstract

Team formation is the first social gate to collaboration in online communities, yet it remains unclear whether public team-formation mechanisms broaden access to collaborators or reproduce existing hierarchies. We examine this question on Kaggle, a data science competition platform whose "Looking for a Team" (L4T) megathreads let participants publicly seek teammates for on-platform competitions. Grounded in Communities of Practice theory, we conduct two complementary studies of 18 competitions held in 2023. Study 1 analyzes the reply network among 671 megathread participants and finds that 89.3% are low-tier users, yet higher-tier users receive significantly more replies (Kruskal-Wallis H=16.46, p=.00246) and achieve higher rates of forum-visible teaming success (52.9% vs. 32.6%; chi-squared=10.53, p=.001), a proxy for eventual team membership. Linking megathread posters to verified team rosters from 16 competitions partially supports this proxy. Twenty-six final teams contained two or more megathread posters, indicating that megathread interaction sometimes, but not always, maps onto realized teaming. Study 2 links participation traces from 219 users to private leaderboard outcomes and finds that productive participation (submission count rho=.435, cross-competition participation rho=.247) is positively associated with performance, whereas megathread-specific discussion is not (rho=-.021). The submission-performance association appears stronger in higher tiers, although the novice subgroup estimate is imprecise. Together, the findings suggest that open access to team-seeking forums does not guarantee equal participation. Visible expertise shapes who attracts attention, and engagement in the community's core practice is more strongly linked to success than discussion alone. We discuss implications for designing more equitable team formation in online collaboration environments.