Wikipedia replies boost certain newcomers editing chances
Who Benefits from Wikipedia's Growth Mentorship? The Role of Newcomer Information Needs
Social and Information NetworksHuman-Computer Interaction
Summary
Not all newcomers to Wikipedia benefit equally from getting help from mentors. The authors found that when new editors ask questions and get answers, they tend to edit more in the short term, especially if their questions are about rules, editing tasks, or specific how-to issues. However, newcomers who just don’t know what to do don’t seem to benefit from replies. Also, faster and more focused replies lead to more editing. This helps us understand how to support new Wikipedia editors better.
What this means in practice
- •For community managers: Improve volunteer mentor response prioritization by focusing on newcomer questions about rules and how-to editing to boost newcomer retention.
- •For online platform designers: Design onboarding systems that prompt mentors to reply quickly and stay on-topic to increase new user engagement and contributions.
Tested on one dataset.
Authors
Yubo Zhou, Pengyu Chen, Ceren Budak
Abstract
Evaluations of Wikipedia's programs for new editors usually ask whether a program works on average; we ask which newcomers benefit when their question to a mentor gets a reply. English Wikipedia's Growth mentorship system assigns every new account a volunteer mentor, and about a quarter of the questions newcomers send never get a reply. Using the first questions of 34,073 newcomers (2021 to 2026), we compare newcomers who received a reply with similar newcomers who did not, matched on 164 characteristics recorded before the question (propensity score stratification). (1) Does a reply help newcomers keep editing? Yes, in the short term: in the 14 days after the reply, newcomers who received one were 1.8 percentage points (pp) more likely to edit an article (22% vs. an estimated 20% without a reply) and 1.8pp more likely to edit on two or more days. Later in the first year, the only difference that remains significant after correction for multiple testing is in the share who edit an article at least once between six months and one year after the reply (+1.5pp). (2) Does the effect depend on what the newcomer asked? Yes. We sort questions by Morrison's (1993) information-seeking types, which earlier studies measured mostly through self-reports, using a language model checked against human labels. A reply has significant effects for questions about rules and norms (+3.4pp), questions that show the newcomer's earlier editing (+3.4pp) and specific how-to questions (+2.4pp). For newcomers who do not know what to work on, a reply has no detectable effect, and the effect is 4.2pp smaller than for newcomers with other questions. (3) Which replies are followed by more editing? Among newcomers who received a reply, those whose reply came sooner or stayed closer to the topic of their question edited more.