AI summaryⓘ
The authors looked at recent research papers about language technologies for languages that don’t have many resources, especially focusing on how these papers talk about helping local communities and addressing inequality. They found that many papers use certain common phrases that might make it harder to really hold researchers accountable or produce fair knowledge with and for these communities. Also, claims about benefits to communities are often not clearly proven. While many studies say they aim to involve communities, the authors found that most focus more on creating language tools and tests rather than making bigger changes. They suggest ways for people to better evaluate these claims and avoid misunderstandings.
Low-resource languagesNatural Language ProcessingMultilingualityCommunity participationDecolonisationResearch framingBenchmarkingACL AnthologyAccountabilityEquitable knowledge production
Abstract
Building language technologies and conducting NLP research for low-resource languages---particularly when led by native speakers or involving participatory research practices---are often framed as means of addressing inequality, serving local communities, and, at times, contributing to *decolonisation*. In this paper, we examine recently published NLP and ML papers, focusing on the narratives used to characterise multilinguality, low-resource languages, and underrepresented cultures. We propose a framework for analysing research framings and identify recurring rhetorical patterns that may hinder accountability and constrain equitable knowledge production for---and by---underserved communities. We further assess the evidential basis of assertions regarding community benefit and find that such statements are often weakly supported or left unsubstantiated. Although community ownership and participation are frequently presented as key objectives, our analysis, supported by statistics from the ACL Anthology, suggests that research outputs more often prioritise resource creation and benchmarking---important but distinct goals---over evidence of broader structural change. We conclude by offering practical recommendations to help authors, reviewers, and readers critically assess these assertions and avoid potentially misleading framings.