Generative search favors loudest Reddit voices over diverse perspectives

The Wisdom of the Loudest: A Large-Scale Audit of Generative Search on Reddit

Information Retrieval

Summary

Online communities like Reddit have many voices sharing advice and support, but when search tools generate answers, they often highlight the opinions that are most visible and authoritative rather than the full variety of experiences. The authors studied 10,000 questions across multiple Reddit communities and found that formal, directive comments were more likely to appear in generated answers, while personal stories and first-person voices were lost. This means generative search isn't just summarizing all opinions evenly—it tends to highlight the loudest and most official voices. Designing these systems should consider keeping traceability, diversity, and clear communication.

What this means in practice

  • For search engine developers: Improve generative search ranking to maintain diverse and personal community perspectives in answers.
  • For content moderation teams: Adjust moderation and visibility tools to balance exposure between formal authoritative comments and personal experiential voices.

Authors

Agam Goyal, Wang Claire, Eshwar Chandrasekharan

Abstract

Online communities are valued not only for answers, but for the diversity of experiences and perspectives they contain. Generative search increasingly mediates access to this discourse, yet little is known about which community voices survive retrieval and synthesis. We audit Reddit Answers using 10,000 queries from 20 advice- and support-seeking communities, repeated three times to produce 30,000 answers over 14.68M comments. We find that differences across runs are driven primarily by retrieval, answers routinely combine evidence across communities, and selection strongly favors already-visible, top-level comments. Formal and directive language is more likely to be surfaced, while experiential voice is less likely to survive selection and is further weakened during synthesis, with first-person singular language declining sharply. These findings show that community-grounded generative search is not neutral summarization, and should be designed not only for relevance and fluency, but also for provenance, plurality, and legibility.
View PDFOpen arXiv