AI generated content does not reduce trust in gender biased statements
Evaluating Human Sensitivity to Gender Biased AI-Generated Content through Human Assessment of Google's Autocomplete Function
Computation and Language
Summary
People often worry that information made by AI might feel less trustworthy, especially about sensitive topics like gender. This paper studied Spanish speakers reading gender-related statements and tested if knowing the content came from AI changed their opinions or how quickly they responded. The researchers found that whether participants knew the content was AI-generated or not, it didn't change their agreement or reaction times. This suggests people may treat AI-generated statements as credible as human-authored ones, even when biases exist.
What this means in practice
- •For content moderators: Adapt moderation practices knowing AI-generated biased content may be equally trusted by users despite origin disclosures.
- •For social media platform teams: Design trust-building features that consider users do not inherently distrust AI-labeled biased statements.
Authors
Tamara Serrano, Nikoleta Pantelidou, Raquel Montero, Natalia Moskvina, Paolo Morosi, Evelina Leivada
Abstract
Large Language Models (LLMs) are increasingly present, but their effects on human users remain underexplored. We tested whether AI-attributed information influences views regarding gender-related statements, a domain where biases are pervasive. Spanish-speaking participants recruited through Prolific evaluated biased statements derived from Google's autocomplete function and human-authored, non-biased gender-related facts. Participants were either informed that some of the material was AI-generated or received no information about its origin. AI attribution did not affect reaction times or agreement judgments. This result suggests that AI-generated content does not automatically raise credibility concerns and may be evaluated with less scrutiny compared to human-produced content.