Large language model errors inspire creativity in different work stages

From LLM Hallucinations to Inspiration in Creative Work

Human-Computer Interaction

Summary

Sometimes, large language models (LLMs) make mistakes called hallucinations, where they create unexpected or wrong ideas. The authors studied how creative workers in research, design, and social media decide when these mistakes actually inspire them. They found that inspiration depends on how relevant the idea is, the task phase, and how easily the idea can be adapted. Their work also shows how this inspiration affects trust and interaction with the AI, and suggests ways to design AI tools that better handle these creative moments.

What this means in practice

  • For content creators: Use AI tools that highlight and manage hallucinated ideas to boost creative inspiration while allowing error correction during content development.
  • For product designers: Design AI-assisted creative tools that adjust hallucination control based on the creative stage and user priorities for better idea exploration.

Authors

Xinrui Lin, Heyan Huang, Shuning Zhang, Qi Wang, Youchao Zhou, John Vines

Abstract

Large language models (LLMs) can introduce unexpected ideas through hallucinations, yet little is known about when creative practitioners find these errors inspiring or how these judgments shape interactions. We conducted a retrospective qualitative study with 20 experienced practitioners in research, design, and social media content creation, thematically analyzing 41 hallucination cases and 20 semi-structured interviews. Our framework links inspiration judgments of hallucinations based on goal relevance, task stage, content adaptability, and type-specific factors to behaviors across not-inspired, inspired-by, and inspired-to states. We characterize downstream interaction consequences, showing how hallucination-inspired experiences vary across creative stages and reshape role-differentiated trust, and propose these consequences as a dimension of hallucination evaluation. Finally, we derive design recommendations for stage-sensitive control of divergence and adherence, user-defined constraint priorities, differentiated hallucination labels, and salvage support for preserving useful ideas while correcting errors. These contributions deepen HCI understanding of hallucinations and responsible LLM design in creative work.