Counselors find AI help efficient but worry about skill loss
Benefits and Barriers to Human-AI Teaming for Crisis Counseling
Human-Computer InteractionComputers and Society
Summary
Counselors working on a crisis hotline in India used an AI assistant to help with messages to people in distress. The AI helped them write empathetic and clear replies more quickly and caught details they might miss. However, some worry that relying too much on AI might reduce their own counseling skills or feel less genuine to clients. The study shows AI can support counselors but needs careful design to keep human connection strong.
What this means in practice
- •For mental health services: Use AI copilots to assist crisis counselors in managing message drafts, improving efficiency and empathy while monitoring for over-reliance risks.
- •For customer support teams: Incorporate AI-assisted message scaffolding tools to increase response speed and reduce stress in high-pressure communication contexts.
Authors
Ivy Pham, Akshay Swaminathan, Sebastian Garcia, Jaimie Lim, Gloria Ye, Divyanjali Verma, Alan Pham, Chastin Chung, Shreya Shah, Shaked Azzam, Sharang Phadke, Ivan Lopez, William Wang, Angelina Wang, Nigam H. Shah
Abstract
Background: AI systems are increasingly deployed to support mental health clinicians, yet real-world evidence remains limited. In crisis counseling, where clients often seek human connection, understanding whether AI augmentation preserves or undermines meaningful human engagement is essential. Methods: In a mixed-methods study of a counselor-facing AI copilot on a WhatsApp-based crisis hotline in India (Mar.-Oct. 2025), counselors could request, edit, and send AI messages. We analyzed 20 interviews, 8 shadowing sessions, 56 survey responses, and edits in 27,778 copilot messages from 108 counselors via thematic analysis (Technology Acceptance Model 2, plus inductive coding of emergent factors), and survey statistics. Results: Counselors reported high copilot acceptance (survey): 98.2% found it helpful; 89.3% likely to continue use; 80.4% reported efficiency gains. Interviews highlighted sentence scaffolding, empathetic phrasing, stress reduction, catching missed details, and efficiency. Barriers (survey) included repetitive outputs (23.2%), lack of context (17.9%), and authenticity concerns (10.7%). While 69.6% (survey) reported skill enhancement, interviews surfaced skill atrophy concerns. Counselors frequently accepted copilot suggestions, editing to remove questions, adjust tone, or personalize style. Conclusion: In one of the largest real-world deployments of a counselor-facing mental health AI copilot, counselors reported reduced cognitive load, empathetic communication, and greater efficiency, alongside concerns about skill atrophy, authenticity, and over-reliance. In settings like crisis counseling where clients seek human connection, AI tools must balance operational support with preserving clinical skill and genuine therapeutic engagement. Designs soliciting approval or editing of complete drafts may overweight efficiency at the expense of sustained human engagement.