Richard manages voice tasks with persistent mobile session control
Richard: Voice-First Mobile Interaction for Persistent Tasks
Human-Computer InteractionArtificial Intelligence
Summary
Mobile devices often struggle to balance voice-based requests with users' need to control their attention and keep track of ongoing tasks. The authors present Richard, a system that separates voice conversations from task execution, letting users pause, revise, and review their requests over time. It links these conversations and tasks through persistent records, providing visual feedback and backend coordination. This design helps users manage tasks more reliably even when they disconnect or switch attention.
What this means in practice
- •For mobile app developers: Integrate persistent voice task management into mobile apps to allow users to pause, revise, and review voice-driven requests seamlessly.
- •For personal assistant software teams: Create voice assistants that maintain task continuity and provide structured feedback even after user disconnection or task delays.$Commercial implications: Enables more reliable and user-controlled voice assistant experiences, improving product differentiation and user retention.
Authors
Xinyang Chen
Abstract
Mobile terminals need to provide application and network services while supporting users' control over their attention. We explore voice-first interaction organized around requests and delegated tasks, allowing users to leave a conversation and later inspect, revise, and retrieve the work. We present Richard, a system prototype that manages voice sessions, task execution, and result delivery separately, linking them through persistent request records. Conversation and task views provide visual feedback, while the backend coordinates immediate responses, dedicated service operations, and agent tasks. Request revisions, execution states, and notifications remain associated with the relevant task. We examine this design through Android functional records, controlled lifecycle verification, and execution records of a real programming request. Controlled verification reproduces revision, execution after confirmation, and result retention; deployed-service records show backend progress and failure feedback after client disconnection. These observations inform the design of task continuity, user control, and service integration in mobile voice interaction, providing an implementation basis for personal computing devices that accommodate intermittent user participation.