Selfrionette controller enables avatar control and haptics using fingertip force input
Selfrionette: A Fingertip Force-Input Controller for Continuous Full-Body Avatar Manipulation and Diverse Haptic Interactions
Human-Computer Interaction
Summary
Moving freely in virtual reality usually requires space and full body tracking equipment, but this research introduces Selfrionette, a handheld device that lets users control their whole body’s avatar by applying force with just their fingertips. The device not only controls movements but also simulates realistic touch sensations by pushing back on the fingers. The authors tested the system and found it lets users interact and feel objects in the virtual world almost as naturally as with full body tracking, even in limited spaces.
What this means in practice
- •For virtual reality developers: Create VR experiences that allow full-body avatar control and rich haptic feedback with minimal physical space using fingertip force input.
- •For assistive technology designers: Design VR interfaces enabling users with limited mobility or space constraints to navigate and interact using fingertip force input for full-body avatar control.
Authors
Takeru Hashimoto, Yutaro Hirao
Abstract
We propose Selfrionette, a controller that uses fingertip force input to drive avatar movements in virtual reality (VR). This system enables users to interact with virtual objects and walk in VR using only fingertip force, overcoming physical and spatial constraints. Additionally, by fixing users' fingers, it provides users with counterforces equivalent to the applied force, allowing for diverse and wide dynamic range haptic feedback by adjusting the relationship between force input and virtual movement. To evaluate the effectiveness of the proposed method, this paper focuses on hand interaction as a first step. In User Study 1, we measured usability and embodiment during reaching tasks under Selfrionette, body tracking, and finger tracking conditions. In User Study 2, we investigated whether users could perceive haptic properties such as weight, friction, and compliance under the same conditions as User Study 1. Selfrionette was found to be comparable to body tracking in realism of haptic interaction, enabling embodied avatar experiences even in limited spatial conditions.