Fostering Emotional Perspective-Taking: An Exploration of Affective Face-Tracking Interactions in the VR Narrative Rekindle
2026-06-01 • Human-Computer Interaction
Human-Computer InteractionMultimedia
AI summaryⓘ
The authors explore how using emotions detected through a VR headset's face-tracking can improve Interactive Digital Narratives (IDN). Instead of just changing game settings based on emotions, their approach helps players feel closer to their in-story character by sharing emotional experiences. This means players can connect more deeply with the story they are part of. Their model is tested within a specific authored narrative, which is different from previous work.
Interactive Digital NarrativeVirtual RealityFace TrackingEmotional Perspective-TakingBiometric DataPlayer EngagementNarrative ExperienceAffective InteractionVR HeadsetEmotion Recognition
Authors
Hector Fan, Casper Hartveld, Mark Sivak
Abstract
Interest in leveraging emotions in Interactive Digital Narrative (IDN) has been growing, and Virtual Reality (VR) offers rich access to real-time biometric data such as facial expressions; yet this capability remains underexplored in novel IDN design. Existing approaches typically treat emotion input superficially, such as adjusting system difficulty or aesthetics, but rarely influence how players experience the narrative itself. Prior work also lacks a focus on a specific authored narrative. We propose an experimental affective interaction model that uses a VR headset's built-in face-tracking capability to recognize player emotional states, fostering "emotional perspective-taking" between the player and their embodied story character, thereby deepening the player's emotional connection to the character and their narrative engagement with the VR experience.