Draped Surfaces: A Contour-Adaptive Interface Overlaid on the Physical Environment for Mixed Reality Workspaces
2026-07-01 • Human-Computer Interaction
Human-Computer Interaction
AI summaryⓘ
The authors created a new way to display virtual windows in mixed reality that wraps these windows around real physical objects instead of floating them freely in space. This helps users see and interact with both the digital content and real-world items more easily. They tested their design and found it helps reduce extra hand movements while still keeping text readable. Their work suggests a better setup for mixed reality workspaces that helps users stay aware of their real surroundings while using virtual tools.
Mixed RealityVirtual WindowsOcclusionUser InterfaceHand MovementText LegibilityHuman-Computer InteractionSpatial Computing
Authors
SoonUk Kwon, Barrett Ens, Pourang Irani
Abstract
Conventional Mixed Reality (MR) workspaces are frequently organized in cockpit-like layouts, where multiple floating windows surround the user. While this configuration facilitates access to digital content, it often induces occlusion, reducing understanding of the physical environment and limiting access to real-world objects. To overcome this challenge, we present the Contour-Adaptive Mixed Environment Overlays (CAMEO), a contour-adaptive MR interface that drapes virtual windows onto physical surfaces. This design integrates digital content with nearby items, thereby improving users' visual access to background objects and supporting interaction with them. We evaluate CAMEO in two controlled studies. The first demonstrates that draping reduces hand-movement detours relative to flat mid-air surfaces, enabling more direct interaction with nearby items. The second shows that controlled window deformation does not significantly impair text legibility when compared to flat surfaces. Together, these findings contribute a novel design paradigm for MR workspaces that balances immersion, readability, and environmental understanding.