Papers for

augmented reality interface designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Virtual objects recalled better than physical ones in mixed reality office

Exploring Object Recall in an Object-Rich AR Office Scene

Abstract: Augmented reality (AR) changes how users perceive and attend to their surroundings. Prior work suggests AR can reduce attention to the physical world, but it remains unclear whether this holds in environments dense with both virtual and physical objects, and which factors most affect object recall. This study examines recall in a mixed-reality office scene after an object-selection task, testing object-level factors (virtuality, size), context-level factors (semantic congruency, saliency), and user-level factors (cueing, dual tasking). Cueing informed participants of a later recall test, while dual tasking added cognitive load through a secondary audio task. Virtual objects were recalled more accurately than physical ones. Cueing produced a modest improvement in recall of present objects. Using playback software to reconstruct each participant's view throughout the trials, we computed object-level saliency and found a weak positive correlation with recall, slightly stronger than the effects of virtuality, but not reaching statistical significance. These findings have implications for AR interface design and for building mixed-reality environments that better support cognition during real-world tasks.

Tue 13 OctHuman-Computer Interaction
The gist
People often have to remember objects around them, but augmented reality (AR) changes how we focus on things in the real world. This study looked at how well people remember virtual and physical objects after a task in a cluttered AR office setting. They found that people remembered virtual objects better than physical ones, and giving a hint about the memory test helped a little. Other factors like how noticeable objects were didn’t strongly affect memory. The researchers hope their findings help make AR tools that better support real-world tasks.
Open → 2610.18183v1

Reliable co speech gesture generation balancing semantics and rhythm

When Semantics Matter: Reliability-Aware Semantic-Rhythm Control for Co-Speech Gesture Generation

Abstract: Co-speech gesture generation aims to synthesize natural gestures that are both temporally synchronized with speech and semantically consistent with the spoken content. Although recent methods can generate rhythmically plausible motions, they often rely heavily on acoustic prosody while underutilizing textual semantics, especially when semantic annotations are incomplete, noisy, or unavailable. Consequently, the generated gestures may follow speech rhythm while failing to express the intended semantics. To address this problem, we propose a reliability-aware semantic-rhythm control framework for co-speech gesture generation. We first learn a discrete motion prior that represents continuous gestures in a compact and structured motion-code space. We then introduce a dual-branch semantic contribution estimation mechanism consisting of a full multimodal branch and an audio-only branch. Their distributional discrepancy is formulated as conditional information gain to quantify how much textual semantics changes the predicted motion. Based on this estimate, a controllable semantic-rhythm objective selectively strengthens semantic guidance in content-relevant segments while limiting unnecessary semantic intervention in rhythm-dominant segments. Furthermore, we treat background noise as an acoustic reliability condition and introduce noise-conditioned feature modulation together with beneficial latent perturbation to improve generation robustness under realistic acoustic environments. Experiments on benchmark datasets demonstrate that the proposed framework achieves a favorable balance among semantic expressiveness, rhythmic synchronization, motion diversity, and robustness, enabling reliable and controllable co-speech gesture generation.

Tue 29 SeptComputer Vision and Pattern Recognition
The gist
Making animated gestures that match spoken words can be tricky because gestures should flow with the speech rhythm and also show the meaning behind the words. The authors found that past methods rely too much on sound patterns and not enough on the actual meaning of speech, which can cause gestures to miss important content. They designed a new system that watches how much meaning influences motion and adjusts the gestures accordingly, improving how well gestures match both meaning and rhythm. Their system also handles noisy sound better, so it works well even in less-than-ideal listening situations.
Open → 2609.36685v1