Skip to main content Skip to main navigation

Publikation

When AR Hinders Performance: The Hidden Costs of Video-See-Through Displays

Hamraz Javaheri; Vitor Fortes Rey; David Kariem Habusch; Jakob Karolus; Paul Lukowicz
In: ACM VRST. ACM Symposium on Virtual Reality Software and Technology (VRST-25), 31st ACM Symposium on Virtual Reality Software and Technology, November 12-14, Montreal, QC, Canada, ISBN 979-8-4007-2118-2/2025/11, ACM, 2025.

Zusammenfassung

Head-mounted displays (HMDs) are increasingly used in safety-critical fields such as surgery, aviation, and industrial manufacturing. As major manufacturers shift toward video-see through (VST) designs to deliver unified AR and VR experiences, they also replace direct visual access to the real world with a video feed. This design choice raises concerns about its impact on user performance. This study investigates the isolated impacts of VST and optical-see through HMDs on user real-world perceptual–motor performance by comparing two leading HMDs, Apple Vision Pro (AVP) and HoloLens 2 (MHL2) against unencumbered vision using the Purdue Pegboard Test (PPT), a standard assessment of manual dexterity. Twenty participants completed tasks across three conditions (AVP, MHL2, and Baseline), while we recorded dexterity scores, cognitive load, system usability, VR sickness, and subjective feedback. Movement data were also collected via Apple Watches. Study results with 20 participants revealed that dexterity scores significantly declined under the AVP condition across all subtests. This was accompanied by significantly higher cognitive load and a notable drop in RMS acceleration values (observed in the RMS analysis of a subset of 13 participants). The analysis on dexterity score yielded a significant difference between MHL2 and Baseline only for a single subtest of the PPT (Left Hand). Post-task interviews revealed greater discomfort, visual fatigue, and reduced task confidence with AVP. These findings suggest that current VST HMDs impose a hidden ergonomic cost undermining user performance in tasks where precision, and comfort are essential. For AR applications designed to enhance user performance, such as assistive tools, training systems, or task guidance interfaces, designers must account for and mitigate this performance degradation through counterbalancing strategies to offset the visual and cognitive burden introduced by VST HMDs.