Publikation
GTK: An Open-Source Toolkit for Gaze-based Interaction in XR
László Kopácsi; Michael Barz; Daniel Sonntag
In: 2026 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (IEEEVR-2026), March 21-25, Daegu, Korea, Republic of, IEEE, 3/2026.
Zusammenfassung
Gaze interaction is becoming increasingly prevalent in Extended Reality (XR) due to the widespread integration of eye-tracking sensors in modern head-mounted displays. However, implementing robust gaze-based interfaces requires substantial development effort, often leading to reimplementation of established interaction patterns. We present the Gaze Interaction Toolkit (GTK), an open-source Unity package designed to facilitate the integration of active and passive gaze-based interaction in XR environments. GTK provides modular components including gaze-aware interactables, gaze-contingent information displays, and spatial context menus, as well as tools for onboarding, visual attention monitoring, and eye-tracking accuracy assessment. We demonstrate these features through an industrial sorting task scenario that systematically introduces users to multimodal gaze-assisted interaction techniques, illustrating the toolkit's capabilities for developing gaze-responsive user interfaces in XR training applications.
Projekte
- MASTER - MASTER: Mixed reality ecosystem for teaching robotics in manufacturing
- No-IDLE - Interactive Deep Learning Enterprise
