Publication
Human-Centered Design of Mixed Reality Applications in Medical Education - GreifbAR
Robert Luzsa; Moritz Queisner; Christopher Remde; Igor Sauer; Nadia Robertini; Susanne Mayr
In: reale Teilhabe - Transformative Technologien für eine inklusivere Gesellschaft Virtuelle Beteiligung. Virtuelle Beteiligung, reale Teilhabe: Transformative Technologien für eine inklusivere Gesellschaft. Pages 385-408, ISBN 978-3-593-46260-8, Campus Verlag, 7/2025.
Abstract
The capabilities of mixed reality (MR) applications to combine visualizations with a user’s real environment offer benefits for the training of complex surgical skills like the tying of surgical knots. By wearing a virtual reality headset combined with a passthrough function, users can see additional information that adapts to their body or physical objects, such as visual instructions to perform a work task or they can receive individualized feedback based on their movement. To ensure usability, user acceptance and effective learning outcomes of MR applications, it is essential to assess the knowledge of domain experts as well as to derive requirements from state-of-the-art training concepts. This chapter provides an overview of tools and challenges associated with integrating users into the development of medical MR applications. Drawing on findings and insights gained during the development of an MR-based knot-tying trainer in the Tangible Reality project, the chapter offers recommendations for effectively incorporating users into the design of similar MR applications.