Publikation
Using Eye-gaze and Visualization To Augment Memory: A Framework for Improving Context Recognition and Recall
Jason Orlosky; Takumi Toyama; Daniel Sonntag; Kiyoshi Kiyokawa
In: Proceedings of the 16th International Conference on Human-Computer Interaction. Human Computer Interaction International Conferences (HCII-14), Pages 282-291, LNCS Springer, 2014.
Zusammenfassung
In our everyday lives, bits of important information are lost due to the fact that our brain fails to convert a large portion of short term memory into long term memory. In this paper, we propose a framework that uses an eye-tracking interface to store pieces of forgotten information and present them back to the user later with an integrated head mounted display (HMD). This process occurs in three main steps, including context recognition, data storage, and augmented reality (AR) display. We demonstrate the system’s ability to recall information with the example of a lost book page by detecting when the user reads the book again and intelligently presenting the last read position back to the user. Two short user evaluations show that the system can recall book pages within 40 milliseconds, and that the position where a user left off can be calculated with approximately 0.5 centimeter accuracy.