Gaze Guided Object Recognition Using a Head-Mounted Eye Tracker

Publication

Takumi Toyama, Thomas Kieninger, Faisal Shafait, Andreas Dengel

In: The Seventh ACM Symposium on Eye Tracking Research & Applications. Symposium on Eye Tracking Research & Applications (ETRA-2012) March 28-30 Santa Barbara California United States ACM 2012.

Abstract

Wearable eye trackers open up a large number of opportunities to cater for the information needs of users in today's dynamic society. Users no longer have to sit in front of a traditional desk-mounted eye tracker to benefit from the direct feedback given by the eye tracker about users' interest. Instead, eye tracking can be used as a ubiquitous interface in a real-world environment to provide users with supporting information that they need. This paper presents a novel application of intelligent interaction with the environment by combining eye tracking technology with real-time object recognition. In this context we present i) algorithms for guiding object recognition by using fixation points ii) algorithms for generating evidence of users' gaze on particular objects iii) building a next generation museum guide called Museum Guide 2.0 as a prototype application of gaze-based information provision in a real-world environment. We performed several experiments to evaluate our gazebased object recognition methods. Furthermore, we conducted a user study in the context of Museum Guide 2.0 to evaluate the usability of the new gaze-based interface for information provision. These results show that an enormous amount of potential exists for using a wearable eye tracker as a human-environment interface.

Projekte

Perspecting - Perspecting

Toyama-Gaze-Guided-Object-Recognition-ETRA12.pdf (pdf, 2 MB )

Gaze Guided Object Recognition Using a Head-Mounted Eye Tracker

Abstract

Projekte

Follow us on:

Editor

Newsletter

Locations