Skip to main content Skip to main navigation


Towards Remote Expert Supported Autonomous Assistant Robots in Shopping Environments

Niko Kleer; Martin Feick; Florian Daiber; Michael Feld
In: Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction. ACM/IEEE International Conference on Human-Robot Interaction (HRI-2024), March 11-14, Boulder, CO, USA, Pages 613-617, ISBN 979-8-4007-0323-2, ACM, 2024.


Autonomous robots that assist customers during their shopping trips may become ubiquitous in the near future. However, these systems are limited in their ability to appropriately reply to all of a customer's requests. Therefore, a dedicated human expert has to remotely ``take over'' and resolve the customer's issue to warrant a satisfying experience. As a result, a Transfer of Control from a machine to a human takes place. This creates the problem that the expert needs to quickly review what has happened prior to the take-over to provide optimal assistance. To address this, we designed and implemented an interactive summary concept allowing experts to quickly filter and review the most relevant information to solve the given issue. Finally, we provide an example use case illustrating how a remote expert may solve a request using our system.