Continuous Adaptive Machine-Learning of Transfer of Control Situations

Continuous Adaptive Machine-Learning of Transfer of Control Situations

A remaining major challenge with autonomous systems is the handling of situations that the system cannot handle on its own. Up to now, this transfer of control has been considered in isolation. An important step towards long-term autonomous systems and the aim of the project is to develop systems that can learn from past situations in order to improve their behaviour in future, similar situations. As a result, the transfer of control to humans can become more efficient, and in some cases even obsolete, which is also a core requirement of the industry.

CAMELOT is in this sense a follow-up project of TRACTAT and builds on its results by looking at the task from the perspective of self-learning systems and multimodal human-machine interaction. Machine learning models support the system to recognize and classify situations. The models are multiply adaptive; they can be improved by passive observation and by actively being teached by user to deal with new situations. Multimodality plays a role on the one hand as a source for the recognition of user behaviour in response to the system, and on the other hand for the natural communication between system and user in case of a transfer of control. By using new methods in combining symbolic and sub-symbolic learning, not only is explainability and extensibility ensured, but the overall recognition performance is also improved compared to the state of the art.

Share project:

Contact Person
Dr.-Ing. Michael Feld
Dr.-Ing. Tim Schwartz


Publications about the project

Amr Gomaa, Guillermo Reyes, Michael Feld

In: ICMI '21: International Conference on Multimodal Interaction. ACM International Conference on Multimodal Interaction (ICMI-2021) located at 23rd ACM International Conference on Multimodal Interaction October 18-22 Montreal (Hybrid) QC Canada ISBN 978-1-4503-8481-0 Association for Computing Machinery (ACM) 10/2021.

To the publication
Guillermo Reyes, Alexandra Katrin Alles

In: 26th International Conference on Intelligent User Interfaces. International Conference on Intelligent User Interfaces (IUI-2021) April 13-17 College Station/Virtual TX United States Pages 356-365 ISBN 9781450380171 Association for Computing Machinery (ACM) 4/2021.

To the publication

German Research Center for Artificial Intelligence
Deutsches Forschungszentrum für Künstliche Intelligenz