Skip to main content Skip to main navigation

Project

EXPECT

Exploring the Potential of Pervasive Embedded Brain Reading in Human Robot Collaborations

Exploring the Potential of Pervasive Embedded Brain Reading in Human Robot Collaborations

  • Duration:

The main goal of the EXPECT project is the development of an adaptive, self-learning platform for human-robot collaboration that not only enables various types of active interaction, but is also capable of inferring human intention from multimodal data (gestures, speech, eye movements, and brain activity). In the project, methods for automated labeling and joint evaluation of multimodal human data will be developed and evaluated in test scenarios. The systematic experiments also serve to investigate the question of how fundamentally significant brain data is for intention prediction in humans. Thus, EXPECT has a direct positive impact on the increased collaboration between humans and robots in the working world. The technologies to be developed in EXPECT can be used in many ways, for example in space travel and extraterrestrial exploration, robot-assisted rehabilitation and assistance as well as in industrial MRI.

Sponsors

BMBF - Federal Ministry of Education and Research

01IW20003

BMBF - Federal Ministry of Education and Research

Images

© DFKI GmbH, Annemarie Popp

Possible VR-based training scenario for serious gaming

Multimodal data for alternative interaction principles and optimization stroke rehabilitation measures

Publications about the project

- (Hrsg.)

ACM International Conference on Multimodal Interaction (ICMI), October 9-13, Paris, France, IEEE, 10/2023.

To the publication

Mansi Sharma; Shuang Chen; Philipp Müller; Maurice Rekrut; Antonio Krüger

In: Proceedings of the 25th International Conference on Multimodal Interaction. ACM International Conference on Multimodal Interaction (ICMI), Pages 345-354, IEEE, 2023.

To the publication

Tobias Jungbluth; Maurice Rekrut; Antonio Krüger

In: Proceedings of the IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering. IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE-2023), Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering, October 25-27, Mailand, Italy, IEEE, 2023.

To the publication