Skip to main content Skip to main navigation

Project

HaLeR

HaLeR - Detection of action deviations through learning with limited computing resources

HaLeR - Detection of action deviations through learning with limited computing resources

  • Duration:

The HaLeR project aims to develop solutions for a flexible and adaptive MMI. The developed methods should allow a system to react and adapt flexibly to human behaviour in case of situation changes. For this purpose, an approach is to be developed that automatically recognizes the connections between individual behavioral segments and adapts them to new, similar situations, so that upcoming behaviour can be predicted in a way appropriate to the situation. Thus, deviations in human behavior are detected and the behavior of the system within a human-machine collaboration is adapted accordingly. This makes the MMI flexible, since the system successfully supports the human being despite changed movement (e.g. changed sequence of behavioral segments). In order to detect human action deviations, both the human's movements are analyzed by means of motion tracking and intrinsic motivations and evaluations of current situations using EEG data. The focus is on methods that do not require large computing capacities. This enables the application of the methods in scenarios with limited resources, such as space missions. By combining the analysis of both data types, an overall system for the detection of action deviations is to be created. This will be evaluated in a space scenario, which allows the investigation on the basis of simplified conditions, as the movements of the astronaut are restricted by the space suit.

Sponsors

BMWi - Federal Ministry for Economic Affairs and Energy

DFKI: 50RA2024, Uni: 50RA2023

DLR

BMWi - Federal Ministry for Economic Affairs and Energy

Publications about the project

Su-Kyoung Kim; Julian Liersch; Elsa Andrea Kirchner

In: 25th International Conference on Human-Computer Interaction. International Conference on Human-Computer Interaction (HCII-2023), July 23-28, Copenhagen, Denmark, Springer, 7/2023.

To the publication

Sadique Adnan Siddiqui; Lisa Gutzeit; Frank Kirchner

In: International Conference on Pattern Recognition Applications and Methods. International Conference on Pattern Recognition Applications and Methods (ICPRAM-2022), February 3-5, Pages 338-345, ISBN 978-989-758-549-4, n.n. 2/2022.

To the publication

Lisa Gutzeit

In: Proceedings of the 10th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM. International Conference on Pattern Recognition Applications and Methods (ICPRAM-2021), February 4-6, Pages 243-250, ISBN 978-989-758-486-2, SciTePress, 2/2021.

To the publication