Skip to main content Skip to main navigation

Project | MILKI-PSY

Duration:
Multimodal immersive learning with artificial intelligence for psychomotor skills

Multimodal immersive learning with artificial intelligence for psychomotor skills

Development of psychomotor skills (e.g. in medicine, sports) requires practical exercise, direct feedback and reflection. In order to achieve the desired learning success, individual support is essential.

The BMBF project MILKI-PSY aims to create AI-supported, data-intensive, multimodal, immersive learning environments for the independent training of psychomotor skills. This creates a cross-domain approach that makes it possible to record the activities of experts in a multimodal manner and to use these recordings as blueprints for learners. With the help of AI-supported analyzes, the learning progress is to be supported by automated error detection and generated, individual feedback.

This creates a holistic, innovative learning environment for learning psychomotor skills, in which individual learning processes are personalized based on complex data analyzes and supported by AI.

Partners

Technische Hochschule Köln Deutsches Forschungszentrum für Künstliche Intelligenz Rheinisch-Westfälisch Technische Hochschule Leibniz Institut für Bildungsforschung und Bildungsinformation Deutsche Sporthochschule Köln

Publications about the project

  1. IMPECT-POSE: A Complete Front-end and Back-end Architecture for Pose Tracking and Feedback

    Abhishek Samanta; Hitesh Kotte; Patrick Handwerk; Khaleel Asyraaf Mat Sanusi; Mai Geisen; Milos Kravcik; Nghia Duong-Trung

    In: UMAP Adjunct '24: Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization. International Conference on User Modeling, Adaptation, and Personalization (UMAP-2024), July 1-4, Cagliari, Italy, Pages 142-147, ISBN 979-8-4007-0466-6, ACM, New York, NY, United States, 6/2024.
  2. Real-Time Posture Correction in Gym Exercises: A Computer Vision-Based Approach for Performance Analysis, Error Classification and Feedback

    Hitesh Kotte; Milos Kravcik; Nghia Duong-Trung

    In: Khaleel Asyraaf Mat Sanusi; Bibeg Limbu; Jan Schneider; Milos Kravcik; Roland Klemke (Hrsg.). Proceedings of the Third International Workshop on Multimodal Immersive Learning Systems (MILeS 2023). International Workshop on Multimodal Immersive Learning Systems (MILeS-2023), located at Eighteenth European Conference on Technology Enhanced Learning (EC-TEL 2023), September 4-8, Aveiro, Portugal,…

Sponsors

BMBF - Federal Ministry of Education and Research

16DHB4014

BMBF - Federal Ministry of Education and Research