About
Multimodal Immersive Learning with Artificial Intelligence for Psychomotor Skills
A research consortium around the Cologne Game Lab at TH Köln is developing a learning environment with artificial intelligence to support the independent learning of psychomotor skills. The research project “Multimodal Immersive Learning with Artificial Intelligence for Psychomotor Skills” (MILKI-PSY) designs an innovative environment for independent learning of psychomotor skills. For this purpose, the correct movement sequences are recorded by trainers using cameras and sensors. A virtual avatar generated from this recording will then serve as a model for the learners. This can be displayed on a large screen, in an augmented or virtual reality environment, for example. With the help of artificial intelligence and automated error detection, the learning progress is analyzed and individual feedback is generated.
“The learning environment will be created for basic sequences and fundamental movements of sports. There, it can be a useful complement to the trainer by allowing skills to be practiced and immediate feedback to be provided with the highest precision in real-time. In this way, it will be easier for dancers, for example, to improve their psychomotor skills and adapt their own movement to the optimized movement of the expert,” says project leader Prof. Dr. Roland Klemke from the Cologne Game Lab.
The collaborative research project “MILKI-PSY” is led by the Cologne Game Lab. Project partners include the Institute for Product Development and Design Technology (IPK) at TH Köln, the German Research Center for Artificial Intelligence (DFKI), RWTH Aachen University, the Leibniz Institute for Human Development and Educational Information (DIPF), and the German Sport University Cologne (DSHS). The Federal Ministry of Education and Research is funding the project with more than two million euros. The project, which started in March 2021, will run for three years.