In order to react correctly in an emergency, first responders and medical professionals have to invest a lot of time in training. However, previous simulations often rely on subjective observations and do not provide an objective assessment of performance – data-based approaches and automatable analyses are lacking.
c: SIMStation/Berufsrettung Wien Roland Klockner
The SIMplifEYE project relies on the latest developments in AI and computer vision to improve the quality of training. Together SIMStation GmbH, Soma Reality GmbH and studio PCA of RSA FG develop a platform based on imagebased interaction analysis. The project focuses on the analysis of spatial interactions and the automated recognition of actions and events based on computer vision and machine learning technologies.
Project goals are:
- Analysis of Human-Object-Interaction: Automatic recognition and documentation of trainees’ interaction with objects in the training environment in order to detect behavioral patterns and identify weak points.
- Human Pose Estimation: Precise analysis and modeling of movement patterns and interaction during critical processes.
- Automated creation of event annotations: Recognition of important events for support and relief using event and action detection algorithms.
- Visual Attention Analysis:Eye-tracking technologies are used to record the trainees’ gaze behavior in order to analyze which elements in the environment attract their attention.
- Cognitive Load Analysis: By analyzing gaze patterns and other physiological data, the cognitive load of the trainees is measured in order to identify stress-related challenges and adapt training content.
- High-Level Human Behavior Modeling: Development of data-driven models that depict complex behavioral patterns and decision-making processes of trainees and are made available in the form of objective interpretations.
These technologies make it possible to objectively and automatically evaluate performance and provide personalized training support. In this way, spatial interaction, cognitive load and the efficiency of learning processes can be precisely analyzed.
The SIMplifEYE system is to be integrated into the existing SIMStation training environment and developed and tested under real conditions in collaboration with the Berufsrettung Wien. The aim is to create a new standard for objective, data-based simulation training and improve the quality of training.
Funded by Vienna Business Agency. A fonds by the city of Vienna.
More on our Lead SIMStation:
SIMStation is a leading provider of audiovisual recording and debriefing systems for simulation, learning and training centers. The flexible AV solutions offer outstanding audio and video quality, combined with the most advanced simulation software on the market. Despite their extensive functionality, SIMStation systems are characterized by user-friendliness and intuitive operation. With SIMStation products, training can be controlled, recorded and transmitted live in the highest quality. SIMStation supports trainers and participants in achieving sustainable learning outcomes and thus contributes to maintaining and improving quality and safety standards in the healthcare sector.
