Evaluating a summative feedback option for an industrial virtual learning environment

Abstract

Virtual learning environments (VLEs) have been rapidly emerging as a powerful tool for education and training. One of the primary modes that VLEs use to promote learning is feedback. Although feedback is known to advance training experiences toward achieving learning outcomes, very little work has been undertaken to isolate and measure the learning impact of immediate, summative, or reflective feedback. This study aims to evaluate the learning effect summative feedback has on industrial training via a VLE. Responses were collected from three groups (with 10 participants each) who played the same fire extinguishing scenario with different feedback features – no post-play analytics, includes only post-play analytics, and includes post-play analytics with summative feedback. The participants in each group also completed pre- and post-questionnaires. Data from both questionnaires and game analytics were compared to evaluate the impact of the summative feedback.

According to the findings, the group of participants who used the ADE virtual reality fire safety application with in-game analytics and summative feedback demonstrated a greater degree of change in their responses on the post-test survey compared to the group who played the application without in-game analytics. In conclusion, the use of in-game analytics and summative feedback appeared to have a positive impact on the participants' learning outcomes and their ability to gain new knowledge through the application.