Developing Tools for Audio Visualization and Data Sonification in Unreal Engine 5

Abstract

This production-based thesis was aimed at exploring the possibilities of implementing audio visualization and/or data sonification in video games using Unreal Engine 5.

In the first part of this thesis, an overview of previous research in the field was provided. Functions of game audio were identified along with purposes of audio visualization and data sonification in video games. Practical examples were provided of how the techniques have been used in several popular video games of the past decade. Additionally, basics of audio analysis and synthesis were discussed in that part.

In the second part of the thesis, a practical project in Unreal Engine 5 was documented. The project was commissioned by Dark Amber Softworks and produced over the course of the work. The techniques discussed in the theoretical part were implemented in five prototype scenes and intended for use as development tools in current and future Dark Amber Softworks projects. Possible use cases for each prototype were discussed and further development ideas were suggested. Feedback from focus group testing within the company was also discussed in that part.

The research indicated that audio visualization and data sonification could be an important part of the gameplay and showcased how the discussed techniques could be implemented in an Unreal Engine 5 project.