Real time DSP for immersive speech communication
Laguna Teno, Félix (2018)
Turun ammattikorkeakoulu
2018
All rights reserved
Julkaisun pysyvä osoite on
https://urn.fi/URN:NBN:fi:amk-2018092015278
https://urn.fi/URN:NBN:fi:amk-2018092015278
Tiivistelmä
The field of real time digital signal processing using software has attracted attention but there is not actually a solution to apply acoustic effects to a stream of audio in real time.
The purpose of the thesis was to build a prototype of immersive communication system and set foundations for the readers to build their own ones. The different parts of the prototype were researched, implemented and united into the final system.
Several audio back end technologies, encoders and network implementations were analyzed and the best ones (PortAudio, Opus and raw sockets) were chosen for building the prototype.
The prototype developed in this thesis is working on a local environment, while working unreliably in networked conditions. The design decisions, diagrams, and research are included in this thesis, setting the required foundations. The prototype could be further improved with reliable networking
and a graphical user interface.
The prototype serves as a milestone in the development of similar products and this thesis can be used by computer scientists to develop immersive systems.
The purpose of the thesis was to build a prototype of immersive communication system and set foundations for the readers to build their own ones. The different parts of the prototype were researched, implemented and united into the final system.
Several audio back end technologies, encoders and network implementations were analyzed and the best ones (PortAudio, Opus and raw sockets) were chosen for building the prototype.
The prototype developed in this thesis is working on a local environment, while working unreliably in networked conditions. The design decisions, diagrams, and research are included in this thesis, setting the required foundations. The prototype could be further improved with reliable networking
and a graphical user interface.
The prototype serves as a milestone in the development of similar products and this thesis can be used by computer scientists to develop immersive systems.