|Search by item||HOME > Access full text > Search by item|
JBE, vol. 28, no. 2, pp.213-229, March, 2023
A Real Time 6 DoF Spatial Audio Rendering System based on MPEG-I AEP
Kyeongok Kang, Jae-hyoun Yoo, Daeyoung Jang, Yong Ju Lee, and Taejin Lee
C.A E-mail: email@example.com
In this paper, we introduce a spatial sound rendering system that provides 6DoF spatial sound in real time in response to the
movement of a listener located in a virtual environment. This system was implemented using MPEG-I AEP as a development
environment for the CfP response of MPEG-I Immersive Audio and consists of an encoder and a renderer including a decoder.
The encoder serves to offline encode metadata such as the spatial audio parameters of the virtual space scene included in EIF and
the directivity information of the sound source provided in the SOFA file and deliver them to the bitstream. The renderer receives
the transmitted bitstream and performs 6DoF spatial sound rendering in real time according to the position of the listener. The
main spatial sound processing technologies applied to the rendering system include sound source effect and obstacle effect, and
other ones for the system processing include Doppler effect, sound field effect and etc. The results of self-subjective evaluation of
the developed system are introduced.
Keyword: MPEG-I, Immersive Audio, VR, Encoder, Renderer
 Lauri Savioja et al., “Creating Interactive Virtual Acoustic Environments,” Journal of Audio Engineering Society, Vol.47, No.9, pp.675-705, September 1999. http://www.aes.org/e-lib/browse.cfm?elib=12095
 Lauri Savioja et al., “Overview of geometrical room acoustic modeling techniques,” Journal of Acoustic Society of America, Vol.138, No.2, pp.708-730, August 2015. doi: https://doi.org/10.1121/1.4926438
 Room Acoustics Modeling with Interactive Visualizations (by Lauri Savioja), https://interactiveacoustics.info/ (accessed Feb. 9, 2023)
 Resonance Audio, https://resonance-audio.github.io/resonance-audio/ (accessed Feb. 9, 2023)
 EVERTims, https://evertims.github.io/ (accessed Feb. 9, 2023)
 RAVEN, https://www.akustik.rwth-aachen.de/go/id/dwoc/lidx/1/file/ 183613 (accessed Feb. 9, 2023) RAVEN: A real-time framework for the auralization of interactive virtual environments
 ISO/IEC JTC1/SC29/WG6 N0056, “MPEG-I Immersive Audio Call for proposals,“ Virtual, April 2021.
 ISO/IEC JTC1/SC29/WG6 N100, “MPEG-I Immersive Audio Documentation for the Audio Evaluation Platform, Version 2” Virtual, October 2021.
 ISO/IEC JTC1/SC29/WG6 N0028, “MPEG-I Immersive Audio Architecture and Requirements,” Virtual, January 2021.
 ISO/IEC JTC1/SC29/WG6 N0054, “MPEG-I Immersive Audio Encoder Input Format,” Virtual, April 2021.
 ETSI TS 126 260 V15.0.0 (2018-10), “5G
Objective test methodologies for the evaluation of immersive audio systems (3GPP TS 26.260 version 15.0.0 Release 15), 2018
 N0101 (N20921), "MPEG-I Immersive Audio Subjective Test Logistics document", 5th WG6 meeting (136th MPEG meeting), October 2021, Virtual.
 ISO/IEC JTC1/SC29/WG6 N0105, "MPEG-I Immersive Audio additional instructions for Test Supervisors and Test Subjects," Virtual, October 2021, Virtual.
 ISO/IEC JTC1/SC29/WG6 m55106, "Thoughts on evaluation procedure for MPEG-I CfP," Virtual, October 2020..
 ISO/IEC JTC1/SC29/WG6 N0084, "MPEG-I Immersive Audio Test and Evaluation Procedures," Virtual, July 2021.