Search by item HOME > Access full text > Search by item

Subject  Keyword  Abstract  Author 

JBE, vol. 28, no. 2, pp.213-229, March, 2023

DOI: https://doi.org/10.5909/JBE.2023.28.2.213

A Real Time 6 DoF Spatial Audio Rendering System based on MPEG-I AEP

Kyeongok Kang, Jae-hyoun Yoo, Daeyoung Jang, Yong Ju Lee, and Taejin Lee

C.A E-mail: kokang@etri.re.kr

Abstract:
In this paper, we introduce a spatial sound rendering system that provides 6DoF spatial sound in real time in response to the
movement of a listener located in a virtual environment. This system was implemented using MPEG-I AEP as a development
environment for the CfP response of MPEG-I Immersive Audio and consists of an encoder and a renderer including a decoder.
The encoder serves to offline encode metadata such as the spatial audio parameters of the virtual space scene included in EIF and
the directivity information of the sound source provided in the SOFA file and deliver them to the bitstream. The renderer receives
the transmitted bitstream and performs 6DoF spatial sound rendering in real time according to the position of the listener. The
main spatial sound processing technologies applied to the rendering system include sound source effect and obstacle effect, and
other ones for the system processing include Doppler effect, sound field effect and etc. The results of self-subjective evaluation of
the developed system are introduced.


Keyword: MPEG-I, Immersive Audio, VR, Encoder, Renderer

Reference:
[1] Lauri Savioja et al., “Creating Interactive Virtual Acoustic Environments,” Journal of Audio Engineering Society, Vol.47, No.9, pp.675-705, September 1999. http://www.aes.org/e-lib/browse.cfm?elib=12095
[2] Lauri Savioja et al., “Overview of geometrical room acoustic modeling techniques,” Journal of Acoustic Society of America, Vol.138, No.2, pp.708-730, August 2015. doi: https://doi.org/10.1121/1.4926438
[3] Room Acoustics Modeling with Interactive Visualizations (by Lauri Savioja), https://interactiveacoustics.info/ (accessed Feb. 9, 2023)
[4] Resonance Audio, https://resonance-audio.github.io/resonance-audio/ (accessed Feb. 9, 2023)
[5] EVERTims, https://evertims.github.io/ (accessed Feb. 9, 2023)
[6] RAVEN, https://www.akustik.rwth-aachen.de/go/id/dwoc/lidx/1/file/ 183613 (accessed Feb. 9, 2023) RAVEN: A real-time framework for the auralization of interactive virtual environments
[7] ISO/IEC JTC1/SC29/WG6 N0056, “MPEG-I Immersive Audio Call for proposals,“ Virtual, April 2021.
[8] ISO/IEC JTC1/SC29/WG6 N100, “MPEG-I Immersive Audio Documentation for the Audio Evaluation Platform, Version 2” Virtual, October 2021.
[9] ISO/IEC JTC1/SC29/WG6 N0028, “MPEG-I Immersive Audio Architecture and Requirements,” Virtual, January 2021.
[10] ISO/IEC JTC1/SC29/WG6 N0054, “MPEG-I Immersive Audio Encoder Input Format,” Virtual, April 2021.
[11] ETSI TS 126 260 V15.0.0 (2018-10), “5G
Objective test methodologies for the evaluation of immersive audio systems (3GPP TS 26.260 version 15.0.0 Release 15), 2018
[12] N0101 (N20921), "MPEG-I Immersive Audio Subjective Test Logistics document", 5th WG6 meeting (136th MPEG meeting), October 2021, Virtual.
[13] ISO/IEC JTC1/SC29/WG6 N0105, "MPEG-I Immersive Audio additional instructions for Test Supervisors and Test Subjects," Virtual, October 2021, Virtual.
[14] ISO/IEC JTC1/SC29/WG6 m55106, "Thoughts on evaluation procedure for MPEG-I CfP," Virtual, October 2020..
[15] ISO/IEC JTC1/SC29/WG6 N0084, "MPEG-I Immersive Audio Test and Evaluation Procedures," Virtual, July 2021.

Comment


Editorial Office
1108, New building, 22, Teheran-ro 7-gil, Gangnam-gu, Seoul, Korea
Homepage: www.kibme.org TEL: +82-2-568-3556 FAX: +82-2-568-3557
Copyrightⓒ 2012 The Korean Institute of Broadcast and Media Engineers
All Rights Reserved