Search by item | HOME > Access full text > Search by item |
JBE, vol. 28, no. 2, pp.194-212, March, 2023
DOI: https://doi.org/10.5909/JBE.2023.28.2.194 Towards Group-based Adaptive Streaming for MPEG Immersive Video Jong-Beom Jeong, Soonbin Lee, Jaeyeol Choi, Gwangsoon Lee, Sangwoon Kwak, Won-Sik Cheong, Bongho Lee, and Eun-Seok Ryu C.A E-mail: esryu@skku.edu Abstract: The MPEG immersive video (MIV) coding standard achieved high compression efficiency by removing inter-view redundancy
and merging the residuals of immersive video which consists of multiple texture (color) and geometry (depth) pairs. Grouping of
views that represent similar spaces enables quality improvement and implementation of selective streaming, but this has not been
actively discussed recently. This paper introduces an implementation of group-based encoding into the recent version of MIV
reference software, provides experimental results on optimal views and videos per group, and proposes a decision method for
optimal number of videos for global immersive video representation by using portion of residual videos. Keyword: Metaverse, Virtual reality, MIV, 6DoF, Group-based encoding Reference: [1] E. S. Jang, M. Preda, K. Mammou, A. M. Tourapis, J. Kim, D. B. Graziosi, S. Rhyu, M. Budagavi. 2019. Video-based pointcloud- compression standard in mpeg: From evidence collection to committee draft [standards in a nutshell]. IEEE Signal Processing Magazine, vol. 36, no. 3, pp. 118-123. doi: https://doi.org/10.1109/MSP.2019.2900721 [2] S. Schwarz, M. Pesonen. 2019. Real-time decoding and AR playback of the emerging MPEG video-based point cloud compression standard. Nokia Technologies IBC: Helsinki, Finland. [3] J. M. Boyce, R. Doré, A. Dziembowski, J. Fleureau, J. Jung, B. Kroon, B. Salahieh, V. K. M. Vadakital, L. Yu. 2021. MPEG immersive video coding standard. Proceedings of the IEEE, vol. 109, no. 9, pp. 1521-1536. doi: https://doi.org/10.1109/JPROC.2021.3062590 [4] J. -B. Jeong, S. Lee, E. -S. Ryu. 2022. Rethinking Fatigue-Aware 6DoF Video Streaming: Focusing on MPEG Immersive Video. International Conference on Information Networking 2022 (ICOIN2022), pp. 304-309. doi: https://doi.org/10.1109/ICOIN53446.2022.9687247 [5] Sangho Lee, Hongchang Shin, Gwangsoon Lee, Jeongil Seo. 2022. GPU Implementation of TMIV Decoder for Real-time Playback. The Korean Institute of Broadcast and Media Engineers (KIBME) Summer Conference, pp. 93-96. [6] G. J. Sullivan, J. -R. Ohm, W. -J. Han, T. Wiegand. 2012. Overview of the High Efficiency Video Coding (HEVC) Standard. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 22, No. 12, pp. 1649-1668. doi: https://doi.org/10.1109/TCSVT.2012.2221191 [7] B. Bross, Y. -K. Wang, Y. Ye, S. Liu, J. Chen, G. J. Sullivan, J. -R. Ohm. 2021. Overview of the versatile video coding (VVC) standard and its applications. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 31, No. 10, pp. 3736-3764. doi: https://doi.org/10.1109/TCSVT.2021.3101953 [8] Y. Bai, X. Sheng, S. Li, C. Wang, L. Yu. 2021. [MIV]Undistorted CBA Basketball Test Sequence for MPEG-I Visual, Standard ISO/IEC JTC1/SC29/WG4, m58500. [9] ISO/IEC JTC 1/SC 29/WG 7. 2021. Text of ISO/IEC DIS 23090-5 Visual Volumetric Video-based Coding and Video-based Point Cloud Compression 2nd Edition. Standard ISO/IEC JTC 1/SC 29 WG 7, n00188. [10] ISO/IEC JTC 1/SC 29/WG 4. 2022. Preliminary WD1 of ISO/IEC 23090-12 MPEG Immersive video Ed. 2. Standard ISO/IEC JTC 1/SC 29/WG 4, n00176. [11] D. Park, S. -G. Lim, K. -J. Oh, G. Lee, J. -G. Kim. 2022. Nonlinear Depth Quantization Using Piecewise Linear Scaling for Immersive Video Coding. IEEE Access, Vol. 10, pp. 4483-4494. doi: https://doi.org/10.1109/ACCESS.2022.3140537 [12] J. -B. Jeong, S. Lee, E. -S. Ryu. 2021. Sub‐bitstream packing based lightweight tiled streaming for 6 degree of freedom immersive video. Electronics Letters, Vol. 57, No. 25, pp. 973-976. doi: https://doi.org/10.1049/ell2.12329 Comment |