AI 3D immersive audio codec based on content-adaptive dynamic down-mixing and up-mixing framework

Nam WH, Lee T, Ko SC, Son Y, Chung HK, Kim KR, Kim J, Hwang S, Lee K. AI 3D immersive audio codec based on content-adaptive dynamic down-mixing and up-mixing framework. In: AES Convention 151. Audio Engineering Society; 2021. Paper 10525. Available from: https://aes.org/publications/elibrary-page/?id=21489

@inproceedings{Nam2021_21489,
  author = {Nam, Woo Hyun and Lee, Tammy and Ko, Sang Chul and Son, Yoonjae and Chung, Hyun Kwon and Kim, Kyung-Rae and Kim, Jungkyu and Hwang, Sunghee and Lee, Kyunggeun},
  title = {{AI 3D immersive audio codec based on content-adaptive dynamic down-mixing and up-mixing framework}},
  booktitle = {AES Convention 151},
  note = {Paper 10525},
  year = {2021},
  month = oct,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21489}
}

TY  - CPAPER
TI  - AI 3D immersive audio codec based on content-adaptive dynamic down-mixing and up-mixing framework
AU  - Nam, Woo Hyun
AU  - Lee, Tammy
AU  - Ko, Sang Chul
AU  - Son, Yoonjae
AU  - Chung, Hyun Kwon
AU  - Kim, Kyung-Rae
AU  - Kim, Jungkyu
AU  - Hwang, Sunghee
AU  - Lee, Kyunggeun
T2  - AES Convention 151
M1  - Paper 10525
PY  - 2021
DA  - 2021/10/06
UR  - https://aes.org/publications/elibrary-page/?id=21489
PB  - Audio Engineering Society
LA  - en
AB  - Recently, people who prefer to consume media contents via over the top (OTT) platform, such as YouTube, Netflix etc., rather than a conventional broadcasting get increased more and more. To deliver an immersive audio experience to them more effectively, we propose a unified framework for AI-based 3D immersive audio codec. In this framework, to maximize the original immersiveness even at a down-mixed audio, while enabling to precisely reproduce the original 3D audio from the down-mixed audio, content-adaptive dynamic down-mixing and up-mixing scheme is newly proposed. The experimental results show that the proposed framework can render more improved down-mixed audio compared to the conventional method as well as successfully reproduce the original 3D audio.
ER  -