Spatial Coding of Complex Object-Based Program Material

Breebaart J, Cengarle G, Lu L, Mateos T, Purnhagen H, Tsingos N. Spatial Coding of Complex Object-Based Program Material. J Audio Eng Soc. 2019;67(7/8):486-497. doi:10.17743/jaes.2018.0067

@article{Breebaart2019_20487,
  author = {Breebaart, Jeroen and Cengarle, Giulio and Lu, Lie and Mateos, Toni and Purnhagen, Heiko and Tsingos, Nicolas},
  title = {{Spatial Coding of Complex Object-Based Program Material}},
  journal = {Journal of the Audio Engineering Society},
  volume = {67},
  number = {7/8},
  pages = {486--497},
  year = {2019},
  month = jul,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2018.0067},
  url = {https://doi.org/10.17743/jaes.2018.0067}
}

TY  - JOUR
TI  - Spatial Coding of Complex Object-Based Program Material
AU  - Breebaart, Jeroen
AU  - Cengarle, Giulio
AU  - Lu, Lie
AU  - Mateos, Toni
AU  - Purnhagen, Heiko
AU  - Tsingos, Nicolas
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 67
IS  - 7/8
SP  - 486
EP  - 497
PY  - 2019
DA  - 2019/07/06
DO  - 10.17743/jaes.2018.0067
UR  - https://doi.org/10.17743/jaes.2018.0067
PB  - Audio Engineering Society
LA  - en
AB  - Object-based audio (OBA) program material is challenging to distribute over low bandwidth channels and costly to render for thin clients. This research proposes a dynamic object-grouping solution that can represent a complex object-based scene as an equivalent reduced set of object groups while maintaining perceptually transparent rendering quality. This solution is a type of spatial coding. This paper introduces a real-time greedy simplification technique that addresses limitations of previous approaches by modeling spatial release from masking and distributing input objects into to multiple output groups. The core algorithm is extended to preserve other types of artistic metadata beyond object position. Results of perceptual tests show that this solution can achieve a 10:1 reduction in object count while maintaining high-quality audio playback and rendering flexibility at the endpoint. Spatial coding does not require perceptual coding of the objects’ audio essence but can be further combined with audio coding tools to deliver OBA content at low bit rates. This makes spatial coding a key component of an OBA production and distribution workflow. Object-based content creation, distribution, and rendering workflows require novel methods to process, combine, encode, and simplify complex auditory scenes to allow end-point rendering flexibility, efficiency, and adaptability as well as the means to cater for personalized experiences.
ER  -