A Machine Learning Approach to Hierarchical Categorization of Auditory Objects

Coleman W, Delany SJ, Yan M, Cullen C. A Machine Learning Approach to Hierarchical Categorization of Auditory Objects. J Audio Eng Soc. 2020;68(1/2):48-56. doi:10.17743/jaes.2020.0001

@article{Coleman2020_20717,
  author = {Coleman, William and Delany, Sarah Jane and Yan, Ming and Cullen, Charlie},
  title = {{A Machine Learning Approach to Hierarchical Categorization of Auditory Objects}},
  journal = {Journal of the Audio Engineering Society},
  volume = {68},
  number = {1/2},
  pages = {48--56},
  year = {2020},
  month = jan,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2020.0001},
  url = {https://doi.org/10.17743/jaes.2020.0001}
}

TY  - JOUR
TI  - A Machine Learning Approach to Hierarchical Categorization of Auditory Objects
AU  - Coleman, William
AU  - Delany, Sarah Jane
AU  - Yan, Ming
AU  - Cullen, Charlie
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 68
IS  - 1/2
SP  - 48
EP  - 56
PY  - 2020
DA  - 2020/01/06
DO  - 10.17743/jaes.2020.0001
UR  - https://doi.org/10.17743/jaes.2020.0001
PB  - Audio Engineering Society
LA  - en
AB  - With the advent of new audio delivery technologies, object-based audio conceives of the audio content as being created at the delivery end of the chain. The concept of object-based audio envisages content delivery not via a fixed mix but as a series of auditory objects that can then be controlled either by consumers or by content creators and providers via the accompanying metadata. The proliferation of a variety of consumption modes (stereo headphones, home cinema systems, "hearables"), media formats (mp3, CD, video and audio streaming) and content types (gaming, music, drama, and current affairs broadcasting) has given rise to a complicated landscape where content must often be adapted for multiple end-use scenarios. Such a separation of audio assets facilitates the concept of Variable Asset Compression, where the most important elements from a perceptual standpoint are prioritized before others. In order to implement such a system however, insight is first required into what objects are most important, and how this importance changes over time. This research investigates the first of these questions, the hierarchical classification of isolated auditory objects using machine learning techniques. The results suggest that audio object hierarchies can be successfully modeled.
ER  -