Efficient data collection pipeline for audio machine learning of audio quality

Volk CP, Nordby J, Stegenborg-Andersen T, Zacharov N. Efficient data collection pipeline for audio machine learning of audio quality. In: AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020). Audio Engineering Society; 2020. Paper 10488. Available from: https://aes.org/publications/elibrary-page/?id=21165

@inproceedings{Volk2020_21165,
  author = {Volk, Christer P. and Nordby, Jon and Stegenborg-Andersen, Tore and Zacharov, Nick},
  title = {{Efficient data collection pipeline for audio machine learning of audio quality}},
  booktitle = {AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020)},
  note = {Paper 10488},
  year = {2020},
  month = aug,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=21165}
}

TY  - CPAPER
TI  - Efficient data collection pipeline for audio machine learning of audio quality
AU  - Volk, Christer P.
AU  - Nordby, Jon
AU  - Stegenborg-Andersen, Tore
AU  - Zacharov, Nick
T2  - AES Conference: 2020 AES International Conference on Audio for Virtual and Augmented Reality (August 2020)
M1  - Paper 10488
PY  - 2020
DA  - 2020/08/06
UR  - https://aes.org/publications/elibrary-page/?id=21165
PB  - Audio Engineering Society
LA  - en
AB  - In this paper we study the matter of perceptual evaluation data collection for the purposes of machine learning. Well established listening test methods have been developed and standardised in the audio community over many years. This papers looks at the specific needs for machine learning and seeks to establish efficient data collection methods, that address the requirements of machine learning, whilst also providing robust and repeatable perceptual evaluation results. Following a short review of efficient data collection techniques, including the concept of data augmentation and introduce the new concept of pre-augmentation as an alternative efficient data collection approach. Multiple stimulus presentation style listening tests are then presented for the evaluation of a wide range of audio quality devices (headphones) evaluated by a panel of trained expert assessors. Two tests are presented using a traditional full factorial design and a pre-augmented design to enable the performance comparison of these two approaches. The two approaches are statistically analysed and discussed. Finally, the performance of the two approaches for building machine learning models are reviewed, comparing the performance of a range of baseline models.
ER  -