Deep Learning-Based Single-Ended Quality Prediction for Time-Scale Modified Audio

Roberts T, Nicolson A, Paliwal KK. Deep Learning-Based Single-Ended Quality Prediction for Time-Scale Modified Audio. J Audio Eng Soc. 2021;69(9):644-655. doi:10.17743/jaes.2021.0031

@article{Roberts2021_21461,
  author = {Roberts, Timothy and Nicolson, Aaron and Paliwal, Kuldip K.},
  title = {{Deep Learning-Based Single-Ended Quality Prediction for Time-Scale Modified Audio}},
  journal = {Journal of the Audio Engineering Society},
  volume = {69},
  number = {9},
  pages = {644--655},
  year = {2021},
  month = sep,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2021.0031},
  url = {https://doi.org/10.17743/jaes.2021.0031}
}

TY  - JOUR
TI  - Deep Learning-Based Single-Ended Quality Prediction for Time-Scale Modified Audio
AU  - Roberts, Timothy
AU  - Nicolson, Aaron
AU  - Paliwal, Kuldip K.
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 69
IS  - 9
SP  - 644
EP  - 655
PY  - 2021
DA  - 2021/09/06
DO  - 10.17743/jaes.2021.0031
UR  - https://doi.org/10.17743/jaes.2021.0031
PB  - Audio Engineering Society
LA  - en
AB  - Objective evaluation of audio processed with Time-Scale Modification (TSM) has recently seen improvement with a labeled time-scaled audio dataset used to train an objective measure. This double-ended measure was an extension of Perceptual Evaluation of Audio Quality and required reference and test signals. In this paper two single-ended objective quality measures for time-scaled audio are proposed that do not require a reference signal. Internal representations of spectrogram and speech features are learned by either a Convolutional Neural Network (CNN) or a Bidirectional Gated Recurrent Unit (BGRU) network and fed to a fully connected network to predict Subjective Mean Opinion Scores. The proposed CNN and BGRU measures respectively achieve average Root Mean Square Errors of 0.61 and 0.58 and mean Pearson Correlation Coefficients of 0.77 and 0.79 to the time-scaled audio dataset. The proposed measures are used to evaluate TSM algorithms and comparisons are provided for 15 TSM implementations. A link to implementations of the objective measures is provided.
ER  -