Source Separation for Enabling Dialogue Enhancement in Object-based Broadcast with MPEG-H

Paulus J, Torcoli M, Uhle C, Herre J, Disch S, Fuchs H. Source Separation for Enabling Dialogue Enhancement in Object-based Broadcast with MPEG-H. J Audio Eng Soc. 2019;67(7/8):510-521. doi:10.17743/jaes.2019.0032

@article{Paulus2019_20489,
  author = {Paulus, Jouni and Torcoli, Matteo and Uhle, Christian and Herre, Jürgen and Disch, Sascha and Fuchs, Harald},
  title = {{Source Separation for Enabling Dialogue Enhancement in Object-based Broadcast with MPEG-H}},
  journal = {Journal of the Audio Engineering Society},
  volume = {67},
  number = {7/8},
  pages = {510--521},
  year = {2019},
  month = jul,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2019.0032},
  url = {https://doi.org/10.17743/jaes.2019.0032}
}

TY  - JOUR
TI  - Source Separation for Enabling Dialogue Enhancement in Object-based Broadcast with MPEG-H
AU  - Paulus, Jouni
AU  - Torcoli, Matteo
AU  - Uhle, Christian
AU  - Herre, Jürgen
AU  - Disch, Sascha
AU  - Fuchs, Harald
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 67
IS  - 7/8
SP  - 510
EP  - 521
PY  - 2019
DA  - 2019/07/06
DO  - 10.17743/jaes.2019.0032
UR  - https://doi.org/10.17743/jaes.2019.0032
PB  - Audio Engineering Society
LA  - en
AB  - Low intelligibility of narration or dialogue resulting from high background level is one of the most common complaints in broadcasting. Even when the intelligibility is not compromised, listeners may have personal preferences that differ from the mix being broadcast. Dialogue Enhancement (DE) enables the delivery of optimal dialogue mixing to each listener, be it in terms of intelligibility or for aesthetic preference. This makes DE one of the most promising applications of user interactivity enabled by object-based audio broadcasting, such as MPEG-H. This paper investigates the use of source separation methods to extract dialogue and background from the complex sound mixture for enabling object-based broadcasting when dialogue is not available from the production process, as for example, with legacy content. The presented source separation technology integrates several separation approaches with known limitations into a more powerful overall architecture. In addition, the paper evaluates the subjective benefit of DE using the Adjustment/Satisfaction Test in which the listeners made extensive use of the dialogue level personalization. The fact that the preferred dialogue level had a high variance among the listeners indicates the need for this functionality. Even when an imperfect separation result was used for enabling DE, the possibility for personalizing the dialogue level lead to increased listener satisfaction.
ER  -