Automating Mixing of User-Generated Audio Recordings from the Same Event

Stefanakis N, Mastorakis Y, Alexandridis A, Mouchtaris A. Automating Mixing of User-Generated Audio Recordings from the Same Event. J Audio Eng Soc. 2019;67(4):201-212. doi:10.17743/jaes.2019.0008

@article{Stefanakis2019_20452,
  author = {Stefanakis, Nikolaos and Mastorakis, Yannis and Alexandridis, Anastasios and Mouchtaris, Athanasios},
  title = {{Automating Mixing of User-Generated Audio Recordings from the Same Event}},
  journal = {Journal of the Audio Engineering Society},
  volume = {67},
  number = {4},
  pages = {201--212},
  year = {2019},
  month = apr,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2019.0008},
  url = {https://doi.org/10.17743/jaes.2019.0008}
}

TY  - JOUR
TI  - Automating Mixing of User-Generated Audio Recordings from the Same Event
AU  - Stefanakis, Nikolaos
AU  - Mastorakis, Yannis
AU  - Alexandridis, Anastasios
AU  - Mouchtaris, Athanasios
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 67
IS  - 4
SP  - 201
EP  - 212
PY  - 2019
DA  - 2019/04/06
DO  - 10.17743/jaes.2019.0008
UR  - https://doi.org/10.17743/jaes.2019.0008
PB  - Audio Engineering Society
LA  - en
AB  - When users attend the same public event, there may be multiple audiovisual recordings that are then posted on social media and websites. The availability of such a massive amount of user-generated recordings (UGR) has triggered new research directions related to the search, organization, and management of this content. And it has provided inspiration for new business models for content storage, retrieval, and consumption. The authors propose an approach to combine the available recordings based on a normalization step and a mixing step. The normalization step defines a fixed-with-time gain that is specific to each UGR. In the mixing step, a mechanism that reduces the master gain in accordance with the number of activated inputs at each time is employed. An approach called orthogonal mixing is presented, which is based on the assumption that the mixture components are mutually independent. The presented mixing process allows the combination of multiple short-duration UGRs to produce a longer audio stream, with potentially better quality than any one of its constituent parts. This property is exploited in the design of an automatic mixing process that exploits all the available audio recordings at each moment. Automatic mixing is then possible.
ER  -