Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse

Dziwis D, Von Coler H, Pörschmann C. Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse. J Audio Eng Soc. 2023;71(11):802-812. doi:10.17743/jaes.2022.0096

@article{Dziwis2023_22345,
  author = {Dziwis, Damian and Von Coler, Henrik and Pörschmann, Christoph},
  title = {{Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse}},
  journal = {Journal of the Audio Engineering Society},
  volume = {71},
  number = {11},
  pages = {802--812},
  year = {2023},
  month = nov,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2022.0096},
  url = {https://doi.org/10.17743/jaes.2022.0096}
}

TY  - JOUR
TI  - Orchestra: A Toolbox for Live Music Performances in a Web-Based Metaverse
AU  - Dziwis, Damian
AU  - Von Coler, Henrik
AU  - Pörschmann, Christoph
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 71
IS  - 11
SP  - 802
EP  - 812
PY  - 2023
DA  - 2023/11/06
DO  - 10.17743/jaes.2022.0096
UR  - https://doi.org/10.17743/jaes.2022.0096
PB  - Audio Engineering Society
LA  - en
AB  - As the potential of networked multiuser virtual environments increases under the concept of the metaverse, so do the interest and artistic possibilities of using them for live music performances. Live performances in online metaverse environments offer an easy and environmentally friendly way to bring together artists and audiences from all over the world. Virtualization also enables countless possibilities for designing and creating artistic experiences and new performance practices. For many years, live performances have been established on various virtual platforms, which differ significantly in terms of possible performance practices, user interaction, immersion, and usability. With Orchestra, we are developing an open-source toolbox that uses the Web Audio Application Programming Interface to realize live performances with various performance practices for web-based metaverse environments. Possibilities vary from live streaming of volumetric audio and video, live coding in multiple (including audiovisual) programming languages, to performing with generative algorithms or virtual instruments developed in PureData. These can be combined in various ways and also be used for telematic/networked music ensembles, interactive virtual installations, or novel performance concepts. In this paper, we describe the development and scope of the Orchestra toolbox, as well as use cases that illustrate the artistic possibilities.
ER  -