Annotation and Analysis of Recorded Piano Performances on the Web

Fyfe L, Bedoya D, Chew E. Annotation and Analysis of Recorded Piano Performances on the Web. J Audio Eng Soc. 2022;70(11):962-978. doi:10.17743/jaes.2022.0057

@article{Fyfe2022_22020,
  author = {Fyfe, Lawrence and Bedoya, Daniel and Chew, Elaine},
  title = {{Annotation and Analysis of Recorded Piano Performances on the Web}},
  journal = {Journal of the Audio Engineering Society},
  volume = {70},
  number = {11},
  pages = {962--978},
  year = {2022},
  month = nov,
  publisher = {Audio Engineering Society},
  doi = {10.17743/jaes.2022.0057},
  url = {https://doi.org/10.17743/jaes.2022.0057}
}

TY  - JOUR
TI  - Annotation and Analysis of Recorded Piano Performances on the Web
AU  - Fyfe, Lawrence
AU  - Bedoya, Daniel
AU  - Chew, Elaine
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 70
IS  - 11
SP  - 962
EP  - 978
PY  - 2022
DA  - 2022/11/06
DO  - 10.17743/jaes.2022.0057
UR  - https://doi.org/10.17743/jaes.2022.0057
PB  - Audio Engineering Society
LA  - en
AB  - Advancing knowledge and understanding about performed music is hampered by a lack of annotation data for music expressivity. To enable large-scale collection of annotations and explorations of performed music, the authors have created a workflow that is enabled by CosmoNote, aWeb-based citizen science tool for annotating musical structures created by the performer and experienced by the listener during expressive piano performances. To enable annotation tasks with CosmoNote, annotators can listen to the recorded performances and view synchronized music visualization layers including the audio waveform, recorded notes, extracted audio features such as loudness and tempo, and score features such as harmonic tension. Annotators have the ability to zoom into specific parts of a performance and see visuals and listen to the audio from just that part. The annotation of performed musical structures is done by using boundaries of varying strengths, regions, comments, and note groups. By analyzing the annotations collected with CosmoNote, performance decisions will be able to be modeled and analyzed in order to aid in the understanding of expressive choices in musical performances and discover the vocabulary of performed musical structures.
ER  -