Musical Eliza: An Automatic Musical Accompany System Based on Expressive Feature Analysis

Bocko G, Bocko MF, Headlam D, Lundberg J, Ren G. Musical Eliza: An Automatic Musical Accompany System Based on Expressive Feature Analysis. In: AES Convention 129. Audio Engineering Society; 2010. Paper 8256. Available from: https://aes.org/publications/elibrary-page/?id=15678

@inproceedings{Bocko2010_15678,
  author = {Bocko, Gregory and Bocko, Mark F. and Headlam, Dave and Lundberg, Justin and Ren, Gang},
  title = {{Musical Eliza: An Automatic Musical Accompany System Based on Expressive Feature Analysis}},
  booktitle = {AES Convention 129},
  note = {Paper 8256},
  year = {2010},
  month = nov,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=15678}
}

TY  - CPAPER
TI  - Musical Eliza: An Automatic Musical Accompany System Based on Expressive Feature Analysis
AU  - Bocko, Gregory
AU  - Bocko, Mark F.
AU  - Headlam, Dave
AU  - Lundberg, Justin
AU  - Ren, Gang
T2  - AES Convention 129
M1  - Paper 8256
PY  - 2010
DA  - 2010/11/06
UR  - https://aes.org/publications/elibrary-page/?id=15678
PB  - Audio Engineering Society
LA  - en
AB  - We propose an interactive algorithm that musically accompanies musicians based on the matching of expressive feature patterns to existing archive recordings. For each accompany music segment, multiple realizations with different musical characteristics are performed by master music performers and recorded. Musical expressive features are extracted from each accompany segment and its semantic analysis is obtained using music expressive language model. When the performance of system user is recorded, we extract and analyze musical expressive feature in real time and playback the accompany track from the archive database that best matches the expressive feature pattern. By creating a sense of musical correspondence, our proposed system provides exciting interactive musical communication experience and finds versatile entertainment and pedagogical applications.
ER  -