Opens in a new tab

AES E-Library

← Back to search

Express Paper

From live framedrum performance to music notation: a data-driven approach

Authors: Vryzas, Nikolaos; Bountourakis, Vasileios; Pagonis, Antonis

Express Paper · Paper 246 · June 2024

Abstract

This research focuses on utilizing the traditional frame drum as an input sensor for the creation of music sheets without the need for manual transcription, by training and evaluating models on a dataset containing samples from various frame drums and playing techniques. The existing dataset is extended to include recordings from different frame drums with varying attributes and playing techniques for improved generalization. CNN-based models are employed for audio sample recognition between the main hitting techniques and playing positions. Additional modules for pitch recognition and onset detection are proposed in the system architecture. The models are trained and evaluated on individually recorded samples.

Details

AES Convention
156
Paper number
246
Publication date
June 6, 2024
Affiliation
Aristotle University of Thessaloniki, University Campus, 54124 Thessaloniki, Greece; Aalto University, Department of Information and Communications Engineering, Espoo, Finland; Pagonis Percussion, Thessaloniki, Greece (See document for exact affiliation information.)
Type
Express Paper