AES Technical Committee

Semantic Audio Analysis


This committee provides a forum in the AES for researchers and innovators to come together and discuss and disseminate the newest developments related to Semantic Audio. We are interested in how to extract meaning from audio signals, how to represent it and how to use it.

This includes developments in Music Information Retrieval, Intelligent Audio Editing, Semantic Audio Processing and Semantic Web for Music.

We organize AES International Conferences on Semantic Audio and tutorials and workshops for AES Conventions.

If you are interested in our work or if you would like to propose a workshop or tutorial at a future Convention, please you attend a meeting of the TC SAA at an AES Convention.


Areas of Concentration

  • Music Information Retrieval
  • Audio classification and segmentation
  • Automatic music transcription
  • Semantic Audio Processing
  • Semantic Audio Production, Intelligent Editing and Audio Effects
  • Computational Auditory Scene Analysis
  • Blind source separation
  • Musical similarity
  • Audio indexing, hashing, searching
  • Audio Markup and XML
  • Music Web Services, Semantic Web for Music
  • Digital Archiving and libraries
  • Broadcast Monitoring
  • Musical performance analysis, instrument tuition, musical education

Events at Conventions

  • Deep Learning and AI for Audio Applications - Engineering Best Practices for Data - a tutorial at AES 148th Virtual Convention, 2020 Panelists: Gabriele Bunkheila, MathWorks
  • Deep Learning and AI for Audio Applications - Engineering Best Practices for Data - a tutorial at AES 147th Convention in New York Panelists: Gabriele Bunkheila, MathWorks
  • Practical Deep Learning Introduction for Audio Processing Engineers - a tutorial at AES 146th Convention in Dublin Panelists: Gabriele Bunkheila, MathWorks
  • Practical Deep Learning Introduction for Audio Processing Engineers - a tutorial at AES 145th Convention in New York Panelists: Gabriele Bunkheila, MathWorks
  • Deep Learning for Audio Applications - a workshop at AES 144th Convention in Milan. Panelists: Qiuqiang Kong, University of Surrey and Stylianos Ioannis Mimilakis, Fraunhofer Institute for Digital Media Technology (IDMT) and Christian Uhle, Fraunhofer IIS, International Audio Laboratories Erlangen; chair: Konstantinos Drossos, Tampere University of Technology.
  • Application of Semantic Audio Analysis to the Music Production Workflow - a workshop at AES 139th Convention in New York. Panelists: Jay LeBoeuf (Real Industry, Stanford University, San Francisco, USA) and Bryan Pardo (Northwestern University, USA); co-chairs: György Fazekas (Queen Mary University of London, UK) and Ryan Stables (Birmingham City University, UK).
  • Advances in Semantic Audio and Intelligent Music Production - a tutorial at AES 139th Convention in New York. Panelists: Brecht de Man, Joshua R. Reiss and Thomas Wilmering (Queen Mary University of London, UK); chair: Ryan Stables (Birmingham City University, UK).
  • Objective Analysis in Semantic Audio Analysis and Production - a workshop at the AES 138th Convention in Warsaw. Panelists: Bob Sturm (Queen Mary University of London, UK), Colin Raffael (Columbia University, New York, USA), Xavier Serra (Universitat Pompeu Fabra, Barcelona, Spain); co-chairs: George Fazekas (Queen Mary University of London, UK) and Christian Uhle (Fraunhofer IIS, Germany).
  • Semantic Audio Production - a workshop at the AES 136th Convention in Berlin. With Josh Reiss (Queen Mary University of London, UK), Bryan Pardo (Northwestern University, IL, USA), Stefan Ledergerber (Lawo Group, Zurich, Switzerland), and Christian Uhle (Fraunhofer IIS, Germany).
  • Audio Source Separation - a workshop at the AES 135th Convention in New York Chaired by Gautham Mysore (Adobe Research), with panelists Nicholas Bryan (Stanford University), Derry FitzGerald (Cork Institute of Technology), Elias Kokkinis (accusonus), and Pierre Leveau (Audionamix)
  • Semantic Analysis for Speech Signals - a workshop at the AES 134th Convention in Rome. With Yves Raimond (BBC R&D, UK), Joern Loviscach (University of Applied Sciences Bielefeld, Germany), and Christian Uhle (Fraunhofer IIS, Germany).
  • Semantic Web and Semantic Audio technologies - a tutorial at the AES 132nd Convention in Budapest, with George Fazekas, Thomas Wilmering
  • Semantic Audio Analysis in the Real World - a workshop at the AES 132nd Convention in Budapest. Chaired by Andrew Mason (BBC R&D). Speakers: Andy Hill (I Like Music, UK), Mark Sandler (Queen Mary University of London, UK), Nigel Smith (BBC Audio and Music Interactive, UK), and Christian Uhle (Fraunhofer IIS, Germany)
  • Intelligent Digital Audio Effects (I-DAFx) - a workshop at the AES 127th Convention in New York. Speakers were Udo Zoelzer (Helmut Schmidt University, Germany), Josh Reiss (Queen Mary University of London, UK) and Christian Uhle (Fraunhofer IIS, Germany).
  • Intelligent Digital Audio Effects (I-DAFx) - a workshop at the AES 126th Convention in Munich. Speakers were Udo Zoelzer (Helmut Schmidt University, Germany), Josh Reiss (Queen Mary University of London, UK), Alexander Lerch (zplane.development, Germany) and Christian Uhle (Fraunhofer IIS, Germany). The slides are attached as a single zip-file.
  • Analyzing, Recommending, and Searching Audio Content—Commercial Applications of Music Information Retrieval - a workshop held at the AES 125th Convention in San Francisco. Panelists included Markus Cremer (Gracenote), Matthias Gruhne (Fraunhofer Institute for Digital Media Technology), Tristan Jehan (The Echo Nest), Keyvan Mohajer (Melodis Corporation), and Jay LeBoeuf (Imagine Research).
  • Intelligent audio systems: A review of the foundations and applications of semantic audio analysis and music information retrieval - a tutorial at the AES 124th Convention in Amsterdam. Presenters included: Perfecto Herrera-Boyer (Universitat Pompeu Fabra) and Jay LeBoeuf, Imagine Research.
  • Music 2.0: Music and the Semantic Web - a workshop at the 122nd Convention in Vienna. Speakers were: Scott Cohen of The Orchard, Mark Sandler and Yves Raimond of Queen Mary's Centre for Digital Music, Lucas Gonze of Yahoo!Music, and Oscar Celma of the Music Technology Group at Pompeu Fabra University.
  • Audio Gets Smart - The What and Why of Semantic Audio Analysis- a workshop at AES 115th Convention. Chair: Mark Sandler. Speakers were Dan Ellis of Columbia University, Michael Casey of City University and Juergen Herre of Fraunhoefer IIS. Talks may be downloaded from this website.

Conferences

  • 2017 AES International Conference on Semantic Audio, June 22-24, 2017, Erlangen, Germany, Conference website
  • AES 53rd International Conference on Semantic Audio,27-29 January 2014, London, UK, Conference website
  • AES 42nd International Conference on Semantic Audio, 22-24 July 2011, Ilmenau, Germany, Conference website.

Related JAES Special Issues

  • Web Audio, Vol. 68, Number 10, 2020 October, https://www.aes.org/journal/online/JAES_V68/10/JAES_V68_10_PG701.pdf
  • Sound in Immersion and Emotion, Vol 68, Number 1/2, 2020 January/February https://www.aes.org/tmpFiles/JAES/20210130/JAES_V68_1_2_PG5.pdf
  • Object-Based Audio, Vol. 67, No. 7/8, 2019 July/August https://www.aes.org/tmpFiles/JAES/20210130/JAES_V67_7_8_PG484.pdf
  • Special Issue on Intelligent Audio Processing, Semantics, and Interaction, 2016 July/August - Volume 64 Number ?, 2016 https://www.aes.org/journal/online/JAES_V64/7_8/


Meeting Report:

These documents do not necessarily express the official position of the AES on the issues discussed at these meetings, and only represent the views of committee members participating in the discussion. Any unauthorized use of these publications is prohibited. Authorization must be obtained from the Executive Director of the AES: Email, Tel: +1 212 661 8528, Address: 551 Fifth Ave., Suite 1225, New York, New York 10176, USA.

2022-6-1     Minutes Virtual Meeting 2022-05-31
Description: Minutes from TC SAA Virtual Meeting (Zoom) 2022-05-31

2021-10-12     Minutes Virtual Meeting, 2021-10-12
Description: Minutes Virtual Meeting, 2021-10-12

2021-6-7     Minutes Virtual Meeting, 2021-06-04
Description: Minutes from TC SAA Virtual Meeting (Zoom), 2021-06-04

2021-1-20     Minutes Virtual Meeting 2021-01-19
Description: Minutes from TC SAA Virtual Meeting (Zoom), 2021-01-19

2021-1-14     Minutes Virtual Meeting 2020-10-06
Description: Minutes from TC SAA Virtual Meeting (Zoom), 2020-10-06

2020-6-3     Minutes AES 148
Description: Minutes from TC SAA Meeting held at the AES 148th Convention, Virtual Vienna 2020

2020-4-29     Minutes AES 147
Description: Minutes from TC SAA Meeting held at the AES 147th Convention

2019-3-22     Minutes AES 146
Description: Minutes from TC SAA Meeting held at the AES 146th Convention, Dublin, 2019

2019-3-22     Minutes AES 144
Description: Minutes from TC SAA Meeting held at the AES 144th Convention, Milan, 2018

2017-11-3     Minutes AES143
Description: Minutes from TC SAA Meeting held at the AES 143rd Convention, NY, Oct 2017

2017-6-28     Minutes from Meeting at AES Conference Semantic Audio 2017
Description: Minutes from the meeting held at AES Conference Semantic Audio 2017

2016-6-10     Minutes AES 140
Description: Minutes from TC SAA Meeting held at the AES 140th Convention, Paris, 2016

2015-5-12     Minutes AES 138
Description: Minutes from TC SAA Meeting held at the AES 138th Convention, Warsaw, May 2015

2014-5-5     Minutes AES 136
Description: Minutes from TC SAA Meeting held at the AES 136th Convention, Berlin, May 2014

2013-5-9     Minutes AES 134
Description: Minutes from TC SAA Meeting held at the AES 134rd Convention, Rome, May 2013

2013-1-2     Minutes AES 133
Description: Minutes of the meeting of the SAA TC at the 133rd convention, New York

2010-11-16     TC Minutes from 129th AES TC SAA Meeting
Description: Minutes from 129th AES TC SAA Meeting

2009-5-27     Minutes from 126th Convention
Description: Minutes from meeting of TC-SAA at 126th Convention, Munich, May 2009

2008-10-10     Minutes from 125th Convention
Description: Minutes from 125th Convention

2008-9-29     124th Minutes
Description: Minutes from meeting of TC-SAA at 124th Convention, Amsterdam, May 2008

2006-11-20     Minutes of TC on Semantic Audio, 117st Convention
Description: Minutes of TC on Semantic Audio, 117st Convention

2006-11-20     Minutes of TC on Semantic Audio, 121st Convention
Description: Minutes of TC on Semantic Audio, 121st Convention

2004-7-14     Minutes of TC meeting, AES 116th
Description: Minutes of the meeting held on Sunday 9 May 2004

2003-12-3     Minutes of TC meeting 10 Oct 2003, 115th Convention
Description: minutes of tc meeting in new york, 115th aes

2003-6-26     Minutes of the First meeting of the AES TC on Semantic Audio Analysis
Description: Minutes of the inaugural meeting of the TC on SAA


Other:

2009-5-26     Intelligent Digital Audio Effects (I-DAFx)
Description: Slides are attached as a single zip-file.


Committee Members

 Gerald Schuller  James Johnston  Mark Sandler 
 Bozena Kostek  Karlheinz Brandenburg  Stephen Pope 
 Gautham Mysore  Andrew Mason  Gyorgy Fazekas 
 Christian Uhle  Brecht De Man  Jouni Paulus 
 Matteo Torcoli  Bryan Pardo  Philipp Weber 
 Ilaria Manco  Yixiao Zhang  Dave Moffat 
 Gabriele Bunkheila  Matt Leatherman 

To request membership in this Technical Committee please email the Chair by using the link above.

AES - Audio Engineering Society