Opens in a new tab

AES E-Library

← Back to search

Engineering Brief Open Access

Developing plugins for your ears

Authors: Spittle, Gary; Lee, Michael; Li, Weiming

AES Convention 151 · Paper 656 · October 2021

Abstract

We present a new intuitive development platform that allows algorithm developers to put plugins in our ears. The growing number of advanced audio processing plugins developed for DAWs is enabling highly creative sound experiences. We explain how plugins for DAWs can be easily ported to small embedded processors used in ear worn products and other audio devices. This includes signal processing targeting low latency, low power, high compute and large memory plugins. We describe an open development platform to bring machine learning based algorithms directly to the end user. This will also give plugin developers access to data streams from additional sensors and multichannel audio data beyond stereo music streaming. The next generation of hearables for gaming, music, movies, AR/VR will require processing techniques currently only available to professionals in studios. These new development tools allow algorithms to be created such that end users can select, download and control plugins to unlock innovation that fits their individual needs and personal preferences

Details

Published in
AES Convention 151
AES Convention
151
Paper number
656
Publication date
October 6, 2021
Session subject
Spatial audio applications
Affiliation
Sonical Inc., San Mateo, CA, USA (See document for exact affiliation information.)
Type
Engineering Brief