Opens in a new tab

AES E-Library

← Back to search

Journal Article

Expanding the Frontiers of Web Audio With Autoencoders and JavaScript

Authors: Cámara, Mateo; Blanco, José Luis

Journal of the Audio Engineering Society · Volume 70 · Issue 11 · pp. 979–989 · November 2022

Abstract

This paper presents a non-backend web architecture for generative audio mixing from the Freesound website using a Variational Autoencoder. It is designed to experiment with the nonexisting audios in large audio databases without the need to populate them. It works directly from the browser using JavaScript tools with a serverless approach and relies exclusively on the computational capacity of the client. The platform's Graphical User Interface allows rapid sampling of the autoencoder sound space and is under active development while the logic is finalized. A Variational Autoencoder has been trained to serve as the default model. Users can upload their own to operate independently. The platform aims to provide users with a straightforward and quick-access interface to generative sounds, supporting the audiovisual industry by filling the existing gaps in audio repositories with synthetic media.

Details

Publication
Journal of the Audio Engineering Society
Volume
70
Issue
11
Pages
979–989
Publication date
November 6, 2022
Affiliation
Grupo de Aplicaciones del Procesado de Señales, Information Processing and Telecommunication Center; Escuela Técnica Superior de Ingenieros de Telecomunicación, Universidad Politécnica de Madrid, Spain (See document for exact affiliation information.)
Type
Journal Article