Opens in a new tab

AES E-Library

← Back to search

Journal Article

JSPatcher, a Visual Programming Environment for Building High-Performance Web Audio Applications

Authors: Ren, Shihong; Pottier, Laurent; Buffa, Michel; Yu, Yang

Journal of the Audio Engineering Society · Volume 70 · Issue 11 · pp. 938–950 · November 2022

Abstract

Many visual programming languages (VPLs), which include Max or PureData, provide a graphic canvas for connecting between functions or data. This canvas, also called a patcher, is basically a graph meant to be interpreted as a dataflow computation by the system. Some VPLs are used for multimedia performance or content generation because the user interface system is generally a significant element of the language. This paper presents a Web-based VPL, JSPatcher, which allows users to build audio graphs using the Web Audio API. Users can use aWeb browser to graphically design and run digital signal processor algorithms using domain-specific languages for audio processing, such as FAUST or Gen, and execute them in a dedicated high-priority thread called AudioWorklet. The application can also be utilized to create interactive programs and shareable artworks online with other JavaScript language built-ins, Web APIs, Web-based audio plugins, or external JavaScript modules.

Details

Publication
Journal of the Audio Engineering Society
Volume
70
Issue
11
Pages
938–950
Publication date
November 6, 2022
Affiliation
Shanghai Conservatory of Music, SKLMA, China; Universit´e Jean Monnet, ECLLA Lab, Saint-Etienne, France; Universit´e Jean Monnet, ECLLA Lab, Saint-Etienne, France; Universit´e Cˆote d’Azur, I3S, INRIA, France; Shanghai Conservatory of Music, SKLMA, China (See document for exact affiliation information.)
Type
Journal Article