Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Audio Processing in a Multimodal Framework

Authors: Camurri, Antonio; Coletta, Paolo; Drioli, Carlo; Massari, Alberto; Volpe, Gualtiero

AES Convention 118 · Paper 6390 · May 2005

Abstract

The EyesWeb system (www.eyesweb.org) is an open platform for real-time multimodal processing. It has now reached a mature stage, and is being used both for research in multimodal interfaces and for for applications such as naturally interacting systems for museum exhibits, performing arts, therapy and rehabilitation. This paper presents the latest development concerning audio processing in EyesWeb with a special focus on multimodal processing. The integrated audio processing support includes modules for the analysis and synthesis of audio streams, for musical processing through the MIDI protocol, and for interoperability with other audio processing platforms, technologies and standards. Advanced real-time audio support for the mapping of multimodal input into multimedia output is described in the full paper.

Details

Published in
AES Convention 118
AES Convention
118
Paper number
6390
Publication date
May 6, 2005
Session subject
Miscellaneous Audio Topics
Affiliation
ISTC-CNR, Padova; University of Genova (See document for exact affiliation information.)
Type
Convention Paper