Opens in a new tab

AES E-Library

← Back to search

Convention Paper

Elevator: Emotional Tracking Using Audio/Visual Interaction

Authors: Psarras, Basileios; Floros, Andreas; Strapatsakis, Marianna

AES Convention 126 · Paper 7657 · May 2009

Abstract

The research interest on modeling everyday human emotions and controlling them through typical multimedia content (i.e. audio and video data) has recently increased. In this work, an interactive methodology is introduced for detecting, controlling and tracking emotions. Based on the above methodology, an interactive audiovisual installation termed “Elevator” was realized, aiming to analyze and manipulate simple emotions of the participants (such as anger) using simplified emotion detection audio signal processing techniques and specifically selected combined audio/visual content. As a result, the human emotions are “elevated” to pre-defined levels and appropriately mapped to visual content which corresponds to the emotional “thumbnail” of the participants.

Details

Published in
AES Convention 126
AES Convention
126
Paper number
7657
Publication date
May 6, 2009
Session subject
Audio for Games and Interactive Media
Affiliation
Dept. of Audiovisual Arts, Ionian University, Corfu, Greece (See document for exact affiliation information.)
Type
Convention Paper