Opens in a new tab

AES E-Library

← Back to search

Convention Paper Open Access

Machine Learning Applied to Aspirated and Non-Aspirated Allophone Classification–An Approach Based on Audio “Fingerprinting”

Authors: Piotrowska, Magdalena; Korvel, Grazina; Kurowski, Adam; Kostek, Bozena; Czyzewski, Andrzej

AES Convention 145 · Paper 10070 · October 2018

Abstract

The purpose of this study is to involve both Convolutional Neural Networks and a typical learning algorithm in the allophone classification process. A list of words including aspirated and non-aspirated allophones pronounced by native and non-native English speakers is recorded and then edited and analyzed. Allophones extracted from English speakers’ recordings are presented in the form of two-dimensional spectrogram images and used as input to train the Convolutional Neural Networks. Various settings of the spectral representation are analyzed to determine adequate option for the allophone classification. Then, testing is performed on the basis of non-native speakers’ utterances. The same approach is repeated employing learning algorithm but based on feature vectors. The archived classification results are promising as high accuracy is observed.

Details

Published in
AES Convention 145
AES Convention
145
Paper number
10070
Publication date
October 6, 2018
Session subject
Acoustics and Signal Processing
Affiliation
Vilnius University, Vilnius, Lithuania; Gdansk University of Technology, Gdansk, Poland (See document for exact affiliation information.)
Type
Convention Paper