Phoneme Recognition for 3D Modeled Digital Character Talking Emulation

Kalliris GM, Dimoulas CA, Papanikolaou GV, Avdelidis K, Passias TN, Stoitsis JS. Phoneme Recognition for 3D Modeled Digital Character Talking Emulation. In: AES Convention 112. Audio Engineering Society; 2002. Paper 5626. Available from: https://aes.org/publications/elibrary-page/?id=11340

@inproceedings{Kalliris2002_11340,
  author = {Kalliris, George M. and Dimoulas, Charalampos A. and Papanikolaou, George V. and Avdelidis, Kostas and Passias, Taxiarchis N. and Stoitsis, John S.},
  title = {{Phoneme Recognition for 3D Modeled Digital Character Talking Emulation}},
  booktitle = {AES Convention 112},
  note = {Paper 5626},
  year = {2002},
  month = apr,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=11340}
}

TY  - CPAPER
TI  - Phoneme Recognition for 3D Modeled Digital Character Talking Emulation
AU  - Kalliris, George M.
AU  - Dimoulas, Charalampos A.
AU  - Papanikolaou, George V.
AU  - Avdelidis, Kostas
AU  - Passias, Taxiarchis N.
AU  - Stoitsis, John S.
T2  - AES Convention 112
M1  - Paper 5626
PY  - 2002
DA  - 2002/04/06
UR  - https://aes.org/publications/elibrary-page/?id=11340
PB  - Audio Engineering Society
LA  - en
AB  - The current paper focuses on the design and implementation of a phoneme recognition algorithm that is used to extract the appropriate parameters in order to drive a 3d graphics facial expression and animation procedure. This is used to emulate speech generation to 3d modeled digital characters. At the first development step, LPC, STFT analysis, wavelets, cepstrum and pattern recognition techniques were tested for phoneme recognition and speaker classification. Then, 3d graphics facial expressions and phonemes were related in a library. A client/server application that processes speech, combines library data via morphing techniques and generates a digital character, virtually speaking according to the given speech, was finally designed. Possible applications include cartoon dubbing and web based virtual teleconference.
ER  -