Audio Re-Synthesis Based on Waveform Lookup Tables

Heise S, Hlatky M, Loviscach J. Audio Re-Synthesis Based on Waveform Lookup Tables. In: AES Convention 129. Audio Engineering Society; 2010. Paper 8286. Available from: https://aes.org/publications/elibrary-page/?id=15708

@inproceedings{Heise2010_15708,
  author = {Heise, Sebastian and Hlatky, Michael and Loviscach, Jörn},
  title = {{Audio Re-Synthesis Based on Waveform Lookup Tables}},
  booktitle = {AES Convention 129},
  note = {Paper 8286},
  year = {2010},
  month = nov,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=15708}
}

TY  - CPAPER
TI  - Audio Re-Synthesis Based on Waveform Lookup Tables
AU  - Heise, Sebastian
AU  - Hlatky, Michael
AU  - Loviscach, Jörn
T2  - AES Convention 129
M1  - Paper 8286
PY  - 2010
DA  - 2010/11/06
UR  - https://aes.org/publications/elibrary-page/?id=15708
PB  - Audio Engineering Society
LA  - en
AB  - Transmitting speech signals at optimum quality over a weak narrowband network requires audio codecs that must not only be robust to packet loss and operate at low latency, but also offer a very low bit rate and maintain the original sound of the coded signal. Advanced speech codecs for real-time communication based on code-excited linear prediction provide bandwidths as low as 2 kbit/s. We propose a new coding approach that promises even lower bitrates through a synthesis approach not based on the source-filter model, but merely on a lookup table of audio waveform snippets and their corresponding Mel-Frequency Cepstral Coefficients (MFCC). The encoder performs a nearest-neighbor search for the MFCC features of each incoming audio frame against the lookup table. This process is heavily sped up by building a multi-dimensional search tree of the MFCC-features. In a speech coding application, for each audio frame, only the index of the nearest neighbor in the lookup table would need to be transmitted. The encoder synthesizes the audio signal from the waveform snippets corresponding to the transmitted indices.
ER  -