Perceptual Evaluation of Principal-Component-Based Synthesis of Musical Timbres

Sandell GJ, Martens WL. Perceptual Evaluation of Principal-Component-Based Synthesis of Musical Timbres. J Audio Eng Soc. 1995;43(12):1013-1028. Available from: https://aes.org/publications/elibrary-page/?id=7919

@article{Sandell1995_7919,
  author = {Sandell, Gregory J. and Martens, William L.},
  title = {{Perceptual Evaluation of Principal-Component-Based Synthesis of Musical Timbres}},
  journal = {Journal of the Audio Engineering Society},
  volume = {43},
  number = {12},
  pages = {1013--1028},
  year = {1995},
  month = dec,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=7919}
}

TY  - JOUR
TI  - Perceptual Evaluation of Principal-Component-Based Synthesis of Musical Timbres
AU  - Sandell, Gregory J.
AU  - Martens, William L.
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 43
IS  - 12
SP  - 1013
EP  - 1028
PY  - 1995
DA  - 1995/12/06
UR  - https://aes.org/publications/elibrary-page/?id=7919
PB  - Audio Engineering Society
LA  - en
AB  - Harmonic-based analysis and resynthesis of musical instrument tones, for example, using the phase vocoder method, is a valuable technique, but its data representation is very large. However, this data set is usually highly redundant. Principal components analysis (PCA) can be used to encode such data into a smaller set of orthogonal basis vectors with minimal loss of information. Techniques for applying PCA to such data are explored, and the aural impact of the method on three tones (cello, trombone, and clarinet) are studied in two perception experiments. Results show that nearly identical resyntheses can be produced with a 40-70% data reduction. A preprocessing step called variable-duration temporal partitioning (VDTP) is introduced, which also affords a natural-sounding method for time expansion and contraction of tones. An extension of the PCA technique is also introduced that implements a "timbre space," or coordinate system for interpolation among a group of musical instruments.
ER  -