See Your Audio 3D: A Novel Optical Approach for Simultaneous Visualization of Sound Fields and 3D Objects

Ishikawa K. See Your Audio 3D: A Novel Optical Approach for Simultaneous Visualization of Sound Fields and 3D Objects. In: Convention Paper. Audio Engineering Society; 2025.pp. 10236:1-8. Available from: https://aes.org/publications/elibrary-page/?id=23080

@inproceedings{Ishikawa2025_23080,
  author = {Ishikawa, Kenji},
  title = {{See Your Audio 3D: A Novel Optical Approach for Simultaneous Visualization of Sound Fields and 3D Objects}},
  pages = {10236:1-8},
  url = {https://aes.org/publications/elibrary-page/?id=23080},
  year = {2025},
  month = oct,
  publisher = {Audio Engineering Society},
  address = {Long Beach}
}

TY  - CPAPER
TI  - See Your Audio 3D: A Novel Optical Approach for Simultaneous Visualization of Sound Fields and 3D Objects
AU  - Ishikawa, Kenji
SP  - 1
EP  - 8
M1  - Paper 10236
PY  - 2025
DA  - 2025/10/14
UR  - https://aes.org/publications/elibrary-page/?id=23080
PB  - Audio Engineering Society
CY  - Long Beach
LA  - en
AB  - While sound transmits linguistic and musical information through its temporal variations, its spatial distribution encodes vital information related to three-dimensional perception and spatial audio representation. However, since sound is invisible to the human eye, grasping its spatial characteristics is challenging. This paper proposes a fully optical visualization method for spatial audio waves alongside the 3D geometry and texture of sound sources. The proposed method involves reconstructing a three-dimensional sound field from a high-speed video of projected sound fields measured using optical interferometry. The continuous rotation of the sound source enables the reconstruction of a volumetric sound field from a single video with a spatial resolution finer than 1 mm. The 3D surfaces and textures of the sound source are constructed from an ordinary video using a neural radiance field-based mesh generation technique. The volumetric sound field and 3D objects are integrated and visualized simultaneously in a 3D space, allowing us to visually ascertain where and how the sound is generated and propagates. The proposed method is demonstrated with three examples: sound radiation from a loudspeaker, a smartphone, and an ultrasonic transducer array.
ER  -