Smartphone-Based 360° Video Streaming/Viewing System including Acoustic Immersion

Niwa K, Ochi D, Kameda A, Kamamoto Y, Moriya T. Smartphone-Based 360° Video Streaming/Viewing System including Acoustic Immersion. In: AES Convention 141. Audio Engineering Society; 2016. Paper 9676. Available from: https://aes.org/publications/elibrary-page/?id=18480

@inproceedings{Niwa2016_18480,
  author = {Niwa, Kenta and Ochi, Daisuke and Kameda, Akio and Kamamoto, Yutaka and Moriya, Takehiro},
  title = {{Smartphone-Based 360° Video Streaming/Viewing System including Acoustic Immersion}},
  booktitle = {AES Convention 141},
  note = {Paper 9676},
  year = {2016},
  month = sep,
  publisher = {Audio Engineering Society},
  url = {https://aes.org/publications/elibrary-page/?id=18480}
}

TY  - CPAPER
TI  - Smartphone-Based 360° Video Streaming/Viewing System including Acoustic Immersion
AU  - Niwa, Kenta
AU  - Ochi, Daisuke
AU  - Kameda, Akio
AU  - Kamamoto, Yutaka
AU  - Moriya, Takehiro
T2  - AES Convention 141
M1  - Paper 9676
PY  - 2016
DA  - 2016/09/06
UR  - https://aes.org/publications/elibrary-page/?id=18480
PB  - Audio Engineering Society
LA  - en
AB  - In virtual reality (VR), 360º video services provided through head mounted displays (HMDs) or smartphones are widely used. Despite the fact that the user’s viewpoint seamlessly changes, sounds through the headphones are fixed even when images change in correspondence with user head motion in many 360º video services. We have been studying acoustic immersion technology that is achieved by, for example, generating binaural sounds corresponding to the user head motion. Basically, our method is composed of angular region-wise source enhancement using array observation signals, multichannel audio encoding based on MPEG-4 Audio Lossless Coding (ALS), and binaural synthesizing of enhanced signals using head related transfer functions (HRTFs). In this paper, we constructed a smartphone-based real-time system for streaming/viewing 360º video including acoustic immersion and evaluated it through subjective tests.
ER  -