Augmenting a MIDI Keyboard Using Virtual Interfaces

Desnoyers-Stewart J, Gerhard D, Smith ML. Augmenting a MIDI Keyboard Using Virtual Interfaces. J Audio Eng Soc. 2018;66(6):439-447. doi:10.17743/jaes.2018.0034

@article{DesnoyersStewart2018_19583,
  author = {Desnoyers-Stewart, John and Gerhard, David and Smith, Megan L.},
  title = {{Augmenting a MIDI Keyboard Using Virtual Interfaces}},
  journal = {Journal of the Audio Engineering Society},
  volume = {66},
  number = {6},
  pages = {439--447},
  url = {https://doi.org/10.17743/jaes.2018.0034},
  doi = {10.17743/jaes.2018.0034},
  year = {2018},
  month = jun,
  publisher = {Audio Engineering Society}
}

TY  - JOUR
TI  - Augmenting a MIDI Keyboard Using Virtual Interfaces
AU  - Desnoyers-Stewart, John
AU  - Gerhard, David
AU  - Smith, Megan L.
T2  - Journal of the Audio Engineering Society
J2  - J. Audio Eng. Soc.
VL  - 66
IS  - 6
SP  - 439
EP  - 447
PY  - 2018
DA  - 2018/06/06
DO  - 10.17743/jaes.2018.0034
UR  - https://doi.org/10.17743/jaes.2018.0034
PB  - Audio Engineering Society
LA  - en
AB  - With the ongoing development of virtual reality (VR) systems, such as the HTC Vive and Oculus Rift, there is a need to develop new interfaces that maximize immersion in VR. Several VR interfaces have been successfully developed and implemented for a mixed reality (MR) MIDI keyboard. MR exists along a continuum between a pure real environment and a pure virtual environment. This paper presents a collection of virtual interfaces used to augment a MIDI keyboard synchronized in physical and virtual space. Several virtual interfaces are developed and evaluated. Some utilize the tactility offered by the keyboard’s surface, while others rely on the improved presence offered by the keyboard. An evaluation of these virtual interfaces is made with respect to learnability and the utility to identify the successes and failures of these interfaces. With few exceptions, the interfaces developed offer functional and immersive control in a VR environment. Some mimic ordinary real interfaces without the need for fixed sensors, offering significantly improved flexibility and functionality while taking advantage of the tactility of the keyboard. A number of other interfaces are built upon this immersion to take advantage of the virtual environment.
ER  -