Can I trust my ears in VR? Head-related transfer functions and valuation methods with descriptive attributes in virtual reality

In this article, we present the current state of the art in binaural audio with the focus on head-related transfer functions (HRTFs) and valuation methods of virtual acoustics with descriptive attributes. This combination provides a methodology, which delivers the basis for research studies in virtual reality (VR) on individual and non-individual head-related transfer functions. Based on the largely explored localization perception of static audio signals, this review offers an overview of the directional hearing during head and sound source movement and multimodality in audiovisual virtual environments. Perceptual quality characteristics provide evaluation methods from which future HRTF VR experiments and virtual environments studies on binaural acoustics could benefit.

Early multisensory integration of self and source motion in the auditory system

Discriminating external from self-produced sensory inputs is a major challenge for brains. In the auditory system, sound localization must account for movements of the head and ears, a computation likely to involve multimodal integration. Principal neurons (PNs) of the dorsal cochlear nucleus (DCN) are known to be spatially selective and to receive multimodal sensory information. We studied the responses of PNs to body rotation with or without sound stimulation, as well as to sound source rotation with stationary body. We demonstrated that PNs are sensitive to head direction, and, in the presence of sound, they differentiate between body and sound source movement. Thus, the output of the DCN provides the brain with enough information to disambiguate the movement of a sound source from an acoustically identical relative movement produced by motion of the animal.