Superior colliculus drives stimulus-evoked directionally biased saccades and attempted head movements in head-fixed mice

Animals investigate their environments by directing their gaze towards salient stimuli. In the prevailing view, mouse gaze shifts entail head rotations followed by brainstem-mediated eye movements, including saccades to reset the eyes. These 'recentering' saccades are attributed to head movement-related vestibular cues. However, microstimulating mouse superior colliculus (SC) elicits directed head and eye movements resembling SC-dependent sensory-guided gaze shifts in other species, suggesting that mouse gaze shifts may be more flexible than has been recognized. We investigated this possibility by tracking eye and attempted head movements in a head-fixed preparation that eliminates head movement-related sensory cues. We found tactile stimuli evoke directionally biased saccades coincident with attempted head rotations. Differences in saccade endpoints across stimuli are associated with distinct stimulus-dependent relationships between initial eye position and saccade direction and amplitude. Optogenetic perturbations revealed SC drives these gaze shifts. Thus, head-fixed mice make sensory-guided, SC-dependent gaze shifts involving coincident, directionally biased saccades and attempted head movements. Our findings uncover flexibility in mouse gaze shifts and provide a foundation for studying head-eye coupling.

Binaural Reproduction Based on Bilateral Ambisonics

Binaural reproduction of high-quality spatial sound has gained considerable interest with the recent technology developments in virtual and augmented reality. The reproduction of binaural signals in the Spherical-Harmonics (SH) domain using Ambisonics is now a well-established methodology, with flexible binaural processing realized using SH representations of the sound-field and the Head-Related Transfer Function (HRTF). However, in most practical cases, the binaural reproduction is order-limited, which introduces truncation errors that have a detrimental effect on the perception of the reproduced signals, mainly due to the truncation of the HRTF. Recently, it has been shown that manipulating the HRTF phase component, by ear-alignment, significantly reduces its effective SH order while preserving its phase information, which may be beneficial for alleviating the above detrimental effect. Incorporating the ear-aligned HRTF into the binaural reproduction process has been suggested by using Bilateral Ambisonics, which is an Ambisonics representation of the sound-field formulated at the two ears. While this method imposes challenges on acquiring the sound-field, and specifically, on applying head-rotations, it leads to a significant reduction in errors caused by the limited-order reproduction, which yields a substantial improvement in the perceived binaural reproduction quality even with first order SH.

TeleParallax: Low-Motion-Blur Stereoscopic System With Correct Interpupillary Distance for 3D Head Rotations

Binocular parallax provides cues for depth information when a scene is viewed with both eyes. In visual telepresence systems, stereo cameras are commonly used to simulate human eyes. However, motion blur occurs when these cameras are rotated quickly. The use of omnidirectional cameras can reduce the motion blur, but does not provide the correct interpupillary distance (IPD) when viewers tilt or turn their heads sideways. We propose a method called TeleParallax, in which two omnidirectional cameras are separated by the IPD and the direction of the lenses are kept constant in world coordinates by robotic arms during three-dimensional head rotations. TeleParallax can suppress the increase in image buffering during head rotations because each camera can capture an omnidirectional image with the lens direction fixed. We conducted three user studies to evaluate the perceptual effect of head tilt, eye asynchrony, and delays in IPD correction for a particular rotation. The results indicate that TeleParallax can provide depth perception that is independent of the head movement with less visual discomfort. Although the results show that the users were sensitive to the asynchrony between their eyes and to camera motion during IPDs, they retained the feeling of depth perception within interocular delays of 70 ms and motion velocity of 75°/s. These results imply that TeleParallax has remarkable potential for visual telepresence systems.

Influence of safety glasses, body height and magnification on the occupational eye lens dose during pelvic vascular interventions: a phantom study

Objective By simulating a fluoroscopic-guided vascular intervention, two differently designed radiation safety glasses were compared. The impacts of changing viewing directions and body heights on the eye lens dose were evaluated. Additionally, the effect of variable magnification levels on the arising scattered radiation was determined. Methods A phantom head, replacing the operator’s head, was positioned at different heights and rotated in steps of 20° in the horizontal plane. Thermoluminescent dosimeters (TLD), placed in the left orbit of the phantom, detected eye lens doses under protected and completely exposed conditions. In a second step, radiation dose values with increasing magnification levels were detected by RaySafe i3 dosimeters. Results Changing eye levels and head rotations resulted in a wide range of dose reduction factors (DRF) from 1.1 to 8.5. Increasing the vertical distance between the scattering body and the protective eyewear, DRFs markedly decreased for both glasses. Significant differences between protection glasses were observed. Increasing magnification with consecutively decreasing FOV size variably reduced the dose exposure to the eye lens between 47 and 83%, respectively. Conclusion The safety glasses in the study effectively reduced the dose exposure to the eye lens. However, the extent of the protective effect was significant depending on eye levels and head rotations. This may lead to a false sense of safety for the medical staff. In addition, the application of magnification reduced the quantity of scattering dose significantly. To ensure safe working in the Cath-lab, additional use of protective equipment and the differences in design of protective eyewear should be considered. Key Points • Eye lens dose changes with physical size of the interventionist and viewing direction. • The use of magnification during fluoroscopic-guided interventions reduces scattered radiation.

Virtual reality perspective-taking at scale: Effect of avatar representation, choice, and head movement on prosocial behaviors

The present investigation examined the effect of avatar representation, choice, and head movement on prosocial behaviors and measures of presence after a virtual reality perspective-taking (VRPT) task. Participants were either represented by a set of virtual hands or had no representation during a VRPT task. Of those with hands, only half were able to choose their skin tone. Results showed that there was no significant advantage to having an avatar representation. However, if participants had an avatar and were able to choose their own skin tone, a higher proportion of participants performed prosocial behaviors and reported higher social presence scores compared with participants who had no choice. Regardless of condition, head rotations significantly predicted petition signatures such that the more participants rotated their heads side to side, the more likely they were to sign the petition. Moreover, when participants do not consistently rotate their head side to side, the proportion of petitions signed is on par with individuals who do not complete a VRPT task at all.

Inner ear biomechanics reveals Late Triassic origin of mammalian endothermy

Endothermy (“warm-bloodedness”) underpins the ecological dominance of mammals and birds in diverse environmental settings1-3. However, it is unclear when this crucial feature emerged during mammalian evolutionary history, as most fossil evidence is ambiguous4-25. Here, we show that new information on this key evolutionary transition can be obtained from the morphology of the endolymph-filled semicircular ducts of the inner ear that monitor head rotations and are essential for motor coordination, navigation, and spatial awareness26-31. Increased body temperature during the ectotherm–endotherm transition of mammal ancestors would decrease endolymph viscosity, negatively impacting the biomechanics of the semicircular ducts32,33, while simultaneously increasing activity levels34,35 required improved performance36. Specific morphological changes to the membranous ducts and enclosing bony canals were, therefore, necessary to maintain optimal functionality. We track these morphological changes in 341 vertebrates, including 56 extinct synapsids, and show that canals with relatively thin cross-sections and small radii of curvature are indicative of mammalian endothermy. This inner ear morphotype evolved abruptly ~233 million years ago, during the Late Triassic, in Mammaliamorpha. Our conclusion differs from previous suggestions3-17, and we interpret most stem-mammals as ectotherms. Endothermy as a crucial physiological characteristic joins other distinctive mammalian features that arose during this period of climatic instability37-39.

Non-frontal facial expression recognition based on salient facial patches

Methods using salient facial patches (SFPs) play a significant role in research on facial expression recognition. However, most SFP methods use only frontal face images or videos for recognition, and they do not consider head position variations. We contend that SFP can be an effective approach for recognizing facial expressions under different head rotations. Accordingly, we propose an algorithm, called profile salient facial patches (PSFP), to achieve this objective. First, to detect facial landmarks and estimate head poses from profile face images, a tree-structured part model is used for pose-free landmark localization. Second, to obtain the salient facial patches from profile face images, the facial patches are selected using the detected facial landmarks while avoiding their overlap or the transcending of the actual face range. To analyze the PSFP recognition performance, three classical approaches for local feature extraction, specifically the histogram of oriented gradients (HOG), local binary pattern, and Gabor, were applied to extract profile facial expression features. Experimental results on the Radboud Faces Database show that PSFP with HOG features can achieve higher accuracies under most head rotations.

Real-time face view correction for front-facing cameras

Face views are particularly important in person-to-person communication. Differenes between the camera location and the face orientation can result in undesirable facial appearances of the participants during video conferencing. This phenomenon is particularly noticeable when using devices where the front-facing camera is placed in unconventional locations such as below the display or within the keyboard. In this paper, we take a video stream from a single RGB camera as input, and generate a video stream that emulates the view from a virtual camera at a designated location. The most challenging issue in this problem is that the corrected view often needs out-of-plane head rotations. To address this challenge, we reconstruct the 3D face shape and re-render it into synthesized frames according to the virtual camera location. To output the corrected video stream with natural appearance in real time, we propose several novel techniques including accurate eyebrow reconstruction, high-quality blending between the corrected face image and background, and template-based 3D reconstruction of glasses. Our system works well for different lighting conditions and skin tones, and can handle users wearing glasses. Extensive experiments and user studies demonstrate that our method provides high-quality results.

Quantitative assessment of self-treated canalith repositioning procedures using inertial measurement unit sensors

BACKGROUND: Low success and high recurrence of benign paroxysmal positional vertigo (BPPV) after home-based self-treated Epley and Barbeque (BBQ) roll maneuvers is an important issue. OBJECTIVE: To quantify the cause of low success rate of self-treated Epley and BBQ roll maneuvers and provide a clinically acceptable criterion to guide self-treatment head rotations. METHODS: Twenty-five participants without active BPPV wore a custom head-mount rotation monitoring device for objective measurements. Self-treatment and specialist-assisted maneuvers were compared for head rotation accuracy. Absolute differences between the head rotation evaluation criteria (American Academy of Otolaryngology guidelines) and measured rotation angles were considered as errors. Self-treatment and specialist-treated errors in maneuvers were compared. Between-trial variations and age effects were evaluated. RESULTS: A significantly large error and between-trial variation occurred in step 4 of the self-treated Epley maneuver, with a considerable error in the second trial. The cumulative error of all steps of self-treated BBQ roll maneuver was significantly large. Age effect occurred only in the self-treated BBQ roll maneuver. Errors in specialist-treated maneuvers ranged from 10 to 20 degrees. CONCLUSIONS: Real-time feedback of head movements during simultaneous head-body rotations could increase success rates of self-treatments. Specialist-treated maneuvers can be used as permissible rotation margin criteria.

Non-frontal facial expression recognition based on salient facial patches

Methods using salient facial patches (SFP) play a significant role in research on facial expression recognition. However, most SFP methods use only frontal face images or videos for recognition, and do not consider variations of head position. In our view, SFP can also be a good choice to recognize facial expression under different head rotations, and thus we propose an algorithm for this purpose, called Profile Salient Facial Patches (PSFP). First, in order to detect the facial landmarks from profile face images, the tree-structured part model is used for pose-free landmark localization; this approach excels at detecting facial landmarks and estimating head poses. Second, to obtain the salient facial patches from profile face images, the facial patches are selected using the detected facial landmarks, while avoiding overlap with each other or going beyond the range of the actual face. For the purpose of analyzing the recognition performance of PSFP, three classical approaches for local feature extraction-histogram of oriented Gradients (HOG), local binary pattern (LBP), and Gabor were applied to extract profile facial expression features. Experimental results on radboud faces database show that PSFP with HOG features can achieve higher accuracies under the most head rotations.