scholarly journals Evaluating fMRI-Based Estimation of Eye Gaze during Naturalistic Viewing

2018 ◽  
Author(s):  
Jake Son ◽  
Lei Ai ◽  
Ryan Lim ◽  
Ting Xu ◽  
Stanley Colcombe ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Eye Gaze ◽  
Area Under The Curve ◽  
Neural Correlates ◽  
Brain Network ◽  
Support Vector ◽  
Angular Deviation ◽  
Eye Fixations ◽  
Gaze Patterns ◽  
Primary Determinant

ABSTRACTThe collection of eye gaze information during functional magnetic resonance imaging (fMRI) is important for monitoring variations in attention and task compliance, particularly for naturalistic viewing paradigms (e.g., movies). However, the complexity and setup requirements of current in-scanner eye-tracking solutions can preclude many researchers from accessing such information. Predictive eye estimation regression (PEER) is a previously developed support vector regression-based method for retrospectively estimating eye gaze from the fMRI signal in the eye’s orbit using a 1.5-minute calibration scan. Here, we provide confirmatory validation of the PEER method’s ability to infer eye gaze on a TR-by-TR basis during movie viewing, using simultaneously acquired eye tracking data in five individuals (median angular deviation < 2°). Then, we examine variations in the predictive validity of PEER models across individuals in a subset of data (n=448) from the Child Mind Institute Healthy Brain Network Biobank, identifying head motion as a primary determinant. Finally, we accurately classify which of two movies is being watched based on the predicted eye gaze patterns (area under the curve = .90 ± .02) and map the neural correlates of eye movements derived from PEER. PEER is a freely available and easy-to-use tool for determining eye fixations during naturalistic viewing.

scholarly journals Evaluating fMRI-Based Estimation of Eye Gaze During Naturalistic Viewing

2019 ◽  
Vol 30 (3) ◽  
pp. 1171-1184 ◽  
Author(s):  
Jake Son ◽  
Lei Ai ◽  
Ryan Lim ◽  
Ting Xu ◽  
Stanley Colcombe ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Eye Gaze ◽  
Area Under The Curve ◽  
Neural Correlates ◽  
Brain Network ◽  
Support Vector ◽  
Angular Deviation ◽  
Eye Fixations ◽  
Gaze Patterns ◽  
Primary Determinant

Abstract The collection of eye gaze information during functional magnetic resonance imaging (fMRI) is important for monitoring variations in attention and task compliance, particularly for naturalistic viewing paradigms (e.g., movies). However, the complexity and setup requirements of current in-scanner eye tracking solutions can preclude many researchers from accessing such information. Predictive eye estimation regression (PEER) is a previously developed support vector regression-based method for retrospectively estimating eye gaze from the fMRI signal in the eye’s orbit using a 1.5-min calibration scan. Here, we provide confirmatory validation of the PEER method’s ability to infer eye gaze on a TR-by-TR basis during movie viewing, using simultaneously acquired eye tracking data in five individuals (median angular deviation &lt; 2°). Then, we examine variations in the predictive validity of PEER models across individuals in a subset of data (n = 448) from the Child Mind Institute Healthy Brain Network Biobank, identifying head motion as a primary determinant. Finally, we accurately classify which of the two movies is being watched based on the predicted eye gaze patterns (area under the curve = 0.90 ± 0.02) and map the neural correlates of eye movements derived from PEER. PEER is a freely available and easy-to-use tool for determining eye fixations during naturalistic viewing.

scholarly journals The network underlying human higher-order motor control: Insights from machine learning-based lesion-behaviour mapping in apraxia

2019 ◽  
Author(s):  
Christoph Sperber ◽  
Daniel Wiesen ◽  
Georg Goldenberg ◽  
Hans-Otto Karnath
Keyword(s):  
Motor Control ◽  
Temporal Cortex ◽  
Neural Correlates ◽  
Brain Network ◽  
Higher Order ◽  
Support Vector ◽  
Precentral Gyrus ◽  
Canonical Correlations ◽  
Neurological Patients ◽  
Left Hemisphere Stroke

AbstractNeurological patients with apraxia of pantomime provide us with a unique opportunity to study the neural correlates of higher-order motor function. Previous studies using lesion-behaviour mapping methods led to inconsistent anatomical results, reporting various lesion locations to induce this symptom. We hypothesised that the inconsistencies might arise from limitations of mass-univariate lesion-behaviour mapping approaches if our ability to pantomime the use of objects is organised in a brain network. Thus, we investigated apraxia of pantomime by using multivariate lesion behaviour mapping based both on support vector regression and sparse canonical correlations in a sample of 130 left-hemisphere stroke patients. Both multivariate methods identified multiple areas to underlie high-order motor control, including inferior parietal lobule, precentral gyrus, posterior parts of middle temporal cortex, and insula. Further, long association fibres were affected, such as the superior longitudinal fascicle, inferior occipito-frontal fascicle, uncinated fascicle, and superior occipito-frontal fascicle. The findings thus not only underline the benefits of multivariate lesion-behaviour mapping in brain networks, but they also uncovered that higher-order motor control indeed is based on a common anatomical network.

scholarly journals Eye-Tracking the Emergence of Attentional Anchors in a Mathematics Learning Tablet Activity

2017 ◽  
pp. 166-194 ◽  
Author(s):  
Shakila Shayan ◽  
Dor Abrahamson ◽  
Arthur Bakker ◽  
Carolien A. C. G. Duijzer ◽  
Marieke van der Schaaf
Keyword(s):  
Eye Tracking ◽  
Conceptual Development ◽  
Eye Gaze ◽  
Mathematics Learning ◽  
School Students ◽  
Clinical Interviews ◽  
Reflective Abstraction ◽  
Gaze Patterns ◽  
Sensorimotor Interaction ◽  
Embodiment Theory

Little is known about micro-processes by which sensorimotor interaction gives rise to conceptual development. Per embodiment theory, these micro-processes are mediated by dynamical attentional structures. Accordingly this study investigated eye-gaze behaviors during engagement in solving tablet-based bimanual manipulation tasks designed to foster proportional reasoning. Seventy-six elementary- and vocational-school students (9-15 yo) participated in individual task-based clinical interviews. Data gathered included action-logging, eye-tracking, and videography. Analyses revealed the emergence of stable eye-path gaze patterns contemporaneous with first enactments of effective manipulation and prior to verbal articulations of manipulation strategies. Characteristic gaze patterns included consistent or recurring attention to screen locations that bore non-salient stimuli or no stimuli at all yet bore invariant geometric relations to dynamical salient features. Arguably, this research validates empirically hypothetical constructs from constructivism, particularly reflective abstraction.

scholarly journals Assessing expertise using eye tracking in a Virtual Reality flight simulation

2022 ◽  
Author(s):  
David Harris ◽  
Tom Arthur ◽  
Toby de Burgh ◽  
Mike Duxbury ◽  
Ross Lockett-Kirk ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Eye Movements ◽  
Eye Tracking ◽  
Real World ◽  
Eye Gaze ◽  
Cost Effective ◽  
Flight Simulation ◽  
Training Tool ◽  
Gaze Patterns ◽  
Scaling Analyses

Objective: The aim of this work was to examine the fidelity and validity of an aviation simulation using eye tracking. Background: Commercial head-mounted virtual reality (VR) systems offer a convenient and cost-effective alternative to existing aviation simulation (e.g., for refresher exercises). We performed pre-implementation testing of a novel aviation simulation, designed for head-mounted VR, to determine its fidelity and validity as a training device. Method: Eighteen airline pilots, with varying levels of flight experience, completed a sequence of training ‘flows’. Self-reported measures of presence and workload and users’ perceptions of fidelity were taken. Pilots’ eye movements and performance were recorded to determine whether more experienced pilots showed distinct performance and eye gaze profiles in the simulation, as they would in the real-world. Results: Real-world expertise correlated with eye gaze patterns characterised by fewer, but longer, fixations and a scan path that was more structured and less random. Multidimensional scaling analyses also indicated differential clustering of strategies in more versus less experienced pilots. Subjective ratings of performance, however, showed little relationship with real-world expertise or eye movements. Conclusion: We adopted an evidence-based approach to assessing the fidelity and validity of a VR flight training tool. Pilot reports indicated the simulation was realistic and potentially useful for training, while direct measurement of eye movements was useful for establishing construct validity and psychological fidelity of the simulation.

scholarly journals Combined frequency-tagging EEG and eye-tracking measures provide no support for the “excess mouth/diminished eye attention” hypothesis in autism

2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Sofie Vettori ◽  
Stephanie Van der Donck ◽  
Jannes Nys ◽  
Pieter Moors ◽  
Tim Van Wesemael ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Clinical Symptoms ◽  
Eye Gaze ◽  
Autism Spectrum ◽  
Covert Attention ◽  
Neural Responses ◽  
Lower Face ◽  
Facial Region ◽  
Gaze Patterns ◽  
The Face

Abstract Background Scanning faces is important for social interactions. Difficulty with the social use of eye contact constitutes one of the clinical symptoms of autism spectrum disorder (ASD). It has been suggested that individuals with ASD look less at the eyes and more at the mouth than typically developing (TD) individuals, possibly due to gaze aversion or gaze indifference. However, eye-tracking evidence for this hypothesis is mixed. While gaze patterns convey information about overt orienting processes, it is unclear how this is manifested at the neural level and how relative covert attention to the eyes and mouth of faces might be affected in ASD. Methods We used frequency-tagging EEG in combination with eye tracking, while participants watched fast flickering faces for 1-min stimulation sequences. The upper and lower halves of the faces were presented at 6 Hz and 7.5 Hz or vice versa in different stimulation sequences, allowing to objectively disentangle the neural saliency of the eyes versus mouth region of a perceived face. We tested 21 boys with ASD (8–12 years old) and 21 TD control boys, matched for age and IQ. Results Both groups looked longer at the eyes than the mouth, without any group difference in relative fixation duration to these features. TD boys looked significantly more to the nose, while the ASD boys looked more outside the face. EEG neural saliency data partly followed this pattern: neural responses to the upper or lower face half were not different between groups, but in the TD group, neural responses to the lower face halves were larger than responses to the upper part. Face exploration dynamics showed that TD individuals mostly maintained fixations within the same facial region, whereas individuals with ASD switched more often between the face parts. Limitations Replication in large and independent samples may be needed to validate exploratory results. Conclusions Combined eye-tracking and frequency-tagged neural responses show no support for the excess mouth/diminished eye gaze hypothesis in ASD. The more exploratory face scanning style observed in ASD might be related to their increased feature-based face processing style.

scholarly journals Eye gaze patterns reflect how young fraction learners approach numerical comparisons

2020 ◽  
Vol 6 (1) ◽  
pp. 83-107
Author(s):  
Alison T. Miller Singley ◽  
Jeffrey Lynn Crawford ◽  
Silvia A. Bunge
Keyword(s):  
Academic Achievement ◽  
Eye Movements ◽  
Problem Solving ◽  
Eye Tracking ◽  
Conceptual Development ◽  
Eye Gaze ◽  
Proficiency Levels ◽  
Gaze Patterns ◽  
Different Levels ◽  
Fraction Comparison

Learning fractions is notoriously difficult, yet critically important to mathematical and general academic achievement. Eye-tracking studies are beginning to characterize the strategies that adults use when comparing fractions, but we know relatively little about the strategies used by children. We used eye-tracking to analyze how novice children and mathematically-proficient adults approached a well-studied fraction comparison paradigm. Specifically, eye-tracking can provide insights into the nature of differences: whether they are quantitative—reflecting differences in efficiency—or qualitative—reflecting a fundamentally different approach. We found that children who had acquired the basic fraction rules made more eye movements than did either adults or less proficient children, suggesting a thorough but inefficient problem solving approach. Additionally, correct responses were associated with normative gaze patterns, regardless of age or proficiency levels. However, children paid more attention to irrelevant numerical relationships on conditions that were conceptually difficult. An exploratory analysis points to the possibility that children on the verge of making a conceptual leap attend to the relevant relationships even when they respond incorrectly. These findings indicate the potential of eye-tracking methodology to better characterize the behavior associated with different levels of fraction proficiency, as well as to provide insights for educators regarding how to best support novices at different levels of conceptual development.

scholarly journals Oxytocin administration does not influence eye gaze of volunteers towards physicians nor their self-perceived bonding with physicians

2021 ◽  
Author(s):  
Chiara Jongerius ◽  
Marij A. Hillen ◽  
Ellen M.A. Smets ◽  
Mathijs J. Mol ◽  
Eefje S. Kooij ◽  
...  
Keyword(s):  
Eye Tracking ◽  
Eye Gaze ◽  
Communication Style ◽  
Secondary Outcome ◽  
Critical Determinant ◽  
Gaze Patterns ◽  
Attachment Orientation ◽  
Key Factor ◽  
Patient Health ◽  
Physician Relationship

The patient-physician relationship is a critical determinant for patient health outcomes. Verbal and non-verbal communication, such as eye gaze, are vital aspects of this bond. Neurobiological studies indicate that oxytocin may serve as a link between increased eye gaze and social bonding. Therefore, oxytocin signaling could serve as a key factor influencing eye gaze as well as the patient-physician relationship. We aimed to test the effects of oxytocin on gaze to the eyes of the physician and the patient-physician relationship by conducting a randomized placebo-controlled crossover trial in healthy volunteers with intranasally administered oxytocin (24IU). Eye gaze of sixty-eight male volunteers was studied using eye-tracking. Volunteers engaged in a simulated video call consultation with a physician who provided information about vaccination against the human papilloma virus. Relationship outcomes (including trust, satisfaction and perceived physician communication style) were measured using questionnaires and corrected for possible confounders (social anxiety and attachment orientation). Additional secondary outcome measures were recall of information and pupil diameter and exploratory outcomes were mood and anxiety. Oxytocin did not affect eye tracking parameters of volunteers’ gaze towards the eyes of the physician. Moreover, oxytocin did not affect parameters of bonding between volunteers and the physician, nor other secondary and exploratory outcomes. Bayesian hypothesis testing provided evidence for the absence of effects. These results contradict the notion that oxytocin affects eye gaze patterns or bonding.

Assessing patient and doctor eye gaze patterns between two styles of doctor EHR use in primary care encounters

2012 ◽  
Author(s):  
Onur Asan ◽  
Enid N. H. Montague ◽  
Jie Xu
Keyword(s):  
Primary Care ◽  
Eye Gaze ◽  
Gaze Patterns

The Development of Eye Gaze Patterns during Audiovisual Perception of Affective and Phonetic Information

2019 ◽  
Author(s):  
Hisako W. Yamamoto ◽  
Misako Kawahara ◽  
Akihiro Tanaka
Keyword(s):  
Eye Gaze ◽  
Phonetic Information ◽  
Gaze Patterns ◽  
Audiovisual Perception

scholarly journals Techniques Used for Eye Gaze Interfaces and Survey

2015 ◽  
Vol 1 (6) ◽  
pp. 276
Author(s):  
Maria Rashid ◽  
Wardah Mehmood ◽  
Aliya Ashraf
Keyword(s):  
Eye Tracking ◽  
Eye Gaze ◽  
3D Models ◽  
Image Process ◽  
Usability Problems ◽  
Software Algorithms ◽  
Pupil Detection ◽  
Eye Movement Tracking ◽  
2D And 3D ◽  
Movement Tracking

Eye movement tracking is a method that is now-a-days used for checking the usability problems in the contexts of Human Computer Interaction (HCI). Firstly we present eye tracking technology and key elements.We tend to evaluate the behavior of the use when they are using the interace of eye gaze. Used different techniques i.e. electro-oculography, infrared oculography, video oculography, image process techniques, scrolling techniques, different models, probable approaches i.e. shape based approach, appearance based methods, 2D and 3D models based approach and different software algorithms for pupil detection etc. We have tried to compare the surveys based on their geometric properties and reportable accuracies and eventually we conclude this study by giving some prediction regarding future eye-gaze. We point out some techniques by using various eyes properties comprising nature, appearance and gesture or some combination for eye tracking and detection. Result displays eye-gaze technique is faster and better approach for selection than a mouse selection. Rate of error for all the matters determines that there have been no errors once choosing from main menus with eye mark and with mouse. But there have been a chance of errors when once choosing from sub menus in case of eye mark. So, maintain head constantly in front of eye gaze monitor.

Sign in / Sign up

Export Citation Format

Share Document