Eye-tracking Recordings as Data in EMCA Studies

The article contributes to the ongoing discussion of the potential of using eye-tracking recordings in ethnomethodological conversation analysis (EMCA) by exploring to what extent and under what circumstances such recordings may be useful for EMCA studies of multimodal social interaction. For this purpose, it analyzes examples of social conduct recorded by one video camera and one set of eye-tracking glasses. The article concludes that while eye-tracking recordings may, in some specific cases, provide new analytic possibilities for studying social action, they are by no means indispensable for EMCA research in multimodal social interaction, and making use of mobile eye-tracking equipment and recordings may compromise the data as well as the analytic procedure.

Noticing and weighing alternatives in the reflection of regular classroom teaching: Evidence of expertise using mobile eye-tracking

Instructional videos are widely used to study teachers’ professional vision. A new technological development in video research is mobile eye-tracking (MET). It has the potential to provide fine-grained insights into teachers’ professional vision in action, but has yet been scarcely employed. We addressed this research gap by using MET video feedback to examine how expert and novice teachers differed in their noticing and weighing of alternative teaching strategies. Expert and novice teachers’ lessons were recorded with MET devices. Then, they commented on what they observe while watching their own teaching videos. Using a mixed methods approach, we found that expert and novice teachers did not differ in the number of classroom events they noticed and alternative teaching strategies they mentioned. However, novice teachers were more critical of their own teaching than expert teachers, particularly when they considered alternative teaching strategies. Practical implications for the field of teacher education are discussed.

Students in sight: Using mobile eye-tracking to investigate mathematics teachers’ gaze behaviour during task instruction-giving

Mobile eye-tracking research has provided evidence both on teachers' visual attention in relation to their intentions and on teachers’ student-centred gaze patterns. However, the importance of a teacher’s eye-movements when giving instructions is unexplored. In this study we used mobile eye-tracking to investigate six teachers’ gaze patterns when they are giving task instructions for a geometry problem in four different phases of a mathematical problem-solving lesson. We analysed the teachers’ eye-tracking data, their verbal data, and classroom video recordings. Our paper brings forth a novel interpretative lens for teacher’s pedagogical intentions communicated by gaze during teacher-led moments such as when introducing new tasks, reorganizing the social structures of students for collaboration, and lesson wrap-ups. A change in the students’ task changes teachers’ gaze patterns, which may indicate a change in teacher’s pedagogical intention. We found that teachers gazed at students throughout the lesson, whereas teachers’ focus was at task-related targets during collaborative instruction-giving more than during the introductory and reflective task instructions. Hence, we suggest two previously not detected gaze types: contextualizing gaze for task readiness and collaborative gaze for task focus to contribute to the present discussion on teacher gaze

Mobile Eye-Tracking Data Analysis Using Object Detection via YOLO v4

Remote eye tracking has become an important tool for the online analysis of learning processes. Mobile eye trackers can even extend the range of opportunities (in comparison to stationary eye trackers) to real settings, such as classrooms or experimental lab courses. However, the complex and sometimes manual analysis of mobile eye-tracking data often hinders the realization of extensive studies, as this is a very time-consuming process and usually not feasible for real-world situations in which participants move or manipulate objects. In this work, we explore the opportunities to use object recognition models to assign mobile eye-tracking data for real objects during an authentic students’ lab course. In a comparison of three different Convolutional Neural Networks (CNN), a Faster Region-Based-CNN, you only look once (YOLO) v3, and YOLO v4, we found that YOLO v4, together with an optical flow estimation, provides the fastest results with the highest accuracy for object detection in this setting. The automatic assignment of the gaze data to real objects simplifies the time-consuming analysis of mobile eye-tracking data and offers an opportunity for real-time system responses to the user’s gaze. Additionally, we identify and discuss several problems in using object detection for mobile eye-tracking data that need to be considered.

Saccade and Fixation Eye Movements During Walking in People With Mild Traumatic Brain Injury

Background: Clinical and laboratory assessment of people with mild traumatic brain injury (mTBI) indicate impairments in eye movements. These tests are typically done in a static, seated position. Recently, the use of mobile eye-tracking systems has been proposed to quantify subtle deficits in eye movements and visual sampling during different tasks. However, the impact of mTBI on eye movements during functional tasks such as walking remains unknown.Objective: Evaluate differences in eye-tracking measures collected during gait between healthy controls (HC) and patients in the sub-acute stages of mTBI recovery and to determine if there are associations between eye-tracking measures and gait speed.Methods: Thirty-seven HC participants and 67individuals with mTBI were instructed to walk back and forth over 10-m, at a comfortable self-selected speed. A single 1-min trial was performed. Eye-tracking measures were recorded using a mobile eye-tracking system (head-mounted infra-red Tobbii Pro Glasses 2, 100 Hz, Tobii Technology Inc. VA, United States). Eye-tracking measures included saccadic (frequency, mean and peak velocity, duration and distance) and fixation measurements (frequency and duration). Gait was assessed using six inertial sensors (both feet, sternum, right wrist, lumbar vertebrae and the forehead) and gait velocity was selected as the primary outcome. General linear model was used to compare the groups and association between gait and eye-tracking outcomes were explored using partial correlations.Results: Individuals with mTBI showed significantly reduced saccade frequency (p = 0.016), duration (p = 0.028) and peak velocity (p = 0.032) compared to the HC group. No significant differences between groups were observed for the saccade distance, fixation measures and gait velocity (p > 0.05). A positive correlation was observed between saccade duration and gait velocity only for participants with mTBI (p = 0.025).Conclusion: Findings suggest impaired saccadic eye movement, but not fixations, during walking in individuals with mTBI. These findings have implications in real-world function including return to sport for athletes and return to duty for military service members. Future research should investigate whether or not saccade outcomes are influenced by the time after the trauma and rehabilitation.

New Lens to Reveal the Street Interface. A Morphological-Visual Perception Methodological Contribution for Decoding the Public/Private Edge of Arterial Streets

Streets have different forms that are not defined only by their partitions, furniture, and width, but also by their edges as vital features of their spatiality. The relationship between a street and a building impacts the street interface configurations, resulting in various topological characteristics. Thus, the street interface is a physical entity that is produced by the interrelationship between urban morphological elements (street and building), and the way it is formed and used affects the livability of the street. The methods used in the current study contribute to an empirical urban morphological–visual cognitive investigation of arterial street interface configurations, particularly on the ground floor level, to assess potential relations between variations in the physical configurations that influence pedestrian visual perception using mobile eye-tracking glasses. In conclusion, this study contributes to research into developing a spatial framework for arterial street liveability, addressing the pilot case study of Avenida da República in Lisbon.

Eye-tracking analyses of physician face gaze patterns in consultations

Face gaze is a fundamental non-verbal behaviour and can be assessed using eye-tracking glasses. Methodological guidelines are lacking on which measure to use to determine face gaze. To evaluate face gaze patterns we compared three measures: duration, frequency and dwell time. Furthermore, state of the art face gaze analysis requires time and manual effort. We tested if face gaze patterns in the first 30, 60 and 120 s predict face gaze patterns in the remaining interaction. We performed secondary analyses of mobile eye-tracking data of 16 internal medicine physicians in consultation with 100 of their patients. Duration and frequency of face gaze were unrelated. The lack of association between duration and frequency suggests that research may yield different results depending on which measure of face gaze is used. Dwell time correlates both duration and frequency. Face gaze during the first seconds of the consultations predicted face gaze patterns of the remaining consultation time (R2 0.26 to 0.73). Therefore, face gaze during the first minutes of the consultations can be used to predict face gaze patterns over the complete interaction. Researchers interested to study face gaze may use these findings to make optimal methodological choices.