Identifying Expert and Novice Visual Scanpath Patterns and Their Relationship to Assessing Learning-Relevant Student Characteristics

The paper addresses cognitive processes during a teacher's professional task of assessing learning-relevant student characteristics. We explore how eye-movement patterns (scanpaths) differ across expert and novice teachers during an assessment situation. In an eye-tracking experiment, participants watched an authentic video of a classroom lesson and were subsequently asked to assess five different students. Instead of using typically reported averaged gaze data (e.g., number of fixations), we used gaze patterns as an indicator for visual behavior. We extracted scanpath patterns, compared them qualitatively (common sub-pattern) and quantitatively (scanpath entropy) between experts and novices, and related teachers' visual behavior to their assessment competence. Results show that teachers' scanpaths were idiosyncratic and more similar to teachers of the same expertise group. Moreover, experts monitored all target students more regularly and made recurring scans to re-adjust their assessment. Lastly, this behavior was quantified using Shannon's entropy score. Results indicate that experts' scanpaths were more complex, involved more frequent revisits of all students, and that experts transferred their attention between all students with equal probability. Experts' visual behavior was also statistically related to higher judgment accuracy.

Download Full-text

Gaze and eye movement in dialogue interpreting: An eye-tracking study

Bilingualism Language and Cognition ◽

10.1017/s1366728920000309 ◽

2020 ◽

Vol 23 (4) ◽

pp. 780-787 ◽

Cited By ~ 1

Author(s):

Elisabet Tiselius ◽

Kayle Sneed

Keyword(s):

Eye Tracking ◽

Cognitive Load ◽

Eye Movement ◽

Cognitive Processes ◽

Cognitive Effort ◽

Simultaneous Interpreting ◽

Gaze Patterns ◽

Averted Gaze

AbstractPrevious studies have investigated the cognitive processes of simultaneous interpreting and translation using eye-tracking. No study has yet utilized eye-tracking to investigate cognitive load and cognitive effort in dialogue interpreting. An eye-tracking study was conducted on two groups of interpreters (experienced and inexperienced) with varying language backgrounds during a staged dialogue interpreting session. The aim of the study was to explore gaze patterns in dialogue interpreting in relation to the interpreters’ action and translation direction. The results indicated there were differences in gaze patterns depending on the action and the language used. Participants averted gaze more when interpreting into the allophone language (the L2 for a majority of the participants in this study). This may indicate that interpreting into L2 in a dialogue may involve more cognitive effort than interpreting into L1. Finally, gaze patterns did not differ significantly between inexperienced and experienced dialogue interpreters.

Download Full-text

B-PO04-190 A NOVEL VISUAL DIAGNOSTIC ASSESSMENT OF EXPERT AND NOVICE GAZE PATTERNS ON PEDIATRIC ELECTROCARDIOGRAMS USING EYE TRACKING TECHNOLOGY

Heart Rhythm ◽

10.1016/j.hrthm.2021.06.882 ◽

2021 ◽

Vol 18 (8) ◽

pp. S356

Author(s):

Heather Marie Giacone ◽

Anne M. Dubin ◽

Scott Ceresnak ◽

Henry Chubb ◽

William Rowland Goodyer ◽

...

Keyword(s):

Eye Tracking ◽

Diagnostic Assessment ◽

Gaze Patterns ◽

Expert And Novice ◽

Tracking Technology

Download Full-text

Determining Gaze Behavior Patterns in On-Screen Testing

Journal of Educational Computing Research ◽

10.1177/0735633120978617 ◽

2020 ◽

pp. 073563312097861

Author(s):

Marko Pejić ◽

Goran Savić ◽

Milan Segedinac

Keyword(s):

Eye Tracking ◽

Eye Movement ◽

Undergraduate Students ◽

Behavior Pattern ◽

Machine Learning Techniques ◽

Software System ◽

Gaze Behavior ◽

Gaze Patterns ◽

Presentation Methods ◽

Tracking Device

This study proposes a software system for determining gaze patterns in on-screen testing. The system applies machine learning techniques to eye-movement data obtained from an eye-tracking device to categorize students according to their gaze behavior pattern while solving an on-screen test. These patterns are determined by converting eye movement coordinates into a sequence of regions of interest. The proposed software system extracts features from the sequence and performs clustering that groups students by their gaze pattern. To determine gaze patterns, the system contains components for communicating with an eye-tracking device, collecting and preprocessing students’ gaze data, and visualizing data using different presentation methods. This study presents a methodology to determine gaze patterns and the implementation details of the proposed software. The research was evaluated by determining the gaze patterns of 51 undergraduate students who took a general knowledge test containing 20 questions. This study aims to provide a software infrastructure that can use students’ gaze patterns as an additional indicator of their reading behaviors and their processing attention or difficulty, among other factors.

Download Full-text

An algorithmic approach to determine expertise development using object-related gaze pattern sequences

Behavior Research Methods ◽

10.3758/s13428-021-01652-z ◽

2021 ◽

Author(s):

Felix S. Wang ◽

Céline Gianduzzo ◽

Mirko Meboldt ◽

Quentin Lohmeyer

Keyword(s):

Cognitive Processes ◽

Expert Assessment ◽

Visual Behavior ◽

Gaze Behavior ◽

Expertise Development ◽

Algorithmic Approach ◽

Domain Specific ◽

Gaze Patterns ◽

Sequence Patterns ◽

Task Experience

AbstractEye tracking (ET) technology is increasingly utilized to quantify visual behavior in the study of the development of domain-specific expertise. However, the identification and measurement of distinct gaze patterns using traditional ET metrics has been challenging, and the insights gained shown to be inconclusive about the nature of expert gaze behavior. In this article, we introduce an algorithmic approach for the extraction of object-related gaze sequences and determine task-related expertise by investigating the development of gaze sequence patterns during a multi-trial study of a simplified airplane assembly task. We demonstrate the algorithm in a study where novice (n = 28) and expert (n = 2) eye movements were recorded in successive trials (n = 8), allowing us to verify whether similar patterns develop with increasing expertise. In the proposed approach, AOI sequences were transformed to string representation and processed using the k-mer method, a well-known method from the field of computational biology. Our results for expertise development suggest that basic tendencies are visible in traditional ET metrics, such as the fixation duration, but are much more evident for k-mers of k > 2. With increased on-task experience, the appearance of expert k-mer patterns in novice gaze sequences was shown to increase significantly (p < 0.001). The results illustrate that the multi-trial k-mer approach is suitable for revealing specific cognitive processes and can quantify learning progress using gaze patterns that include both spatial and temporal information, which could provide a valuable tool for novice training and expert assessment.

Download Full-text

Exploring the Cognitive Load of Expert and Novice Map Users Using EEG and Eye Tracking

ISPRS International Journal of Geo-Information ◽

10.3390/ijgi9070429 ◽

2020 ◽

Vol 9 (7) ◽

pp. 429

Author(s):

Merve Keskin ◽

Kristien Ooms ◽

Ahmet Ozgur Dogru ◽

Philippe De Maeyer

Keyword(s):

Eye Tracking ◽

Spatial Memory ◽

Cognitive Load ◽

Cognitive Processes ◽

Memory Task ◽

Significant Difference ◽

Expert And Novice ◽

Memory Experiment ◽

Saccade Velocity ◽

Eeg Power

The main objective of this research is to explore the cognitive processes of expert and novice map users during the retrieval of map-related information, within varying difficulty levels (i.e., easy, moderate, hard), by using eye tracking and electroencephalogram (EEG). In this context, we present a spatial memory experiment consisting of a large number of stimuli to study the effect of task difficulty on map users’ behavior through cognitive load measurements. Next to the reaction time and success rate, we used fixation and saccade related eye tracking metrics (i.e., average fixation duration, the number of fixations per second, saccade amplitude and saccade velocity), and EEG power spectrum (i.e., event-related changes in alpha and theta frequency bands) to identify the cognitive load. While fixation metrics indicated no statistically significant difference between experts and novices, saccade metrics proved the otherwise. EEG power spectral density analysis, on the other side, suggested an increase in theta (i.e., event-related synchronization) and a decrease in alpha (except moderate tasks) (i.e., event-related desynchronization) at all difficulty levels of the task for both experts and novices, which is an indicator of cognitive load. Although no significant difference emerged between two groups, we found a significant difference in their overall performances when the participants were classified as good and relatively bad learners. Triangulating EEG results with the recorded eye tracking data and the qualitative analysis of focus maps indeed provided a detailed insight on the differences of the individuals’ cognitive processes during this spatial memory task.

Download Full-text

Improving the pilot selection process by using eye-tracking tools

Journal of Eye Movement Research ◽

10.16910/jemr.12.3.4 ◽

2020 ◽

Vol 12 (3) ◽

Author(s):

Slaviša Ivan Vlačić ◽

Aleksandar Zdravko Knežević ◽

Saptarshi Mandal ◽

Sanja Rođenkov ◽

Panos Vitsas

Keyword(s):

Eye Tracking ◽

Eye Movement ◽

High Performance ◽

Selection Process ◽

Psychological Testing ◽

Visual Response ◽

Visual Behavior ◽

The Difference ◽

Tracking Device ◽

Pilot Selection

This paper improves the understanding of the use of eye-tracking tools in the pilot selection process. Research of eye movement and attention distribution of candidate pilots may provide the capability for visual behavior prediction in more demanding flight training phases. The research included psychological testing, flight screening of subjects and their achievements in a flight simulator in combination with an eye-tracking device. Participants were divided into three categories: high performance, average performance, and low performance and separately regarded through psychological testing results and flight screening results. An eye-tracking device tracked visual behavior of subjects through the scope and speed of visual perception. The number of fixations and revisits recorded during the simulated visual flight conditions measured the difference in visual response between subjects. Comparison of results showed a positive correlation with psychological test results. Correlation with flight screening selection was not confirmed. We used the new network-based approach with three target importance measures to overcome the shortcomings of traditional eye movement metrics. The results of the adopted network approach presented in the form of graphs and analysis of normalized importance measures showed that it was possible to extract specific saccade strategy for each participant. Discovered differences between them positively detected week ones. In this way, Eye-tracking tools can potentially improve the pilot selection process and complement other tests and assessment methods.

Download Full-text

Navigating Through the Experienced Environment: Insights From Mobile Eye Tracking

Current Directions in Psychological Science ◽

10.1177/0963721420915880 ◽

2020 ◽

Vol 29 (3) ◽

pp. 286-292 ◽

Cited By ~ 4

Author(s):

Koraly Pérez-Edgar ◽

Leigha A. MacNeill ◽

Xiaoxue Fu

Keyword(s):

Visual Field ◽

Eye Tracking ◽

Social Interactions ◽

Cognitive Processes ◽

Point Of View ◽

Gaze Patterns ◽

The World ◽

The Individual ◽

Insight Into ◽

Mobile Eye Tracking

Researchers are acutely interested in how people engage in social interactions and navigate their environment. However, in striving for experimental or laboratory control, we often instead present individuals with representations of social and environmental constructs and infer how they would behave in more dynamic and contingent interactions. Mobile eye tracking (MET) is one approach to connecting the laboratory to the experienced environment. MET superimposes gaze patterns captured through head- or eyeglass-mounted cameras pointed at the eyes onto a separate camera that captures the visual field. As a result, MET allows researchers to examine the world from the point of view of the individual in action. This review touches on the methods and questions that can be asked with this approach, illustrating how MET can provide new insight into social, behavioral, and cognitive processes from infancy through old age.

Download Full-text

If Eyes are the Window to Our Soul, What Role does Eye-Tracking Play in Accounting Research?

Behavioral Research in Accounting ◽

10.2308/bria-52283 ◽

2018 ◽

Vol 31 (2) ◽

pp. 107-133 ◽

Cited By ~ 3

Author(s):

Edward J. Lynch ◽

Lindsay M. Andiola

Keyword(s):

Eye Tracking ◽

Cognitive Processes ◽

Research Tool ◽

Future Research ◽

Behavioral Accounting ◽

Research Directions ◽

Psychological Constructs ◽

Instructional Resource ◽

Future Research Directions ◽

Research Domains

ABSTRACT Recent advances in technology have increased the accessibility and ease in using eye-tracking as a research tool. These advances have the potential to benefit behavioral accounting researchers' understanding of the cognitive processes underlying individuals' judgments, decisions, and behaviors. However, despite its potential and wide use in other disciplines, few behavioral accounting studies use eye-tracking. The purpose of this paper is to familiarize accounting researchers with eye-tracking, including its advantages and limitations as a research tool. We start by providing an overview of eye-tracking and discussing essential terms and useful metrics, as well as the psychological constructs they proxy. We then summarize eye-tracking research across research domains, review accounting studies that use eye-tracking, and identify future research directions across accounting topics. Finally, we provide an instructional resource to guide those researchers interested in using eye-tracking, including important considerations at each stage of the study. JEL Classifications: M41; C91.

Download Full-text

Effects of age on memory for pragmatic implications in advertising

Journal of Pacific Rim Psychology ◽

10.1177/18344909211000452 ◽

2021 ◽

Vol 15 ◽

pp. 183449092110004

Author(s):

Jing Yu ◽

Xue-Rui Peng ◽

Ming Yan

Keyword(s):

Older Adults ◽

Eye Tracking ◽

Cognitive Processes ◽

Time Processing ◽

Movement Data ◽

Processing Strategies ◽

Health Related ◽

Advertising Content ◽

Inferential Processing ◽

Tracking Technology

People employ automatic inferential processing when confronting pragmatically implied claims in advertising. However, whether comprehension and memorization of pragmatic implications differ between young and older adults is unclear. In the present study, we used eye-tracking technology to investigate online cognitive processes during reading of misleading advertisements. We found an interaction between age and advertising content, manifested as our older participants generated higher misleading rates in health-related than in health-irrelevant products, whereas this content-bias did not appear in their younger counterparts. Eye movement data further showed that the older adults spent more time processing critical claims for the health-related products than for the health-irrelevant products. Moreover, the correlations between fixation duration on pragmatic implications and misleading rates showed opposite trends in the two groups. The eye-tracking evidence novelly suggests that young and older adults may adopt different information processing strategies to comprehend pragmatic implications in advertising: More reading possibly enhances young adults’ gist memory whereas it facilitates older adults’ verbatim memory instead.

Download Full-text

A Fast and Effective System for Analysis of Optokinetic Waveforms with a Low-Cost Eye Tracking Device

Healthcare ◽

10.3390/healthcare9010010 ◽

2020 ◽

Vol 9 (1) ◽

pp. 10

Author(s):

Chong-Bin Tsai ◽

Wei-Yu Hung ◽

Wei-Yen Hsu

Keyword(s):

Eye Movements ◽

Eye Tracking ◽

Eye Movement ◽

Low Cost ◽

Saccadic Eye Movements ◽

Slow Phase ◽

Eye Tracker ◽

Effective System ◽

Tracking Device ◽

Traditional Approaches

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.

Download Full-text