scholarly journals Mind-Wandering: What Can We Learn from Eye Movements?

2020 ◽  
Author(s):  
Han Zhang
Keyword(s):  
Visual Search ◽  
Eye Movements ◽  
Cognitive Processing ◽  
Visual Processing ◽  
Scene Perception ◽  
Mind Wandering ◽  
Task Demands ◽  
Search Performance ◽  
Wide Range ◽  
Irrelevant Distractors

Mind-wandering (MW) is ubiquitous and is associated with reduced performance across a wide range of tasks. Recent studies have shown that MW can be related to changes in gaze parameters. In this dissertation, I explored the link between eye movements and MW in three different contexts that involve complex cognitive processing: visual search, scene perception, and reading comprehension. Study 1 examined how MW affects visual search performance, particularly the ability to suppress salient but irrelevant distractors during visual search. Study 2 used a scene encoding task to study how MW affects how eye movements change over time and their relationship with scene content. Study 3 examined how MW affects readers’ ability to detect semantic incongruities in the text and make necessary revisions of their understanding as they read jokes. All three studies showed that MW was associated with decreased task performance at the behavioral level (e.g., response time, recognition, and recall). Eye-tracking further showed that these behavioral costs can be traced to deficits in specific cognitive processes. The final chapter of this dissertation explored whether there are context-independent eye movement features of MW. MW manifests itself in different ways depending on task characteristics. In tasks that require extensive sampling of the stimuli (e.g., reading and scene viewing), MW was related to a global reduction in visual processing. But this was not the case for the search task, which involved speeded, simple visual processing. MW was instead related to increased looking time on the target after it was already located. MW affects the coupling between cognitive efforts and task demands, but the nature of this decoupling depends on the specific features of particular tasks.

scholarly journals Refixation Patterns of Mind-wandering during Real-world Scene Perception

2020 ◽  
Author(s):  
Han Zhang ◽  
Nicola C Anderson ◽  
Kevin Miller
Keyword(s):  
Eye Movements ◽  
Cognitive Processing ◽  
Real World ◽  
Visual Processing ◽  
Visual Information ◽  
Scene Perception ◽  
Mind Wandering ◽  
Quantification Analysis ◽  
The Difference ◽  
Thought Probes

Recent studies have shown that mind-wandering (MW) is associated with changes in eye movement parameters, but have not explored how MW affects the sequential pattern of eye movements involved in making sense of complex visual information. Eye movements naturally unfold over time and this process may reveal novel information about cognitive processing during MW. The current study used Recurrence Quantification Analysis (Anderson, Bischof, Laidlaw, Risko, & Kingstone, 2013) to describe the pattern of refixations (fixations directed to previously-inspected regions) during MW. Participants completed a real-world scene encoding task and responded to thought probes assessing intentional and unintentional MW. Both types of MW were associated with worse memory of the scenes. Importantly, RQA showed that scanpaths during unintentional MW were more repetitive than during on-task episodes, as indicated by a higher recurrence rate and more stereotypical fixation sequences. This increased repetitiveness suggests an adaptive response to processing failures through re-examining previous locations. Moreover, this increased repetitiveness contributed to fixations focusing on a smaller spatial scale of the stimuli. Finally, we were also able to validate several traditional measures: both intentional and unintentional MW were associated with fewer and longer fixations; Eye-blinking increased numerically during both types of MW but the difference was only significant for unintentional MW. Overall, the results advanced our understanding of how visual processing is affected during MW by highlighting the sequential aspect of eye movements.

scholarly journals Periodic attention operates faster during more complex visual search

2021 ◽  
Author(s):  
Garance Merholz ◽  
Laetitia Grabot ◽  
Rufin VanRullen ◽  
Laura Dugué
Keyword(s):  
Visual Search ◽  
Visual Processing ◽  
Visual Information ◽  
Temporal Dynamics ◽  
Task Complexity ◽  
Low Frequency ◽  
Search Performance ◽  
Set Size ◽  
Low Frequency Oscillations ◽  
Wide Range

AbstractAttention has been found to sample visual information periodically, in a wide range of frequencies below 20 Hz. This periodicity may be supported by brain oscillations at corresponding frequencies. We propose that part of the discrepancy in periodic frequencies observed in the literature is due to differences in attentional demands, resulting from heterogeneity in tasks performed. To test this hypothesis, we used visual search and manipulated task complexity, i.e., target discriminability (high, medium, low) and number of distractors (set size), while electro-encephalography was simultaneously recorded. We replicated previous results showing that the phase of pre-stimulus low-frequency oscillations predicts search performance. Crucially, such effects were observed at increasing frequencies within the theta-alpha range (6-18 Hz) for decreasing target discriminability. In medium and low discriminability conditions, correct responses were further associated with higher post-stimulus phase-locking than incorrect ones, in increasing frequency and latency. Finally, the larger the set size, the later the post-stimulus effect peaked. Together, these results suggest that increased complexity (lower discriminability or larger set size) requires more attentional cycles to perform the task, partially explaining discrepancies between reports of attentional sampling. Low-frequency oscillations structure the temporal dynamics of neural activity and aid top-down, attentional control for efficient visual processing.

scholarly journals Separable Influences of Reward on Visual Processing and Choice

2021 ◽  
Vol 33 (2) ◽  
pp. 248-262
Author(s):  
Alireza Soltani ◽  
Mohsen Rakhshan ◽  
Robert J. Schafer ◽  
Brittany E. Burrows ◽  
Tirin Moore
Keyword(s):  
Eye Movements ◽  
Visual Processing ◽  
Visual Motion ◽  
Target Selection ◽  
Wide Range ◽  
Reward Value ◽  
Similarities And Differences ◽  
Visual Targets ◽  
Reinforcement Learning Models ◽  
Selection Of

Primate vision is characterized by constant, sequential processing and selection of visual targets to fixate. Although expected reward is known to influence both processing and selection of visual targets, similarities and differences between these effects remain unclear mainly because they have been measured in separate tasks. Using a novel paradigm, we simultaneously measured the effects of reward outcomes and expected reward on target selection and sensitivity to visual motion in monkeys. Monkeys freely chose between two visual targets and received a juice reward with varying probability for eye movements made to either of them. Targets were stationary apertures of drifting gratings, causing the end points of eye movements to these targets to be systematically biased in the direction of motion. We used this motion-induced bias as a measure of sensitivity to visual motion on each trial. We then performed different analyses to explore effects of objective and subjective reward values on choice and sensitivity to visual motion to find similarities and differences between reward effects on these two processes. Specifically, we used different reinforcement learning models to fit choice behavior and estimate subjective reward values based on the integration of reward outcomes over multiple trials. Moreover, to compare the effects of subjective reward value on choice and sensitivity to motion directly, we considered correlations between each of these variables and integrated reward outcomes on a wide range of timescales. We found that, in addition to choice, sensitivity to visual motion was also influenced by subjective reward value, although the motion was irrelevant for receiving reward. Unlike choice, however, sensitivity to visual motion was not affected by objective measures of reward value. Moreover, choice was determined by the difference in subjective reward values of the two options, whereas sensitivity to motion was influenced by the sum of values. Finally, models that best predicted visual processing and choice used sets of estimated reward values based on different types of reward integration and timescales. Together, our results demonstrate separable influences of reward on visual processing and choice, and point to the presence of multiple brain circuits for the integration of reward outcomes.

scholarly journals No advantage for separating overt and covert attention in visual search

2020 ◽  
Author(s):  
Joseph MacInnes ◽  
Ómar I. Jóhannesson ◽  
Andrey Chetverikov ◽  
Arni Kristjansson
Keyword(s):  
Information Processing ◽  
Visual Search ◽  
Change Blindness ◽  
Task Demands ◽  
Covert Attention ◽  
Search Performance ◽  
Overt Attention ◽  
Complex Scenes ◽  
Improved Performance ◽  
Gaze Position

We move our eyes roughly three times every second while searching complex scenes, but covert attention helps to guide where we allocate those overt fixations. Covert attention may be allocated reflexively or voluntarily, and speeds the rate of information processing at the attended location. Reducing access to covert attention hinders performance, but it is not known to what degree the locus of covert attention is tied to the current gaze position. We compared visual search performance in a traditional gaze contingent display with a second task where a similarly sized contingent window is controlled with a mouse allowing a covert aperture to be controlled independently from overt gaze. Larger apertures improved performance for both mouse and gaze contingent trials suggesting that covert attention was beneficial regardless of control type. We also found evidence that participants used the mouse controlled aperture independently of gaze position, suggesting that participants attempted to untether their covert and overt attention when possible. This untethering manipulation, however, resulted in an overall cost to search performance, a result at odds with previous results in a change blindness paradigm. Untethering covert and overt attention may therefore have costs or benefits depending on the task demands in each case.

scholarly journals Seeing Beyond Salience and Guidance: The Role of Bias and Decision in Visual Search

Vision ◽  
2019 ◽  
Vol 3 (3) ◽  
pp. 46
Author(s):  
Alasdair D. F. Clarke ◽  
Anna Nowakowska ◽  
Amelia R. Hunt
Keyword(s):  
Visual Search ◽  
Eye Movements ◽  
Signal Detection ◽  
Future Research ◽  
Search Performance ◽  
Guided Search ◽  
Vision Science ◽  
Search Tasks ◽  
Field Of Vision

Visual search is a popular tool for studying a range of questions about perception and attention, thanks to the ease with which the basic paradigm can be controlled and manipulated. While often thought of as a sub-field of vision science, search tasks are significantly more complex than most other perceptual tasks, with strategy and decision playing an essential, but neglected, role. In this review, we briefly describe some of the important theoretical advances about perception and attention that have been gained from studying visual search within the signal detection and guided search frameworks. Under most circumstances, search also involves executing a series of eye movements. We argue that understanding the contribution of biases, routines and strategies to visual search performance over multiple fixations will lead to new insights about these decision-related processes and how they interact with perception and attention. We also highlight the neglected potential for variability, both within and between searchers, to contribute to our understanding of visual search. The exciting challenge will be to account for variations in search performance caused by these numerous factors and their interactions. We conclude the review with some recommendations for ways future research can tackle these challenges to move the field forward.

The Influence of Brightness Highlighting on Eye Movements within a Cockpit Display of Traffic Information

2005 ◽  
Vol 49 (17) ◽  
pp. 1644-1648
Author(s):  
Min-Ju Liao ◽  
Stacy Granada ◽  
Walter W. Johnson
Keyword(s):  
Visual Search ◽  
Eye Movements ◽  
Search Task ◽  
Traffic Information ◽  
Search Performance ◽  
Detection Time ◽  
Current Experiment ◽  
Time Analysis ◽  
Cockpit Display ◽  
Eye Fixations

Several experiments were conducted to examine the effect of brightness highlighting on search of a target aircraft among distractor aircraft within a cockpit display of traffic information (CDTI). The present experiment partially replicated the design of one of these experiments, adding an examination of eye movements. The display presented homogenous all bright, all dim, or mixed bright and dim aircraft. Within the mixed display, target aircraft were non-predictive and either bright or dim. Results showed that with the mixed display, participants yielded slower detection times, exhibited more eye fixations, and searched with longer paths, compared to the homogenous all bright or dim displays. The duration of the fixation and the speed of eye movements did not show any difference between the homogeneous and mixed displays. The present detection time analysis did not replicate previous experimental results and this is likely due to the fewer trials given in the current experiment. The present results demonstrated how using highlighting to segregate information domains may impose costs on visual search performance in the early stages of a search task.

scholarly journals Eye movements reflect expertise development in hybrid search

2021 ◽  
Vol 6 (1) ◽  
Author(s):  
Megan H. Papesh ◽  
Michael C. Hout ◽  
Juan D. Guevara Pinto ◽  
Arryn Robbins ◽  
Alexis Lopez
Keyword(s):  
Visual Search ◽  
Eye Movements ◽  
Response Times ◽  
Search Performance ◽  
Hybrid Search ◽  
Domain Specific ◽  
Visual Span ◽  
Change Behavior ◽  
Fixation Probabilities ◽  
Study Participants

AbstractDomain-specific expertise changes the way people perceive, process, and remember information from that domain. This is often observed in visual domains involving skilled searches, such as athletics referees, or professional visual searchers (e.g., security and medical screeners). Although existing research has compared expert to novice performance in visual search, little work has directly documented how accumulating experiences change behavior. A longitudinal approach to studying visual search performance may permit a finer-grained understanding of experience-dependent changes in visual scanning, and the extent to which various cognitive processes are affected by experience. In this study, participants acquired experience by taking part in many experimental sessions over the course of an academic semester. Searchers looked for 20 categories of targets simultaneously (which appeared with unequal frequency), in displays with 0–3 targets present, while having their eye movements recorded. With experience, accuracy increased and response times decreased. Fixation probabilities and durations decreased with increasing experience, but saccade amplitudes and visual span increased. These findings suggest that the behavioral benefits endowed by expertise emerge from oculomotor behaviors that reflect enhanced reliance on memory to guide attention and the ability to process more of the visual field within individual fixations.

Analyzing vision at the complexity level

1990 ◽  
Vol 13 (3) ◽  
pp. 423-445 ◽  
Author(s):  
John K. Tsotsos
Keyword(s):  
Visual Search ◽  
Visual Processing ◽  
Visual Information ◽  
Large Body ◽  
Minimum Cost ◽  
Search Performance ◽  
Complexity Level ◽  
Psychological Evidence ◽  
Architectural Constraints ◽  
Attentional Mechanism

AbstractThe general problem of visual search can be shown to be computationally intractable in a formal, complexity-theoretic sense, yet visual search is extensively involved in everyday perception, and biological systems manage to perform it remarkably well. Complexity level analysis may resolve this contradiction. Visual search can be reshaped into tractability through approximations and by optimizing the resources devoted to visual processing. Architectural constraints can be derived using the minimum cost principle to rule out a large class of potential solutions. The evidence speaks strongly against bottom-up approaches to vision. In particular, the constraints suggest an attentional mechanism that exploits knowledge of the specific problem being solved. This analysis of visual search performance in terms of attentional influences on visual information processing and complexity satisfaction allows a large body of neurophysiological and psychological evidence to be tied together.

Distractor Ratio Influences Patterns of Eye Movements during Visual Search

Perception ◽  
10.1068/p2933 ◽  
2000 ◽  
Vol 29 (2) ◽  
pp. 241-250 ◽  
Author(s):  
Jiye Shen ◽  
Eyal M Reingold ◽  
Marc Pomplun
Keyword(s):  
Visual Search ◽  
Eye Movements ◽  
Search Task ◽  
Search Model ◽  
Search Performance ◽  
Manual Response ◽  
Guided Search ◽  
Different Types ◽  
Conjunctive Search

We examined the flexibility of guidance in a conjunctive search task by manipulating the ratios between different types of distractors. Participants were asked to decide whether a target was present or absent among distractors sharing either colour or shape. Results indicated a strong effect of distractor ratio on search performance. Shorter latency to move, faster manual response, and fewer fixations per trial were observed at extreme distractor ratios. The distribution of saccadic endpoints also varied flexibly as a function of distractor ratio. When there were very few same-colour distractors, the saccadic selectivity was biased towards the colour dimension. In contrast, when most of the distractors shared colour with the target, the saccadic selectivity was biased towards the shape dimension. Results are discussed within the framework of the guided search model.

The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search

2009 ◽  
Vol 62 (8) ◽  
pp. 1457-1506 ◽  
Author(s):  
Keith Rayner
Keyword(s):  
Visual Search ◽  
Eye Movements ◽  
Cognitive Processes ◽  
Real World ◽  
Scene Perception ◽  
Movement Control ◽  
Preview Benefit ◽  
Visual World Paradigm ◽  
Perceptual Span ◽  
Eye Movements During Reading

Eye movements are now widely used to investigate cognitive processes during reading, scene perception, and visual search. In this article, research on the following topics is reviewed with respect to reading: (a) the perceptual span (or span of effective vision), (b) preview benefit, (c) eye movement control, and (d) models of eye movements. Related issues with respect to eye movements during scene perception and visual search are also reviewed. It is argued that research on eye movements during reading has been somewhat advanced over research on eye movements in scene perception and visual search and that some of the paradigms developed to study reading should be more widely adopted in the study of scene perception and visual search. Research dealing with “real-world” tasks and research utilizing the visual-world paradigm are also briefly discussed.

Sign in / Sign up

Export Citation Format

Share Document