Instruments of Vision

Author(s):  
Irem Bugdayci ◽  
Anne-Heloise Dautel ◽  
Robert Wuss ◽  
Ruairi Glynn

In the age of ubiquitous visual technologies and systems, our perceptive apparatuses are constantly challenged, adapted, and shaped by instruments and machines, rendering the observing body as an active site of knowledge. Your Eye's Motion by Luna is an interactive installation that uses real-time eye-tracking to control a robotic creature named Luna (Figure 1). Materializing eye movements through a wondrous spectacle of light, motion, and color, the observer becomes conscious of her gaze enacted and extended by a robotic counterpart. Building on a diverse set of theories and understandings of vision from the fields of cybernetics, visual studies, embodied mind, and more, the project explores how our perceptual apparatuses and bodies are reconfigured in relation to machines and the environment to afford new ways of seeing. Once we see how observing bodies accommodate feedback from actions to cognition, we can uncover the embodied and affective potential of eye movement as an interface for robotics. The curiosity of Luna invests in this potential, articulating a unity between our embodied percepts and machinic environments to create a "vision machine."

Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 10
Author(s):  
Chong-Bin Tsai ◽  
Wei-Yu Hung ◽  
Wei-Yen Hsu

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.


2021 ◽  
pp. 1-26
Author(s):  
Jan-Louis Kruger ◽  
Natalia Wisniewska ◽  
Sixin Liao

Abstract High subtitle speed undoubtedly impacts the viewer experience. However, little is known about how fast subtitles might impact the reading of individual words. This article presents new findings on the effect of subtitle speed on viewers’ reading behavior using word-based eye-tracking measures with specific attention to word skipping and rereading. In multimodal reading situations such as reading subtitles in video, rereading allows people to correct for oculomotor error or comprehension failure during linguistic processing or integrate words with elements of the image to build a situation model of the video. However, the opportunity to reread words, to read the majority of the words in the subtitle and to read subtitles to completion, is likely to be compromised when subtitles are too fast. Participants watched videos with subtitles at 12, 20, and 28 characters per second (cps) while their eye movements were recorded. It was found that comprehension declined as speed increased. Eye movement records also showed that faster subtitles resulted in more incomplete reading of subtitles. Furthermore, increased speed also caused fewer words to be reread following both horizontal eye movements (likely resulting in reduced lexical processing) and vertical eye movements (which would likely reduce higher-level comprehension and integration).


Author(s):  
Gavindya Jayawardena ◽  
Sampath Jayarathna

Eye-tracking experiments involve areas of interest (AOIs) for the analysis of eye gaze data. While there are tools to delineate AOIs to extract eye movement data, they may require users to manually draw boundaries of AOIs on eye tracking stimuli or use markers to define AOIs. This paper introduces two novel techniques to dynamically filter eye movement data from AOIs for the analysis of eye metrics from multiple levels of granularity. The authors incorporate pre-trained object detectors and object instance segmentation models for offline detection of dynamic AOIs in video streams. This research presents the implementation and evaluation of object detectors and object instance segmentation models to find the best model to be integrated in a real-time eye movement analysis pipeline. The authors filter gaze data that falls within the polygonal boundaries of detected dynamic AOIs and apply object detector to find bounding-boxes in a public dataset. The results indicate that the dynamic AOIs generated by object detectors capture 60% of eye movements & object instance segmentation models capture 30% of eye movements.


Author(s):  
Anne E. Cook ◽  
Wei Wei

This chapter provides an overview of eye movement-based reading measures and the types of inferences that may be drawn from each. We provide logistical advice about how to set up stimuli for eye tracking experiments, with different level processes (word, sentence, and discourse) and commonly employed measures of eye movements during reading in mind. We conclude with examples from our own research of studies of eye movements during reading at the word, sentence, and discourse levels, as well as some considerations for future research.


In chapter 1 we describe the method of eye-tracking and how the interest to studying eye movements developed in time. We describe how modern eye-tracking devices work, including several most commonly used in cognitive research (SR-Research, SMI, Tobii). We also give some general information about eye movement parameters during reading and a brief over- view of main models of eye movement control in reading (SWIFT, E-Z Reader). These models take into account a significant amount of empirical data and simulate the interaction of oculo- motor and cognitive processes involved in reading. Differences between the models, as well as different interpretations allowed within the same model, reflect the complexity of reading and the ongoing discussion about the processes involved in it. The section ends up with the pros and cons of using LCD and CRT displays in eye-tracking studies.


2021 ◽  
Vol 13 (3) ◽  
Author(s):  
Judith Beck ◽  
Lars Konieczny

The present study investigates effects of conventionally metered and rhymed poetry on eye-movements in silent reading. Readers saw MRRL poems (i.e., metrically regular, rhymed language) in two layouts. In poem layout, verse endings coincided with line breaks. In prose layout verse endings could be mid-line. We also added metrical and rhyme anomalies. We hypothesized that silently reading MRRL results in building up auditive expectations that are based on a rhythmic “audible gestalt” and propose that rhythmicity is generated through subvocalization. Our results revealed that readers were sensitive to rhythmic-gestalt-anomalies but showed differential effects in poem and prose layouts. Metrical anomalies in particular resulted in robust reading disruptions across a variety of eye-movement measures in the poem layout and caused re-reading of the local context. Rhyme anomalies elicited stronger effects in prose layout and resulted in systematic re-reading of pre-rhymes. The presence or absence of rhythmic-gestalt-anomalies, as well as the layout manipulation, also affected reading in general. Effects of syllable number indicated a high degree of subvocalization. The overall pattern of results suggests that eye-movements reflect, and are closely aligned with, the rhythmic subvocalization of MRRL. This study introduces a two-stage approach to the analysis of long MRRL stimuli and contributes to the discussion of how the processing of rhythm in music and speech may overlap.


Vision ◽  
2021 ◽  
Vol 5 (3) ◽  
pp. 39
Author(s):  
Julie Royo ◽  
Fabrice Arcizet ◽  
Patrick Cavanagh ◽  
Pierre Pouget

We introduce a blind spot method to create image changes contingent on eye movements. One challenge of eye movement research is triggering display changes contingent on gaze. The eye-tracking system must capture the image of the eye, discover and track the pupil and corneal reflections to estimate the gaze position, and then transfer this data to the computer that updates the display. All of these steps introduce delays that are often difficult to predict. To avoid these issues, we describe a simple blind spot method to generate gaze contingent display manipulations without any eye-tracking system and/or display controls.


2020 ◽  
Author(s):  
Aurélie Pistono ◽  
Robert Hartsuiker

To reveal the underlying cause of disfluency, several authors related the pattern of disfluencies to difficulties at specific levels of production, using a Network Task. However, disfluencies are arguably multifactorial. To disentangle disfluency related to word preparation from other factors, we combined this task with eye-tracking. We manipulated lexical and grammatical selection difficulty. In Experiment 1, lines connecting the pictures varied in length. Experiment 2 only used short lines. In both experiments, lexical selection difficulty promoted self- corrections and pauses and longer viewing times. Multivariate pattern analyses (MVPA) demonstrated that lexical selection difficulty is predictable from disfluency and eye-movement data patterns. In Experiment 1, participants spent less time gazing at pictures preceded by long lines, while producing more pauses. This suggests they used a strategy to inspect other areas than the upcoming picture. We conclude that eye-tracking is informative about mechanisms underlying disfluency related to speech encoding, self-monitoring, and stalling strategies.


2021 ◽  
Vol 4 (3) ◽  
pp. 95-112
Author(s):  
Mina Sano

Early childhood children tend to make musical expressions watching other children or the teacher’s piano accompaniment. However, it has not been inspected yet how eye movement is affected by music. To provide the optimized procedure to capture eye movement’s characteristics reflecting music, the statistical technique was used to evaluate effective parameters. In this study, eye trackers (Tobii Glasses 2) were used to acquire data of eye movements during musical expression of early childhood children and to conduct quantitative analysis. 3-year-old, 4-year-old, and 5- year-old children in two early childhood facilities (n=58) participated in eye-tracking while singing multiple songs of major and minor. This paper focuses on saccade (rapid eye movement) and gaze behaviors of early childhood children and mainly conducts, a three-way analysis of variance (ANOVA) on the acquired data (age * facility*tonality). As a result, it was found that the number of occurrences of saccade and the total moving distances of saccade showed a statistical significance between means regarding differences in the tonality of major/minor key of songs, and childcare forms.


2018 ◽  
Vol 21 (3) ◽  
pp. 45-36
Author(s):  
A. K. Volkov ◽  
V. V. Ionov

The X-ray screening systems operators’ professional training is based on the CBT (computer-based training) principle, which has algorithms of adaptive training. These algorithms in existing computer simulators include feedback mechanisms on the basis of trainability exponents – such as the frequency of detecting dangerous objects, the frequency of false alarms and detection time. Further enhancement of the operators’ simulator training effectiveness is associated with the integration of psychophysiological mechanisms providing monitoring of their functional state. Based on the analysis of the particularities of x-ray screening systems operators’ professional training associated with the formation of competences in dangerous objects visual search, the most perspective method is the Eye tracking technology. Domestic and foreign studies of the eye movements characteristics while solving professional tasks in training process are actively developed in various areas. There are no studies of visual search peculiarities in domestic practice in contrast to exterior studies. This research is aimed at considering the usage of Eye tracking technology in the training of x-ray screening systems operators. As the result of the experimental research with the use of mobile eye-tracker Sensomotoric Instruments Eye Tracking Glasses 2.0 the statistical data of eye movement parameters of two groups of subjects with different levels of training have been received. The application of cluster and discriminant analyses methods allowed to identify General classes of these parameters, as well as to obtain the discriminants functions for each group under examination. The theoretical significance of the peculiarities of the operators’ eye movement studies is to identify the patterns of prohibited items visual search. The practical importance of implementation of Eye tracking technology and statistical analysis methods is to increase the reliability of assessment the level of formed competence of x-ray screening systems’ operators in visual search, as well as to develop the potential system of operators’ state monitoring and assessing their visual fatigue.


Sign in / Sign up

Export Citation Format

Share Document