scholarly journals Rhythmic subvocalization: An eye-tracking study on silent poetry reading

2021 ◽  
Vol 13 (3) ◽  
Author(s):  
Judith Beck ◽  
Lars Konieczny

The present study investigates effects of conventionally metered and rhymed poetry on eye-movements in silent reading. Readers saw MRRL poems (i.e., metrically regular, rhymed language) in two layouts. In poem layout, verse endings coincided with line breaks. In prose layout verse endings could be mid-line. We also added metrical and rhyme anomalies. We hypothesized that silently reading MRRL results in building up auditive expectations that are based on a rhythmic “audible gestalt” and propose that rhythmicity is generated through subvocalization. Our results revealed that readers were sensitive to rhythmic-gestalt-anomalies but showed differential effects in poem and prose layouts. Metrical anomalies in particular resulted in robust reading disruptions across a variety of eye-movement measures in the poem layout and caused re-reading of the local context. Rhyme anomalies elicited stronger effects in prose layout and resulted in systematic re-reading of pre-rhymes. The presence or absence of rhythmic-gestalt-anomalies, as well as the layout manipulation, also affected reading in general. Effects of syllable number indicated a high degree of subvocalization. The overall pattern of results suggests that eye-movements reflect, and are closely aligned with, the rhythmic subvocalization of MRRL. This study introduces a two-stage approach to the analysis of long MRRL stimuli and contributes to the discussion of how the processing of rhythm in music and speech may overlap.

Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 10
Author(s):  
Chong-Bin Tsai ◽  
Wei-Yu Hung ◽  
Wei-Yen Hsu

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.


2021 ◽  
pp. 1-26
Author(s):  
Jan-Louis Kruger ◽  
Natalia Wisniewska ◽  
Sixin Liao

Abstract High subtitle speed undoubtedly impacts the viewer experience. However, little is known about how fast subtitles might impact the reading of individual words. This article presents new findings on the effect of subtitle speed on viewers’ reading behavior using word-based eye-tracking measures with specific attention to word skipping and rereading. In multimodal reading situations such as reading subtitles in video, rereading allows people to correct for oculomotor error or comprehension failure during linguistic processing or integrate words with elements of the image to build a situation model of the video. However, the opportunity to reread words, to read the majority of the words in the subtitle and to read subtitles to completion, is likely to be compromised when subtitles are too fast. Participants watched videos with subtitles at 12, 20, and 28 characters per second (cps) while their eye movements were recorded. It was found that comprehension declined as speed increased. Eye movement records also showed that faster subtitles resulted in more incomplete reading of subtitles. Furthermore, increased speed also caused fewer words to be reread following both horizontal eye movements (likely resulting in reduced lexical processing) and vertical eye movements (which would likely reduce higher-level comprehension and integration).


Author(s):  
Gavindya Jayawardena ◽  
Sampath Jayarathna

Eye-tracking experiments involve areas of interest (AOIs) for the analysis of eye gaze data. While there are tools to delineate AOIs to extract eye movement data, they may require users to manually draw boundaries of AOIs on eye tracking stimuli or use markers to define AOIs. This paper introduces two novel techniques to dynamically filter eye movement data from AOIs for the analysis of eye metrics from multiple levels of granularity. The authors incorporate pre-trained object detectors and object instance segmentation models for offline detection of dynamic AOIs in video streams. This research presents the implementation and evaluation of object detectors and object instance segmentation models to find the best model to be integrated in a real-time eye movement analysis pipeline. The authors filter gaze data that falls within the polygonal boundaries of detected dynamic AOIs and apply object detector to find bounding-boxes in a public dataset. The results indicate that the dynamic AOIs generated by object detectors capture 60% of eye movements & object instance segmentation models capture 30% of eye movements.


Author(s):  
Anne E. Cook ◽  
Wei Wei

This chapter provides an overview of eye movement-based reading measures and the types of inferences that may be drawn from each. We provide logistical advice about how to set up stimuli for eye tracking experiments, with different level processes (word, sentence, and discourse) and commonly employed measures of eye movements during reading in mind. We conclude with examples from our own research of studies of eye movements during reading at the word, sentence, and discourse levels, as well as some considerations for future research.


2018 ◽  
Vol 71 (1) ◽  
pp. 3-10 ◽  
Author(s):  
Albrecht W Inhoff ◽  
Julie Gregg ◽  
Ralph Radach

Eye movements were measured during the silent reading of sentences to extract several oculomotor measures. Rather than each measure being examined independently, oculomotor responses were grouped into two types, the assumption being that the grouping would project onto underlying constructs. Properties of forward-directed movements were assumed to reflect the success with which linguistic information was acquired (acquisition), and corrective responses were assumed to reveal readers’ responding to difficulties (correction). These two types of oculomotor responses were linked to indexes of reading accuracy (accuracy), which were obtained from separate materials so that eye movements with one set of materials could be used to predict reading accuracy for another set of materials. Path analyses indicated that correction, but not acquisition, was linked to accuracy. The additional clustering of acquisition, correction, and accuracy scores identified a group of readers with relatively low accuracy scores. These readers were typical in their acquisition of linguistic information but under-used corrective responding.


In chapter 1 we describe the method of eye-tracking and how the interest to studying eye movements developed in time. We describe how modern eye-tracking devices work, including several most commonly used in cognitive research (SR-Research, SMI, Tobii). We also give some general information about eye movement parameters during reading and a brief over- view of main models of eye movement control in reading (SWIFT, E-Z Reader). These models take into account a significant amount of empirical data and simulate the interaction of oculo- motor and cognitive processes involved in reading. Differences between the models, as well as different interpretations allowed within the same model, reflect the complexity of reading and the ongoing discussion about the processes involved in it. The section ends up with the pros and cons of using LCD and CRT displays in eye-tracking studies.


Vision ◽  
2021 ◽  
Vol 5 (3) ◽  
pp. 39
Author(s):  
Julie Royo ◽  
Fabrice Arcizet ◽  
Patrick Cavanagh ◽  
Pierre Pouget

We introduce a blind spot method to create image changes contingent on eye movements. One challenge of eye movement research is triggering display changes contingent on gaze. The eye-tracking system must capture the image of the eye, discover and track the pupil and corneal reflections to estimate the gaze position, and then transfer this data to the computer that updates the display. All of these steps introduce delays that are often difficult to predict. To avoid these issues, we describe a simple blind spot method to generate gaze contingent display manipulations without any eye-tracking system and/or display controls.


2020 ◽  
Author(s):  
Aurélie Pistono ◽  
Robert Hartsuiker

To reveal the underlying cause of disfluency, several authors related the pattern of disfluencies to difficulties at specific levels of production, using a Network Task. However, disfluencies are arguably multifactorial. To disentangle disfluency related to word preparation from other factors, we combined this task with eye-tracking. We manipulated lexical and grammatical selection difficulty. In Experiment 1, lines connecting the pictures varied in length. Experiment 2 only used short lines. In both experiments, lexical selection difficulty promoted self- corrections and pauses and longer viewing times. Multivariate pattern analyses (MVPA) demonstrated that lexical selection difficulty is predictable from disfluency and eye-movement data patterns. In Experiment 1, participants spent less time gazing at pictures preceded by long lines, while producing more pauses. This suggests they used a strategy to inspect other areas than the upcoming picture. We conclude that eye-tracking is informative about mechanisms underlying disfluency related to speech encoding, self-monitoring, and stalling strategies.


2021 ◽  
Vol 4 (3) ◽  
pp. 95-112
Author(s):  
Mina Sano

Early childhood children tend to make musical expressions watching other children or the teacher’s piano accompaniment. However, it has not been inspected yet how eye movement is affected by music. To provide the optimized procedure to capture eye movement’s characteristics reflecting music, the statistical technique was used to evaluate effective parameters. In this study, eye trackers (Tobii Glasses 2) were used to acquire data of eye movements during musical expression of early childhood children and to conduct quantitative analysis. 3-year-old, 4-year-old, and 5- year-old children in two early childhood facilities (n=58) participated in eye-tracking while singing multiple songs of major and minor. This paper focuses on saccade (rapid eye movement) and gaze behaviors of early childhood children and mainly conducts, a three-way analysis of variance (ANOVA) on the acquired data (age * facility*tonality). As a result, it was found that the number of occurrences of saccade and the total moving distances of saccade showed a statistical significance between means regarding differences in the tonality of major/minor key of songs, and childcare forms.


2018 ◽  
Vol 21 (3) ◽  
pp. 45-36
Author(s):  
A. K. Volkov ◽  
V. V. Ionov

The X-ray screening systems operators’ professional training is based on the CBT (computer-based training) principle, which has algorithms of adaptive training. These algorithms in existing computer simulators include feedback mechanisms on the basis of trainability exponents – such as the frequency of detecting dangerous objects, the frequency of false alarms and detection time. Further enhancement of the operators’ simulator training effectiveness is associated with the integration of psychophysiological mechanisms providing monitoring of their functional state. Based on the analysis of the particularities of x-ray screening systems operators’ professional training associated with the formation of competences in dangerous objects visual search, the most perspective method is the Eye tracking technology. Domestic and foreign studies of the eye movements characteristics while solving professional tasks in training process are actively developed in various areas. There are no studies of visual search peculiarities in domestic practice in contrast to exterior studies. This research is aimed at considering the usage of Eye tracking technology in the training of x-ray screening systems operators. As the result of the experimental research with the use of mobile eye-tracker Sensomotoric Instruments Eye Tracking Glasses 2.0 the statistical data of eye movement parameters of two groups of subjects with different levels of training have been received. The application of cluster and discriminant analyses methods allowed to identify General classes of these parameters, as well as to obtain the discriminants functions for each group under examination. The theoretical significance of the peculiarities of the operators’ eye movement studies is to identify the patterns of prohibited items visual search. The practical importance of implementation of Eye tracking technology and statistical analysis methods is to increase the reliability of assessment the level of formed competence of x-ray screening systems’ operators in visual search, as well as to develop the potential system of operators’ state monitoring and assessing their visual fatigue.


Sign in / Sign up

Export Citation Format

Share Document