Why subtitle speed matters: Evidence from word skipping and rereading

2021 ◽  
pp. 1-26
Author(s):  
Jan-Louis Kruger ◽  
Natalia Wisniewska ◽  
Sixin Liao
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Lexical Processing ◽  
Situation Model ◽  
Linguistic Processing ◽  
Reading Behavior ◽  
New Findings ◽  
Word Skipping

Abstract High subtitle speed undoubtedly impacts the viewer experience. However, little is known about how fast subtitles might impact the reading of individual words. This article presents new findings on the effect of subtitle speed on viewers’ reading behavior using word-based eye-tracking measures with specific attention to word skipping and rereading. In multimodal reading situations such as reading subtitles in video, rereading allows people to correct for oculomotor error or comprehension failure during linguistic processing or integrate words with elements of the image to build a situation model of the video. However, the opportunity to reread words, to read the majority of the words in the subtitle and to read subtitles to completion, is likely to be compromised when subtitles are too fast. Participants watched videos with subtitles at 12, 20, and 28 characters per second (cps) while their eye movements were recorded. It was found that comprehension declined as speed increased. Eye movement records also showed that faster subtitles resulted in more incomplete reading of subtitles. Furthermore, increased speed also caused fewer words to be reread following both horizontal eye movements (likely resulting in reduced lexical processing) and vertical eye movements (which would likely reduce higher-level comprehension and integration).

scholarly journals Word Skipping in Reading English as a Foreign Language: Evidence from Eye Tracking

2016 ◽  
Vol 3 (2) ◽  
pp. 22-31
Author(s):  
Емраг Долґунсоз ◽  
Аріф Сарісобан
Keyword(s):  
Second Language ◽  
Cognitive Psychology ◽  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Movement Control ◽  
Vocabulary Knowledge ◽  
Psychological Review ◽  
Eye Movement Control ◽  
Word Skipping

During reading, readers never fixate on all words in the text; shorter words sometimes gain zero fixation and skipped by the reader. Relying on E-Z Reader Model, this research hypothesized that a similar skipping effect also exists for a second language. The current study examined word skipping rates in EFL (English as a Foreign Language) with 75 EFL learners by using eye tracking methodology. The results showed that word skipping was affected by EFL reading proficiency significantly and articles (a, an, the) were skipped more than content words. Furthermore, more skilled learners were observed to have less fixation count and skipped more words during reading while less skilled learners employed more fixations and skipped less words. Eye tracking as a novel method to observe learner development and progress in EFL reading was also discussed.  References Altarriba, J., Kroll, J. F., Sholl, A.. & Rayner, K. (1996). The influence of lexical andconceptual constraints on reading mixed-language sentences: Evidence from eye fixations andnaming times. Memory & Cognition, 24, 477–492. Balota, D. A., Pollatsek, A., & Rayner, K. (1985). The interaction of contextual constraints andparafoveal visual information in reading. Cognitive Psychology, 17, 364–388. Binder, K. S., Pollatsek, A., & Rayner, K. (1999). Extraction of information to the left of thefixated word in reading. Journal of Experimental Psychology: Human Perception andPerformance, 25, 1162–1172. Brysbaert, M., & Vitu, F. (1998). Word Skipping: Implications for Theories of Eye MovementControl in Reading. In: Eye Guidance in Reading and Scene Perception. (pp. 125–147).G. Underwood, (Ed.). Oxford: Elsevier. Carpenter, P. A., & Just, M. A. (1983). What your eyes do while your mind is reading. In: EyeMovements in Reading: Perceptual and Language processes , (pp. 275–307), K. Rayner (ed.).New York: Academic Press. Djamasbi, S., Siegel, M., Skorinko, J., & Tullis, T. (2011). Online viewing and aestheticpreferences of generation y and the baby boom generation: Testing user web site experiencethrough eye tracking. International Journal of Electronic Commerce, 15(4), 121–158. Dolgunsöz, E. (2015). Measuring Attention in Second Language Reading Using Eye-tracking:The Case of the Noticing Hypothesis. Journal of Eye Movement Research, 8(5). Drieghe, D., Brysbaert, M., Desmet, T., & De Baecke, C. (2004). Word skipping in reading: Onthe interplay of linguistic and visual factors. European Journal of Cognitive Psychology,16(1–2), 79–103. Godfroid, A., Boers, F., & Housen, A. (2013). An eye for words: Gauging the role of attentionin incidental L2 vocabulary acquisition by means of eye-tracking. Studies in Second languageAcquisition, 35(3), 483–517. Henderson, J. M., & Ferreira, F. (1993). Eye movement control during reading: Fixationmeasures reflect foveal but not parafoveal processing difficulty. Canadian Journal ofExperimental Psychology, 47, 201–221. Joe, A. (1995). Text based tasks and incidental vocabulary learning. Foreign languageResearch, 11(2), 95–111. Just, M. A., & Carpenter, P. (1980). A theory of reading: From eye fixations tocomprehension. Psychological Review, 85, 109–130. Liu, P. L. (2014). Using eye tracking to understand the responses of learners to vocabularylearning strategy instruction and use. Computer Assisted Language Learning, 27(4), 330–343. McNeill, A. (1996). Vocabulary Knowledge profiles: Evidence from Chinese speaking ESLspeakers. Hong Kong Journal of Applied Linguistics 1(1), 39–63. Pollatsek, A., Reichle, E., & Rayner, K. (2003). Modeling eye movements in reading. In: TheMind’s Eyes: Cognitive and Applied Aspects of Eye Movement Research. (pp. 361–390).J. Hyona, R. Radach, & H. Deubel, (Eds.). Amsterdam: Elsevier. Radach, R., & Kempe, V. (1993). An individual analysis of initial fixation positions inreading. In: Perception and cognition: Advances in eye movement research (pp. 213–226). G.d’Ydewalle & J. Van Rensbergen (Eds.). Amsterdam: North Holland. Rayner, K. (1998). Eye Movements in Reading and Information Processing: 20 Years ofResearch, Psychological Bulletin, 124 (3), 372–422 Rayner, K., & Fischer, M. H. (1996). Mindless reading revisited: eye movements duringreading and scanning are different. Perception & Psychophysics, 58(5), 734–747. Rayner, K., & Well, A. D. (1996). Effects of contextual constraint on eye movements duringreading: a further examination. Psychonomic Bulletin & Review, 3, 504–509. Rayner, K., Binder, K. S., Ashby, J., & Pollatsek, A. (2001). Eye movement control inreading: word predictability has little influence on initial landing positions in words. VisionResearch, 41(7), 943–954. Rayner, K., Reichle, E. D., & Pollatsek, A. (2005). Eye movement control in reading and theE-Z Reader model. In: Cognitive Processes in Eye Guidance (pp. 131-162). G. Underwood(Ed.),. Oxford: Oxford University Press. Rayner, K., Sereno, S. C., & Raney, G. E. (1996). Eye movement control in reading: acomparison of two types of models. Journal of Experimental Psychology: Human Perceptionand Performance, 22, 1188–1200. Reichle, E., Pollatsek, A., Fisher, D. L., & Rayner, K. (1998). Toward a model of eyemovement control in reading. Psychological Review, 105, 125–157. Scarcella, R. & C. Zimmerman (1998). ESL student performance on a text of academiclexicon. Studies in Second language Acquisition, 20(1), 27–49. Schilling, H. E., Rayner, K., & Chumbley, J. I. (1998). Comparing naming, lexical decision,and eye fixation times: Word frequency effects and individual differences. Memory &Cognition, 26(6), 1270–1281. Schroeder, S., Hyönä, J., & Liversedge, S. P. (2015). Developmental eye-tracking research inreading: Introduction to the special issue. Journal of Cognitive Psychology, 27(5), 500–510. Smith, B. (2012). Eye tracking as a measure of noticing: A study of explicit recasts in SCMC.Language Learning & Technology, 16(3), 53–81. Wesche, M. & T. Paribakht (1996). Assessing vocabulary knowledge: depth vs. breadth.Canadian Modern Language Review, 53(1), 13–40. Winke, P., Gass, S., & Sydorenko, T. (2013). Factors Influencing the Use of Captions byForeign Language Learners: An Eye‐Tracking Study. The Modern Language Journal, 97(1),254–275.

scholarly journals A Fast and Effective System for Analysis of Optokinetic Waveforms with a Low-Cost Eye Tracking Device

Healthcare ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 10
Author(s):  
Chong-Bin Tsai ◽  
Wei-Yu Hung ◽  
Wei-Yen Hsu
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Low Cost ◽  
Saccadic Eye Movements ◽  
Slow Phase ◽  
Eye Tracker ◽  
Effective System ◽  
Tracking Device ◽  
Traditional Approaches

Optokinetic nystagmus (OKN) is an involuntary eye movement induced by motion of a large proportion of the visual field. It consists of a “slow phase (SP)” with eye movements in the same direction as the movement of the pattern and a “fast phase (FP)” with saccadic eye movements in the opposite direction. Study of OKN can reveal valuable information in ophthalmology, neurology and psychology. However, the current commercially available high-resolution and research-grade eye tracker is usually expensive. Methods & Results: We developed a novel fast and effective system combined with a low-cost eye tracking device to accurately quantitatively measure OKN eye movement. Conclusions: The experimental results indicate that the proposed method achieves fast and promising results in comparisons with several traditional approaches.

scholarly journals Automated Filtering of Eye Movements Using Dynamic AOI in Multiple Granularity Levels

2021 ◽  
Vol 12 (1) ◽  
pp. 49-64
Author(s):  
Gavindya Jayawardena ◽  
Sampath Jayarathna
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Eye Gaze ◽  
Movement Analysis ◽  
Movement Data ◽  
Bounding Boxes ◽  
Multiple Granularity ◽  
Instance Segmentation ◽  
Segmentation Models

Eye-tracking experiments involve areas of interest (AOIs) for the analysis of eye gaze data. While there are tools to delineate AOIs to extract eye movement data, they may require users to manually draw boundaries of AOIs on eye tracking stimuli or use markers to define AOIs. This paper introduces two novel techniques to dynamically filter eye movement data from AOIs for the analysis of eye metrics from multiple levels of granularity. The authors incorporate pre-trained object detectors and object instance segmentation models for offline detection of dynamic AOIs in video streams. This research presents the implementation and evaluation of object detectors and object instance segmentation models to find the best model to be integrated in a real-time eye movement analysis pipeline. The authors filter gaze data that falls within the polygonal boundaries of detected dynamic AOIs and apply object detector to find bounding-boxes in a public dataset. The results indicate that the dynamic AOIs generated by object detectors capture 60% of eye movements & object instance segmentation models capture 30% of eye movements.

Using Eye Movements to Study Reading Processes

2017 ◽  
pp. 27-47 ◽  
Author(s):  
Anne E. Cook ◽  
Wei Wei
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Future Research ◽  
Reading Processes ◽  
Reading Measures ◽  
Set Up ◽  
Eye Movements During Reading

This chapter provides an overview of eye movement-based reading measures and the types of inferences that may be drawn from each. We provide logistical advice about how to set up stimuli for eye tracking experiments, with different level processes (word, sentence, and discourse) and commonly employed measures of eye movements during reading in mind. We conclude with examples from our own research of studies of eye movements during reading at the word, sentence, and discourse levels, as well as some considerations for future research.

scholarly journals Chapter 1. Eye-tracking: facts and figures

2018 ◽  
pp. 15-44
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Movement Control ◽  
General Information ◽  
Cognitive Research ◽  
Pros And Cons ◽  
Movement Parameters ◽  
Tracking Devices

In chapter 1 we describe the method of eye-tracking and how the interest to studying eye movements developed in time. We describe how modern eye-tracking devices work, including several most commonly used in cognitive research (SR-Research, SMI, Tobii). We also give some general information about eye movement parameters during reading and a brief over- view of main models of eye movement control in reading (SWIFT, E-Z Reader). These models take into account a significant amount of empirical data and simulate the interaction of oculo- motor and cognitive processes involved in reading. Differences between the models, as well as different interpretations allowed within the same model, reflect the complexity of reading and the ongoing discussion about the processes involved in it. The section ends up with the pros and cons of using LCD and CRT displays in eye-tracking studies.

scholarly journals Rhythmic subvocalization: An eye-tracking study on silent poetry reading

2021 ◽  
Vol 13 (3) ◽  
Author(s):  
Judith Beck ◽  
Lars Konieczny
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Silent Reading ◽  
Local Context ◽  
Two Stage ◽  
Differential Effects ◽  
Poetry Reading ◽  
High Degree

The present study investigates effects of conventionally metered and rhymed poetry on eye-movements in silent reading. Readers saw MRRL poems (i.e., metrically regular, rhymed language) in two layouts. In poem layout, verse endings coincided with line breaks. In prose layout verse endings could be mid-line. We also added metrical and rhyme anomalies. We hypothesized that silently reading MRRL results in building up auditive expectations that are based on a rhythmic “audible gestalt” and propose that rhythmicity is generated through subvocalization. Our results revealed that readers were sensitive to rhythmic-gestalt-anomalies but showed differential effects in poem and prose layouts. Metrical anomalies in particular resulted in robust reading disruptions across a variety of eye-movement measures in the poem layout and caused re-reading of the local context. Rhyme anomalies elicited stronger effects in prose layout and resulted in systematic re-reading of pre-rhymes. The presence or absence of rhythmic-gestalt-anomalies, as well as the layout manipulation, also affected reading in general. Effects of syllable number indicated a high degree of subvocalization. The overall pattern of results suggests that eye-movements reflect, and are closely aligned with, the rhythmic subvocalization of MRRL. This study introduces a two-stage approach to the analysis of long MRRL stimuli and contributes to the discussion of how the processing of rhythm in music and speech may overlap.

scholarly journals Effects of word predictability on eye movements during Arabic reading

2021 ◽  
Author(s):  
Maryam A. AlJassmi ◽  
Kayleigh L. Warrington ◽  
Victoria A. McGowan ◽  
Sarah J. White ◽  
Kevin B. Paterson
Keyword(s):  
Eye Movements ◽  
Eye Movement ◽  
Morphological Characteristics ◽  
Movement Control ◽  
Writing Systems ◽  
Eye Fixations ◽  
Varying Length ◽  
Word Predictability ◽  
Word Skipping ◽  
Alphabetic Writing

AbstractContextual predictability influences both the probability and duration of eye fixations on words when reading Latinate alphabetic scripts like English and German. However, it is unknown whether word predictability influences eye movements in reading similarly for Semitic languages like Arabic, which are alphabetic languages with very different visual and linguistic characteristics. Such knowledge is nevertheless important for establishing the generality of mechanisms of eye-movement control across different alphabetic writing systems. Accordingly, we investigated word predictability effects in Arabic in two eye-movement experiments. Both produced shorter fixation times for words with high compared to low predictability, consistent with previous findings. Predictability did not influence skipping probabilities for (four- to eight-letter) words of varying length and morphological complexity (Experiment 1). However, it did for short (three- to four-letter) words with simpler structures (Experiment 2). We suggest that word-skipping is reduced, and affected less by contextual predictability, in Arabic compared to Latinate alphabetic reading, because of specific orthographic and morphological characteristics of the Arabic script.

scholarly journals Using the Blind Spot to Investigate Trans-Saccadic Perception

Vision ◽  
2021 ◽  
Vol 5 (3) ◽  
pp. 39
Author(s):  
Julie Royo ◽  
Fabrice Arcizet ◽  
Patrick Cavanagh ◽  
Pierre Pouget
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Tracking System ◽  
Blind Spot ◽  
The Gaze ◽  
Gaze Position

We introduce a blind spot method to create image changes contingent on eye movements. One challenge of eye movement research is triggering display changes contingent on gaze. The eye-tracking system must capture the image of the eye, discover and track the pupil and corneal reflections to estimate the gaze position, and then transfer this data to the computer that updates the display. All of these steps introduce delays that are often difficult to predict. To avoid these issues, we describe a simple blind spot method to generate gaze contingent display manipulations without any eye-tracking system and/or display controls.

scholarly journals Eye-movements can help disentangle mechanisms underlying disfluency

2020 ◽  
Author(s):  
Aurélie Pistono ◽  
Robert Hartsuiker
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Lexical Selection ◽  
Self Monitoring ◽  
Speech Encoding ◽  
Movement Data ◽  
Multivariate Pattern

To reveal the underlying cause of disfluency, several authors related the pattern of disfluencies to difficulties at specific levels of production, using a Network Task. However, disfluencies are arguably multifactorial. To disentangle disfluency related to word preparation from other factors, we combined this task with eye-tracking. We manipulated lexical and grammatical selection difficulty. In Experiment 1, lines connecting the pictures varied in length. Experiment 2 only used short lines. In both experiments, lexical selection difficulty promoted self- corrections and pauses and longer viewing times. Multivariate pattern analyses (MVPA) demonstrated that lexical selection difficulty is predictable from disfluency and eye-movement data patterns. In Experiment 1, participants spent less time gazing at pictures preceded by long lines, while producing more pauses. This suggests they used a strategy to inspect other areas than the upcoming picture. We conclude that eye-tracking is informative about mechanisms underlying disfluency related to speech encoding, self-monitoring, and stalling strategies.

scholarly journals Quantitative Analysis of Eye Movements during Singing of Early Childhood Children

2021 ◽  
Vol 4 (3) ◽  
pp. 95-112
Author(s):  
Mina Sano
Keyword(s):  
Early Childhood ◽  
Quantitative Analysis ◽  
Eye Movements ◽  
Eye Tracking ◽  
Eye Movement ◽  
Analysis Of Variance ◽  
Statistical Significance ◽  
Statistical Technique ◽  
Rapid Eye Movement ◽  
Effective Parameters

Early childhood children tend to make musical expressions watching other children or the teacher’s piano accompaniment. However, it has not been inspected yet how eye movement is affected by music. To provide the optimized procedure to capture eye movement’s characteristics reflecting music, the statistical technique was used to evaluate effective parameters. In this study, eye trackers (Tobii Glasses 2) were used to acquire data of eye movements during musical expression of early childhood children and to conduct quantitative analysis. 3-year-old, 4-year-old, and 5- year-old children in two early childhood facilities (n=58) participated in eye-tracking while singing multiple songs of major and minor. This paper focuses on saccade (rapid eye movement) and gaze behaviors of early childhood children and mainly conducts, a three-way analysis of variance (ANOVA) on the acquired data (age * facility*tonality). As a result, it was found that the number of occurrences of saccade and the total moving distances of saccade showed a statistical significance between means regarding differences in the tonality of major/minor key of songs, and childcare forms.

Sign in / Sign up

Export Citation Format

Share Document