scholarly journals Look before you leap

2014 ◽  
Vol 4 (1) ◽  
pp. 3-24 ◽  
Author(s):  
Ruth Koops van ’t Jagt ◽  
John Hoeks ◽  
Gillis J. Dorleijn ◽  
Petra Hendriks
Keyword(s):  
Eye Tracking ◽  
Dynamic Model ◽  
Language Processing ◽  
Reading Patterns ◽  
Physical Layout ◽  
Integrative Processes

This study describes two eye tracking experiments investigating the processing of poetry with and without enjambments. In Experiment 1, poetic fragments with authentic prospective (syntactically incomplete) or retrospective (syntactically complete) enjambments were investigated; in Experiment 2, enjambments were created — for the purpose of the experiment — from poetry that did not originally contain enjambments. We hypothesized that the layout of the text in poetic fragments would affect the degree to which integrative processes take place: in case of prospective enjambments, the syntactic incompleteness may preclude integration at the end of the line (before going to the next line), whereas retrospective enjambments may cause considerable re-interpretation at the next line. We indeed found significant differences in reading patterns between prose and poetry, poetry with and without enjambment, and poetry with prospective and retrospective enjambment. We interpret these results as favoring a dynamic model of language processing, where the amount and type of integration is determined by syntactic (in)completeness, semantic (in)completeness, but also the physical layout of the text.

The Opposition of Surprisal and Semantic Similarity in the Prediction of Language Processing: Evidence from Eye-tracking Data

2020 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Eye Tracking ◽  
Semantic Similarity ◽  
Cognitive Processing ◽  
Language Processing ◽  
Language Comprehension ◽  
Word Processing ◽  
Reading Time ◽  
Computational Models ◽  
Tracking Data ◽  
Dynamic Approach

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.

scholarly journals Mining reading patterns from eye-tracking data: method and demonstration

2019 ◽  
Vol 19 (2) ◽  
pp. 345-369 ◽  
Author(s):  
Constantina Ioannou ◽  
Indira Nurdiani ◽  
Andrea Burattin ◽  
Barbara Weber
Keyword(s):  
Eye Tracking ◽  
Tracking Data ◽  
Reading Patterns

scholarly journals Visual Patterns in Reading Tasks: An Eye-Tracking Analysis of Meares-Irlen Syndrome Simulation Effects

2019 ◽  
Author(s):  
João Vitor Macedo Romera ◽  
Rafael Nobre Orsi ◽  
Rodrigo Filev Maia ◽  
Carlos Eduardo Thomaz
Keyword(s):  
Visual Perception ◽  
Eye Tracking ◽  
High Accuracy ◽  
Cognitive System ◽  
Visual Patterns ◽  
Irlen Syndrome ◽  
Visual Stress ◽  
Reading Patterns

This work investigates reading patterns based on effects of the Meares-Irlen Syndrome (SMI), a visual-perception deficit that affects indirectly our cognitive system. The most common symptoms related to SMI in reading tasks are visual stress, sensation of moving letters and distortions in the text. These effects have been computationally simulated here and using eye-tracking information of a number of participants we have been able to linearly classify each effects with high accuracy.

scholarly journals A Survey on Using Gaze Behaviour for Natural Language Processing

2020 ◽  
Author(s):  
Sandeep Mathias ◽  
Diptesh Kanojia ◽  
Abhijit Mishra ◽  
Pushpak Bhattacharya
Keyword(s):  
Natural Language Processing ◽  
Natural Language ◽  
Eye Tracking ◽  
Language Processing ◽  
Word Identification ◽  
Test Time ◽  
Gaze Behaviour ◽  
Cognitive Information ◽  
Essay Grading ◽  
Multiple Languages

Gaze behaviour has been used as a way to gather cognitive information for a number of years. In this paper, we discuss the use of gaze behaviour in solving different tasks in natural language processing (NLP) without having to record it at test time. This is because the collection of gaze behaviour is a costly task, both in terms of time and money. Hence, in this paper, we focus on research done to alleviate the need for recording gaze behaviour at run time. We also mention different eye tracking corpora in multiple languages, which are currently available and can be used in natural language processing. We conclude our paper by discussing applications in a domain - education - and how learning gaze behaviour can help in solving the tasks of complex word identification and automatic essay grading.

scholarly journals The male bias of a masculine generic pronoun: Evidence from eye-tracking and sentence evaluation

2020 ◽  
Author(s):  
Theresa Redl ◽  
Stefan L. Frank ◽  
Peter de Swart ◽  
Helen de Hoop
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Possessive Pronoun ◽  
Male Bias ◽  
Gender Information

Two experiments tested whether the Dutch possessive pronoun zijn ‘his’ gives rise to a gender inference and thus causes a male bias when used generically in sentences such as Everyone was putting on his shoes. Experiment 1 (N = 120, 48 male) was a conceptual replication of a previous eye-tracking study that had not found evidence of a male bias. The results of the current eye-tracking experiment showed the masculine generic pronoun to trigger a gender inference and cause a male bias, but for male participants and in neutral stereotype contexts only. No evidence for a male bias was thus found in stereotypically female and male contexts and for female participants altogether. Experiment 2 (N = 80, 40 male) used the same stimuli as Experiment 1, but employed the sentence evaluation paradigm. No evidence of a male bias was found in Experiment 2. Taken together, the results suggest that the masculine generic pronoun zijn ‘his’ can cause a male bias for male participants when no other gender information is provided, but only surfaces with a method such as eye-tracking, which taps directly into automatic language processing. Furthermore, the results suggest that the intended generic reading of the masculine possessive pronoun zijn ‘his’ is readily available for women.

scholarly journals Divergence point analyses of visual world data: applications to bilingual research

2020 ◽  
pp. 1-9
Author(s):  
Kate Stone ◽  
Sol Lago ◽  
Daniel J. Schad
Keyword(s):  
Confidence Interval ◽  
Eye Tracking ◽  
Language Processing ◽  
Multiple Comparisons ◽  
Individual Factors ◽  
Visual World ◽  
World Data ◽  
Divergence Point ◽  
L2 Processing ◽  
Divergence Points

Abstract Much work has shown that differences in the timecourse of language processing are central to comparing native (L1) and non-native (L2) speakers. However, estimating the onset of experimental effects in timecourse data presents several statistical problems including multiple comparisons and autocorrelation. We compare several approaches to tackling these problems and illustrate them using an L1-L2 visual world eye-tracking dataset. We then present a bootstrapping procedure that allows not only estimation of an effect onset, but also of a temporal confidence interval around this divergence point. We describe how divergence points can be used to demonstrate timecourse differences between speaker groups or between experimental manipulations, two important issues in evaluating L2 processing accounts. We discuss possible extensions of the bootstrapping procedure, including determining divergence points for individual speakers and correlating them with individual factors like L2 exposure and proficiency. Data and an analysis tutorial are available at https://osf.io/exbmk/.

scholarly journals Monolingual and bilingual children's processing of coarticulation cues during spoken word recognition

2020 ◽  
Vol 47 (6) ◽  
pp. 1189-1206
Author(s):  
Félix DESMEULES-TRUDEL ◽  
Charlotte MOORE ◽  
Tania S. ZAMUNER
Keyword(s):  
Word Recognition ◽  
Eye Tracking ◽  
Old English ◽  
Language Processing ◽  
Spoken Word Recognition ◽  
Spoken Word ◽  
Bilingual Children ◽  
Phonetic Cues ◽  
Vowel Nasalization ◽  
English Monolingual

AbstractBilingual children cope with a significant amount of phonetic variability when processing speech, and must learn to weigh phonetic cues differently depending on the cues’ respective roles in their two languages. For example, vowel nasalization is coarticulatory and contrastive in French, but coarticulatory-only in English. In this study, we extended an investigation of the processing of coarticulation in two- to three-year-old English monolingual children (Zamuner, Moore & Desmeules-Trudel, 2016) to a group of four- to six-year-old English monolingual children and age-matched English–French bilingual children. Using eye tracking, we found that older monolingual children and age-matched bilingual children showed more sensitivity to coarticulation cues than the younger children. Moreover, when comparing the older monolinguals and bilinguals, we found no statistical differences between the two groups. These results offer support for the specification of coarticulation in word representations, and indicate that, in some cases, bilingual children possess language processing skills similar to monolinguals.

Sign in / Sign up

Export Citation Format

Share Document