Eye Tracking and Spoken Language Comprehension

2017 ◽  
pp. 88-105
Author(s):  
Elizabeth Kaplan ◽  
Tatyana Levari ◽  
Jesse Snedeker
Keyword(s):  
Young Children ◽  
Eye Tracking ◽  
Language Processing ◽  
Language Comprehension ◽  
Developmental Disorders ◽  
Spoken Language ◽  
Syntactic Analysis ◽  
Primary Focus ◽  
Insight Into ◽  
Spoken Language Comprehension

Constructing a more precise and deeper understanding of how listeners, and particularly young children, comprehend spoken language is a primary focus for both psycholinguists and educators alike. This chapter highlights how, over the course of the past 20 years, eye tracking has become a crucial and widely used methodology to gain insight into online spoken language comprehension. We address how various eye-tracking paradigms have informed current theories of language comprehension across the processing stream, focusing on lexical discrimination, syntactic analysis, and pragmatic inferences. Additionally, this chapter aims to bridge the gap between psycholinguistic research and educational topics, such as how early linguistic experiences influence later educational outcomes and ways in which eye-tracking methods can provide additional insight into the language processing of children with developmental disorders.

Eye Tracking and Spoken Language Comprehension

2019 ◽  
pp. 642-659
Author(s):  
Elizabeth Kaplan ◽  
Tatyana Levari ◽  
Jesse Snedeker
Keyword(s):  
Young Children ◽  
Eye Tracking ◽  
Language Processing ◽  
Language Comprehension ◽  
Developmental Disorders ◽  
Spoken Language ◽  
Syntactic Analysis ◽  
Primary Focus ◽  
Insight Into ◽  
Spoken Language Comprehension

Constructing a more precise and deeper understanding of how listeners, and particularly young children, comprehend spoken language is a primary focus for both psycholinguists and educators alike. This chapter highlights how, over the course of the past 20 years, eye tracking has become a crucial and widely used methodology to gain insight into online spoken language comprehension. We address how various eye-tracking paradigms have informed current theories of language comprehension across the processing stream, focusing on lexical discrimination, syntactic analysis, and pragmatic inferences. Additionally, this chapter aims to bridge the gap between psycholinguistic research and educational topics, such as how early linguistic experiences influence later educational outcomes and ways in which eye-tracking methods can provide additional insight into the language processing of children with developmental disorders.

scholarly journals Fronto-temporal brain systems supporting spoken language comprehension

2007 ◽  
Vol 363 (1493) ◽  
pp. 1037-1054 ◽  
Author(s):  
Lorraine K Tyler ◽  
William Marslen-Wilson
Keyword(s):  
Functional Connectivity ◽  
Language Processing ◽  
Language Comprehension ◽  
Critical Role ◽  
Spoken Language ◽  
Semantic Interpretation ◽  
Syntactic Analysis ◽  
Connectivity Analysis ◽  
Sentence Level ◽  
Spoken Language Comprehension

The research described here combines psycholinguistically well-motivated questions about different aspects of human language comprehension with behavioural and neuroimaging studies of normal performance, incorporating both subtractive analysis techniques and functional connectivity methods, and applying these tasks and techniques to the analysis of the functional and neural properties of brain-damaged patients with selective linguistic deficits in the relevant domains. The results of these investigations point to a set of partially dissociable sub-systems supporting three major aspects of spoken language comprehension, involving regular inflectional morphology, sentence-level syntactic analysis and sentence-level semantic interpretation. Differential patterns of fronto-temporal connectivity for these three domains confirm that the core aspects of language processing are carried out in a fronto-temporo-parietal language system which is modulated in different ways as a function of different linguistic processing requirements. No one region or sub-region holds the key to a specific language function; each requires the coordination of activity within a number of different regions. Functional connectivity analysis plays the critical role of indicating the regions which directly participate in a given sub-process, by virtue of their joint time-dependent activity. By revealing these codependencies, connectivity analysis sharpens the pattern of structure–function relations underlying specific aspects of language performance.

Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension

2010 ◽  
Vol 57 (1) ◽  
pp. 5-16 ◽  
Author(s):  
Pirita Pyykkönen ◽  
Juhani Järvikivi
Keyword(s):  
Eye Tracking ◽  
Language Comprehension ◽  
Spoken Language ◽  
Visual World ◽  
Implicit Causality ◽  
Causality Information ◽  
Spoken Language Comprehension

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.

Spoken language comprehension: insights from eye movements

2007 ◽  
pp. 308-326 ◽  
Author(s):  
Michael K. Tanenhaus
Keyword(s):  
Eye Movements ◽  
Language Processing ◽  
Language Comprehension ◽  
Language Production ◽  
World Literature ◽  
Spoken Language ◽  
Response Measure ◽  
Visual World ◽  
Spoken Language Processing ◽  
Spoken Language Comprehension

Recently, eye movements have become a widely used response measure for studying spoken language processing in both adults and children, in situations where participants comprehend and generate utterances about a circumscribed “Visual World” while fixation is monitored, typically using a free-view eye-tracker. Psycholinguists now use the Visual World eye-movement method to study both language production and language comprehension, in studies that run the gamut of current topics in language processing. Eye movements are a response measure of choice for addressing many classic questions about spoken language processing in psycholinguistics. This article reviews the burgeoning Visual World literature on language comprehension, highlighting some of the seminal studies and examining how the Visual World approach has contributed new insights to our understanding of spoken word recognition, parsing, reference resolution, and interactive conversation. It considers some of the methodological issues that come to the fore when psycholinguists use eye movements to examine spoken language comprehension.

Activating Gender Stereotypes During Online Spoken Language Processing

2010 ◽  
Vol 57 (2) ◽  
pp. 126-133 ◽  
Author(s):  
Pirita Pyykkönen ◽  
Jukka Hyönä ◽  
Roger P. G. van Gompel
Keyword(s):  
Eye Tracking ◽  
Mental Models ◽  
Language Processing ◽  
Gender Stereotypes ◽  
Language Comprehension ◽  
Spoken Language ◽  
World Knowledge ◽  
Tracking Method ◽  
Spoken Language Processing ◽  
Coherence Relation

This study used the visual world eye-tracking method to investigate activation of general world knowledge related to gender-stereotypical role names in online spoken language comprehension in Finnish. The results showed that listeners activated gender stereotypes elaboratively in story contexts where this information was not needed to build coherence. Furthermore, listeners made additional inferences based on gender stereotypes to revise an already established coherence relation. Both results are consistent with mental models theory (e.g., Garnham, 2001 ). They are harder to explain by the minimalist account ( McKoon & Ratcliff, 1992 ), which suggests that people limit inferences to those needed to establish coherence in discourse.

Working Memory and Spoken Language Comprehension in Young Children

1999 ◽  
Vol 34 (5-6) ◽  
pp. 364-373 ◽  
Author(s):  
Anne-Marie Adams ◽  
Lorna Bourke ◽  
Catherine Willis
Keyword(s):  
Working Memory ◽  
Young Children ◽  
Language Comprehension ◽  
Spoken Language ◽  
Spoken Language Comprehension

The Opposition of Surprisal and Semantic Similarity in the Prediction of Language Processing: Evidence from Eye-tracking Data

2020 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Eye Tracking ◽  
Semantic Similarity ◽  
Cognitive Processing ◽  
Language Processing ◽  
Language Comprehension ◽  
Word Processing ◽  
Reading Time ◽  
Computational Models ◽  
Tracking Data ◽  
Dynamic Approach

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.

Sign in / Sign up

Export Citation Format

Share Document