scholarly journals Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Author(s):  
Likan Zhan
Author(s):  
Llorenç Andreu ◽  
Mònica Sanz-Torrent

Eye movements have become a commonly used response measure in studies of spoken language processing. These studies are included in the so-called ‘visual world paradigm' in which participants' eye movements are monitored during scene viewing in language comprehension and production activities. In this chapter the most important aspects for running eye-tracking studies in children are revised. Developmental studies using eye movements have increased in the last ten years from babies to adolescents. However, there are only a handful of papers based on the ‘visual world paradigm' that analyze the spoken language in children with language disorders. These studies using eye movements have explored spoken word recognition; verb argument and thematic relations; and narrative comprehension and production. Results has proven eye tracker to be an effective tool for understanding language representation and processing in children with language disorders.


Author(s):  
Michael K. Tanenhaus

Recently, eye movements have become a widely used response measure for studying spoken language processing in both adults and children, in situations where participants comprehend and generate utterances about a circumscribed “Visual World” while fixation is monitored, typically using a free-view eye-tracker. Psycholinguists now use the Visual World eye-movement method to study both language production and language comprehension, in studies that run the gamut of current topics in language processing. Eye movements are a response measure of choice for addressing many classic questions about spoken language processing in psycholinguistics. This article reviews the burgeoning Visual World literature on language comprehension, highlighting some of the seminal studies and examining how the Visual World approach has contributed new insights to our understanding of spoken word recognition, parsing, reference resolution, and interactive conversation. It considers some of the methodological issues that come to the fore when psycholinguists use eye movements to examine spoken language comprehension.


2021 ◽  
pp. 1-32
Author(s):  
Haoyan Ge ◽  
Iris Mulders ◽  
Xin Kang ◽  
Aoju Chen ◽  
Virginia Yip

Abstract This “visual-world” eye-tracking study investigated the processing of focus in English sentences with preverbal only by L2 learners whose L1 was either Cantonese or Dutch, compared to native speakers of English. Participants heard only-sentences with prosodic prominence either on the object or on the verb and viewed pictures containing an object-focus alternative and a verb-focus alternative. We found that both L2 groups showed delayed eye movements to the alternative of focus, which was different from the native speakers of English. Moreover, Dutch learners of English were even slower than Cantonese learners of English in directing fixations to the alternative of focus. We interpreted the delayed fixation patterns in both L2 groups as evidence of difficulties in integrating multiple interfaces in real time. Furthermore, the similarity between English and Dutch in the use of prosody to mark focus hindered Dutch learners’ L2 processing of focus, whereas the difference between English and Cantonese in the realization of focus facilitated Cantonese learners’ processing of focus in English.


Linguistics ◽  
2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Judith Köhne-Fuetterer ◽  
Heiner Drenhaus ◽  
Francesca Delogu ◽  
Vera Demberg

Abstract While there is a substantial amount of evidence for language processing being a highly incremental and predictive process, we still know relatively little about how top-down discourse based expectations are combined with bottom-up information such as discourse connectives. The present article reports on three experiments investigating this question using different methodologies (visual world paradigm and ERPs) in two languages (German and English). We find support for highly incremental processing of causal and concessive discourse connectives, causing anticipation of upcoming material. Our visual world study shows that anticipatory looks depend on the discourse connective; furthermore, the German ERP study revealed an N400 effect on a gender-marked adjective preceding the target noun, when the target noun was inconsistent with the expectations elicited by the combination of context and discourse connective. Moreover, our experiments reveal that the facilitation of downstream material based on earlier connectives comes at the cost of reversing original expectations, as evidenced by a P600 effect on the concessive relative to the causal connective.


Sign in / Sign up

Export Citation Format

Share Document