scholarly journals Divergence point analyses of visual world data: applications to bilingual research

2020 ◽  
pp. 1-9
Author(s):  
Kate Stone ◽  
Sol Lago ◽  
Daniel J. Schad
Keyword(s):  
Confidence Interval ◽  
Eye Tracking ◽  
Language Processing ◽  
Multiple Comparisons ◽  
Individual Factors ◽  
Visual World ◽  
World Data ◽  
Divergence Point ◽  
L2 Processing ◽  
Divergence Points

Abstract Much work has shown that differences in the timecourse of language processing are central to comparing native (L1) and non-native (L2) speakers. However, estimating the onset of experimental effects in timecourse data presents several statistical problems including multiple comparisons and autocorrelation. We compare several approaches to tackling these problems and illustrate them using an L1-L2 visual world eye-tracking dataset. We then present a bootstrapping procedure that allows not only estimation of an effect onset, but also of a temporal confidence interval around this divergence point. We describe how divergence points can be used to demonstrate timecourse differences between speaker groups or between experimental manipulations, two important issues in evaluating L2 processing accounts. We discuss possible extensions of the bootstrapping procedure, including determining divergence points for individual speakers and correlating them with individual factors like L2 exposure and proficiency. Data and an analysis tutorial are available at https://osf.io/exbmk/.

scholarly journals Divergence point analyses of visual world data: applications to bilingual research

2020 ◽  
Author(s):  
Kate Stone ◽  
Sol Lago ◽  
Daniel Schad
Keyword(s):  
Open Access ◽  
Confidence Interval ◽  
Language Processing ◽  
Multiple Comparisons ◽  
Individual Factors ◽  
Visual World ◽  
Divergence Point ◽  
L2 Processing ◽  
Divergence Points ◽  
Language And Cognition

**This paper is now available open access in Bilingualism: Language and Cognition. Please see the Peer-reviewed publication DOI below.** Much work has shown that differences in the timecourse of language processing are central to comparing native (L1) and non-native (L2) speakers. However, estimating the onset of experimental effects in timecourse data presents several statistical problems including multiple comparisons and autocorrelation. We compare several approaches to tackling these problems and illustrate them using an L1-L2 visual world eye-tracking dataset. We then present a bootstrapping procedure that allows not only estimation of an effect onset, but also of a temporal confidence interval around this divergence point. We describe how divergence points can be used to demonstrate timecourse differences between speaker groups or between experimental manipulations, two important issues in evaluating L2 processing accounts. We discuss possible extensions of the bootstrapping procedure, including determining divergence points for individual speakers and correlating them with individual factors like L2 exposure and proficiency. Data and an analysis tutorial are available at https://osf.io/exbmk/.

The processing of passive sentences in German

2020 ◽  
Vol 11 (2) ◽  
pp. 163-195
Author(s):  
Valentina Cristante ◽  
Sarah Schimke
Keyword(s):  
Eye Tracking ◽  
Primary School ◽  
Language Processing ◽  
Empirical Data ◽  
Age Groups ◽  
Visual World ◽  
German Speaking ◽  
Passive Sentence ◽  
Auxiliary Verb ◽  
Age Range

Abstract This study examines the processing and interpretation of passive sentences in German-speaking seven-year-olds, ten-year-olds, and adults. This structure is often assumed to be particularly difficult to understand, and not yet fully mastered in primary school (Kemp, Bredel, & Reich, 2008), i.e. in children aged between six and eleven. Few studies provide empirical data concerning this age range; it is therefore unknown whether this assumption is warranted. Against this background, we tested whether the three age groups differed in their off-line comprehension of passive sentences. In addition, we employed Visual World eye-tracking to measure processing difficulties that may differ between age groups and may not be reflected in the final interpretations. Previous studies on adult language processing in German and English have documented a preference to interpret sentences according to an agent-first strategy. Our results show that all three groups make use of this strategy, and that all of them are able to revise this interpretation once the first cue indicating a passive sentence is encountered (the auxiliary verb form wurde). We conclude that at least from age seven on, children have the linguistic and cognitive prerequisites to process the passive morphosyntax of German and to revise initial sentence misinterpretations.

USING EYE-TRACKING TO INVESTIGATE TOPICS IN L2 ACQUISITION AND L2 PROCESSING

2013 ◽  
Vol 35 (2) ◽  
pp. 213-235 ◽  
Author(s):  
Leah Roberts ◽  
Anna Siyanova-Chanturia
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Target Language ◽  
Tracking Data ◽  
L2 Acquisition ◽  
Tracking Method ◽  
L2 Processing ◽  
Major Benefit ◽  
The Moment

Second language (L2) researchers are becoming more interested in both L2 learners’ knowledge of the target language and how that knowledge is put to use during real-time language processing. Researchers are therefore beginning to see the importance of combining traditional L2 research methods with those that capture the moment-by-moment interpretation of the target language, such as eye-tracking. The major benefit of the eye-tracking method is that it can tap into real-time (or online) comprehension processes during the uninterrupted processing of the input, and thus, the data can be compared to those elicited by other, more metalinguistic tasks to offer a broader picture of language acquisition and processing. In this article, we present an overview of the eye-tracking technique and illustrate the method with L2 studies that show how eye-tracking data can be used to (a) investigate language-related topics and (b) inform key debates in the fields of L2 acquisition and L2 processing.

scholarly journals Spared bottom-up but impaired top-down interactive effects during naturalistic language processing in schizophrenia: evidence from the visual-world paradigm

2018 ◽  
Vol 49 (08) ◽  
pp. 1335-1345 ◽  
Author(s):  
Hugh Rabagliati ◽  
Nathaniel Delaney-Busch ◽  
Jesse Snedeker ◽  
Gina Kuperberg
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Interactive Effects ◽  
Top Down ◽  
Visual World ◽  
Bottom Up ◽  
Lexical Representations ◽  
Spoken Language Processing ◽  
Level Information

AbstractBackgroundPeople with schizophrenia process language in unusual ways, but the causes of these abnormalities are unclear. In particular, it has proven difficult to empirically disentangle explanations based on impairments in the top-down processing of higher level information from those based on the bottom-up processing of lower level information.MethodsTo distinguish these accounts, we used visual-world eye tracking, a paradigm that measures spoken language processing during real-world interactions. Participants listened to and then acted out syntactically ambiguous spoken instructions (e.g. ‘tickle the frog with the feather’, which could either specify how to tickle a frog, or which frog to tickle). We contrasted how 24 people with schizophrenia and 24 demographically matched controls used two types of lower level information (prosody and lexical representations) and two types of higher level information (pragmatic and discourse-level representations) to resolve the ambiguous meanings of these instructions. Eye tracking allowed us to assess how participants arrived at their interpretation in real time, while recordings of participants’ actions measured how they ultimately interpreted the instructions.ResultsWe found a striking dissociation in participants’ eye movements: the two groups were similarly adept at using lower level information to immediately constrain their interpretations of the instructions, but only controls showed evidence of fast top-down use of higher level information. People with schizophrenia, nonetheless, did eventually reach the same interpretations as controls.ConclusionsThese data suggest that language abnormalities in schizophrenia partially result from a failure to use higher level information in a top-down fashion, to constrain the interpretation of language as it unfolds in real time.

scholarly journals Using eye-tracking to investigate topics in L2 acquisition and L2 sentence and discourse processing

2021 ◽  
Author(s):  
L Roberts ◽  
Anna Siyanova
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Discourse Processing ◽  
Target Language ◽  
L2 Acquisition ◽  
Cambridge University ◽  
L2 Processing ◽  
Major Benefit ◽  
The Moment

Second language (L2) researchers are becoming more interested in both L2 learners' knowledge of the target language and how that knowledge is put to use during real-time language processing. Researchers are therefore beginning to see the importance of combining traditional L2 research methods with those that capture the moment-by-moment interpretation of the target language, such as eye-tracking. The major benefit of the eye-tracking method is that it can tap into real-time (or online) comprehension processes during the uninterrupted processing of the input, and thus, the data can be compared to those elicited by other, more metalinguistic tasks to offer a broader picture of language acquisition and processing. In this article, we present an overview of the eye-tracking technique and illustrate the method with L2 studies that show how eye-tracking data can be used to (a) investigate language-related topics and (b) inform key debates in the fields of L2 acquisition and L2 processing. Copyright © Cambridge University Press 2013.

scholarly journals Using eye-tracking to investigate topics in L2 acquisition and L2 sentence and discourse processing

2021 ◽  
Author(s):  
L Roberts ◽  
Anna Siyanova
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Discourse Processing ◽  
Target Language ◽  
L2 Acquisition ◽  
Cambridge University ◽  
L2 Processing ◽  
Major Benefit ◽  
The Moment

Second language (L2) researchers are becoming more interested in both L2 learners' knowledge of the target language and how that knowledge is put to use during real-time language processing. Researchers are therefore beginning to see the importance of combining traditional L2 research methods with those that capture the moment-by-moment interpretation of the target language, such as eye-tracking. The major benefit of the eye-tracking method is that it can tap into real-time (or online) comprehension processes during the uninterrupted processing of the input, and thus, the data can be compared to those elicited by other, more metalinguistic tasks to offer a broader picture of language acquisition and processing. In this article, we present an overview of the eye-tracking technique and illustrate the method with L2 studies that show how eye-tracking data can be used to (a) investigate language-related topics and (b) inform key debates in the fields of L2 acquisition and L2 processing. Copyright © Cambridge University Press 2013.

Processing focus in native and non-native speakers of English: an eye-tracking study in the visual world paradigm

2021 ◽  
pp. 1-32
Author(s):  
Haoyan Ge ◽  
Iris Mulders ◽  
Xin Kang ◽  
Aoju Chen ◽  
Virginia Yip
Keyword(s):  
Eye Movements ◽  
Eye Tracking ◽  
Real Time ◽  
Native Speakers ◽  
Visual World ◽  
Visual World Paradigm ◽  
L2 Processing ◽  
Multiple Interfaces ◽  
Native Speakers Of English ◽  
The Difference

Abstract This “visual-world” eye-tracking study investigated the processing of focus in English sentences with preverbal only by L2 learners whose L1 was either Cantonese or Dutch, compared to native speakers of English. Participants heard only-sentences with prosodic prominence either on the object or on the verb and viewed pictures containing an object-focus alternative and a verb-focus alternative. We found that both L2 groups showed delayed eye movements to the alternative of focus, which was different from the native speakers of English. Moreover, Dutch learners of English were even slower than Cantonese learners of English in directing fixations to the alternative of focus. We interpreted the delayed fixation patterns in both L2 groups as evidence of difficulties in integrating multiple interfaces in real time. Furthermore, the similarity between English and Dutch in the use of prosody to mark focus hindered Dutch learners’ L2 processing of focus, whereas the difference between English and Cantonese in the realization of focus facilitated Cantonese learners’ processing of focus in English.

scholarly journals Incremental processing of telicity in Italian children

2021 ◽  
Vol 1 ◽  
pp. 71
Author(s):  
Jasmijn E. Bosch ◽  
Mathilde Chailleux ◽  
Francesca Foppolo
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Lexical Semantics ◽  
Semantic Meaning ◽  
Additional Time ◽  
Visual World ◽  
Visual World Paradigm ◽  
Incremental Processing ◽  
Final Interpretation ◽  
Italian Children

A sentence like 'Lyn has peeled the apple' triggers two types of inferences: a telicity inference that the event is telic; and a culmination inference that the event has reached its telos and has stopped. This results in the final interpretation of the sentence that Lyn has completely peeled the apple. We present an eye-tracking study to test children's ability to predict the upcoming noun (e.g., the apple) during the incremental processing of sentences like 'Look at the picture in which he/she has peeled the…' in which the predicate is telic and the verb appears in the perfective form. By means of the Visual World Paradigm, we aimed to investigate children's ability to use the lexical semantics and aspectual morphology of verbs during language processing. To test if children can predict the target (e.g., a completely peeled apple) by exploiting the lexical-semantic meaning of the verb, we contrasted the target picture with a picture of an object that cannot be peeled; to test if they can predict on the basis of the verb's perfective morphology, we compared the target with the picture of a half-peeled apple. Our results show that Italian children can anticipate the upcoming noun in both cases, providing evidence that children can exploit the morphosyntactic cue on the verb (perfective aspect) to incrementally derive the culmination inference that the telos is reached and the event is completed. We also show that the integration of aspect requires some additional time compared to the integration of the basic lexical semantics of the verb.

Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension

2010 ◽  
Vol 57 (1) ◽  
pp. 5-16 ◽  
Author(s):  
Pirita Pyykkönen ◽  
Juhani Järvikivi
Keyword(s):  
Eye Tracking ◽  
Language Comprehension ◽  
Spoken Language ◽  
Visual World ◽  
Implicit Causality ◽  
Causality Information ◽  
Spoken Language Comprehension

A visual world eye-tracking study investigated the activation and persistence of implicit causality information in spoken language comprehension. We showed that people infer the implicit causality of verbs as soon as they encounter such verbs in discourse, as is predicted by proponents of the immediate focusing account ( Greene & McKoon, 1995 ; Koornneef & Van Berkum, 2006 ; Van Berkum, Koornneef, Otten, & Nieuwland, 2007 ). Interestingly, we observed activation of implicit causality information even before people encountered the causal conjunction. However, while implicit causality information was persistent as the discourse unfolded, it did not have a privileged role as a focusing cue immediately at the ambiguous pronoun when people were resolving its antecedent. Instead, our study indicated that implicit causality does not affect all referents to the same extent, rather it interacts with other cues in the discourse, especially when one of the referents is already prominently in focus.

The Opposition of Surprisal and Semantic Similarity in the Prediction of Language Processing: Evidence from Eye-tracking Data

2020 ◽  
Author(s):  
Kun Sun
Keyword(s):  
Eye Tracking ◽  
Semantic Similarity ◽  
Cognitive Processing ◽  
Language Processing ◽  
Language Comprehension ◽  
Word Processing ◽  
Reading Time ◽  
Computational Models ◽  
Tracking Data ◽  
Dynamic Approach

Expectations or predictions about upcoming content play an important role during language comprehension and processing. One important aspect of recent studies of language comprehension and processing concerns the estimation of the upcoming words in a sentence or discourse. Many studies have used eye-tracking data to explore computational and cognitive models for contextual word predictions and word processing. Eye-tracking data has previously been widely explored with a view to investigating the factors that influence word prediction. However, these studies are problematic on several levels, including the stimuli, corpora, statistical tools they applied. Although various computational models have been proposed for simulating contextual word predictions, past studies usually preferred to use a single computational model. The disadvantage of this is that it often cannot give an adequate account of cognitive processing in language comprehension. To avoid these problems, this study draws upon a massive natural and coherent discourse as stimuli in collecting the data on reading time. This study trains two state-of-art computational models (surprisal and semantic (dis)similarity from word vectors by linear discriminative learning (LDL)), measuring knowledge of both the syntagmatic and paradigmatic structure of language. We develop a `dynamic approach' to compute semantic (dis)similarity. It is the first time that these two computational models have been merged. Models are evaluated using advanced statistical methods. Meanwhile, in order to test the efficiency of our approach, one recently developed cosine method of computing semantic (dis)similarity based on word vectors data adopted is used to compare with our `dynamic' approach. The two computational and fixed-effect statistical models can be used to cross-verify the findings, thus ensuring that the result is reliable. All results support that surprisal and semantic similarity are opposed in the prediction of the reading time of words although both can make good predictions. Additionally, our `dynamic' approach performs better than the popular cosine method. The findings of this study are therefore of significance with regard to acquiring a better understanding how humans process words in a real-world context and how they make predictions in language cognition and processing.

Sign in / Sign up

Export Citation Format

Share Document