scholarly journals Spared bottom-up but impaired top-down interactive effects during naturalistic language processing in schizophrenia: evidence from the visual-world paradigm

2018 ◽  
Vol 49 (08) ◽  
pp. 1335-1345 ◽  
Author(s):  
Hugh Rabagliati ◽  
Nathaniel Delaney-Busch ◽  
Jesse Snedeker ◽  
Gina Kuperberg
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Interactive Effects ◽  
Top Down ◽  
Visual World ◽  
Bottom Up ◽  
Lexical Representations ◽  
Spoken Language Processing ◽  
Level Information

AbstractBackgroundPeople with schizophrenia process language in unusual ways, but the causes of these abnormalities are unclear. In particular, it has proven difficult to empirically disentangle explanations based on impairments in the top-down processing of higher level information from those based on the bottom-up processing of lower level information.MethodsTo distinguish these accounts, we used visual-world eye tracking, a paradigm that measures spoken language processing during real-world interactions. Participants listened to and then acted out syntactically ambiguous spoken instructions (e.g. ‘tickle the frog with the feather’, which could either specify how to tickle a frog, or which frog to tickle). We contrasted how 24 people with schizophrenia and 24 demographically matched controls used two types of lower level information (prosody and lexical representations) and two types of higher level information (pragmatic and discourse-level representations) to resolve the ambiguous meanings of these instructions. Eye tracking allowed us to assess how participants arrived at their interpretation in real time, while recordings of participants’ actions measured how they ultimately interpreted the instructions.ResultsWe found a striking dissociation in participants’ eye movements: the two groups were similarly adept at using lower level information to immediately constrain their interpretations of the instructions, but only controls showed evidence of fast top-down use of higher level information. People with schizophrenia, nonetheless, did eventually reach the same interpretations as controls.ConclusionsThese data suggest that language abnormalities in schizophrenia partially result from a failure to use higher level information in a top-down fashion, to constrain the interpretation of language as it unfolds in real time.

scholarly journals Limits on expectation-based processing: Use of grammatical aspect for co-reference in L2

2020 ◽  
pp. 1-25
Author(s):  
Theres Grüter ◽  
Hannah Rohde
Keyword(s):  
Real Time ◽  
Language Processing ◽  
Judgment Task ◽  
Linguistic Knowledge ◽  
Real Time Processing ◽  
Time Processing ◽  
Grammatical Aspect ◽  
Level Information ◽  
Native Speakers Of English ◽  
Reference Processing

Abstract This study examines the use of discourse-level information to create expectations about reference in real-time processing, testing whether patterns previously observed among native speakers of English generalize to nonnative speakers. Findings from a visual-world eye-tracking experiment show that native (L1; N = 53) but not nonnative (L2; N = 52) listeners’ proactive coreference expectations are modulated by grammatical aspect in transfer-of-possession events. Results from an offline judgment task show these L2 participants did not differ from L1 speakers in their interpretation of aspect marking on transfer-of-possession predicates in English, indicating it is not lack of linguistic knowledge but utilization of this knowledge in real-time processing that distinguishes the groups. English proficiency, although varying substantially within the L2 group, did not modulate L2 listeners’ use of grammatical aspect for reference processing. These findings contribute to the broader endeavor of delineating the role of prediction in human language processing in general, and in the processing of discourse-level information among L2 users in particular.

Spoken language comprehension: insights from eye movements

2007 ◽  
pp. 308-326 ◽  
Author(s):  
Michael K. Tanenhaus
Keyword(s):  
Eye Movements ◽  
Language Processing ◽  
Language Comprehension ◽  
Language Production ◽  
World Literature ◽  
Spoken Language ◽  
Response Measure ◽  
Visual World ◽  
Spoken Language Processing ◽  
Spoken Language Comprehension

Recently, eye movements have become a widely used response measure for studying spoken language processing in both adults and children, in situations where participants comprehend and generate utterances about a circumscribed “Visual World” while fixation is monitored, typically using a free-view eye-tracker. Psycholinguists now use the Visual World eye-movement method to study both language production and language comprehension, in studies that run the gamut of current topics in language processing. Eye movements are a response measure of choice for addressing many classic questions about spoken language processing in psycholinguistics. This article reviews the burgeoning Visual World literature on language comprehension, highlighting some of the seminal studies and examining how the Visual World approach has contributed new insights to our understanding of spoken word recognition, parsing, reference resolution, and interactive conversation. It considers some of the methodological issues that come to the fore when psycholinguists use eye movements to examine spoken language comprehension.

scholarly journals Divergence point analyses of visual world data: applications to bilingual research

2020 ◽  
pp. 1-9
Author(s):  
Kate Stone ◽  
Sol Lago ◽  
Daniel J. Schad
Keyword(s):  
Confidence Interval ◽  
Eye Tracking ◽  
Language Processing ◽  
Multiple Comparisons ◽  
Individual Factors ◽  
Visual World ◽  
World Data ◽  
Divergence Point ◽  
L2 Processing ◽  
Divergence Points

Abstract Much work has shown that differences in the timecourse of language processing are central to comparing native (L1) and non-native (L2) speakers. However, estimating the onset of experimental effects in timecourse data presents several statistical problems including multiple comparisons and autocorrelation. We compare several approaches to tackling these problems and illustrate them using an L1-L2 visual world eye-tracking dataset. We then present a bootstrapping procedure that allows not only estimation of an effect onset, but also of a temporal confidence interval around this divergence point. We describe how divergence points can be used to demonstrate timecourse differences between speaker groups or between experimental manipulations, two important issues in evaluating L2 processing accounts. We discuss possible extensions of the bootstrapping procedure, including determining divergence points for individual speakers and correlating them with individual factors like L2 exposure and proficiency. Data and an analysis tutorial are available at https://osf.io/exbmk/.

The processing of passive sentences in German

2020 ◽  
Vol 11 (2) ◽  
pp. 163-195
Author(s):  
Valentina Cristante ◽  
Sarah Schimke
Keyword(s):  
Eye Tracking ◽  
Primary School ◽  
Language Processing ◽  
Empirical Data ◽  
Age Groups ◽  
Visual World ◽  
German Speaking ◽  
Passive Sentence ◽  
Auxiliary Verb ◽  
Age Range

Abstract This study examines the processing and interpretation of passive sentences in German-speaking seven-year-olds, ten-year-olds, and adults. This structure is often assumed to be particularly difficult to understand, and not yet fully mastered in primary school (Kemp, Bredel, & Reich, 2008), i.e. in children aged between six and eleven. Few studies provide empirical data concerning this age range; it is therefore unknown whether this assumption is warranted. Against this background, we tested whether the three age groups differed in their off-line comprehension of passive sentences. In addition, we employed Visual World eye-tracking to measure processing difficulties that may differ between age groups and may not be reflected in the final interpretations. Previous studies on adult language processing in German and English have documented a preference to interpret sentences according to an agent-first strategy. Our results show that all three groups make use of this strategy, and that all of them are able to revise this interpretation once the first cue indicating a passive sentence is encountered (the auxiliary verb form wurde). We conclude that at least from age seven on, children have the linguistic and cognitive prerequisites to process the passive morphosyntax of German and to revise initial sentence misinterpretations.

USING EYE-TRACKING TO INVESTIGATE TOPICS IN L2 ACQUISITION AND L2 PROCESSING

2013 ◽  
Vol 35 (2) ◽  
pp. 213-235 ◽  
Author(s):  
Leah Roberts ◽  
Anna Siyanova-Chanturia
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Target Language ◽  
Tracking Data ◽  
L2 Acquisition ◽  
Tracking Method ◽  
L2 Processing ◽  
Major Benefit ◽  
The Moment

Second language (L2) researchers are becoming more interested in both L2 learners’ knowledge of the target language and how that knowledge is put to use during real-time language processing. Researchers are therefore beginning to see the importance of combining traditional L2 research methods with those that capture the moment-by-moment interpretation of the target language, such as eye-tracking. The major benefit of the eye-tracking method is that it can tap into real-time (or online) comprehension processes during the uninterrupted processing of the input, and thus, the data can be compared to those elicited by other, more metalinguistic tasks to offer a broader picture of language acquisition and processing. In this article, we present an overview of the eye-tracking technique and illustrate the method with L2 studies that show how eye-tracking data can be used to (a) investigate language-related topics and (b) inform key debates in the fields of L2 acquisition and L2 processing.

scholarly journals When too many vowels impede language processing: An eye-tracking study of Danish-learning children

2019 ◽  
Author(s):  
Fabio Trecca ◽  
Dorthe Bleses ◽  
Anders Højen ◽  
Thomas O. Madsen ◽  
Morten H. Christiansen
Keyword(s):  
Language Acquisition ◽  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Speech Processing ◽  
Word Segmentation ◽  
Word Boundary ◽  
Early Language ◽  
Acquisition Process ◽  
Word Boundaries

Research has suggested that Danish-learning children lag behind in early language acquisition. The phenomenon has been attributed to the opaque phonetic structure of Danish, which features an unusually large number of non-consonantal sounds (i.e., vowels and semivowels/glides). The large amount of vocalic sounds in speech is thought to provide fewer cues to word segmentation and to make language processing harder, thus hindering the acquisition process. In this study, we explored whether the presence of vocalic sounds at word boundaries impedes real-time speech processing in 24-month-old Danish-learning children, compared to word boundaries that are marked by consonantal sounds. Using eye-tracking, we tested children’s real-time comprehension of known consonant-initial and vowel-initial words, when presented in either a consonant-final carrier phrase or in a vowel-final carrier phrase, thus resulting in the four boundary types C#C, C#V, V#C, and V#V. Our results showed that the presence of vocalic sounds around a word boundary—especially before—impedes processing of Danish child-directed sentences.

scholarly journals Do Musicians and Non-musicians Differ in Speech-on-Speech Processing?

2021 ◽  
Vol 12 ◽  
Author(s):  
Elif Canseza Kaplan ◽  
Anita E. Wagner ◽  
Paolo Toffanin ◽  
Deniz Başkent
Keyword(s):  
Speech Perception ◽  
Eye Tracking ◽  
Language Processing ◽  
Speech Processing ◽  
Time Course ◽  
Spoken Language ◽  
Recall Task ◽  
Spoken Language Processing ◽  
Sentence Recall ◽  
Gaze Fixations

Earlier studies have shown that musically trained individuals may have a benefit in adverse listening situations when compared to non-musicians, especially in speech-on-speech perception. However, the literature provides mostly conflicting results. In the current study, by employing different measures of spoken language processing, we aimed to test whether we could capture potential differences between musicians and non-musicians in speech-on-speech processing. We used an offline measure of speech perception (sentence recall task), which reveals a post-task response, and online measures of real time spoken language processing: gaze-tracking and pupillometry. We used stimuli of comparable complexity across both paradigms and tested the same groups of participants. In the sentence recall task, musicians recalled more words correctly than non-musicians. In the eye-tracking experiment, both groups showed reduced fixations to the target and competitor words’ images as the level of speech maskers increased. The time course of gaze fixations to the competitor did not differ between groups in the speech-in-quiet condition, while the time course dynamics did differ between groups as the two-talker masker was added to the target signal. As the level of two-talker masker increased, musicians showed reduced lexical competition as indicated by the gaze fixations to the competitor. The pupil dilation data showed differences mainly in one target-to-masker ratio. This does not allow to draw conclusions regarding potential differences in the use of cognitive resources between groups. Overall, the eye-tracking measure enabled us to observe that musicians may be using a different strategy than non-musicians to attain spoken word recognition as the noise level increased. However, further investigation with more fine-grained alignment between the processes captured by online and offline measures is necessary to establish whether musicians differ due to better cognitive control or sound processing.

scholarly journals Using eye-tracking to investigate topics in L2 acquisition and L2 sentence and discourse processing

2021 ◽  
Author(s):  
L Roberts ◽  
Anna Siyanova
Keyword(s):  
Eye Tracking ◽  
Real Time ◽  
Language Processing ◽  
Discourse Processing ◽  
Target Language ◽  
L2 Acquisition ◽  
Cambridge University ◽  
L2 Processing ◽  
Major Benefit ◽  
The Moment

Second language (L2) researchers are becoming more interested in both L2 learners' knowledge of the target language and how that knowledge is put to use during real-time language processing. Researchers are therefore beginning to see the importance of combining traditional L2 research methods with those that capture the moment-by-moment interpretation of the target language, such as eye-tracking. The major benefit of the eye-tracking method is that it can tap into real-time (or online) comprehension processes during the uninterrupted processing of the input, and thus, the data can be compared to those elicited by other, more metalinguistic tasks to offer a broader picture of language acquisition and processing. In this article, we present an overview of the eye-tracking technique and illustrate the method with L2 studies that show how eye-tracking data can be used to (a) investigate language-related topics and (b) inform key debates in the fields of L2 acquisition and L2 processing. Copyright © Cambridge University Press 2013.

Sign in / Sign up

Export Citation Format

Share Document