In the Mind’s Eye: Eye-Tracking and Multi-modal Integration During Bilingual Spoken-Language Processing

2015 ◽  
pp. 147-164 ◽  
Author(s):  
Sarah Chabal ◽  
Viorica Marian
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Spoken Language ◽  
Spoken Language Processing ◽  
Mind's Eye

scholarly journals Do Musicians and Non-musicians Differ in Speech-on-Speech Processing?

2021 ◽  
Vol 12 ◽  
Author(s):  
Elif Canseza Kaplan ◽  
Anita E. Wagner ◽  
Paolo Toffanin ◽  
Deniz Başkent
Keyword(s):  
Speech Perception ◽  
Eye Tracking ◽  
Language Processing ◽  
Speech Processing ◽  
Time Course ◽  
Spoken Language ◽  
Recall Task ◽  
Spoken Language Processing ◽  
Sentence Recall ◽  
Gaze Fixations

Earlier studies have shown that musically trained individuals may have a benefit in adverse listening situations when compared to non-musicians, especially in speech-on-speech perception. However, the literature provides mostly conflicting results. In the current study, by employing different measures of spoken language processing, we aimed to test whether we could capture potential differences between musicians and non-musicians in speech-on-speech processing. We used an offline measure of speech perception (sentence recall task), which reveals a post-task response, and online measures of real time spoken language processing: gaze-tracking and pupillometry. We used stimuli of comparable complexity across both paradigms and tested the same groups of participants. In the sentence recall task, musicians recalled more words correctly than non-musicians. In the eye-tracking experiment, both groups showed reduced fixations to the target and competitor words’ images as the level of speech maskers increased. The time course of gaze fixations to the competitor did not differ between groups in the speech-in-quiet condition, while the time course dynamics did differ between groups as the two-talker masker was added to the target signal. As the level of two-talker masker increased, musicians showed reduced lexical competition as indicated by the gaze fixations to the competitor. The pupil dilation data showed differences mainly in one target-to-masker ratio. This does not allow to draw conclusions regarding potential differences in the use of cognitive resources between groups. Overall, the eye-tracking measure enabled us to observe that musicians may be using a different strategy than non-musicians to attain spoken word recognition as the noise level increased. However, further investigation with more fine-grained alignment between the processes captured by online and offline measures is necessary to establish whether musicians differ due to better cognitive control or sound processing.

Activating Gender Stereotypes During Online Spoken Language Processing

2010 ◽  
Vol 57 (2) ◽  
pp. 126-133 ◽  
Author(s):  
Pirita Pyykkönen ◽  
Jukka Hyönä ◽  
Roger P. G. van Gompel
Keyword(s):  
Eye Tracking ◽  
Mental Models ◽  
Language Processing ◽  
Gender Stereotypes ◽  
Language Comprehension ◽  
Spoken Language ◽  
World Knowledge ◽  
Tracking Method ◽  
Spoken Language Processing ◽  
Coherence Relation

This study used the visual world eye-tracking method to investigate activation of general world knowledge related to gender-stereotypical role names in online spoken language comprehension in Finnish. The results showed that listeners activated gender stereotypes elaboratively in story contexts where this information was not needed to build coherence. Furthermore, listeners made additional inferences based on gender stereotypes to revise an already established coherence relation. Both results are consistent with mental models theory (e.g., Garnham, 2001 ). They are harder to explain by the minimalist account ( McKoon & Ratcliff, 1992 ), which suggests that people limit inferences to those needed to establish coherence in discourse.

Children With Cochlear Implants Use Semantic Prediction to Facilitate Spoken Word Recognition

2021 ◽  
pp. 1-14
Author(s):  
Christina Blomquist ◽  
Rochelle S. Newman ◽  
Yi Ting Huang ◽  
Jan Edwards
Keyword(s):  
Word Recognition ◽  
Target Word ◽  
Cochlear Implants ◽  
Language Processing ◽  
Spoken Word Recognition ◽  
Spoken Language ◽  
Spoken Word ◽  
Semantic Cues ◽  
Matched Group ◽  
Spoken Language Processing

Purpose Children with cochlear implants (CIs) are more likely to struggle with spoken language than their age-matched peers with normal hearing (NH), and new language processing literature suggests that these challenges may be linked to delays in spoken word recognition. The purpose of this study was to investigate whether children with CIs use language knowledge via semantic prediction to facilitate recognition of upcoming words and help compensate for uncertainties in the acoustic signal. Method Five- to 10-year-old children with CIs heard sentences with an informative verb ( draws ) or a neutral verb ( gets ) preceding a target word ( picture ). The target referent was presented on a screen, along with a phonologically similar competitor ( pickle ). Children's eye gaze was recorded to quantify efficiency of access of the target word and suppression of phonological competition. Performance was compared to both an age-matched group and vocabulary-matched group of children with NH. Results Children with CIs, like their peers with NH, demonstrated use of informative verbs to look more quickly to the target word and look less to the phonological competitor. However, children with CIs demonstrated less efficient use of semantic cues relative to their peers with NH, even when matched for vocabulary ability. Conclusions Children with CIs use semantic prediction to facilitate spoken word recognition but do so to a lesser extent than children with NH. Children with CIs experience challenges in predictive spoken language processing above and beyond limitations from delayed vocabulary development. Children with CIs with better vocabulary ability demonstrate more efficient use of lexical-semantic cues. Clinical interventions focusing on building knowledge of words and their associations may support efficiency of spoken language processing for children with CIs. Supplemental Material https://doi.org/10.23641/asha.14417627

Rediscovering 25 years of discoveries in spoken language processing: a preliminary ISCA archive analysis

2013 ◽  
Author(s):  
Joseph Mariani ◽  
Patrick Paroubek ◽  
Gil Francopoulo ◽  
Marine Delaborde
Keyword(s):  
Language Processing ◽  
Spoken Language ◽  
Spoken Language Processing

Spoken language comprehension: insights from eye movements

2007 ◽  
pp. 308-326 ◽  
Author(s):  
Michael K. Tanenhaus
Keyword(s):  
Eye Movements ◽  
Language Processing ◽  
Language Comprehension ◽  
Language Production ◽  
World Literature ◽  
Spoken Language ◽  
Response Measure ◽  
Visual World ◽  
Spoken Language Processing ◽  
Spoken Language Comprehension

Recently, eye movements have become a widely used response measure for studying spoken language processing in both adults and children, in situations where participants comprehend and generate utterances about a circumscribed “Visual World” while fixation is monitored, typically using a free-view eye-tracker. Psycholinguists now use the Visual World eye-movement method to study both language production and language comprehension, in studies that run the gamut of current topics in language processing. Eye movements are a response measure of choice for addressing many classic questions about spoken language processing in psycholinguistics. This article reviews the burgeoning Visual World literature on language comprehension, highlighting some of the seminal studies and examining how the Visual World approach has contributed new insights to our understanding of spoken word recognition, parsing, reference resolution, and interactive conversation. It considers some of the methodological issues that come to the fore when psycholinguists use eye movements to examine spoken language comprehension.

Sign in / Sign up

Export Citation Format

Share Document