scholarly journals I’m not sure that curve means what you think it means: Toward a [more] realistic understanding of the role of eye-movement generation in the Visual World Paradigm

2020 ◽  
Author(s):  
Bob McMurray
Keyword(s):  
Language Processing ◽  
Type I Error ◽  
Sampling Procedure ◽  
Type I ◽  
Visual World ◽  
Visual World Paradigm ◽  
Stochastic Sampling ◽  
Data Visualizations ◽  
Sequential Nature

The Visual World Paradigm (VWP) is a powerful experimental paradigm for language. Listeners respond to speech in a “visual world” consisting of potential referents of the speech. Fixations to these referents provides insight into the preliminary states of language processing as decisions unfold. The VWP has become the dominant paradigm in psycholinguistics and extended to every level of language, development, and disorders. Part of its impact is the impressive data visualizations which reveal the millisecond-by-millisecond timecourse of processing, and advances have been made in developing new analyses that precisely characterize this timecourse. However, all theoretical and statistical approaches make the tacit assumption that the timecourse of fixations is closely related to the underlying activation in the system. It is unclear if this assumption holds given the sequential nature of fixations, and their long refractory period. I investigated this assumption with a series of simulations. Each simulation starts with a set of true underlying activation functions and generates simulated fixations using a simple stochastic sampling procedure that respects the sequential nature of fixations. I then analyzed the results to determine the conditions under which the observed fixations curves match the underlying, the reliability of the observed data, and the implications for Type I Error and power. These simulations demonstrate that even under the simplest fixation-based models, observed fixation curves are systematically biased relative to the underlying and substantially noisier, with important implications for reliability and power. I then present a potential generative model that may ultimately overcome many of these issues. **This is a preprint of a manuscript that is under review. Please do not cite without the authors permission.

Re-reconsidering the role of temporal order in spoken word recognition

2019 ◽  
Vol 72 (11) ◽  
pp. 2574-2583 ◽  
Author(s):  
Julie Gregg ◽  
Albrecht W Inhoff ◽  
Cynthia M Connine
Keyword(s):  
Word Recognition ◽  
Spoken Word Recognition ◽  
Spoken Word ◽  
Lexical Representation ◽  
Coarse Grain ◽  
Visual World ◽  
Visual World Paradigm ◽  
Lexical Activation ◽  
Stimulus Materials

Spoken word recognition models incorporate the temporal unfolding of word information by assuming that positional match constrains lexical activation. Recent findings challenge the linearity constraint. In the visual world paradigm, Toscano, Anderson, and McMurray observed that listeners preferentially viewed a picture of a target word’s anadrome competitor (e.g., competitor bus for target sub) compared with phonologically unrelated distractors (e.g., well) or competitors sharing an overlapping vowel (e.g., sun). Toscano et al. concluded that spoken word recognition relies on coarse grain spectral similarity for mapping spoken input to a lexical representation. Our experiments aimed to replicate the anadrome effect and to test the coarse grain similarity account using competitors without vowel position overlap (e.g., competitor leaf for target flea). The results confirmed the original effect: anadrome competitor fixation curves diverged from unrelated distractors approximately 275 ms after the onset of the target word. In contrast, the no vowel position overlap competitor did not show an increase in fixations compared with the unrelated distractors. The contrasting results for the anadrome and no vowel position overlap items are discussed in terms of theoretical implications of sequential match versus coarse grain similarity accounts of spoken word recognition. We also discuss design issues (repetition of stimulus materials and display parameters) concerning the use of the visual world paradigm in making inferences about online spoken word recognition.

scholarly journals The pictures who shall not be named: Empirical support for benefits of preview in the Visual World Paradigm

2020 ◽  
Author(s):  
Keith S Apfelbaum ◽  
Jamie Klein-Packard ◽  
Bob McMurray
Keyword(s):  
Visual Search ◽  
Language Processing ◽  
Spoken Word Recognition ◽  
Empirical Support ◽  
Visual Scene ◽  
Linguistic Processing ◽  
Visual World ◽  
Visual World Paradigm ◽  
Processing Strategies ◽  
Memory Representations

A common critique of the Visual World Paradigm (VWP) in psycholinguistic studies is that what is designed as a measure of language processes is corrupted by the visual context of the task. This is crucial, particularly in studies of spoken word recognition, where the displayed images are usually seen as just a part of the measure and are not of fundamental interest. Many variants of the VWP allow participants to sample the visual scene before a trial begins. However, this could bias their interpretations of the later speech or even lead to abnormal processing strategies (e.g., comparing the input to only preactivated working memory representations). Prior work has focused only on whether preview duration changes fixation patterns. However, preview could affect a number of processes, such as visual search, that would not challenge the interpretation of the VWP. The present study uses a series of targeted manipulations of the preview period to ask if preview alters looking behavior during a trial, and why. Results show that standard psycholinguistic effects seen in the VWP are not dependent on preview, and are not enhanced by explicit phonological prenaming. Moreover, some forms of preview can eliminate nuisance variance deriving from object recognition and visual search demands in order to produce a more sensitive measure of linguistic processing. These results deepen our understanding of how the visual scene interacts with language processing to drive fixations patterns in the VWP, and reinforce the value of the VWP as a tool for measuring real-time language processing.

Iconic culture-specific images influence language non-selective translation activation in bilinguals

2018 ◽  
Vol 1 (2) ◽  
pp. 221-250 ◽  
Author(s):  
Keerthana Kapiley ◽  
Ramesh Kumar Mishra
Keyword(s):  
Language Processing ◽  
Time Course ◽  
Spoken Word Recognition ◽  
Spoken Word ◽  
Visual Language ◽  
Cohort Member ◽  
Visual World ◽  
Visual World Paradigm ◽  
Selective Translation ◽  
Task Time

Abstract Two experiments using the visual-world paradigm examined whether culture-specific images influence the activation of translation equivalents during spoken-word recognition in bilinguals. In Experiment 1, the participants performed a visual-world task during which they were asked to click on the target after the spoken word (L1 or L2). In Experiment 2, the participants were presented with culture-specific images (faces representing L1, L2 and Neutral) during the visual world task. Time-course analysis of Experiment 1 revealed that there were a significantly higher number of looks to TE-cohort member compared to distractors only when participants heard to L2 words. In Experiment 2, when the cultural-specific images were congruent with the spoken word’s language, participants deployed higher number of looks to TE-cohort member compared to distractors. This effect was seen in both the language directions but not when the culture-specific images were incongruent with the spoken word. The eyetracking data suggest that culture-specific images influence cross-linguistic activation of semantics during bilingual audio-visual language processing.

scholarly journals The online processing of causal and concessive discourse connectives

Linguistics ◽  
2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Judith Köhne-Fuetterer ◽  
Heiner Drenhaus ◽  
Francesca Delogu ◽  
Vera Demberg
Keyword(s):  
Present Article ◽  
Language Processing ◽  
Top Down ◽  
N400 Effect ◽  
Visual World ◽  
Visual World Paradigm ◽  
Incremental Processing ◽  
Online Processing ◽  
The Cost ◽  
Discourse Connectives

Abstract While there is a substantial amount of evidence for language processing being a highly incremental and predictive process, we still know relatively little about how top-down discourse based expectations are combined with bottom-up information such as discourse connectives. The present article reports on three experiments investigating this question using different methodologies (visual world paradigm and ERPs) in two languages (German and English). We find support for highly incremental processing of causal and concessive discourse connectives, causing anticipation of upcoming material. Our visual world study shows that anticipatory looks depend on the discourse connective; furthermore, the German ERP study revealed an N400 effect on a gender-marked adjective preceding the target noun, when the target noun was inconsistent with the expectations elicited by the combination of context and discourse connective. Moreover, our experiments reveal that the facilitation of downstream material based on earlier connectives comes at the cost of reversing original expectations, as evidenced by a P600 effect on the concessive relative to the causal connective.

The Visual World Paradigm in Children with Spoken Language Disorders

2017 ◽  
pp. 262-282
Author(s):  
Llorenç Andreu ◽  
Mònica Sanz-Torrent
Keyword(s):  
Eye Movements ◽  
Language Processing ◽  
Spoken Word Recognition ◽  
Language Disorders ◽  
Spoken Language ◽  
Developmental Studies ◽  
Eye Tracker ◽  
Visual World ◽  
Visual World Paradigm ◽  
Language Representation

Eye movements have become a commonly used response measure in studies of spoken language processing. These studies are included in the so-called ‘visual world paradigm' in which participants' eye movements are monitored during scene viewing in language comprehension and production activities. In this chapter the most important aspects for running eye-tracking studies in children are revised. Developmental studies using eye movements have increased in the last ten years from babies to adolescents. However, there are only a handful of papers based on the ‘visual world paradigm' that analyze the spoken language in children with language disorders. These studies using eye movements have explored spoken word recognition; verb argument and thematic relations; and narrative comprehension and production. Results has proven eye tracker to be an effective tool for understanding language representation and processing in children with language disorders.

scholarly journals Incremental processing of telicity in Italian children

2021 ◽  
Vol 1 ◽  
pp. 71
Author(s):  
Jasmijn E. Bosch ◽  
Mathilde Chailleux ◽  
Francesca Foppolo
Keyword(s):  
Eye Tracking ◽  
Language Processing ◽  
Lexical Semantics ◽  
Semantic Meaning ◽  
Additional Time ◽  
Visual World ◽  
Visual World Paradigm ◽  
Incremental Processing ◽  
Final Interpretation ◽  
Italian Children

A sentence like 'Lyn has peeled the apple' triggers two types of inferences: a telicity inference that the event is telic; and a culmination inference that the event has reached its telos and has stopped. This results in the final interpretation of the sentence that Lyn has completely peeled the apple. We present an eye-tracking study to test children's ability to predict the upcoming noun (e.g., the apple) during the incremental processing of sentences like 'Look at the picture in which he/she has peeled the…' in which the predicate is telic and the verb appears in the perfective form. By means of the Visual World Paradigm, we aimed to investigate children's ability to use the lexical semantics and aspectual morphology of verbs during language processing. To test if children can predict the target (e.g., a completely peeled apple) by exploiting the lexical-semantic meaning of the verb, we contrasted the target picture with a picture of an object that cannot be peeled; to test if they can predict on the basis of the verb's perfective morphology, we compared the target with the picture of a half-peeled apple. Our results show that Italian children can anticipate the upcoming noun in both cases, providing evidence that children can exploit the morphosyntactic cue on the verb (perfective aspect) to incrementally derive the culmination inference that the telos is reached and the event is completed. We also show that the integration of aspect requires some additional time compared to the integration of the basic lexical semantics of the verb.

scholarly journals Real-time processing of event descriptions for partially- and fully-completed events: Evidence from the visual world paradigm

2021 ◽  
Vol 6 (1) ◽  
pp. 118
Author(s):  
Max J. Kaplan ◽  
Amulya Raju ◽  
Sudha Arunachalam
Keyword(s):  
Real Time ◽  
Language Processing ◽  
Visual World ◽  
Visual World Paradigm ◽  
Real Time Processing ◽  
Time Processing ◽  
Semantic Account ◽  
Verb Forms ◽  
Partial Completion ◽  
English Speaking

The current study investigated non-culminating accomplishments through an experimental lens. We used a well-established paradigm for studying real-time language processing using eye-tracking, the visual world paradigm. Our study was modeled after Altmann and Kamide’s (2007) investigation of processing of aspectual information contained in a perfect verb form (e.g., has eaten). We compared English-speaking adults’ interpretations of sentences like ‘The girl has eaten a cookie’ and ‘The girl was eating a cookie’ in the context of one of two visual scenes. In the Full Completion condition, the scene depicted two referents that were compatible with the predicate: one was compatible with the expected end state of the event (e.g., an empty plate), the other with an unrealized version of the event (e.g., an uneaten cookie). In the Partial Completion condition, the scene depicted a referent that was compatible with a partially-completed version of the event (e.g., part of a cookie on a plate) and an unrealized interpretation (e.g., an uneaten cookie). For verb forms in the perfect (e.g., has eaten) but not in the progressive, we found a difference between conditions; listeners preferred to look at the fully-affected referent in the Full Completion condition as compared to the partially-affected referent in the Partial Completion condition. We take the results as suggestive in favor of a pragmatic rather than semantic account of non-culmination interpretations in English.

Adjuvant enzalutamide for the treatment of early-stage androgen receptor-positive (AR+) TNBC.

2019 ◽  
Vol 37 (15_suppl) ◽  
pp. 546-546 ◽  
Author(s):  
Tiffany A. Traina ◽  
Leigh Ann Boyle ◽  
Artavazd Arumov ◽  
Sujata Patil ◽  
Marcia Edelweiss ◽  
...  
Keyword(s):  
Type I Error ◽  
Early Stage ◽  
Hot Flashes ◽  
Standard Of Care ◽  
Stage I ◽  
Type I ◽  
Primary Analysis ◽  
Secondary Analyses ◽  
Clinical Trial Information

546 Background: A subset of TNBC is dependent on AR signaling. Enzalutamide (ENZA), an AR-antagonist, has activity in patients (pts) with metastatic AR+ TNBC, with a clinical benefit rate of 33%. This study tests the feasibility of adjuvant ENZA for the treatment (tx) of early stage, AR+ TNBC. We now report the primary endpoint (endpt) and safety. Methods: Eligible pts have centrally confirmed, Stage I-III, ER/PR < 1%, HER2(-), AR ≥1% BC and completed all planned surgery, chemotx and radiation (RT) < 6 months of tx start. AR testing by IHC per MSK methods. Tx consists of ENZA 160mg daily for 1 year (y) with the option to extend tx to 2y. Toxicity per NCI CTCAEv4 every (q) 4 weeks (wk) for 12 wk, then q3 months. Primary endpt: feasibility of 1y ENZA defined as the discontinuation rate due to toxicity, consent withdrawal or tolerability. 50 pts are enrolled to have 46 evaluable pts required to discriminate between feasibility of 50% and 70%, with type I error 5% and 88% power. Pts who have disease progression (PD) or die during 1st y of ENZA and do not have tx discontinuation due to the above will not be included in the primary analysis. If 29 pts complete 1y, adjuvant ENZA will be deemed feasible. Secondary endpts: safety and 3y DFS and OS. Exploratory endpts: PROs and biomarker development. Results: Between 5/2016-6/2018, 50 pts were enrolled. Pt and tumor characteristics (N = 50): Median age 55y (33-81); Stage: I 20 (40%), II 23 (46%), III 7 (14%); Grade (gr): 2 = 26%, 3 = 74%. AR > 10% = 35 (70%), AR ≤10% = 15 (30%). Chemotx 47/50 (94%): Neoadjuvant (neo) 40%, Adjuvant (adj) 60%; Anthracycline/Taxane-based 38/47 (81%), Platinum 1/47 (2%), Docetaxel/Cyclophosphamide 3/47 (6%), other 5/47 (11%). 13/19 who received neo tx failed pCR; 9/13 (69.2%) received adj capecitabine. RT: 38/50 (76%). 27 pts completed 1y of tx. 7 pts will be evaluable by 6/1/19. 1 pt to complete 1y 6/21/19. 15 pts are off tx: PD (3), toxicity (5), noncompliance (4), withdrawal of consent (3). Tx-related AEs, any gr, > 10% (N = 50): fatigue (48%), hot flashes (22%), headache (18%), hyperglycemia (18%), nausea (18%), WBC decreased (16%), dizziness (14%), arthralgia (12%), dyspnea (12%). Tx-related, gr 3 AEs: fatigue (6%), hyperglycemia (2%), hypertension (2%). No gr 4/5 AEs or seizures. 11 pts had dose reduction. Conclusions: Feasibility of adjuvant ENZA will be fully evaluable in 4/2019 and is anticipated to meet the prespecified statistical expectations for primary endpt. ENZA is well tolerated following locoregional tx and standard of care systemic tx. Secondary analyses and correlatives are ongoing to define the role of AR in TNBC. Clinical trial information: NCT02750358.

Sign in / Sign up

Export Citation Format

Share Document