scholarly journals The language network is recruited but not required for non-verbal event semantics

2019 ◽  
Author(s):  
Anna A. Ivanova ◽  
Zachary Mineroff ◽  
Vitor Zimmerer ◽  
Nancy Kanwisher ◽  
Rosemary Varley ◽  
...  

AbstractThe ability to combine individual meanings into complex representations of the world is often associated with language. Yet people also construct combinatorial event-level representations from non-linguistic input, e.g. from visual scenes. Here, we test whether the language network in the human brain is involved in and necessary for semantic processing of nonverbal events. In Experiment 1, we scanned participants with fMRI while they performed a semantic plausibility judgment task vs. a difficult perceptual control task on sentences and line drawings that describe/depict simple agent-patient interactions. We found that the language network responded robustly during the semantic task but not during the perceptual control task. This effect was observed for both sentences and pictures (although the response to sentences was stronger). Thus, language regions in healthy adults are engaged during a semantic task performed on pictorial depictions of events. But is this engagement necessary? In Experiment 2, we tested two individuals with global aphasia, who have sustained massive damage to perisylvian language areas and display severe language difficulties, against a group of age-matched control participants. Individuals with aphasia were severely impaired on a task of matching sentences and pictures. However, they performed close to controls in assessing the plausibility of pictorial depictions of agent-patient interactions. Overall, our results indicate that the left fronto-temporal language network is recruited but not necessary for semantic processing of nonverbal events.

2021 ◽  
pp. 1-26
Author(s):  
Anna A. Ivanova ◽  
Zachary Mineroff ◽  
Vitor Zimmerer ◽  
Nancy Kanwisher ◽  
Rosemary Varley ◽  
...  

The ability to combine individual concepts of objects, properties, and actions into complex representations of the world is often associated with language. Yet combinatorial event-level representations can also be constructed from nonverbal input, such as visual scenes. Here, we test whether the language network in the human brain is involved in and necessary for semantic processing of events presented nonverbally. In Experiment 1, we scanned participants with fMRI while they performed a semantic plausibility judgment task versus a difficult perceptual control task on sentences and line drawings that describe/depict simple agent–patient interactions. We found that the language network responded robustly during the semantic task performed on both sentences and pictures (although its response to sentences was stronger). Thus, language regions in healthy adults are engaged during a semantic task performed on pictorial depictions of events. But is this engagement necessary? In Experiment 2, we tested two individuals with global aphasia, who have sustained massive damage to perisylvian language areas and display severe language difficulties, against a group of age-matched control participants. Individuals with aphasia were severely impaired on the task of matching sentences to pictures. However, they performed close to controls in assessing the plausibility of pictorial depictions of agent–patient interactions. Overall, our results indicate that the left frontotemporal language network is recruited but not necessary for semantic processing of nonverbally presented events.


2018 ◽  
Author(s):  
Evelina Fedorenko ◽  
Idan Blank ◽  
Matthew Siegelman ◽  
Zachary Mineroff

AbstractTo understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such “syntactic hub”, and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semanticvs.morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical itemsvs.only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions—or even voxel subsets—within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language—to share meanings across minds.


2017 ◽  
Vol 6 (2) ◽  
pp. 23-30
Author(s):  
Yu Kanazawa ◽  
◽  

Emotion is a pervasive phenomenon whose pivotal impacts on cognition have been proposed and increasingly acknowledged (e.g., operator effect and “(de-)energizing” effect; cf. Ciompi & Panksepp, 2005; Damasio, 2003; LeDoux, 2012). In accordance with this, second language acquisition (SLA) studies have recently seen an “affective turn” (Pavlenko, 2013) and several theories have been proposed and studies conducted concerning the effect of affect in SLA from such perspectives as motivation (Dörnyei & Ushioda, 2011), foreign language anxiety/enjoyment (Dewaele & MacIntyre, 2016), Directed Motivational Currents (Dörnyei, Henry, & Muir, 2016), and emotional intelligence (Gregersen & MacIntyre, 2017; Kanazawa, 2016b). The purpose of the experiments was to examine whether emotion-involved semantic processing (EmInvSemProc) results in better incidental L2 memory performance compared to other types of semantic processing (viz., a lexical decision task [LDT] for Experiment A and an imageability judgment task [IJT] for Experiment B).


2020 ◽  
Vol 32 (1) ◽  
pp. 36-49 ◽  
Author(s):  
Jin Wang ◽  
Mabel L. Rice ◽  
James R. Booth

Previous studies have found specialized syntactic and semantic processes in the adult brain during language comprehension. Young children have sophisticated semantic and syntactic aspects of language, yet many previous fMRI studies failed to detect this specialization, possibly due to experimental design and analytical methods. In this current study, 5- to 6-year-old children completed a syntactic task and a semantic task to dissociate these two processes. Multivoxel pattern analysis was used to examine the correlation of patterns within a task (between runs) or across tasks. We found that the left middle temporal gyrus showed more similar patterns within the semantic task compared with across tasks, whereas there was no difference in the correlation within the syntactic task compared with across tasks, suggesting its specialization in semantic processing. Moreover, the left superior temporal gyrus showed more similar patterns within both the semantic task and the syntactic task as compared with across tasks, suggesting its role in integration of semantic and syntactic information. In contrast to the temporal lobe, we did not find specialization or integration effects in either the opercular or triangular part of the inferior frontal gyrus. Overall, our study showed that 5- to 6-year-old children have already developed specialization and integration in the temporal lobe, but not in the frontal lobe, consistent with developmental neurocognitive models of language comprehension in typically developing young children.


2015 ◽  
Vol 6 (1) ◽  
pp. 227-234 ◽  
Author(s):  
Mei Jiang ◽  
Li-Xia Yang ◽  
Lin Jia ◽  
Xin Shi ◽  
Hong Wang ◽  
...  

AbstractObjective: The aim of this study is to evaluate variations in cortical activation in early and late Uygur-Chinese bilinguals from the Xinjiang Uygur Autonomous Region of China. Methodology: During a semantic judgment task with visual stimulation by a single Chinese or Uygur word, functional magnetic resonance imaging (fMRI) was performed. The fMRI data regarding activated cortical areas and volumes by both languages were analyzed. Results: The first language (L1) and second language (L2) activated language-related hemispheric regions, including the left inferior frontal and parietal cortices, and L1 specifically activated the left middle temporal gyrus. For both L1 and L2, cortical activation was greater in the left hemisphere, and there was no significant difference in the lateralization index (LI) between the two languages (p > 0.05). Although the total activated cortical areas were larger in early than late bilinguals, the activation volumes were not significantly different. Conclusion: Activated brains areas in early and late fluent bilinguals largely overlapped. However, these areas were more scattered upon presentation of L2 than L1, and L1 had a more specific pattern of activation than L2. For both languages, the left hemisphere was dominant. We found that L2 proficiency level rather than age of acquisition had a greater influence on which brain areas were activated with semantic processing.


2016 ◽  
Vol 28 (10) ◽  
pp. 1568-1583 ◽  
Author(s):  
Giovanna Egidi ◽  
Alfonso Caramazza

This research studies the neural systems underlying two integration processes that take place during natural discourse comprehension: consistency evaluation and passive comprehension. Evaluation was operationalized with a consistency judgment task and passive comprehension with a passive listening task. Using fMRI, the experiment examined the integration of incoming sentences with more recent, local context and with more distal, global context in these two tasks. The stimuli were stories in which we manipulated the consistency of the endings with the local context and the relevance of the global context for the integration of the endings. A whole-brain analysis revealed several differences between the two tasks. Two networks previously associated with semantic processing and attention orienting showed more activation during the judgment than the passive listening task. A network previously associated with episodic memory retrieval and construction of mental scenes showed greater activity when global context was relevant, but only during the judgment task. This suggests that evaluation, more than passive listening, triggers the reinstantiation of global context and the construction of a rich mental model for the story. Finally, a network previously linked to fluent updating of a knowledge base showed greater activity for locally consistent endings than inconsistent ones, but only during passive listening, suggesting a mode of comprehension that relies on a local scope approach to language processing. Taken together, these results show that consistency evaluation and passive comprehension weigh differently on distal and local information and are implemented, in part, by different brain networks.


2021 ◽  
Vol 12 ◽  
Author(s):  
Chia-Ho Lai ◽  
Shu-Kai Hsieh ◽  
Chia-Lin Lee ◽  
Lily I-Wen Su ◽  
Te-Hsin Liu ◽  
...  

The present study aimed to investigate the neural mechanism underlying semantic processing in Mandarin Chinese adult learners, focusing on the learners who were Indo-European language speakers with advanced levels of proficiency in Mandarin Chinese. We used functional magnetic resonance imaging technique and a semantic judgment task to test 24 Mandarin Chinese adult learners (L2 group) and 26 Mandarin Chinese adult native speakers (L1 group) as a control group. In the task, participants were asked to indicate whether two-character pairs were related in meaning. Compared to the L1 group, the L2 group had greater activation in the bilateral occipital regions, including the fusiform gyrus and middle occipital gyrus, as well as the right superior parietal lobule. On the other hand, less activation in the bilateral temporal regions was found in the L2 group relative to the L1 group. Correlation analysis further revealed that, within the L2 group, increased activation in the left middle temporal gyrus/superior temporal gyrus (M/STG, BA 21) was correlated with higher accuracy in the semantic judgment task as well as better scores in the two vocabulary tests, the Assessment of Chinese character list for grade 3 to grade 9 (A39) and the Peabody Picture Vocabulary Test-Revised. In addition, functional connectivity analysis showed that connectivity strength between the left fusiform gyrus and left ventral inferior frontal gyrus (IFG, BA 47) was modulated by the accuracy in the semantic judgment task in the L1 group. By contrast, this modulation effect was weaker in the L2 group. Taken together, our study suggests that Mandarin Chinese adult learners rely on greater recruitment of the bilateral occipital regions to process orthographic information to access the meaning of Chinese characters. Also, our correlation results provide convergent evidence that the left M/STG (BA 21) plays a crucial role in the storage of semantic knowledge for readers to access to conceptual information. Moreover, the connectivity results indicate that the left ventral pathway (left fusiform gyrus-left ventral IFG) is associated with orthographic-semantic processing in Mandarin Chinese. However, this semantic-related ventral pathway might require more time and language experience to be developed, especially for the late adult learners of Mandarin Chinese.


Author(s):  
Dhana Wolf ◽  
Linn-Marlen Rekittke ◽  
Irene Mittelberg ◽  
Martin Klasen ◽  
Klaus Mathiak

2017 ◽  
Author(s):  
Mariana Vega-Mendoza ◽  
Martin John Pickering ◽  
Mante S. Nieuwland

In two ERP experiments, we investigated whether readers prioritize animacy over real-world event-knowledge during sentence comprehension. We used the paradigm of Paczynski and Kuperberg (2012), who argued that animacy is prioritized based on the observations that the ‘related anomaly effect’ (reduced N400s for context-related anomalous words compared to unrelated words) does not occur for animacy violations, and that animacy violations but not relatedness violations elicit P600 effects. Participants read passive sentences with plausible agents (e.g., The prescription for the mental disorder was written by the psychiatrist) or implausible agents that varied in animacy and semantic relatedness (schizophrenic/guard/pill/fence). In Experiment 1 (with a plausibility judgment task), plausible sentences elicited smaller N400s relative to all types of implausible sentences. Moreover, animate words elicited smaller N400s than inanimate words, and related words elicited smaller N400s than unrelated words. Crucially, at the P600 time-window, we observed more positive ERPs for animate than inanimate words and for related than unrelated words at anterior regions. In Experiment 2 (with no judgment task), we observed an N400 effect with animacy violations, but no other effects. Taken together, the results of our experiments fail to support a prioritized role of animacy information over real-world event-knowledge, but they support an interactive, constraint-based view on incremental semantic processing.


2020 ◽  
Vol 19 (2) ◽  
pp. 1-7
Author(s):  
Juliana Novo Gomes ◽  
Julia Cataldo Lopes

Seeking to decipher the process of understanding and producing language, Fedorenko reports three discoveries made by her laboratory during the last decade, achieved through behavioral, computational and brain imaging methodologies. First, Fedorenko proposes that regions that support the language are selective only to it. She then argues that regions that support syntactic processing are the same ones that support semantic processing. Finally, Fedorenko suggests that the primary driver for activation in the language region is semantic composition and not syntax, as the literature had been indicating: if a syntactically messed up input provides sufficient evidence for the semantic composition, the language network maximum response is achieved. Thus, syntactic properties could be constrained by communicative pressures. She concludes that, interpreted together, these results point to a strong integration between lexicon and syntax, approaching theoretical models such as construction and usage-based grammars.


Sign in / Sign up

Export Citation Format

Share Document