Memory Effects of Speech and Gesture Binding: Cortical and Hippocampal Activation in Relation to Subsequent Memory Performance

2009 ◽  
Vol 21 (4) ◽  
pp. 821-836 ◽  
Author(s):  
Benjamin Straube ◽  
Antonia Green ◽  
Susanne Weis ◽  
Anjan Chatterjee ◽  
Tilo Kircher

In human face-to-face communication, the content of speech is often illustrated by coverbal gestures. Behavioral evidence suggests that gestures provide advantages in the comprehension and memory of speech. Yet, how the human brain integrates abstract auditory and visual information into a common representation is not known. Our study investigates the neural basis of memory for bimodal speech and gesture representations. In this fMRI study, 12 participants were presented with video clips showing an actor performing meaningful metaphoric gestures (MG), unrelated, free gestures (FG), and no arm and hand movements (NG) accompanying sentences with an abstract content. After the fMRI session, the participants performed a recognition task. Behaviorally, the participants showed the highest hit rate for sentences accompanied by meaningful metaphoric gestures. Despite comparable old/new discrimination performances (d′) for the three conditions, we obtained distinct memory-related left-hemispheric activations in the inferior frontal gyrus (IFG), the premotor cortex (BA 6), and the middle temporal gyrus (MTG), as well as significant correlations between hippocampal activation and memory performance in the metaphoric gesture condition. In contrast, unrelated speech and gesture information (FG) was processed in areas of the left occipito-temporal and cerebellar region and the right IFG just like the no-gesture condition (NG). We propose that the specific left-lateralized activation pattern for the metaphoric speech–gesture sentences reflects semantic integration of speech and gestures. These results provide novel evidence about the neural integration of abstract speech and gestures as it contributes to subsequent memory performance.

2015 ◽  
Vol 46 (3) ◽  
pp. 505-518 ◽  
Author(s):  
I. A. Clark ◽  
E. A. Holmes ◽  
M. W. Woolrich ◽  
C. E. Mackay

BackgroundA hallmark symptom after psychological trauma is the presence of intrusive memories. It is unclear why only some moments of trauma become intrusive, and how these memories involuntarily return to mind. Understanding the neural mechanisms involved in the encoding and involuntary recall of intrusive memories may elucidate these questions.MethodParticipants (n = 35) underwent functional magnetic resonance imaging (fMRI) while being exposed to traumatic film footage. After film viewing, participants indicated within the scanner, while undergoing fMRI, if they experienced an intrusive memory of the film. Further intrusive memories in daily life were recorded for 7 days. After 7 days, participants completed a recognition memory test. Intrusive memory encoding was captured by comparing activity at the time of viewing ‘Intrusive scenes’ (scenes recalled involuntarily), ‘Control scenes’ (scenes never recalled involuntarily) and ‘Potential scenes’ (scenes recalled involuntarily by others but not that individual). Signal change associated with intrusive memory involuntary recall was modelled using finite impulse response basis functions.ResultsWe found a widespread pattern of increased activation for Intrusive v. both Potential and Control scenes at encoding. The left inferior frontal gyrus and middle temporal gyrus showed increased activity in Intrusive scenes compared with Potential scenes, but not in Intrusive scenes compared with Control scenes. This pattern of activation persisted when taking recognition memory performance into account. Intrusive memory involuntary recall was characterized by activity in frontal regions, notably the left inferior frontal gyrus.ConclusionsThe left inferior frontal gyrus may be implicated in both the encoding and involuntary recall of intrusive memories.


2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Mi Li ◽  
Hongpei Xu ◽  
Shengfu Lu

Background. In the past, studies on the lateralization of the left and right hemispheres of the brain suggested that depression is dominated by the right hemisphere of the brain, but the neural basis of this theory remains unclear. Method. Functional magnetic resonance imaging of the brain was performed in 22 depressive patients and 15 healthy controls. The differences in the mean values of the regional homogeneity (ReHo) of two groups were compared, and the low-frequency amplitudes of these differential brain regions were compared. Results. The results show that compared with healthy subjects, depressive patients had increased ReHo values in the right superior temporal gyrus, right middle temporal gyrus, left inferior temporal gyrus, left middle temporal gyrus, right middle frontal gyrus, triangular part of the right inferior frontal gyrus, orbital part of the right inferior frontal gyrus, right superior occipital gyrus, right middle occipital gyrus, bilateral anterior cingulate, and paracingulate gyri; reduced ReHo values were seen in the right fusiform gyrus, left middle occipital gyrus, left lingual gyrus, and left inferior parietal except in the supramarginal and angular gyri. Conclusions. The results show that regional homogeneity mainly occurs in the right brain, and the overall performance of the brain is such that right hemisphere synchronization is enhanced while left hemisphere synchronization is weakened. ReHo abnormalities in the resting state can predict abnormalities in individual neurological activities that reflect changes in the structure and function of the brain; abnormalities shown with this indicator are the neuronal basis for the phenomenon that the right hemisphere of the brain has a dominant effect on depression.


2018 ◽  
Author(s):  
Jiahe Zhang ◽  
Joseph Andreano ◽  
Bradford C. Dickerson ◽  
Alexandra Touroutoglou ◽  
Lisa Feldman Barrett

ABSTRACT“Superagers” are older adults who, despite their advanced age, maintain youthful memory. Previous morphometry studies revealed multiple default mode network (DMN) and salience network (SN) regions whose cortical thickness is preserved in superagers and correlates with memory performance. In this study, we examined the intrinsic functional connectivity within DMN and SN in 41 young (24.5 ± 3.6 years old) and 40 elderly adults (66.9 ± 5.5 years old). As in prior studies, superaging was defined as youthful performance on a memory recall task, the California Verbal Learning Test (CVLT). Participants underwent a resting state fMRI scan and performed a separate visual-verbal recognition memory task. As predicted, within both DMN and SN, superagers had stronger connectivity compared to typical older adults and similar connectivity compared to young adults. Superagers also performed similarly to young adults and better than typical older adults on the recognition task, demonstrating youthful episodic memory that generalized across memory tasks. Stronger connectivity within each network independently predicted better performance on both the CVLT and recognition task in older adults. Variation in intrinsic connectivity explained unique variance in memory performance, above and beyond preserved neuroanatomy. A post-hoc analysis revealed that DMN and SN nodes were more strongly inversely correlated in superagers than in typical older adults but were similarly correlated in superagers and young adults. Stronger between-network inverse correlations also predicted better memory performance in the entire sample of older adults. These results extend our understanding of the neural basis of superaging as a model of successful aging.SIGNIFICANCE STATEMENTMemory capacity generally declines with age, but a unique group of older adults – ‘superagers’ – have memory capacities rivaling those of younger adults, as well as preserved neuroanatomy in an ensemble of regions contained in two core intrinsic brain networks – the default mode and salience networks. In this study, we assessed the strength of intrinsic connectivity within these networks in superagers and typical older adults compared to young adults. We also expanded the behavioral assessment of memory. As predicted, superagers have intrinsic connectivity within the default mode and salience networks that is stronger than typical older adults and similar to that of young adults. Within older adults, preserved intrinsic connectivity within each network was uniquely associated with better memory performance.


2019 ◽  
Vol 30 (1) ◽  
pp. 72-84 ◽  
Author(s):  
Jiahe Zhang ◽  
Joseph M Andreano ◽  
Bradford C Dickerson ◽  
Alexandra Touroutoglou ◽  
Lisa Feldman Barrett

Abstract “Superagers” are older adults who, despite their advanced age, maintain youthful memory. Previous morphometry studies revealed multiple default mode network (DMN) and salience network (SN) regions whose cortical thickness is greater in superagers and correlates with memory performance. In this study, we examined the intrinsic functional connectivity within DMN and SN in 41 young (24.5 ± 3.6 years old) and 40 older adults (66.9 ± 5.5 years old). Superaging was defined as youthful performance on a memory recall task, the California Verbal Learning Test (CVLT). Participants underwent a resting-state functional magnetic resonance imaging (fMRI) scan and performed a separate visual–verbal recognition memory task. As predicted, within both DMN and SN, superagers had stronger connectivity compared with typical older adults and similar connectivity compared with young adults. Superagers also performed similarly to young adults and better than typical older adults on the recognition task, demonstrating youthful episodic memory that generalized across memory tasks. Stronger connectivity within each network independently predicted better performance on both the CVLT and recognition task in older adults. Variation in intrinsic connectivity explained unique variance in memory performance, above and beyond youthful neuroanatomy. These results extend our understanding of the neural basis of superaging as a model of successful aging.


2017 ◽  
Vol 24 (3) ◽  
pp. 213-223 ◽  
Author(s):  
Chelsea C. Hays ◽  
Zvinka Z. Zlatar ◽  
Laura Campbell ◽  
M.J. Meloy ◽  
Christina E. Wierenga

AbstractObjectives: Subjective cognitive decline (SCD), or self-reported cognitive decline despite normal neuropsychological test performance, is a risk factor for objective cognitive decline and Alzheimer’s disease (AD). While brain mechanisms contributing to SCD are not well defined, studies show associations with vascular risk factors and altered cerebral blood flow (CBF), raising the hypothesis that those with SCD might be experiencing vascular dysregulation, or a disruption in the normal relationship between CBF and cognition. We examined whether the association between CBF and verbal memory performance differs between those with SCD (SCD+) and those without SCD (SCD-). Methods: Linear mixed-effects models were used to investigate whether the voxel-wise relationship between arterial spin labeling (ASL) MRI-measured CBF and verbal memory performance was modified by SCD among a group of 70 cognitively normal older adults (35 SCD+, 35 SCD-; mean age=72) matched on age, gender, and symptoms of depression. Results: Results indicated that the SCD- group exhibited positive associations between verbal memory and CBF within the posterior cingulate cortex, middle temporal gyrus, and inferior frontal gyrus, whereas the SCD+ group displayed negative associations between verbal memory and CBF within the posterior cingulate cortex, middle temporal gyrus, hippocampus, fusiform gyrus, and inferior frontal gyrus. Conclusions: Findings suggest that, while higher CBF is supportive of memory function in those without SCD, higher CBF may no longer support memory function in those presenting with SCD, perhaps reflecting neurovascular dysregulation. (JINS, 2018, 24, 213–223)


2005 ◽  
Vol 17 (2) ◽  
pp. 273-281 ◽  
Author(s):  
Marco Tettamanti ◽  
Giovanni Buccino ◽  
Maria Cristina Saccuman ◽  
Vittorio Gallese ◽  
Massimo Danna ◽  
...  

Observing actions made by others activates the cortical circuits responsible for the planning and execution of those same actions. This observation–execution matching system (mirror-neuron system) is thought to play an important role in the understanding of actions made by others. In an fMRI experiment, we tested whether this system also becomes active during the processing of action-related sentences. Participants listened to sentences describing actions performed with the mouth, the hand, or the leg. Abstract sentences of comparable syntactic structure were used as control stimuli. The results showed that listening to action-related sentences activates a left fronto-parieto-temporal network that includes the pars opercularis of the inferior frontal gyrus (Broca's area), those sectors of the premotor cortex where the actions described are motorically coded, as well as the inferior parietal lobule, the intraparietal sulcus, and the posterior middle temporal gyrus. These data provide the first direct evidence that listening to sentences that describe actions engages the visuomotor circuits which subserve action execution and observation.


2012 ◽  
Vol 24 (1) ◽  
pp. 133-147 ◽  
Author(s):  
Carin Whitney ◽  
Marie Kirk ◽  
Jamie O'Sullivan ◽  
Matthew A. Lambon Ralph ◽  
Elizabeth Jefferies

To understand the meanings of words and objects, we need to have knowledge about these items themselves plus executive mechanisms that compute and manipulate semantic information in a task-appropriate way. The neural basis for semantic control remains controversial. Neuroimaging studies have focused on the role of the left inferior frontal gyrus (LIFG), whereas neuropsychological research suggests that damage to a widely distributed network elicits impairments of semantic control. There is also debate about the relationship between semantic and executive control more widely. We used TMS in healthy human volunteers to create “virtual lesions” in structures typically damaged in patients with semantic control deficits: LIFG, left posterior middle temporal gyrus (pMTG), and intraparietal sulcus (IPS). The influence of TMS on tasks varying in semantic and nonsemantic control demands was examined for each region within this hypothesized network to gain insights into (i) their functional specialization (i.e., involvement in semantic representation, controlled retrieval, or selection) and (ii) their domain dependence (i.e., semantic or cognitive control). The results revealed that LIFG and pMTG jointly support both the controlled retrieval and selection of semantic knowledge. IPS specifically participates in semantic selection and responds to manipulations of nonsemantic control demands. These observations are consistent with a large-scale semantic control network, as predicted by lesion data, that draws on semantic-specific (LIFG and pMTG) and domain-independent executive components (IPS).


2021 ◽  
Author(s):  
Shujie Geng ◽  
Wanwan Guo ◽  
Kunyu Xu ◽  
Tianye Jia ◽  
Wei Zhou ◽  
...  

Word reading includes a series of cognitive processes that convert low-level visual characteristics to neural representations. However, the consistency of the neural mechanisms for processing these cognitive components across different writing systems in bilinguals remains inconclusive. Here, we explored this question by employing representational similarity analysis with a semantic access task involving Chinese words, English words and Chinese pinyin. Divergent spatial distribution patterns were detected for each type of brain representation across ideographic and alphabetic languages, resulting in 100% classification accuracy. Meanwhile, convergent cognitive components processing was found in the core language-related regions in left hemisphere, including the inferior frontal gyrus, temporal pole, superior and middle temporal gyrus, precentral gyrus and supplementary motor areas. Broadly, our findings indicated that the neural basis for word recognition of different writing systems in bilinguals was divergent in spatial locations of neural representations but convergent in functions, which supported and enriched the assimilation-accommodation hypothesis.


2021 ◽  
Author(s):  
Jonathan Henry Venezia ◽  
Virginia Richards ◽  
Gregory Hickok

We recently developed a method to estimate speech-driven spectrotemporal receptive fields (STRFs) using fMRI. The method uses spectrotemporal modulation filtering, a form of acoustic distortion that renders speech sometimes intelligible and sometimes unintelligible. Using this method, we found significant STRF tuning only in classic auditory regions throughout the superior temporal lobes. However, our analysis was not optimized to detect small clusters of tuned STRFs as might be expected in non-auditory regions. Here, we re-analyze our data using a more sensitive multivariate procedure, and we identify STRF tuning in non-auditory regions including the left dorsal premotor cortex (left dPM), left inferior frontal gyrus (LIFG), and bilateral calcarine sulcus (calcS). All three regions responded more to intelligible than unintelligible speech, but left dPM and calcS responded significantly to vocal pitch and demonstrated strong functional connectivity with early auditory regions. However, only left dPM’s STRF predicted activation on trials rated as unintelligible by listeners, a hallmark auditory profile. LIFG, on the other hand, responded almost exclusively to intelligible speech and was functionally connected with classic speech-language regions in the superior temporal sulcus and middle temporal gyrus. LIFG’s STRF was also (weakly) able to predict activation on unintelligible trials, suggesting the presence of a partial ‘acoustic trace’ in the region. We conclude that left dPM is part of the human dorsal laryngeal motor cortex, a region previously shown to be capable of operating in an ‘auditory mode’ to encode vocal pitch. Further, given previous observations that LIFG is involved in syntactic working memory and/or processing of linear order, we conclude that LIFG is part of a higher-order speech circuit that exerts a top-down influence on processing of speech acoustics. Finally, because calcS is modulated by emotion, we speculate that changes in the quality of vocal pitch may have contributed to its response.


2012 ◽  
Vol 25 (0) ◽  
pp. 180
Author(s):  
Antonia Thelen ◽  
Céline Cappe ◽  
Micah M. Murray

Multisensory experiences influence subsequent memory performance and brain responses. Studies have thus far concentrated on semantically congruent pairings, leaving unresolved the influence of stimulus pairing and memory sub-types. Here, we paired images with unique, meaningless sounds during a continuous recognition task to determine if purely episodic, single-trial multisensory experiences can incidentally impact subsequent visual object discrimination. Psychophysics and electrical neuroimaging analyses of visual evoked potentials (VEPs) compared responses to repeated images either paired or not with a meaningless sound during initial encounters. Recognition accuracy was significantly impaired for images initially presented as multisensory pairs and could not be explained in terms of differential attention or transfer of effects from encoding to retrieval. VEP modulations occurred at 100–130 and 270–310 ms and stemmed from topographic differences indicative of network configuration changes within the brain. Distributed source estimations localized the earlier effect to regions of the right posterior temporal gyrus (STG) and the later effect to regions of the middle temporal gyrus (MTG). Responses in these regions were stronger for images previously encountered as multisensory pairs. Only the later effect correlated with performance such that greater MTG activity in response to repeated visual stimuli was linked with greater performance decrements. The present findings suggest that brain networks involved in this discrimination may critically depend on whether multisensory events facilitate or impair later visual memory performance. More generally, the data support models whereby effects of multisensory interactions persist to incidentally affect subsequent behavior as well as visual processing during its initial stages.


Sign in / Sign up

Export Citation Format

Share Document