scholarly journals Weighted RSA: an improved framework on the perception of audio-visual affective speech in left insula and superior temporal gyrus

2020 ◽  
Author(s):  
Junhai Xu ◽  
Haibin Dong ◽  
Fei Guo ◽  
Zeyu Wang ◽  
Jianguo Wei ◽  
...  

AbstractBeing able to accurately perceive the emotion expressed by the facial or verbal expression from others is critical to successful social interaction. However, only few studies examined the multimodal interactions on speech emotion, and there is no consistence in studies on the speech emotion perception. It remains unclear, how the speech emotion of different valence is perceived on the multimodal stimuli by our human brain. In this paper, we conducted a functional magnetic resonance imaging (fMRI) study with an event-related design, using dynamic facial expressions and emotional speech stimuli to express different emotions, in order to explore the perception mechanism of speech emotion in audio-visual modality. The representational similarity analysis (RSA), whole-brain searchlight analysis, and conjunction analysis of emotion were used to interpret the representation of speech emotion in different aspects. Significantly, a weighted RSA approach was creatively proposed to evaluate the contribution of each candidate model to the best fitted model. The results of weighted RSA indicated that the fitted models were superior to all candidate models and the weights could be used to explain the representation of ROIs. The bilateral amygdala has been shown to be associated with the processing of both positive and negative emotions except neutral emotion. It is indicated that the left posterior insula and the left anterior superior temporal gyrus (STG) play important roles in the perception of multimodal speech emotion.

2008 ◽  
Vol 20 (9) ◽  
pp. 1698-1710 ◽  
Author(s):  
William W. Graves ◽  
Thomas J. Grabowski ◽  
Sonya Mehta ◽  
Prahlad Gupta

Impairments in phonological processing have been associated with damage to the region of the left posterior superior temporal gyrus (pSTG), but the extent to which this area supports phonological processing, independent of semantic processing, is less clear. We used repetition priming and neural repetition suppression during functional magnetic resonance imaging (fMRI) in an auditory pseudoword repetition task as a semantics-free model of lexical (whole-word) phonological access. Across six repetitions, we observed repetition priming in terms of decreased reaction time and repetition suppression in terms of reduced neural activity. An additional analysis aimed at sublexical phonology did not show significant effects in the areas where repetition suppression was observed. To test if these areas were relevant to real word production, we performed a conjunction analysis with data from a separate fMRI experiment which manipulated word frequency (a putative index of lexical phonological access) in picture naming. The left pSTG demonstrated significant effects independently in both experiments, suggesting that this area participates specifically in accessing lexical phonology.


2001 ◽  
Vol 15 (4) ◽  
pp. 221-240 ◽  
Author(s):  
Kent A. Kiehl ◽  
Kristin R. Laurens ◽  
Timothy L. Duty ◽  
Bruce B. Forster ◽  
Peter F. Liddle

Abstract Whole brain event-related functional magnetic resonance imaging (fMRI) techniques were employed to elucidate the cerebral sites involved in processing rare target and novel visual stimuli during an oddball discrimination task. The analyses of the hemodynamic response to the visual target stimuli revealed a distributed network of neural sources in anterior and posterior cingulate, inferior and middle frontal gyrus, bilateral parietal lobules, anterior superior temporal gyrus, amygdala, and thalamus. The analyses of the hemodynamic response for the visual novel stimuli revealed an extensive network of neural activations in occipital lobes and posterior temporal lobes, bilateral parietal lobules, and lateral frontal cortex. The hemodynamic response associated with processing target and novel stimuli in the visual modality were also compared with data from an analogous study in the auditory modality ( Kiehl et al., 2001 ). Similar patterns of activation were observed for target and novel stimuli in both modalities, but there were some significant differences. The results support the hypothesis that target detection and novelty processing are associated with neural activation in widespread neural areas, suggesting that the brain seems to adopt a strategy of activating many potentially useful brain regions despite the low probability that these brain regions are necessary for task performance.


Neurocase ◽  
2013 ◽  
Vol 19 (6) ◽  
pp. 592-603 ◽  
Author(s):  
Céline Borg ◽  
Nathalie Bedoin ◽  
Roland Peyron ◽  
Soline Bogey ◽  
Bernard Laurent ◽  
...  

2020 ◽  
Vol 1 (1) ◽  
Author(s):  
William Matchin ◽  
Emily Wood

Abstract Matchin and Hickok (2020) proposed that the left posterior inferior frontal gyrus (PIFG) and the left posterior temporal lobe (PTL) both play a role in syntactic processing, broadly construed, attributing distinct functions to these regions with respect to production and perception. Consistent with this hypothesis, functional dissociations between these regions have been demonstrated with respect to lesion–symptom mapping in aphasia. However, neuroimaging studies of syntactic comprehension typically show similar activations in these regions. In order to identify whether these regions show distinct activation patterns with respect to syntactic perception and production, we performed an fMRI study contrasting the subvocal articulation and perception of structured jabberwocky phrases (syntactic), sequences of real words (lexical), and sequences of pseudowords (phonological). We defined two sets of language-selective regions of interest (ROIs) in individual subjects for the PIFG and the PTL using the contrasts [syntactic > lexical] and [syntactic > phonological]. We found robust significant interactions of comprehension and production between these 2 regions at the syntactic level, for both sets of language-selective ROIs. This suggests a core difference in the function of these regions with respect to production and perception, consistent with the lesion literature.


NeuroImage ◽  
2008 ◽  
Vol 41 (3) ◽  
pp. 1142-1153 ◽  
Author(s):  
Sho Yagishita ◽  
Takamitsu Watanabe ◽  
Tomoki Asari ◽  
Hiroshi Ito ◽  
Motoichiro Kato ◽  
...  

2020 ◽  
Author(s):  
Long Tang ◽  
Toshimitsu Takahashi ◽  
Tamami Shimada ◽  
Masayuki Komachi ◽  
Noriko Imanishi ◽  
...  

Abstract The position of any event in time could be in the present, past, or future. This temporal discrimination is vitally important in our daily conversations, but it remains elusive how the human brain distinguishes among the past, present, and future. To address this issue, we searched for neural correlates of presentness, pastness, and futurity, each of which is automatically evoked when we hear sentences such as “it is raining now,” “it rained yesterday,” or “it will rain tomorrow.” Here, we show that sentences that evoked “presentness” activated the bilateral precuneus more strongly than those that evoked “pastness” or “futurity.” Interestingly, this contrast was shared across native speakers of Japanese, English, and Chinese languages, which vary considerably in their verb tense systems. The results suggest that the precuneus serves as a key region that provides the origin (that is, the Now) of our time perception irrespective of differences in tense systems across languages.


2018 ◽  
Vol 9 ◽  
Author(s):  
Keiko Watanabe ◽  
Yuri Masaoka ◽  
Mitsuru Kawamura ◽  
Masaki Yoshida ◽  
Nobuyoshi Koiwa ◽  
...  

Cortex ◽  
2009 ◽  
Vol 45 (4) ◽  
pp. 517-526 ◽  
Author(s):  
Alexander P. Leff ◽  
Paul Iverson ◽  
Thomas M. Schofield ◽  
James M. Kilner ◽  
Jennifer T. Crinion ◽  
...  

2014 ◽  
Vol 2014 ◽  
pp. 1-4 ◽  
Author(s):  
S. Bhattacharyya ◽  
X. Cai ◽  
J. P. Klein

The Gerstmann syndrome of dyscalculia, dysgraphia, left-right confusion, and finger agnosia is generally attributed to lesions near the angular gyrus of the dominant hemisphere. A 68-year-old right-handed woman presented with sudden difficulty completing a Sudoku grid and was found to have dyscalculia, dysgraphia, and left-right confusion. Magnetic resonance imaging (MRI) showed a focus of abnormal reduced diffusivity in the left posterior insula and temporoparietal operculum consistent with acute infarct. Gerstmann syndrome from an insular or peri-insular lesion has not been described in the literature previously. Pathological and functional imaging studies show connections between left posterior insular region and inferior parietal lobe. We postulate that the insula and operculum lesion disrupted key functional networks resulting in a pseudoparietal presentation.


Sign in / Sign up

Export Citation Format

Share Document