scholarly journals Neural Basis of the Sound-Symbolic Crossmodal Correspondence Between Auditory Pseudowords and Visual Shapes

2021 ◽  
pp. 1-50
Author(s):  
Kelly McCormick ◽  
Simon Lacey ◽  
Randall Stilla ◽  
Lynne C. Nygaard ◽  
K. Sathian

Abstract Sound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g., ‘takete’ or ‘maluma’, and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword–shape pairs that were sound-symbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. During attention to auditory pseudowords, however, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test competing explanations of sound symbolism, but found no evidence for mediation via language, and only limited evidence for accounts based on multisensory integration and a general magnitude system. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.

2018 ◽  
Author(s):  
Kelly McCormick ◽  
Simon Lacey ◽  
Randall Stilla ◽  
Lynne C. Nygaard ◽  
K. Sathian

ABSTRACTSound symbolism refers to the association between the sounds of words and their meanings, often studied using the crossmodal correspondence between auditory pseudowords, e.g. ‘takete’ or ‘maluma’, and pointed or rounded visual shapes, respectively. In a functional magnetic resonance imaging study, participants were presented with pseudoword-shape pairs that were sound-symbolically congruent or incongruent. We found no significant congruency effects in the blood oxygenation level-dependent (BOLD) signal when participants were attending to visual shapes. Rather, during attention to auditory pseudowords, we observed greater BOLD activity for incongruent compared to congruent audiovisual pairs bilaterally in the intraparietal sulcus and supramarginal gyrus, and in the left middle frontal gyrus. We compared this activity to independent functional contrasts designed to test potential underlying mechanisms, but found no evidence for semantic mediation, and only limited evidence for multisensory integration and magnitude estimation. Instead, we suggest that the observed incongruency effects are likely to reflect phonological processing and/or multisensory attention. These findings advance our understanding of sound-to-meaning mapping in the brain.


2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Mi Li ◽  
Hongpei Xu ◽  
Shengfu Lu

Background. In the past, studies on the lateralization of the left and right hemispheres of the brain suggested that depression is dominated by the right hemisphere of the brain, but the neural basis of this theory remains unclear. Method. Functional magnetic resonance imaging of the brain was performed in 22 depressive patients and 15 healthy controls. The differences in the mean values of the regional homogeneity (ReHo) of two groups were compared, and the low-frequency amplitudes of these differential brain regions were compared. Results. The results show that compared with healthy subjects, depressive patients had increased ReHo values in the right superior temporal gyrus, right middle temporal gyrus, left inferior temporal gyrus, left middle temporal gyrus, right middle frontal gyrus, triangular part of the right inferior frontal gyrus, orbital part of the right inferior frontal gyrus, right superior occipital gyrus, right middle occipital gyrus, bilateral anterior cingulate, and paracingulate gyri; reduced ReHo values were seen in the right fusiform gyrus, left middle occipital gyrus, left lingual gyrus, and left inferior parietal except in the supramarginal and angular gyri. Conclusions. The results show that regional homogeneity mainly occurs in the right brain, and the overall performance of the brain is such that right hemisphere synchronization is enhanced while left hemisphere synchronization is weakened. ReHo abnormalities in the resting state can predict abnormalities in individual neurological activities that reflect changes in the structure and function of the brain; abnormalities shown with this indicator are the neuronal basis for the phenomenon that the right hemisphere of the brain has a dominant effect on depression.


2009 ◽  
Vol 30 (2) ◽  
pp. 449-458 ◽  
Author(s):  
Barış Yeşilyurt ◽  
Kevin Whittingstall ◽  
Kâmil Uğurbil ◽  
Nikos K Logothetis ◽  
Kâmil Uludağ

There is currently a great interest to combine electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) to study brain function. Earlier studies have shown different EEG components to correlate well with the fMRI signal arguing for a complex relationship between both measurements. In this study, using separate EEG and fMRI measurements, we show that (1) 0.1 ms visual stimulation evokes detectable hemodynamic and visual-evoked potential (VEP) responses, (2) the negative VEP deflection at ∼80 ms (N2) co-varies with stimulus duration/intensity such as with blood oxygenation level-dependent (BOLD) response; the positive deflection at ∼120 ms (P2) does not, and (3) although the N2 VEP–BOLD relationship is approximately linear, deviation is evident at the limit of zero N2 VEP. The latter finding argues that, although EEG and fMRI measurements can co-vary, they reflect partially independent processes in the brain tissue. Finally, it is shown that the stimulus-induced impulse response function (IRF) at 0.1 ms and the intrinsic IRF during rest have different temporal dynamics, possibly due to predominance of neuromodulation during rest as compared with neurotransmission during stimulation. These results extend earlier findings regarding VEP–BOLD coupling and highlight the component- and context-dependency of the relationship between evoked potentials and hemodynamic responses.


2021 ◽  
Author(s):  
Xingyu Liu ◽  
Yuxuan Dai ◽  
Hailun Xie ◽  
Zonglei Zhen

Naturalistic stimuli, such as movies, are being increasingly used to map brain function because of their high ecological validity. The pioneering studyforrest and other naturalistic neuroimaging projects have provided free access to multiple movie-watching functional magnetic resonance imaging (fMRI) datasets to prompt the community for naturalistic experimental paradigms. However, sluggish blood-oxygenation-level-dependent fMRI signals are incapable of resolving neuronal activity with the temporal resolution at which it unfolds. Instead, magnetoencephalography (MEG) measures changes in the magnetic field produced by neuronal activity and is able to capture rich dynamics of the brain at the millisecond level while watching naturalistic movies. Herein, we present the first public prolonged MEG dataset collected from 11 participants while watching the 2 h long audio-visual movie "Forrest Gump". Minimally preprocessed data was also provided to facilitate the use. As a studyforrest extension, we envision that this dataset, together with fMRI data from the studyforrest project, will serve as a foundation for exploring the neural dynamics of various cognitive functions in real-world contexts.


eLife ◽  
2014 ◽  
Vol 3 ◽  
Author(s):  
Robert L Barry ◽  
Seth A Smith ◽  
Adrienne N Dula ◽  
John C Gore

Functional magnetic resonance imaging using blood oxygenation level dependent (BOLD) contrast is well established as one of the most powerful methods for mapping human brain function. Numerous studies have measured how low-frequency BOLD signal fluctuations from the brain are correlated between voxels in a resting state, and have exploited these signals to infer functional connectivity within specific neural circuits. However, to date there have been no previous substantiated reports of resting state correlations in the spinal cord. In a cohort of healthy volunteers, we observed robust functional connectivity between left and right ventral (motor) horns, and between left and right dorsal (sensory) horns. Our results demonstrate that low-frequency BOLD fluctuations are inherent in the spinal cord as well as the brain, and by analogy to cortical circuits, we hypothesize that these correlations may offer insight into the execution and maintenance of sensory and motor functions both locally and within the cerebrum.


2010 ◽  
Vol 104 (4) ◽  
pp. 1838-1840 ◽  
Author(s):  
Helen. S. Palmer

Blood oxygenation level dependent (BOLD) functional magnetic resonance imaging (fMRI) is widely used as a measure of neuronal activity, despite an incomplete understanding of the hemodynamic and neural bases for BOLD signals. Recent work by Lee and colleagues investigated whether activating genetically specified neurons elicits BOLD responses. Integrating optogenetic control of specific cells and fMRI showed that stimulating excitatory neurons triggers a positive BOLD signal with conventional kinetics locally and delayed weaker BOLD signals distally.


Sign in / Sign up

Export Citation Format

Share Document