scholarly journals Modulation of brain activity by selective attention to audiovisual dialogues

2019 ◽  
Author(s):  
Alina Leminen ◽  
Maxime Verwoert ◽  
Mona Moisala ◽  
Viljami Salmela ◽  
Patrik Wikman ◽  
...  

AbstractIn real-life noisy situations, we can selectively attend to conversations in the presence of irrelevant voices, but neurocognitive mechanisms in such natural listening situations remaiin largely unexplored. Previous research has shown distributed activity in the mid superior temporal gyrus (STG) and sulcus (STS) while listening to speech and human voices, in the posterior STS and fusiform gyrus when combining auditory, visual and linguistic information, as well as in lefthemisphere temporal and frontal cortical areas during comprehension. In the present functional magnetic resonance imaging (fMRI) study, we investigated how selective attention modulates neural responses to naturalistic audiovisual dialogues. Our healthy adult participants (N = 15) selectively attended to video-taped dialogues between a man and woman in the presence of irrelevant continuous speech in the background. We modulated the auditory quality of dialogues with noise vocoding and their visual quality by masking speech-related facial movements. Both increased auditory quality and increased visual quality were associated with bilateral activity enhancements in the STG/STS. In addition, decreased audiovisual stimulus quality elicited enhanced fronto-parietal activity, presumably reflecting increased attentional demands. Finally, attention to the dialogues, in relation to a control task where a fixation cross was attended and the dialogue ignored, yielded enhanced activity in the left planum polare, angular gyrus, the right temporal pole, as well as in the orbitofrontal/ventromedial prefrontal cortex and posterior cingulate gyrus. Our findings suggest that naturalistic conversations effectively engage participants and reveal brain networks related to social perception in addition to speech and semantic processing networks.

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Xiao-Man Yu ◽  
Lin-Lin Qiu ◽  
Hai-Xia Huang ◽  
Xiang Zuo ◽  
Zhen-He Zhou ◽  
...  

Abstract Background Schizophrenia (SZ) and obsessive-compulsive disorder (OCD) share many demographic characteristics and severity of clinical symptoms, genetic risk factors, pathophysiological underpinnings, and brain structure and function. However, the differences in the spontaneous brain activity patterns between the two diseases remain unclear. Here this study aimed to compare the features of intrinsic brain activity in treatment-naive participants with SZ and OCD and to explore the relationship between spontaneous brain activity and the severity of symptoms. Methods In this study, 22 treatment-naive participants with SZ, 27 treatment-naive participants with OCD, and sixty healthy controls (HC) underwent a resting-state functional magnetic resonance imaging (fMRI) scan. The amplitude of low-frequency fluctuation (ALFF), regional homogeneity (ReHo) and degree of centrality (DC) were performed to examine the intrinsic brain activity of participants. Additionally, the relationships among spontaneous brain activity, the severity of symptoms, and the duration of illness were explored in SZ and OCD groups. Results Compared with SZ group and HC group, participants with OCD had significantly higher ALFF in the right angular gyrus and the left middle frontal gyrus/precentral gyrus and significantly lower ALFF in the left superior temporal gyrus/insula/rolandic operculum and the left postcentral gyrus, while there was no significant difference in ALFF between SZ group and HC group. Compared with HC group, lower ALFF in the right supramarginal gyrus/inferior parietal lobule and lower DC in the right lingual gyrus/calcarine fissure and surrounding cortex of the two patient groups, higher ReHo in OCD group and lower ReHo in SZ group in the right angular gyrus/middle occipital gyrus brain region were documented in the present study. DC in SZ group was significantly higher than that in HC group in the right inferior parietal lobule/angular gyrus, while there were no significant DC differences between OCD group and HC group. In addition, ALFF in the left postcentral gyrus were positively correlated with positive subscale score (r = 0.588, P = 0.013) and general psychopathology subscale score (r = 0.488, P = 0.047) respectively on the Positive and Negative Syndrome Scale (PANSS) in SZ group. ALFF in the left superior temporal gyrus/insula/rolandic operculum of participants with OCD were positively correlated with compulsion subscale score (r = 0.463, P = 0.030) on the Yale-Brown Obsessive-Compulsive Scale (Y-BOCS). The longer the illness duration in SZ group, the smaller the ALFF of the left superior temporal gyrus/insula/rolandic operculum (Rho = 0.-492, P = 0.020). The longer the illness duration in OCD group, the higher the ALFF of the right supramarginal gyrus/inferior parietal lobule (Rho = 0.392, P = 0.043) and the left postcentral gyrus (Rho = 0.385, P = 0.048), and the lower the DC of the right inferior parietal lobule/angular gyrus (Rho = − 0.518, P = 0.006). Conclusion SZ and OCD show some similarities in spontaneous brain activity in parietal and occipital lobes, but exhibit different patterns of spontaneous brain activity in frontal, temporal, parietal, occipital, and insula brain regions, which might imply different underlying neurobiological mechanisms in the two diseases. Compared with OCD, SZ implicates more significant abnormalities in the functional connections among brain regions.


2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Meir Meshulam ◽  
Liat Hasenfratz ◽  
Hanna Hillman ◽  
Yun-Fei Liu ◽  
Mai Nguyen ◽  
...  

AbstractDespite major advances in measuring human brain activity during and after educational experiences, it is unclear how learners internalize new content, especially in real-life and online settings. In this work, we introduce a neural approach to predicting and assessing learning outcomes in a real-life setting. Our approach hinges on the idea that successful learning involves forming the right set of neural representations, which are captured in canonical activity patterns shared across individuals. Specifically, we hypothesized that learning is mirrored in neural alignment: the degree to which an individual learner’s neural representations match those of experts, as well as those of other learners. We tested this hypothesis in a longitudinal functional MRI study that regularly scanned college students enrolled in an introduction to computer science course. We additionally scanned graduate student experts in computer science. We show that alignment among students successfully predicts overall performance in a final exam. Furthermore, within individual students, we find better learning outcomes for concepts that evoke better alignment with experts and with other students, revealing neural patterns associated with specific learned concepts in individuals.


2008 ◽  
Vol 20 (12) ◽  
pp. 2185-2197 ◽  
Author(s):  
Jennifer T. Coull ◽  
Bruno Nazarian ◽  
Franck Vidal

The temporal discrimination paradigm requires subjects to compare the duration of a probe stimulus to that of a sample previously stored in working or long-term memory, thus providing an index of timing that is independent of a motor response. However, the estimation process itself comprises several component cognitive processes, including timing, storage, retrieval, and comparison of durations. Previous imaging studies have attempted to disentangle these components by simply measuring brain activity during early versus late scanning epochs. We aim to improve the temporal resolution and precision of this approach by using rapid event-related functional magnetic resonance imaging to time-lock the hemodynamic response to presentation of the sample and probe stimuli themselves. Compared to a control (color-estimation) task, which was matched in terms of difficulty, sustained attention, and motor preparation requirements, we found selective activation of the left putamen for the storage (“encoding”) of stimulus duration into working memory (WM). Moreover, increased putamen activity was linked to enhanced timing performance, suggesting that the level of putamen activity may modulate the depth of temporal encoding. Retrieval and comparison of stimulus duration in WM selectively activated the right superior temporal gyrus. Finally, the supplementary motor area was equally active during both sample and probe stages of the task, suggesting a fundamental role in timing the duration of a stimulus that is currently unfolding in time.


2019 ◽  
Author(s):  
S. A. Herff ◽  
C. Herff ◽  
A. J. Milne ◽  
G. D. Johnson ◽  
J. J. Shih ◽  
...  

AbstractRhythmic auditory stimuli are known to elicit matching activity patterns in neural populations. Furthermore, recent research has established the particular importance of high-gamma brain activity in auditory processing by showing its involvement in auditory phrase segmentation and envelope-tracking. Here, we use electrocorticographic (ECoG) recordings from eight human listeners, to see whether periodicities in high-gamma activity track the periodicities in the envelope of musical rhythms during rhythm perception and imagination. Rhythm imagination was elicited by instructing participants to imagine the rhythm to continue during pauses of several repetitions. To identify electrodes whose periodicities in high-gamma activity track the periodicities in the musical rhythms, we compute the correlation between the autocorrelations (ACC) of both the musical rhythms and the neural signals. A condition in which participants listened to white noise was used to establish a baseline. High-gamma autocorrelations in auditory areas in the superior temporal gyrus and in frontal areas on both hemispheres significantly matched the autocorrelation of the musical rhythms. Overall, numerous significant electrodes are observed on the right hemisphere. Of particular interest is a large cluster of electrodes in the right prefrontal cortex that is active during both rhythm perception and imagination. This indicates conscious processing of the rhythms’ structure as opposed to mere auditory phenomena. The ACC approach clearly highlights that high-gamma activity measured from cortical electrodes tracks both attended and imagined rhythms.


2007 ◽  
Vol 46 (02) ◽  
pp. 247-250 ◽  
Author(s):  
H. Takahashi ◽  
N. Yahata ◽  
M. Matsuura ◽  
K. Asai ◽  
Y. Okubo ◽  
...  

Summary Objectives : In our previous functional magnetic resonance imaging (fMRI) study, we determined that there was distinct left hemispheric dominance for lexical- semantic processing without the influence of human voice perception in right-handed healthy subjects. However, the degree of right-handedness in the right-handed subjects ranged from 52 to 100 according to the Edinburgh Handedness Inventory (EHI) score. In the present study, we aimed to clarify the correlation between the degree of right-handedness and language dominance in the fronto-temporo-parietal cortices by examining cerebral activation for lexical-semantic processing. Methods : Twenty-seven normal right-handed healthy subjects were scanned by fMRI while listening to sentences (SEN), reverse sentences (rSEN), and identifiable non-vocal sounds (SND). Fronto-temporo-parietal activation was observed in the left hemisphere under the SEN - rSEN contrast, which included lexical- semantic processing without the influence of human voice perception. Laterality Indexwas calculated as LI = (L - R)/(L + R) X 100, L: left, R: right. Results : Laterality Index in the fronto-temporo-parietal cortices did not correlate with the degree of right-handedness in EHI score. Conclusions : The present study indicated that the degree of right-handedness from 52 to 100 in EHI score had no effect on the degree of left hemispheric dominance for lexical-semantic processing in right-handed healthy subjects.


2005 ◽  
Vol 93 (3) ◽  
pp. 1498-1509 ◽  
Author(s):  
Christina Schmitz ◽  
Per Jenmalm ◽  
H. Henrik Ehrsson ◽  
Hans Forssberg

When humans repetitively lift the same object, the fingertip forces are targeted to the weight of the object. The anticipatory programming of the forces depends on sensorimotor memory representations that provide information on the object weight. In the present study, we investigate the neural substrates of these sensorimotor memory systems by recording the neural activity during predictable or unpredictable changes in the weight of an object in a lifting task. An unpredictable change in weight leads to erroneous programming of the fingertip forces. This triggers corrective mechanisms and an update of the sensorimotor memories. In the present fMRI study, healthy right-handed subjects repetitively lifted an object between right index finger and thumb. In the constant condition, which served as a control, the weight of the object remained constant (either 230 or 830 g). The weight alternated between 230 and 830 g during the regular condition and was irregularly changed between the two weights during the irregular condition. When we contrasted regular minus constant and irregular minus constant, we found activations in the right inferior frontal gyrus pars opercularis (area 44), the left parietal operculum and the right supramarginal gyrus. Furthermore, irregular was associated with stronger activation in the right inferior frontal cortex as compared with regular. Taken together, these results suggest that the updating of sensorimotor memory representations and the corrective reactions that occur when we manipulate different objects correspond to changes in synaptic activity in these fronto-parietal circuits.


2007 ◽  
Vol 19 (6) ◽  
pp. 1013-1020 ◽  
Author(s):  
Gorana Pobric ◽  
Stefan R. Schweinberger ◽  
Michal Lavidor

Recent evidence suggests that priming of objects across different images (abstract priming) and priming of specific images of an object (form-specific priming) are mediated by dissociable neural processing subsystems that operate in parallel and are predominantly linked to left and right hemispheric processing, respectively [Marsolek, C. J. Dissociable neural subsystems underlie abstract and specific object recognition. Psychological Science, 10, 111–118, 1999]. Previous brain imaging studies have provided important information about the neuroanatomical regions that are involved in form-specific and abstract priming; however, these techniques did not fully establish the functional significance of priming-related changes in cortical brain activity. Here, we used repetitive transcranial magnetic stimulation (rTMS) in order to establish the functional role of the right occipital cortex in form-specific priming [Kroll, N. E. A., Yonelinas, A. P., Kishiyama, M. M., Baynes, K., Knight, R. T., & Gazzaniga, M. S. The neural substrates of visual implicit memory: Do the two hemispheres play different roles? Journal of Cognitive Neuroscience, 15, 833–842, 2003]. Compared to no TMS and sham TMS, rTMS of the right occipital cortex disrupted immediate form-specific priming in a semantic categorization task. Left occipital rTMS, on the other hand, had no converse effect on abstractive priming. Abstract priming may involve deeper semantic processing and may be unresponsive to magnetic stimulation of a single cortical locus. Our TMS results show that form-specific priming relies on a visual word-form system localized in the right occipital lobe, in line with the predictions from divided visual field behavioral studies [Marsolek, 1999].


2011 ◽  
Vol 23 (11) ◽  
pp. 3620-3636 ◽  
Author(s):  
David B. Miele ◽  
Tor D. Wager ◽  
Jason P. Mitchell ◽  
Janet Metcalfe

Judgments of agency refer to people's self-reflective assessments concerning their own control: their assessments of the extent to which they themselves are responsible for an action. These self-reflective metacognitive judgments can be distinguished from action monitoring, which involves the detection of the divergence (or lack of divergence) between observed states and expected states. Presumably, people form judgments of agency by metacognitively reflecting on the output of their action monitoring and then consciously inferring the extent to which they caused the action in question. Although a number of previous imaging studies have been directed at action monitoring, none have assessed judgments of agency as a potentially separate process. The present fMRI study used an agency paradigm that not only allowed us to examine the brain activity associated with action monitoring but that also enabled us to investigate those regions associated with metacognition of agency. Regarding action monitoring, we found that being “out of control” during the task (i.e., detection of a discrepancy between observed and expected states) was associated with increased brain activity in the right TPJ, whereas being “in control” was associated with increased activity in the pre-SMA, rostral cingulate zone, and dorsal striatum (regions linked to self-initiated action). In contrast, when participants made self-reflective metacognitive judgments about the extent of their own control (i.e., judgments of agency) compared with when they made judgments that were not about control (i.e., judgments of performance), increased activity was observed in the anterior PFC, a region associated with self-reflective processing. These results indicate that action monitoring is dissociable from people's conscious self-attributions of control.


2016 ◽  
Author(s):  
Janice Chen ◽  
Yuan Chang Leong ◽  
Kenneth A Norman ◽  
Uri Hasson

Our daily lives revolve around sharing experiences and memories with others. When different people recount the same events, how similar are their underlying neural representations? In this study, participants viewed a fifty-minute audio-visual movie, then verbally described the events while undergoing functional MRI. These descriptions were completely unguided and highly detailed, lasting for up to forty minutes. As each person spoke, event-specific spatial patterns were reinstated (movie-vs.-recall correlation) in default network, medial temporal, and high-level visual areas; moreover, individual event patterns were highly discriminable and similar between people during recollection (recall-vs.-recall similarity), suggesting the existence of spatially organized memory representations. In posterior medial cortex, medial prefrontal cortex, and angular gyrus, activity patterns during recall were more similar between people than to patterns elicited by the movie, indicating systematic reshaping of percept into memory across individuals. These results reveal striking similarity in how neural activity underlying real-life memories is organized and transformed in the brains of different people as they speak spontaneously about past events.


2020 ◽  
Vol 15 (12) ◽  
pp. 1326-1335
Author(s):  
Zhihao Wang ◽  
Yiwen Wang ◽  
Xiaolin Zhou ◽  
Rongjun Yu

Abstract People commonly use bluffing as a strategy to manipulate other people’s beliefs about them for gain. Although bluffing is an important part of successful strategic thinking, the inter-brain mechanisms underlying bluffing remain unclear. Here, we employed a functional near-infrared spectroscopy hyperscanning technique to simultaneously record the brain activity in the right temporal-parietal junction in 32 pairs of participants when they played a bluffing game against each other or with computer opponents separately. We also manipulated the penalty for bluffing (high vs low). Under the condition of high relative to low penalty, results showed a higher bluffing rate and a higher calling rate in human-to-human as compared to human-to-computer pairing. At the neural level, high relative to low penalty condition increased the interpersonal brain synchronization (IBS) in the right angular gyrus (rAG) during human-to-human as compared to human-to-computer interaction. Importantly, bluffing relative to non-bluffing, under the high penalty and human-to-human condition, resulted in an increase in response time and enhanced IBS in the rAG. Participants who bluffed more frequently also elicited stronger IBS. Our findings support the view that regions associated with mentalizing become synchronized during bluffing games, especially under the high penalty and human-to-human condition.


Sign in / Sign up

Export Citation Format

Share Document