Predictive Impact of Contextual Objects during Action Observation: Evidence from Functional Magnetic Resonance Imaging

2020 ◽  
Vol 32 (2) ◽  
pp. 326-337 ◽  
Author(s):  
Nadiya El-Sourani ◽  
Ima Trempler ◽  
Moritz F. Wurm ◽  
Gereon R. Fink ◽  
Ricarda I. Schubotz

The processing of congruent stimuli, such as an object or action in its typical location, is usually associated with reduced neural activity, probably due to facilitated recognition. However, in some situations, congruency increases neural activity—for example, when objects next to observed actions are likely versus unlikely to be involved in forthcoming action steps. Here, we investigated using fMRI whether the processing of contextual cues during action perception is driven by their (in)congruency and, thus, informative value to make sense of an observed scene. Specifically, we tested whether both highly congruent contextual objects (COs), which strongly indicate a future action step, and highly incongruent COs, which require updating predictions about possible forthcoming action steps, provide more anticipatory information about the action course than moderately congruent COs. In line with our hypothesis that especially the inferior frontal gyrus (IFG) subserves the integration of the additional information into the predictive model of the action, we found highly congruent and incongruent COs to increase bilateral activity in action observation nodes, that is, the IFG, the occipitotemporal cortex, and the intraparietal sulcus. Intriguingly, BA 47 was significantly stronger engaged for incongruent COs reflecting the updating of prediction in response to conflicting information. Our findings imply that the IFG reflects the informative impact of COs on observed actions by using contextual information to supply and update the currently operating predictive model. In the case of an incongruent CO, this model has to be reconsidered and extended toward a new overarching action goal.

2018 ◽  
Vol 2018 ◽  
pp. 1-7 ◽  
Author(s):  
Yingzhi Lu ◽  
Qi Zhao ◽  
Yingying Wang ◽  
Chenglin Zhou

Objective. This study aims at investigating differences in the spontaneous brain activity and functional connectivity in the sensorimotor system between ballroom dancers and nondancers, to further support the functional alteration in people with expertise. Materials and Methods. Twenty-three ballroom dancers and twenty-one matched novices with no dance experience were recruited in this study. Amplitude of low-frequency fluctuation (ALFF) and seed-based functional connectivity, as methods for assessing resting-state functional magnetic resonance imaging (rs-fMRI) data, were used to reveal the resting-state brain function in these participants. Results. Compared to the novices, ballroom dancers showed increased ALFF in the left middle temporal gyrus, bilateral precentral gyrus, bilateral inferior frontal gyrus, left postcentral gyrus, left inferior temporal gyrus, right middle occipital gyrus, right superior temporal gyrus, and left middle frontal gyrus. The ballroom dancers also demonstrated lower ALFF in the left lingual gyrus and altered functional connectivity between the inferior frontal gyrus and temporal, parietal regions. Conclusions. Our results indicated that ballroom dancers showed elevated neural activity in sensorimotor regions relative to novices and functional alterations in frontal-temporal and frontal-parietal connectivity, which may reflect specific training experience related to ballroom dancing, including high-capacity action perception, attentional control, and movement adjustment.


2019 ◽  
Vol 121 (4) ◽  
pp. 1451-1464 ◽  
Author(s):  
Andreea Loredana Cretu ◽  
Kathy Ruddy ◽  
Maria Germann ◽  
Nicole Wenderoth

Contextual information accompanying others’ actions modulates “motor resonance”, i.e., neural activity within motor areas that is elicited by movement observation. One possibility is that we weigh and combine such information in a Bayesian manner according to their relative uncertainty. Therefore, contextual information becomes particularly useful when others’ actions are difficult to discriminate. It is unclear, however, whether this uncertainty modulates the neural activity in primary motor cortex (M1) during movement observation. Here, we applied single-pulse transcranial magnetic stimulation (TMS) while subjects watched different grasping actions. We operationalized motor resonance as grip-specific modulation of corticomotor excitability measured in the index (FDI) versus the little finger abductor (ADM). We experimentally modulated either the availability of kinematic information ( experiment 1) or the reliability of contextual cues ( experiment 2). Our results indicate that even in the absence of movement kinematics, reliable contextual information is enough to trigger significant muscle-specific corticomotor excitability changes in M1, which are strongest when both kinematics and contextual information are available. These findings suggest that bottom-up mechanisms that activate motor representations as a function of the observed kinematics and top-down mechanisms that activate motor representations associated with arbitrary cues converge in M1. NEW & NOTEWORTHY Our study reveals new neurophysiological insights in support of the Bayesian account of action observation by showing that “motor resonance”, i.e., neural activity evoked by observing others’ actions, incorporates the uncertainty related to both contextual (prior beliefs) and kinematic (sensory evidence) cues. Notably, we show that muscle-specific modulation of M1 is strongest when context and movement kinematics are available, and it can be elicited even in the absence of movement kinematics.


2018 ◽  
Author(s):  
Andreea Loredana Cretu ◽  
Kathy Ruddy ◽  
Maria Germann ◽  
Nicole Wenderoth

ABSTRACTContextual information accompanying others’ actions modulates “motor resonance”, i.e. neural activity within motor areas that is elicited by movement observation. One possibility is that we weight and combine such information in a Bayesian manner according to their relative uncertainty. Therefore, contextual information becomes particularly useful when others’ actions are ambiguous. It is unclear, however, whether this uncertainty modulates the neural activity in primary motor cortex (M1) during movement observation. Here we applied single-pulse transcranial magnetic stimulation (TMS) while subjects watched different grasping actions. We operationalized motor resonance as grip specific modulation of corticomotor excitability measured in the index (FDI) versus the little finger abductor (ADM). We experimentally modulated either the availability of kinematic information (Exp. 1) or the reliability of contextual cues (Exp. 2). Our results indicate that even in the absence of movement kinematics, reliable contextual information is enough to trigger significant muscle-specific corticomotor excitability changes in M1 (p<.0001) which are strongest when both kinematics and contextual information are available (p<.005). These findings suggest that bottom-up mechanisms that activate motor representations as a function of the observed kinematics, and top-down mechanisms which activate motor representations associated with arbitrary cues converge in M1 in a statistically optimal manner.


2021 ◽  
pp. 1-9
Author(s):  
Haeme R.P. Park ◽  
Miranda R. Chilver ◽  
Arthur Montalto ◽  
Javad Jamshidi ◽  
Peter R. Schofield ◽  
...  

Abstract Background Although mental wellbeing has been linked with positive health outcomes, including longevity and improved emotional and cognitive functioning, studies examining the underlying neural mechanisms of both subjective and psychological wellbeing have been sparse. We assessed whether both forms of wellbeing are associated with neural activity engaged during positive and negative emotion processing and the extent to which this association is driven by genetics or environment. Methods We assessed mental wellbeing in 230 healthy adult monozygotic and dizygotic twins using a previously validated questionnaire (COMPAS-W) and undertook functional magnetic resonance imaging during a facial emotion viewing task. We used linear mixed models to analyse the association between COMPAS-W scores and emotion-elicited neural activation. Univariate twin modelling was used to evaluate heritability of each brain region. Multivariate twin modelling was used to compare twin pairs to assess the contributions of genetic and environmental factors to this association. Results Higher levels of wellbeing were associated with greater neural activity in the dorsolateral prefrontal cortex, localised in the right inferior frontal gyrus (IFG), in response to positive emotional expressions of happiness. Univariate twin modelling showed activity in the IFG to have 20% heritability. Multivariate twin modelling suggested that the association between wellbeing and positive emotion-elicited neural activity was driven by common variance from unique environment (r = 0.208) rather than shared genetics. Conclusions Higher mental wellbeing may have a basis in greater engagement of prefrontal neural regions in response to positive emotion, and this association may be modifiable by unique life experiences.


1993 ◽  
Vol 163 (3) ◽  
pp. 308-314 ◽  
Author(s):  
G. E. Berrios ◽  
E. Y. H. Chen

Current overemphasis on nosological diagnosis has led to a neglect of the process of symptom recognition. There is evidence, however, that the perception of the symptom alone does not guarantee symptom ascertainment since a decision-making component is also involved. To achieve the latter, additional information must be provided by the contextual cues implicit in the ongoing diagnostic hypothesis. Current diagnostic systems, however, still assume a two-stage model according to which symptom and disease recognition are independent cognitive events. This paper suggests that this model is inadequate and that descriptive psychopathology is nottransparent. It then describes a neural network simulation to make various aspects of the problem explicit. This takes into account the multidimensional and probabilistic aspects of symptom recognition and is, from this point of view, superior to traditional algorithmic models. It also has the capacity to represent the different cognitive styles involved in symptom recognition.


2020 ◽  
Vol 14 ◽  
Author(s):  
David A. Tovar ◽  
Jacob A. Westerberg ◽  
Michele A. Cox ◽  
Kacie Dougherty ◽  
Thomas A. Carlson ◽  
...  

Most of the mammalian neocortex is comprised of a highly similar anatomical structure, consisting of a granular cell layer between superficial and deep layers. Even so, different cortical areas process different information. Taken together, this suggests that cortex features a canonical functional microcircuit that supports region-specific information processing. For example, the primate primary visual cortex (V1) combines the two eyes' signals, extracts stimulus orientation, and integrates contextual information such as visual stimulation history. These processes co-occur during the same laminar stimulation sequence that is triggered by the onset of visual stimuli. Yet, we still know little regarding the laminar processing differences that are specific to each of these types of stimulus information. Univariate analysis techniques have provided great insight by examining one electrode at a time or by studying average responses across multiple electrodes. Here we focus on multivariate statistics to examine response patterns across electrodes instead. Specifically, we applied multivariate pattern analysis (MVPA) to linear multielectrode array recordings of laminar spiking responses to decode information regarding the eye-of-origin, stimulus orientation, and stimulus repetition. MVPA differs from conventional univariate approaches in that it examines patterns of neural activity across simultaneously recorded electrode sites. We were curious whether this added dimensionality could reveal neural processes on the population level that are challenging to detect when measuring brain activity without the context of neighboring recording sites. We found that eye-of-origin information was decodable for the entire duration of stimulus presentation, but diminished in the deepest layers of V1. Conversely, orientation information was transient and equally pronounced along all layers. More importantly, using time-resolved MVPA, we were able to evaluate laminar response properties beyond those yielded by univariate analyses. Specifically, we performed a time generalization analysis by training a classifier at one point of the neural response and testing its performance throughout the remaining period of stimulation. Using this technique, we demonstrate repeating (reverberating) patterns of neural activity that have not previously been observed using standard univariate approaches.


2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Melody M. Y. Chan ◽  
Yvonne M. Y. Han

Abstract Background Impaired imitation has been found to be an important factor contributing to social communication deficits in individuals with autism spectrum disorder (ASD). It has been hypothesized that the neural correlate of imitation, the mirror neuron system (MNS), is dysfunctional in ASD, resulting in imitation impairment as one of the key behavioral manifestations in ASD. Previous MNS studies produced inconsistent results, leaving the debate of whether “broken” mirror neurons in ASD are unresolved. Methods This meta-analysis aimed to explore the differences in MNS activation patterns between typically developing (TD) and ASD individuals when they observe biological motions with or without social-emotional components. Effect size signed differential mapping (ES-SDM) was adopted to synthesize the available fMRI data. Results ES-SDM analysis revealed hyperactivation in the right inferior frontal gyrus and left supplementary motor area in ASD during observation of biological motions. Subgroup analysis of experiments involving the observation of stimuli with or without emotional component revealed hyperactivation in the left inferior parietal lobule and left supplementary motor during action observation without emotional components, whereas hyperactivation of the right inferior frontal gyrus was found during action observation with emotional components in ASD. Subgroup analyses of age showed hyperactivation of the bilateral inferior frontal gyrus in ASD adolescents, while hyperactivation in the right inferior frontal gyrus was noted in ASD adults. Meta-regression within ASD individuals indicated that the right cerebellum crus I activation increased with age, while the left inferior temporal gyrus activation decreased with age. Limitations This meta-analysis is limited in its generalization of the findings to individuals with ASD by the restricted age range, heterogeneous study sample, and the large within-group variation in MNS activation patterns during object observation. Furthermore, we only included action observation studies which might limit the generalization of our results to the imitation deficits in ASD. In addition, the relatively small sample size for individual studies might also potentially overestimate the effect sizes. Conclusion The MNS is impaired in ASD. The abnormal activation patterns were found to be modulated by the nature of stimuli and age, which might explain the contradictory results from earlier studies on the “broken mirror neuron” debate.


2015 ◽  
Vol 122 (2) ◽  
pp. 250-261 ◽  
Author(s):  
Edward F. Chang ◽  
Kunal P. Raygor ◽  
Mitchel S. Berger

Classic models of language organization posited that separate motor and sensory language foci existed in the inferior frontal gyrus (Broca's area) and superior temporal gyrus (Wernicke's area), respectively, and that connections between these sites (arcuate fasciculus) allowed for auditory-motor interaction. These theories have predominated for more than a century, but advances in neuroimaging and stimulation mapping have provided a more detailed description of the functional neuroanatomy of language. New insights have shaped modern network-based models of speech processing composed of parallel and interconnected streams involving both cortical and subcortical areas. Recent models emphasize processing in “dorsal” and “ventral” pathways, mediating phonological and semantic processing, respectively. Phonological processing occurs along a dorsal pathway, from the posterosuperior temporal to the inferior frontal cortices. On the other hand, semantic information is carried in a ventral pathway that runs from the temporal pole to the basal occipitotemporal cortex, with anterior connections. Functional MRI has poor positive predictive value in determining critical language sites and should only be used as an adjunct for preoperative planning. Cortical and subcortical mapping should be used to define functional resection boundaries in eloquent areas and remains the clinical gold standard. In tracing the historical advancements in our understanding of speech processing, the authors hope to not only provide practicing neurosurgeons with additional information that will aid in surgical planning and prevent postoperative morbidity, but also underscore the fact that neurosurgeons are in a unique position to further advance our understanding of the anatomy and functional organization of language.


2011 ◽  
Vol 23 (2) ◽  
pp. 414-424 ◽  
Author(s):  
Simone Vossel ◽  
Ralph Weidner ◽  
Gereon R. Fink

Besides the fact that RTs in cognitive tasks are affected by the specific demands of a trial, the context in which this trial occurs codetermines the speed of the response. For instance, invalid spatial cues generally prolong RTs to targets in the location-cueing paradigm, whereas the magnitude of these RT costs additionally varies as a function of the preceding trial types so that RTs for invalid trials may be increased when preceded by valid rather than invalid trials. In the present fMRI study, we investigated trial sequence effects in a combined oddball and location-cueing paradigm. In particular, we tested whether RTs and neural activity to infrequent invalid or deviant targets varied as a function of the number of preceding valid standard trials. As expected, RTs in invalid and deviant trials were significantly slower when more valid standard trials had been presented beforehand. This behavioral effect was reflected in the neural activity of the right inferior/middle frontal gyrus where the amplitude of the hemodynamic response in invalid and deviant trials was positively related to the number of preceding valid standard trials. In contrast, decreased activity (i.e., a negative parametric modulation effect) was observed when more valid standard trials were successively presented. Further positive parametric effects for the number of preceding valid standard trials were observed in the left caudate nucleus and lingual gyrus. The data suggest that inferior frontal cortex extracts both event regularities and irregularities in event streams.


2019 ◽  
Author(s):  
Leyla Tarhan ◽  
Talia Konkle

Humans observe a wide range of actions in their surroundings. How is the visual cortex organized to process this diverse input? Using functional neuroimaging, we measured brain responses while participants viewed short videos of everyday actions, then probed the structure in these responses using voxel-wise encoding modeling. Responses were well fit by feature spaces that capture the body parts involved in an action and the action’s targets (i.e. whether the action was directed at an object, another person, the actor, and space). Clustering analyses revealed five large-scale networks that summarized the voxel tuning: one related to social aspects of an action, and four related to the scale of the interaction envelope, ranging from fine-scale manipulations directed at objects, to large-scale whole-body movements directed at distant locations. We propose that these networks reveal the major representational joints in how actions are processed by visual regions of the brain.Significance StatementHow does the brain perceive other people’s actions? Prior work has established that much of the visual cortex is active when observing others’ actions. However, this activity reflects a wide range of processes, from identifying a movement’s direction to recognizing its social content. We investigated how these diverse processes are organized within the visual cortex. We found that five networks respond during action observation: one that is involved in processing actions’ social content, and four that are involved in processing agent-object interactions and the scale of the effect that these actions have on the world (its “interaction envelope”). Based on these findings, we propose that sociality and interaction envelope size are two of the major features that organize action perception in the visual cortex.


Sign in / Sign up

Export Citation Format

Share Document