scholarly journals Biased credit assignment in motivational learning biases arises through prefrontal influences on striatal learning

2021 ◽  
Author(s):  
Johannes Algermissen ◽  
Jennifer C. Swart ◽  
Rene Scheeringa ◽  
Roshan Cools ◽  
Hanneke E. M. den Ouden

Actions are biased by the outcomes they can produce: Humans are more likely to show action under reward prospect, but hold back under punishment prospect. Such motivational biases derive not only from biased response selection, but also from biased learning: humans tend to attribute rewards to their own actions, but are reluctant to attribute punishments to having held back. The neural origin of these biases is unclear; in particular, it remains open whether motivational biases arise solely from an evolutionarily old, subcortical architecture or also due to younger, cortical influences. Simultaneous EEG-fMRI allowed us to track which regions encoded biased prediction errors in which order. Biased prediction errors occurred in cortical regions (ACC, vmPFC, PCC) before subcortical regions (striatum). These results highlight that biased learning is not a mere feature of the basal ganglia, but arises through prefrontal cortical contributions, revealing motivational biases to be a potentially flexible, sophisticated mechanism.

Author(s):  
Nikolaus Steinbeis

This chapter reviews the neurocognitive mechanisms underlying social development during middle childhood. The author focuses on social abilities (e.g., theory of mind and empathy) and prosocial behavior (e.g., sharing and helping). The chapter discusses studies and theories on developmental changes in these social phenomena and references evidence of neurocognitive underpinnings where available. The author argues that changes in social development during childhood can best be explained in developments in regulatory processes, such as behavioral control, emotion regulation, conflict processing, and self-other control. The author refers to this cluster of functions as social control mechanisms. Changes in these social control mechanisms are driven by the maturation of neural circuitry comprising prefrontal cortical regions and their interactions with subcortical regions. Crucially, while the neurocognitive mechanisms underlying social development are distinct for different abilities and behaviors, it appears to be domain-general processes that predominantly shape social development during middle childhood.


2019 ◽  
Vol 30 (1) ◽  
pp. 85-99 ◽  
Author(s):  
Farshad A Mansouri ◽  
Mark J Buckley ◽  
Daniel J Fehring ◽  
Keiji Tanaka

Abstract Imaging and neural activity recording studies have shown activation in the primate prefrontal cortex when shifting attention between visual dimensions is necessary to achieve goals. A fundamental unanswered question is whether representations of these dimensions emerge from top-down attentional processes mediated by prefrontal regions or from bottom-up processes within visual cortical regions. We hypothesized a causative link between prefrontal cortical regions and dimension-based behavior. In large cohorts of humans and macaque monkeys, performing the same attention shifting task, we found that both species successfully shifted between visual dimensions, but both species also showed a significant behavioral advantage/bias to a particular dimension; however, these biases were in opposite directions in humans (bias to color) versus monkeys (bias to shape). Monkeys’ bias remained after selective bilateral lesions within the anterior cingulate cortex (ACC), frontopolar cortex, dorsolateral prefrontal cortex (DLPFC), orbitofrontal cortex (OFC), or superior, lateral prefrontal cortex. However, lesions within certain regions (ACC, DLPFC, or OFC) impaired monkeys’ ability to shift between these dimensions. We conclude that goal-directed processing of a particular dimension for the executive control of behavior depends on the integrity of prefrontal cortex; however, representation of competing dimensions and bias toward them does not depend on top-down prefrontal-mediated processes.


Stroke ◽  
2015 ◽  
Vol 46 (suppl_1) ◽  
Author(s):  
David S Liebeskind ◽  
Sunil A Sheth ◽  
Farhad Mehrkhani ◽  
Shahmir Kamalian ◽  
Fabien Scalzo ◽  
...  

Background: Numerous studies have compared CT with DWI ASPECTS, yet differences in timing between study acquisition may impart error or confound. We analyzed a large cohort of concurrently acquired CT and MRI to discern differences in regional variation in the ability to detect early ischemia. Methods: CT and DWI were acquired within 1 hour of each other during the first 8 hours after symptom onset and pooled from two large academic stroke centers for these analyses. Two raters independently scored CT ASPECTS and DWI ASPECTS at separate reading sessions. Modified DWI-ASPECTS (including only >20% per region) was also scored. Consensus readings were then utilized to compare regional ASPECTS across the 3 ASPECTS scales using the kappa statistic. Results: 136 patients underwent both CT and DWI within 1 hour of each other in the setting of acute ischemic stroke. Regional involvement on DWI included caudate in 57%, lentiform in 73%, insula in 69%, internal capsule in 24%, M1 in 34%, M2 in 49%, M3 in 36%, M4 in 21%, M5 in 57% and M6 in 41%. The agreement between CT and DWI varied by region, from caudate kappa 0.616 (0.484-0.748), to lentiform 0.602 (0.457-0.748), insula 0.690 (0.558-0.822), internal capsule 0.374 (0.189-0.559), M1 0.583 (0.435-0.731), M2 0.515 (0.389-0.641), M3 0.421 (0.275-0.568), M4 0.453 (0.262-0.644), M5 0.388 (0.268-0.507) and M6 0.500 (0.366-0.634). Modified DWI-ASPECTS (>20% per region) and CT demonstrated overall better agreement, yet still markedly varied by region. In general, CT and DWI ASPECTS reveal good agreement in subcortical structures, whereas very limited agreement is noted in several cortical ischemic regions. Modified-DWI ASPECTS improves cortical agreement, yet remains poor in the internal capsule. Conclusions: Detection of early ischemia varies considerably depending on the location or topography depicted with either CT or MRI. Deep subcortical regions are best detected with either modality, whereas cortical regions exhibit marked distinctions. Modified DWI ASPECTS improves agreement with CT ASPECTS in cortical regions.


2007 ◽  
Vol 1 (1) ◽  
pp. 10-17 ◽  
Author(s):  
André Palmini ◽  
Victor Geraldi Haase

Abstract The constant conflict between decisions leading to immediate pleasurable consequences versus behaviors aiming at long-term social advantages is reviewed here in the framework of the evolutionary systems regulating behavior. The inescapable temporal perspective in decision-making in everyday life is highlighted and integrated with the role of the executive functions in the modulation of subcortical systems. In particular, the representations of the 'non-existent' future in the prefrontal cortical regions and how these representations can bridge theory and practice in everyday life are addressed. Relevant discussions regarding the battle between emotions and reasons in the determination of more complex decisions in the realm of neuroeconomics and in moral issues have been reserved for a second essay.


2013 ◽  
Vol 7 (1) ◽  
pp. 75-82 ◽  
Author(s):  
Dong Seok Yi ◽  
Maxime Bertoux ◽  
Eneida Mioshi ◽  
John R. Hodges ◽  
Michael Hornberger

ABSTRACT Behavioural disturbances in frontotemporal dementia (FTD) are thought to reflect mainly atrophy of cortical regions. Recent studies suggest that subcortical brain regions, in particular the striatum, are also significantly affected and this pathology might play a role in the generation of behavioural symptoms. Objective: To investigate prefrontal cortical and striatal atrophy contributions to behavioural symptoms in FTD. Methods: One hundred and eighty-two participants (87 FTD patients, 39 AD patients and 56 controls) were included. Behavioural profiles were established using the Cambridge Behavioural Inventory Revised (CBI-R) and Frontal System Behaviour Scale (FrSBe). Atrophy in prefrontal (VMPFC, DLPFC) and striatal (caudate, putamen) regions was established via a 5-point visual rating scale of the MRI scans. Behavioural scores were correlated with atrophy rating scores. Results: Behavioural and atrophy ratings demonstrated that patients were significantly impaired compared to controls, with bvFTD being most severely affected. Behavioural-anatomical correlations revealed that VMPFC atrophy was closely related to abnormal behaviour and motivation disturbances. Stereotypical behaviours were associated with both VMPFC and striatal atrophy. By contrast, disturbance of eating was found to be related to striatal atrophy only. Conclusion: Frontal and striatal atrophy contributed to the behavioural disturbances seen in FTD, with some behaviours related to frontal, striatal or combined fronto-striatal pathology. Consideration of striatal contributions to the generation of behavioural disturbances should be taken into account when assessing patients with potential FTD.


2020 ◽  
Author(s):  
Jayne Morriss ◽  
Tiffany Bell ◽  
Nicolò Biagi ◽  
Tom Johnstone ◽  
Carien M. van Reekum

AbstractHeightened responding to uncertain threat is associated with anxiety disorder pathology. Here, we sought to determine if individual differences in self-reported intolerance of uncertainty (IU) underlie differential recruitment of neural circuitry during instructed threat of shock (n = 42). During the task, cues signalled uncertain threat of shock (50%) or certain safety from shock. Ratings, skin conductance and functional magnetic resonance imaging was acquired. Overall, participants displayed greater amygdala activation to uncertain threat vs. safe cues, in the absence of an effect of IU. However, we found that high was associated with greater activity in the medial prefrontal cortex and dorsomedial rostral prefrontal cortex to uncertain threat vs safe cues. These findings suggest that, during instructed threat of shock, IU is specifically related, over trait anxiety, to activation in prefrontal cortical regions. Taken together, these findings highlight the potential of self-reported IU in identifying mechanisms that may be related to conscious threat appraisal and anxiety disorder pathology.


2020 ◽  
Author(s):  
Chad E. Forbes ◽  
Rachel C Amey ◽  
Adam Magerman ◽  
Irmak Olcaysoy Okten

Social identity and stereotype threat (ST) are situational stressors that increase arousal and negative affect and impair performance when women are outnumbered by men. One consequence of these effects could be that women develop learned aversions towards stigmatized STEM domains. Five studies tested whether stereotypic STEM images (STEMIs) prompt aversive responses that predict ST-like outcomes, including underperformance in ST contexts and more negative ST-oriented memories over time. Using a dot-probe paradigm, Studies 1 and 2 found that women perceived STEMIs as more negatively arousing compared to men, but only ST women exhibited greater arousal responses to STEMIs compared to stereotypic non-STEM images (NonSTEMIs) and underperformed; men in this context showed a similar arousal response to STEMIs and NonSTEMIs and performed better. Study 3 replicated this effect among female STEM majors and linked aversive responses to more negative affect laden memories for the STEM lab experience five weeks later. Using EEG, Study 4 found that enhanced processing of STEMIs presented during an attentional blink task (indexed via increased communication between occipital and prefrontal cortical regions) predicted underperformance on a math test among ST women but marginally better performance among men. Study 5 mitigated ST underperformance effects among women utilizing a dot-probe training paradigm that blunted arousal responses to STEMIs; instructing men to attend to STEMIs facilitated their performance. STEM aversions may thus facilitate ST-like effects, possibly defining what the “threat” in ST is, however, blunting aversions can attenuate these effects when women work alongside men in STEM performance situations.


2003 ◽  
Vol 9 (7) ◽  
pp. 1031-1040 ◽  
Author(s):  
MICHAEL A. KRAUT ◽  
VINCE CALHOUN ◽  
JEFFERY A. PITCOCK ◽  
CATHERINE CUSICK ◽  
JOHN HART

Previous studies by our group have demonstrated fMRI signal changes and synchronized gamma rhythm EEG oscillations between thalamus and cortical regions as subjects recall objects from visually presented features. Here, we extend this work by estimating the time course of fMRI signal changes in the cortical and subcortical regions found to exhibit evidence for task-related activation. Our results indicate that there are separate loci of signal changes in the thalamus (dorsomedial and pulvinar) that exhibit notable differences in times of onset, peak and return to baseline of signal changes. The signal changes in the pulvinar demonstrate the slowest transients of all the cortical and subcortical regions we examined. Evaluation of cortical regions demonstrated salient differences as well, with the signal changes in Brodmann area 6 (BA6) rising, peaking, and returning to baseline earlier than those detected in other regions. We conclude that BA6 mediates early designation or refinement of search criteria, and that the pulvinar may be involved in the binding of feature stimuli for an integrated object memory. (JINS, 2003, 9, 1031–1040.)


Sign in / Sign up

Export Citation Format

Share Document