scholarly journals Dissociable Roles of Ventral and Dorsal Striatum in Instrumental Conditioning

Science ◽  
2004 ◽  
Vol 304 (5669) ◽  
pp. 452-454 ◽  
Author(s):  
J. O'Doherty
Keyword(s):  
Instrumental Conditioning ◽  
Dorsal Striatum

Viral restoration of dopamine signaling to the dorsal striatum restores instrumental conditioning to dopamine-deficient mice

2006 ◽  
Vol 191 (3) ◽  
pp. 567-578 ◽  
Author(s):  
Siobhan Robinson ◽  
Aundrea J. Rainwater ◽  
Thomas S. Hnasko ◽  
Richard D. Palmiter
Keyword(s):  
Instrumental Conditioning ◽  
Dorsal Striatum ◽  
Dopamine Signaling ◽  
Deficient Mice

scholarly journals Habits are negatively regulated by HDAC3 in the dorsal striatum

2017 ◽  
Author(s):  
Melissa Malvaez ◽  
Venuz Y. Greenfield ◽  
Dina P. Matheos ◽  
Nicolas A. Angelillis ◽  
Michael D. Murphy ◽  
...  
Keyword(s):  
Habit Formation ◽  
Instrumental Conditioning ◽  
Behavioral Control ◽  
Dorsal Striatum ◽  
Negative Regulator ◽  
Regulatory Mechanisms ◽  
Hdac Inhibition ◽  
Optimal Behavior ◽  
Transcriptional Regulatory ◽  
Transcriptional Regulatory Mechanisms

SUMMARYOptimal behavior results from a balance of control between two strategies, one cognitive/goal-directed and one habitual, which rely on the anatomically distinct dorsomedial (DMS) and dorsolateral (DLS) striatum, respectively. The transcriptional regulatory mechanisms required to learn and transition between these strategies are unknown. Here we identified a critical negative regulator of habit learning. Histone deacetylase (HDAC) inhibition following instrumental conditioning accelerated habitual control of behavior. HDAC3, a transcriptional repressor, was removed from the promoters of learning-related genes in the dorsal striatum as habits formed with overtraining and with post-training HDAC inhibition. Decreasing HDAC3 function in the DLS accelerated habit formation, while DLS HDAC3 overexpression prevented habit. HDAC3 activity in the DMS was also found to constrain habit formation. These results challenge the strict dissociation between DMS and DLS function in goal-directed v. habitual behavioral control and identify dorsal striatal HDAC3 as a critical molecular substrate of the transition to habit.

scholarly journals Human Dorsal Striatum Encodes Prediction Errors during Observational Learning of Instrumental Actions

2012 ◽  
Vol 24 (1) ◽  
pp. 106-118 ◽  
Author(s):  
Jeffrey C. Cooper ◽  
Simon Dunne ◽  
Teresa Furey ◽  
John P. O'Doherty
Keyword(s):  
Observational Learning ◽  
Instrumental Conditioning ◽  
Dorsal Striatum ◽  
Prediction Errors ◽  
Learning Condition ◽  
Direct Experience ◽  
Reward Prediction ◽  
Instrumental Task ◽  
Human Participants ◽  
Model Based Analysis

The dorsal striatum plays a key role in the learning and expression of instrumental reward associations that are acquired through direct experience. However, not all learning about instrumental actions require direct experience. Instead, humans and other animals are also capable of acquiring instrumental actions by observing the experiences of others. In this study, we investigated the extent to which human dorsal striatum is involved in observational as well as experiential instrumental reward learning. Human participants were scanned with fMRI while they observed a confederate over a live video performing an instrumental conditioning task to obtain liquid juice rewards. Participants also performed a similar instrumental task for their own rewards. Using a computational model-based analysis, we found reward prediction errors in the dorsal striatum not only during the experiential learning condition but also during observational learning. These results suggest a key role for the dorsal striatum in learning instrumental associations, even when those associations are acquired purely by observing others.

High dietary restraint improves performance on a food-motivated probabilistic selection task

2019 ◽  
Author(s):  
Jennifer R Sadler ◽  
Grace Elisabeth Shearrer ◽  
Nichollette Acosta ◽  
Kyle Stanley Burger
Keyword(s):  
Reinforcement Learning ◽  
Instrumental Conditioning ◽  
Food Reinforcement ◽  
Dietary Restraint ◽  
Memory Task ◽  
Brain Response ◽  
Anthropometric Measures ◽  
Instrumental Task ◽  
The Impact ◽  
Reward And Punishment

BACKGROUND: Dietary restraint represents an individual’s intent to limit their food intake and has been associated with impaired passive food reinforcement learning. However, the impact of dietary restraint on an active, response dependent learning is poorly understood. In this study, we tested the relationship between dietary restraint and food reinforcement learning using an active, instrumental conditioning task. METHODS: A sample of ninety adults completed a response-dependent instrumental conditioning task with reward and punishment using sweet and bitter tastes. Brain response via functional MRI was measured during the task. Participants also completed anthropometric measures, reward/motivation related questionnaires, and a working memory task. Dietary restraint was assessed via the Dutch Restrained Eating Scale. RESULTS: Two groups were selected from the sample: high restraint (n=29, score >2.5) and low restraint (n=30; score <1.85). High restraint was associated with significantly higher BMI (p=0.003) and lower N-back accuracy (p=0.045). The high restraint group also was marginally better at the instrumental conditioning task (p=0.066, r=0.37). High restraint was also associated with significantly greater brain response in the intracalcarine cortex (MNI: 15, -69, 12; k=35, pfwe< 0.05) to bitter taste, compared to neutral taste.CONCLUSIONS: High restraint was associated with improved performance on an instrumental task testing how individuals learn from reward and punishment. This may be mediated by greater brain response in the primary visual cortex, which has been associated with mental representation. Results suggest that dietary restraint does not impair response-dependent reinforcement learning.

The Effect of PAOPA, a Novel Allosteric Modulator of Dopamine D2 Receptors, on Select Signaling Proteins Following Sub-Chronic Administration in the Rat

2020 ◽  
Vol 13 ◽  
Author(s):  
Ritesh Daya ◽  
Joella Ho ◽  
Sharon Thomson ◽  
Jayant Bhandari ◽  
Ram K. Mishra
Keyword(s):  
Frontal Cortex ◽  
Mechanism Of Action ◽  
Dopamine D2 Receptor ◽  
D2 Receptor ◽  
Dorsal Striatum ◽  
D2 Receptors ◽  
Dopamine D2 ◽  
Therapeutic Mechanism ◽  
Clinical Models ◽  
G Protein Coupled

Background: Allosteric modulators of G-protein coupled receptors regulate receptor activity by binding to sites other than the active site and have emerged as a new and highly desirable class of drugs. PAOPA (3(R)-[(2(S)- pyrrolidinylcarbonyl)amino]-2-oxo-1-pyrrolidineacetamide), a peptidomimetic analog of Prolyl-Leucyl-Glycinamide, is a potent dopamine D2 receptor allosteric modulator. PAOPA has shown therapeutic effects in pre-clinical models of schizophrenia and extrapyramidal dysfunction. Objective: in this study, we sought to examine the biomolecular underpinnings of PAOPA‘s therapeutic outcomes in preclinical models of schizophrenia. Method: Following sub-chronic (daily for 7 days) administration of PAOPA, we assessed levels of dopamine D2 receptors, receptor kinases (GRK2 (G protein-coupled receptor kinase 2) and Arrestin-3), and phosphorylated mitogenactivated protein kinase (MAPKs), namely, extracellular signal-regulated kinases (ERK1/2) in the hippocampus, medial pre-frontal cortex, nucleus accumbens, pre-frontal cortex, and dorsal striatum via protein quantification. Results: Following 7 days of daily PAOPA treatment, we observed decreased GRK2 and increased dopamine D2 receptor expression in the dorsal striatum. These findings potentially underscore PAOPA’s therapeutic mechanism of action for the positive-like symptoms of schizophrenia in pre-clinical animal models. Additionally, we observed a decline in GRK2 in the hippocampus and an increase in phosphorylated ERK1 in the pre-frontal cortex, suggestive of a role for PAOPA in treating cognitive and/or affective dysfunction in pre-clinical models. Conclusion: While further studies are required to elucidate PAOPA’s mechanism of action, this study builds on prior investigations and develops an early framework to describe the therapeutic mechanism of action of PAOPA.

scholarly journals Striatal and hippocampal contributions to flexible navigation in rats and humans

2020 ◽  
Vol 4 ◽  
pp. 239821282097977
Author(s):  
Christoffer J. Gahnstrom ◽  
Hugo J. Spiers
Keyword(s):  
Caudate Nucleus ◽  
Spatial Navigation ◽  
Dorsal Striatum ◽  
Future Research ◽  
Neural Responses ◽  
Learning Models ◽  
Transition Structure ◽  
Cortical Areas ◽  
Reinforcement Learning Models ◽  
Human Neuroimaging

The hippocampus has been firmly established as playing a crucial role in flexible navigation. Recent evidence suggests that dorsal striatum may also play an important role in such goal-directed behaviour in both rodents and humans. Across recent studies, activity in the caudate nucleus has been linked to forward planning and adaptation to changes in the environment. In particular, several human neuroimaging studies have found the caudate nucleus tracks information traditionally associated with that by the hippocampus. In this brief review, we examine this evidence and argue the dorsal striatum encodes the transition structure of the environment during flexible, goal-directed behaviour. We highlight that future research should explore the following: (1) Investigate neural responses during spatial navigation via a biophysically plausible framework explained by reinforcement learning models and (2) Observe the interaction between cortical areas and both the dorsal striatum and hippocampus during flexible navigation.

Sign in / Sign up

Export Citation Format

Share Document