scholarly journals The Role of Striatal Tonically Active Neurons in Reward Prediction Error Signaling during Instrumental Task Performance

2011 ◽  
Vol 31 (4) ◽  
pp. 1507-1515 ◽  
Author(s):  
P. Apicella ◽  
S. Ravel ◽  
M. Deffains ◽  
E. Legallet
Keyword(s):  
Task Performance ◽  
Prediction Error ◽  
Reward Prediction Error ◽  
Tonically Active Neurons ◽  
Reward Prediction ◽  
Instrumental Task

scholarly journals Reward prediction error and declarative memory

2020 ◽  
Author(s):  
Kate Ergo ◽  
Esther De Loof ◽  
Tom Verguts
Keyword(s):  
Prediction Error ◽  
Declarative Memory ◽  
Empirical Studies ◽  
Reward Prediction Error ◽  
Reward Prediction ◽  
Emerging Patterns ◽  
Declarative Learning ◽  
Open Issues

Learning based on reward prediction error (RPE) was originally proposed in the context of non-declarative memory. We postulate that RPE may support declarative memory as well. Indeed, recent years have witnessed a number of independent empirical studies reporting effects of RPE on declarative memory. In this paper, we provide a brief overview of these studies, point out emerging patterns, and identify open issues such as the role of signed versus unsigned RPEs in declarative learning.

scholarly journals Dopamine neurons of the VTA encode active conspecific interaction and promote social learning through social reward prediction error

2020 ◽  
Author(s):  
Clément Prévost-Solié ◽  
Benoit Girard ◽  
Beatrice Righetti ◽  
Malika Tapparel ◽  
Camilla Bellone
Keyword(s):  
Social Learning ◽  
Social Interactions ◽  
Prediction Error ◽  
Cooperative Behavior ◽  
Dopamine Neurons ◽  
Neuron Activity ◽  
Social Reward ◽  
Reward Prediction Error ◽  
Reward Prediction ◽  
Instrumental Task

AbstractSocial interactions motivate behavior in many species, facilitating learning, foraging and cooperative behavior. However, how the brain encodes the reinforcing properties of social interactions remains elusive. Here using in vivo recording in freely moving mice, we show that Dopamine (DA) neurons of the Ventral Tegmental Area (VTA) increase their activity during active interactions with unfamiliar conspecific. Using a social instrumental task, we then show that VTA DA neuron activity signals social reward prediction error and drives social reinforcement learning. Thereby, our findings propose that VTA DA neurons are a neural substrate for a social learning signal driving motivated behavior.One Sentence SummaryDA neurons are a substrate for social reward learning through the Social Reward Prediction Error.

scholarly journals Distinct signals in medial and lateral VTA dopamine neurons modulate fear extinction at different times

eLife ◽  
2020 ◽  
Vol 9 ◽  
Author(s):  
Lili X Cai ◽  
Katherine Pizano ◽  
Gregory W Gundersen ◽  
Cameron L Hayes ◽  
Weston T Fleming ◽  
...  
Keyword(s):  
Deep Learning ◽  
Prediction Error ◽  
Fear Extinction ◽  
Freezing Behavior ◽  
Dopamine Neurons ◽  
Reward Prediction Error ◽  
Reward Prediction ◽  
Time Period ◽  
Temporal Dependencies

Dopamine (DA) neurons are thought to encode reward prediction error (RPE), in addition to other signals, such as salience. While RPE is known to support learning, the role of salience in learning remains less clear. To address this, we recorded and manipulated VTA DA neurons in mice during fear extinction. We applied deep learning to classify mouse freezing behavior, eliminating the need for human scoring. Our fiber photometry recordings showed DA neurons in medial and lateral VTA have distinct activity profiles during fear extinction: medial VTA activity more closely reflected RPE, while lateral VTA activity more closely reflected a salience-like signal. Optogenetic inhibition of DA neurons in either region slowed fear extinction, with the relevant time period for inhibition differing across regions. Our results indicate salience-like signals can have similar downstream consequences to RPE-like signals, although with different temporal dependencies.

scholarly journals Distinct signals in medial and lateral VTA dopamine neurons modulate fear extinction at different times

2020 ◽  
Author(s):  
Lili X. Cai ◽  
Katherine Pizano ◽  
Gregory W. Gundersen ◽  
Cameron L. Hayes ◽  
Weston T. Fleming ◽  
...  
Keyword(s):  
Deep Learning ◽  
Prediction Error ◽  
Fear Extinction ◽  
Freezing Behavior ◽  
Dopamine Neurons ◽  
Reward Prediction Error ◽  
Reward Prediction ◽  
Time Period ◽  
Temporal Dependencies

Dopamine (DA) neurons are known to encode reward prediction error (RPE), in addition to other signals, such as salience. While RPE is known to support learning, the role of salience in supporting learning remains less clear. To address this, we recorded and manipulated VTA DA neurons in mice during fear extinction, a behavior we observed to generate spatially segregated RPE and salience signals. We applied deep learning to classify mouse freezing behavior, eliminating the need for human scoring. Our fiber photometry recordings showed that DA neurons in medial and lateral VTA have distinct activity profiles during fear extinction: medial VTA activity more closely reflected RPE, while lateral VTA activity more closely reflected a salience-like signal. Optogenetic inhibition of DA neurons in either region slowed fear extinction, with the relevant time period for inhibition differing across regions. Our results indicate that salience-like signals can have similar downstream consequences to RPE-like signals, although with different temporal dependencies.

scholarly journals A VTA GABAergic computational model of dissociated reward prediction error computation in classical conditioning

2020 ◽  
Author(s):  
Pramod Kaushik ◽  
Jérémie Naudé ◽  
Surampudi Bapi Raju ◽  
Frédéric Alexandre
Keyword(s):  
Classical Conditioning ◽  
Computational Model ◽  
Prediction Error ◽  
Ventral Striatum ◽  
Dopamine Neurons ◽  
System Level ◽  
Reward Prediction Error ◽  
Twin Peaks ◽  
Reward Prediction ◽  
Error Computation

AbstractClassical Conditioning is a fundamental learning mechanism where the Ventral Striatum is generally thought to be the source of inhibition to Ventral Tegmental Area (VTA) Dopamine neurons when a reward is expected. However, recent evidences point to a new candidate in VTA GABA encoding expectation for computing the reward prediction error in the VTA. In this system-level computational model, the VTA GABA signal is hypothesised to be a combination of magnitude and timing computed in the Peduncolopontine and Ventral Striatum respectively. This dissociation enables the model to explain recent results wherein Ventral Striatum lesions affected the temporal expectation of the reward but the magnitude of the reward was intact. This model also exhibits other features in classical conditioning namely, progressively decreasing firing for early rewards closer to the actual reward, twin peaks of VTA dopamine during training and cancellation of US dopamine after training.

T92. Time Scales of Encoding the Reward Prediction Error in Youth: Representation of Past Events

2018 ◽  
Vol 83 (9) ◽  
pp. S164
Author(s):  
Hanna Keren ◽  
Nathan Fox ◽  
Ellen Leibenluft ◽  
Daniel S. Pine ◽  
Argyris Stringaris
Keyword(s):  
Time Scales ◽  
Prediction Error ◽  
Reward Prediction Error ◽  
Reward Prediction

scholarly journals O5.1. STRIATAL DOPAMINE AND REDUCED REWARD PREDICTION ERROR SIGNALING IN UNMEDICATED SCHIZOPHRENIA PATIENTS

2020 ◽  
Vol 46 (Supplement_1) ◽  
pp. S11-S11
Author(s):  
Teresa Katthagen ◽  
Jakob Kaminski ◽  
Andreas Heinz ◽  
Ralph Buchert ◽  
Florian Schlagenhauf
Keyword(s):  
Prediction Error ◽  
Negative Symptoms ◽  
Ventral Striatum ◽  
Striatal Dopamine ◽  
Dopamine Synthesis ◽  
Positive Symptoms ◽  
Healthy Controls ◽  
Reward Prediction Error ◽  
Reward Prediction ◽  
Significant Difference

Abstract Background Increased striatal dopamine synthesis capacity (DSC) has consistently been reported in patients with schizophrenia (Sz). However, the functional mechanism translating this into behavior and symptoms remains unclear. It has been proposed that heightened striatal dopamine may blunt dopaminergic reward prediction error (RPE) signaling during reinforcement learning. Methods In this study, we investigated striatal DSC and RPEs and their association in unmedicated Sz and healthy controls. 23 healthy controls (HC) and 20 unmedicated Sz took part in an FDOPA-PET scan measuring DSC and underwent fMRI scanning, where they performed a reversal learning paradigm. We compared groups regarding DSC und neural RPE signals and probed the respective correlation (23 HC and 16 Sz for both measures). Results There was no significant difference between HC and Sz in DSC. Taking into account comorbid alcohol abuse revealed that only patients without such abuse showed elevated DSC in the associative and sensorimotor striatum, while those with abuse did not differ from HC. Patients performed worse during learning, accompanied by a reduced RPE signal in the ventral striatum. In HC, the DSC in the limbic striatum correlated with higher RPE signaling, while there was no significant association in patients. DSC in the associative striatum correlated with higher positive symptoms, and blunted RPE signaling was associated with negative symptoms. Discussion Our results suggest that dopamine modulation of RPE is impaired in schizophrenia. Furthermore, we observed a dissociation with elevated DSC in the associative and sensorimotor striatum contributing to positive symptoms and blunted RPE in the ventral striatum to negative symptoms.

Sign in / Sign up

Export Citation Format

Share Document