scholarly journals Phasic inhibition of dopamine neurons is an instrumental punisher

2020 ◽  
Author(s):  
Constance Yunzhi Peng ◽  
Philip Jean-Richard-dit-Bressel ◽  
Sophia Gilchrist ◽  
John M. Power ◽  
Gavan P. McNally

AbstractIt is well established that the activity of VTA dopamine neurons is sufficient to serve as a Pavlovian reinforcer but whether this activity can also serve as instrumental reinforcer is less well understood. Here we studied the effects of optogenetic inhibition of VTA dopamine neurons in instrumental conditioning preparations. We show that optogenetic inhibition of VTA dopamine neurons causes a response-specific, contingency-sensitive suppression of instrumental responding. This suppression was due to instrumental response, not Pavlovian stimulus, learning and could not be attributed to deepened instrumental extinction learning. These effects of optogenetic inhibition of VTA dopamine neurons on instrumental responding are formally similar to the effects of aversive events in instrumental preparations and show that optogenetic inhibition of VTA dopamine neurons is sufficient to serve as an instrumental punisher.

eLife ◽  
2016 ◽  
Vol 5 ◽  
Author(s):  
Hideyuki Matsumoto ◽  
Ju Tian ◽  
Naoshige Uchida ◽  
Mitsuko Watabe-Uchida

Dopamine is thought to regulate learning from appetitive and aversive events. Here we examined how optogenetically-identified dopamine neurons in the lateral ventral tegmental area of mice respond to aversive events in different conditions. In low reward contexts, most dopamine neurons were exclusively inhibited by aversive events, and expectation reduced dopamine neurons’ responses to reward and punishment. When a single odor predicted both reward and punishment, dopamine neurons’ responses to that odor reflected the integrated value of both outcomes. Thus, in low reward contexts, dopamine neurons signal value prediction errors (VPEs) integrating information about both reward and aversion in a common currency. In contrast, in high reward contexts, dopamine neurons acquired a short-latency excitation to aversive events that masked their VPE signaling. Our results demonstrate the importance of considering the contexts to examine the representation in dopamine neurons and uncover different modes of dopamine signaling, each of which may be adaptive for different environments.


1979 ◽  
Vol 44 (2) ◽  
pp. 675-678
Author(s):  
Richard A. Feinberg ◽  
John P. Lombardo ◽  
Franklin G. Miller ◽  
Michele K. Steigleder

34 subjects who scored internally and 34 externally on locus of control learned an instrumental response the reinforcement for which was listening to another person yield (large magnitude of reinforcement) or disagree (small magnitude of reinforcement). Contrary to previous evidence locus of control did not influence conditioning of response speed.


Author(s):  
Ximena I Salinas-Hernández ◽  
Pascal Vogel ◽  
Sebastian Betz ◽  
Raffael Kalisch ◽  
Torfi Sigurdsson ◽  
...  

2018 ◽  
Author(s):  
Kauê Machado Costa ◽  
Jochen Roeper

AbstractInhibition of midbrain dopamine neurons is thought to underlie the signaling of events that are less rewarding than expected and drive learning based on these negative prediction errors. It has recently been shown that Kv4.3 channels influence the integration of inhibitory inputs in specific subpopulations of dopamine neurons. The functional properties of Kv4.3 channels are themselves strongly determined by the binding of auxiliary β-subunits; among them KChIP4a stands-out for its unique combination of modulatory effects. These include decreasing surface membrane trafficking and slowing inactivation kinetics. Therefore, we hypothesized that KChIP4a expression in dopamine neurons could play a crucial role in behavior, in particular by affecting the computation of negative prediction errors. We developed a mouse line where the alternative exon that codes for the KChIP4a splice variant was selectively deleted in midbrain dopamine neurons. In a reward-based reinforcement learning task, we observed that dopamine neuron-specific KChIP4a deletion selectively accelerated the rate of extinction learning, without impacting the acquisition of conditioned responses. We further found that this effect was due to a faster decrease in the initiation rate of goal-directed behaviors, and not faster increases in action disengagement. Furthermore, computational fitting of the behavioral data with a Rescorla-Wagner model confirmed that the observed phenotype was attributable to a selective increase in the learning rate from negative prediction errors. Finally, KChIP4a deletion did not affect performance in other dopamine-sensitive behavioral tasks that did not involve learning from disappointing events, including an absence of effects on working memory, locomotion and novelty preference. Taken together, our results demonstrate that an exon- and midbrain dopamine neuron-specific deletion of an A-type K+ channel β-subunit leads to a selective gain of function in extinction learning.One Sentence SummaryExon- and midbrain dopamine neuron-specific deletion of the Kv4 channel β-subunit KChIP4a selectively accelerates extinction learning


2021 ◽  
Vol 135 (3) ◽  
pp. 415-425
Author(s):  
Constance Y. Peng ◽  
Philip Jean-Richard-dit-Bressel ◽  
Sophia Gilchrist ◽  
John M. Power ◽  
Gavan P. McNally

1981 ◽  
Vol 33 (2b) ◽  
pp. 123-135 ◽  
Author(s):  
Paul Garrud ◽  
Glyn Goodall ◽  
N. J. Mackintosh

In two experiments, rats were first exposed to pairings of a clicker and food; they were subsequently, in order to measure the effectiveness of the clicker as a conditioned reinforcer, given the opportunity to press a lever which turned the clicker on. For one group of animals the food originally delivered in the presence of the clicker had been contingent on their performance of an instrumental response (running in a running wheel); for a second the contingency between clicker and food had been purely classical. Although the actual correlation between clicker and food was identical for the two groups, the clicker was a less effective conditioned reinforcer for the first group than for the second. In a third experiment, all animals were initially required to run to obtain food in the presence of the clicker, but one group received additional trials on which food was delivered contingent on running in the absence of the clicker. This group showed less tendency to lever press for the clicker than a second group that had received free food on trials when the clicker was not presented. The results of all three experiments suggest that conditioning to the clicker could be overshadowed if the occurrence of food was more reliably predicted by the execution of an instrumental running response; they thus support the view that instrumental conditioning depends on the establishment of an association between response and reinforcer similar to the association between stimulus and reinforcer underlying classical conditioning.


2019 ◽  
Author(s):  
RC Evans ◽  
EL Twedell ◽  
M Zhu ◽  
J Ascencio ◽  
R Zhang ◽  
...  

AbstractSubstania nigra (SNc) dopaminergic neurons show a pause-rebound firing pattern in response to aversive events. Because these neurons integrate information from predominately inhibitory brain areas, it is important to determine which inputs functionally inhibit the dopamine neurons and whether this pause-rebound firing pattern can be produced by a solely inhibitory input. Here, we functionally map genetically-defined inhibitory projections from the dorsal striatum (striosome and matrix) and globus pallidus (GPe; parvalbumin and Lhx6) onto SNc neurons. We find that GPe and striosomal inputs both pause firing in SNc neurons, but rebound firing only occurs after inhibition from striosomes. Indeed, we find that striosomes are synaptically optimized to produce rebound and preferentially inhibit a subpopulation of ventral, intrinsically rebound-ready SNc dopaminergic neurons on their reticulata dendrites. Therefore, we describe a self-contained dendrite-specific striatonigral circuit that can produce pause-rebound firing in the absence of excitatory input.


eLife ◽  
2018 ◽  
Vol 7 ◽  
Author(s):  
Ximena I Salinas-Hernández ◽  
Pascal Vogel ◽  
Sebastian Betz ◽  
Raffael Kalisch ◽  
Torfi Sigurdsson ◽  
...  

Extinction of fear responses is critical for adaptive behavior and deficits in this form of safety learning are hallmark of anxiety disorders. However, the neuronal mechanisms that initiate extinction learning are largely unknown. Here we show, using single-unit electrophysiology and cell-type specific fiber photometry, that dopamine neurons in the ventral tegmental area (VTA) are activated by the omission of the aversive unconditioned stimulus (US) during fear extinction. This dopamine signal occurred specifically during the beginning of extinction when the US omission is unexpected, and correlated strongly with extinction learning. Furthermore, temporally-specific optogenetic inhibition or excitation of dopamine neurons at the time of the US omission revealed that this dopamine signal is both necessary for, and sufficient to accelerate, normal fear extinction learning. These results identify a prediction error-like neuronal signal that is necessary to initiate fear extinction and reveal a crucial role of DA neurons in this form of safety learning.


Sign in / Sign up

Export Citation Format

Share Document