scholarly journals Nucleus-accumbens dopamine tracks aversive stimulus duration and prediction but not value or prediction error

2021 ◽  
Author(s):  
J.N. Goedhoop ◽  
B.J.G. van den Boom ◽  
T. Arbab ◽  
I. Willuhn

ABSTRACTThe role of dopamine in processing aversive stimuli is under debate: Credits range from no involvement at all, to acting as a punishment-prediction error (PPE) signal. Here, we systematically investigated dopamine release in the nucleus-accumbens core (NAC), which is closely linked to reward-prediction errors, in rats that were exposed to white noise (WN), a versatile, underutilized aversive stimulus, and its predictive cues. Both induced a negative dopamine ramp, followed by slow signal recovery upon stimulus cessation. In contrast to reward conditioning, dopamine was unaffected by WN value, context valence, or probabilistic contingencies, and the WN dopamine-response shifted only partially towards its predictive cue. However, unpredicted WN provoked slower post-stimulus signal recovery than predicted WN. Despite differing signal qualities, dopamine responses to simultaneous presentation of rewarding and aversive stimuli were additive. Together, our findings indicate that instead of a PPE, NAC dopamine primarily tracks prediction and duration of punishment.

Author(s):  
Michiel Van Elk ◽  
Harold Bekkering

We characterize theories of conceptual representation as embodied, disembodied, or hybrid according to their stance on a number of different dimensions: the nature of concepts, the relation between language and concepts, the function of concepts, the acquisition of concepts, the representation of concepts, and the role of context. We propose to extend an embodied view of concepts, by taking into account the importance of multimodal associations and predictive processing. We argue that concepts are dynamically acquired and updated, based on recurrent processing of prediction error signals in a hierarchically structured network. Concepts are thus used as prior models to generate multimodal expectations, thereby reducing surprise and enabling greater precision in the perception of exemplars. This view places embodied theories of concepts in a novel predictive processing framework, by highlighting the importance of concepts for prediction, learning and shaping categories on the basis of prediction errors.


2020 ◽  
Author(s):  
Allison R. Bechard ◽  
Carly N. Logan ◽  
Javier Mesa ◽  
Yasmin Padovan‐Hernandez ◽  
Harrison Blount ◽  
...  

2014 ◽  
Vol 76 (10) ◽  
pp. 810-815 ◽  
Author(s):  
Susan E. Doyle ◽  
Carolina Ramôa ◽  
Garrett Garber ◽  
Joshua Newman ◽  
Zeeshan Toor ◽  
...  

2019 ◽  
Author(s):  
Emilie Werlen ◽  
Soon-Lim Shin ◽  
Francois Gastambide ◽  
Jennifer Francois ◽  
Mark D Tricklebank ◽  
...  

AbstractIn an uncertain world, the ability to predict and update the relationships between environmental cues and outcomes is a fundamental element of adaptive behaviour. This type of learning is typically thought to depend on prediction error, the difference between expected and experienced events, and in the reward domain this has been closely linked to mesolimbic dopamine. There is also increasing behavioural and neuroimaging evidence that disruption to this process may be a cross-diagnostic feature of several neuropsychiatric and neurological disorders in which dopamine is dysregulated. However, the precise relationship between haemodynamic measures, dopamine and reward-guided learning remains unclear. To help address this issue, we used a translational technique, oxygen amperometry, to record haemodynamic signals in the nucleus accumbens (NAc) and orbitofrontal cortex (OFC) while freely-moving rats performed a probabilistic Pavlovian learning task. Using a model-based analysis approach to account for individual variations in learning, we found that the oxygen signal in the NAc correlated with a reward prediction error, whereas in the OFC it correlated with an unsigned prediction error or salience signal. Furthermore, an acute dose of amphetamine, creating a hyperdopaminergic state, disrupted rats’ ability to discriminate between cues associated with either a high or a low probability of reward and concomitantly corrupted prediction error signalling. These results demonstrate parallel but distinct prediction error signals in NAc and OFC during learning, both of which are affected by psychostimulant administration. Furthermore, they establish the viability of tracking and manipulating haemodynamic signatures of reward-guided learning observed in human fMRI studies using a proxy signal for BOLD in a freely behaving rodent.


2021 ◽  
Author(s):  
Laura L Grima ◽  
Marios C Panayi ◽  
Oliver Harmson ◽  
Emilie Syed ◽  
Sanjay G Manohar ◽  
...  

While it is well established that dopamine transmission is integral in mediating the influence of reward expectations on reward-seeking actions, the precise causal role of dopamine transmission in moment-to-moment cue-driven behavioural control remains contentious. This is a particular issue in situations where it is necessary to refrain from responding to achieve a beneficial outcome. To examine this, we manipulated dopamine transmission pharmacologically as rats performed a Go/No-Go task that required them to either make or withhold action to gain either a small or large reward. Stimulation of D1Rs, both globally and locally in the nucleus accumbens core (NAcC) region consistently disrupted No-Go performance, potentiating inappropriate responses that clustered strongly just after cue presentation. D1R blockade did not, however, improve rats' ability to withhold responses, but instead primarily disrupted performance on Go trials. While global D1R blockade caused a general reduction of invigoration of reward seeking actions, intra-NAcC administration of the D1R antagonist by contrast increased the likelihood that Go trial performance was in an "unfocused" state. Such a state was characterised, both on and off drug, by a reduction in the precision and speed of responding even though the appropriate action sequence was often executed. These findings suggests that the balance of activity at NAcC D1Rs plays a key role in enabling the rapid activation of a focused, reward-seeking state to enable animals to efficiently and accurately achieve their goal.


IBRO Reports ◽  
2019 ◽  
Vol 6 ◽  
pp. S347
Author(s):  
Elina Kc ◽  
Hyeong Cheol Moon ◽  
Sang Hwan Hyun ◽  
Young Seok Park

2020 ◽  
Author(s):  
Mary Hermann ◽  
Timothy Alexander ◽  
Christopher N. Wahlheim ◽  
Jeffrey M. Zacks

When people experience everyday activities, their comprehension can be shaped by expectations that derive from similar recent experiences, which can affect the encoding of the new experience into memory. When a new experience includes changes—such as a driving route being blocked by construction—this can lead to interference in subsequent memory. However, theories based on prediction-error-driven learning propose that unpredicted changes can lead to facilitation rather than interference. One potential mechanism of effective encoding of event changes is the retrieval of related features from previous events. Another such mechanism is the generation of a prediction error when a predicted feature is contradicted. In two experiments, we tested for effects of these two mechanisms on memory for changed features in movies of everyday activities. Participants viewed movies of an actor performing everyday activities across two fictitious days. Some event features changed across the days, and some features violated viewers’ predictions. Retrieval of previous event features while viewing the second movie was associated with better subsequent memory, providing evidence for the retrieval mechanism. Contrary to our hypotheses, there was not support for the error mechanism: Prediction error was not associated with better memory when it was observed correlationally (Experiment 1) or directly manipulated (Experiment 2). These results support a key role for episodic retrieval in the encoding of new events. They also indicate boundary conditions on the role of prediction errors in driving new learning. Both findings have clear implications for theories of event memory.


2020 ◽  
pp. 107385842090759
Author(s):  
Kelly M. J. Diederen ◽  
Paul C. Fletcher

A large body of work has linked dopaminergic signaling to learning and reward processing. It stresses the role of dopamine in reward prediction error signaling, a key neural signal that allows us to learn from past experiences, and that facilitates optimal choice behavior. Latterly, it has become clear that dopamine does not merely code prediction error size but also signals the difference between the expected value of rewards, and the value of rewards actually received, which is obtained through the integration of reward attributes such as the type, amount, probability and delay. More recent work has posited a role of dopamine in learning beyond rewards. These theories suggest that dopamine codes absolute or unsigned prediction errors, playing a key role in how the brain models associative regularities within its environment, while incorporating critical information about the reliability of those regularities. Work is emerging supporting this perspective and, it has inspired theoretical models of how certain forms of mental pathology may emerge in relation to dopamine function. Such pathology is frequently related to disturbed inferences leading to altered internal models of the environment. Thus, it is critical to understand the role of dopamine in error-related learning and inference.


Sign in / Sign up

Export Citation Format

Share Document