scholarly journals Dissociating the effect of reward uncertainty and timing uncertainty on neural indices of reward prediction errors: A reward positivity (RewP) event-related potential (ERP) study

2021 ◽  
Author(s):  
Alexandra M Muir ◽  
Addison C Eberhard ◽  
Megan S Walker ◽  
Angus Bennion ◽  
Mikle South ◽  
...  
Keyword(s):  
Event Related Potential ◽  
The Other ◽  
Prediction Errors ◽  
Healthy Individuals ◽  
Feedback Timing ◽  
Reward Positivity ◽  
Reward Prediction ◽  
Timing Uncertainty ◽  
Within Subjects

Accurate reward predictions include forecasting both what a reward will be and when a reward will occur. We tested how variations in the certainty of reward outcome and certainty in timing of feedback presentation modulate neural indices of reward prediction errors using the reward positivity (RewP) component of the scalp-recorded brain event-related potential (ERP). In a within-subjects design, seventy-three healthy individuals completed two versions of a cued doors task; one cued the probability of a reward outcome while the other cued the probability of a delay before feedback. Replicating previous results, RewP amplitude was larger for uncertain feedback compared to certain feedback. Additionally, RewP amplitude was differentially associated with uncertainty of presence/absence of reward, but not uncertainty of feedback timing. Findings suggest a dissociation in that RewP amplitude is modulated by reward prediction certainty but is less affected by certainty surrounding timing of feedback.

How We Learn to Make Decisions: Rapid Propagation of Reinforcement Learning Prediction Errors in Humans

2014 ◽  
Vol 26 (3) ◽  
pp. 635-644 ◽  
Author(s):  
Olav E. Krigolson ◽  
Cameron D. Hassall ◽  
Todd C. Handy
Keyword(s):  
Reinforcement Learning ◽  
Prediction Error ◽  
Human Error ◽  
Dopamine Neurons ◽  
Prediction Errors ◽  
Neural Basis ◽  
Error Related Negativity ◽  
Reward Positivity ◽  
Reward Prediction ◽  
Feedback Error

Our ability to make decisions is predicated upon our knowledge of the outcomes of the actions available to us. Reinforcement learning theory posits that actions followed by a reward or punishment acquire value through the computation of prediction errors—discrepancies between the predicted and the actual reward. A multitude of neuroimaging studies have demonstrated that rewards and punishments evoke neural responses that appear to reflect reinforcement learning prediction errors [e.g., Krigolson, O. E., Pierce, L. J., Holroyd, C. B., & Tanaka, J. W. Learning to become an expert: Reinforcement learning and the acquisition of perceptual expertise. Journal of Cognitive Neuroscience, 21, 1833–1840, 2009; Bayer, H. M., & Glimcher, P. W. Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron, 47, 129–141, 2005; O'Doherty, J. P. Reward representations and reward-related learning in the human brain: Insights from neuroimaging. Current Opinion in Neurobiology, 14, 769–776, 2004; Holroyd, C. B., & Coles, M. G. H. The neural basis of human error processing: Reinforcement learning, dopamine, and the error-related negativity. Psychological Review, 109, 679–709, 2002]. Here, we used the brain ERP technique to demonstrate that not only do rewards elicit a neural response akin to a prediction error but also that this signal rapidly diminished and propagated to the time of choice presentation with learning. Specifically, in a simple, learnable gambling task, we show that novel rewards elicited a feedback error-related negativity that rapidly decreased in amplitude with learning. Furthermore, we demonstrate the existence of a reward positivity at choice presentation, a previously unreported ERP component that has a similar timing and topography as the feedback error-related negativity that increased in amplitude with learning. The pattern of results we observed mirrored the output of a computational model that we implemented to compute reward prediction errors and the changes in amplitude of these prediction errors at the time of choice presentation and reward delivery. Our results provide further support that the computations that underlie human learning and decision-making follow reinforcement learning principles.

scholarly journals Aberrant reward prediction error during Pavlovian appetitive learning in alexithymia

2019 ◽  
Vol 14 (10) ◽  
pp. 1119-1129
Author(s):  
Francesca Starita ◽  
Mattia Pietrelli ◽  
Caterina Bertini ◽  
Giuseppe di Pellegrino
Keyword(s):  
Prediction Error ◽  
Event Related Potential ◽  
Extensive Literature ◽  
Prediction Errors ◽  
Appetitive Conditioning ◽  
Emotional Stimuli ◽  
Internal Representations ◽  
Reward Prediction ◽  
Underlying Mechanisms ◽  
Emotional Value

Abstract Extensive literature shows that alexithymia, a subclinical trait defined by difficulties in identifying and describing feelings, is characterized by multifaceted impairments in processing emotional stimuli. Nevertheless, its underlying mechanisms remain elusive. Here, we hypothesize that alexithymia may be characterized by an alteration in learning the emotional value of encountered stimuli and test this by assessing differences between individuals with low (LA) and high (HA) levels of alexithymia in the computation of reward prediction errors (RPEs) during Pavlovian appetitive conditioning. As a marker of RPE, the amplitude of the feedback-related negativity (FRN) event-related potential was assessed while participants were presented with two conditioned stimuli (CS) associated with expected or unexpected feedback, indicating delivery of reward or no-reward. No-reward (vs reward) feedback elicited the FRN both in LA and HA. However, unexpected (vs expected) feedback enhanced the FRN in LA but not in HA, indicating impaired computation of RPE in HA. Thus, although HA show preserved sensitivity to rewards, they cannot use this response to update the value of CS that predict them. This impairment may hinder the construction of internal representations of emotional stimuli, leaving individuals with alexithymia unable to effectively recognize, respond and regulate their response to emotional stimuli.

scholarly journals Dopamine enhances model-free credit assignment through boosting of retrospective model-based inference

eLife ◽  
2021 ◽  
Vol 10 ◽  
Author(s):  
Lorenz Deserno ◽  
Rani Moran ◽  
Jochen Michely ◽  
Ying Lee ◽  
Peter Dayan ◽  
...  
Keyword(s):  
Drug Effect ◽  
Prediction Errors ◽  
Credit Assignment ◽  
Double Blind ◽  
Cooperative Interactions ◽  
Model Based ◽  
Model Free ◽  
Reward Prediction ◽  
Dependent Change ◽  
Within Subjects

Dopamine is implicated in representing model-free (MF) reward prediction errors a as well as influencing model-based (MB) credit assignment and choice. Putative cooperative interactions between MB and MF systems include a guidance of MF credit assignment by MB inference. Here, we used a double-blind, placebo-controlled, within-subjects design to test an hypothesis that enhancing dopamine levels boosts the guidance of MF credit assignment by MB inference. In line with this, we found that levodopa enhanced guidance of MF credit assignment by MB inference, without impacting MF and MB influences directly. This drug effect correlated negatively with a dopamine-dependent change in purely MB credit assignment, possibly reflecting a trade-off between these two MB components of behavioural control. Our findings of a dopamine boost in MB inference guidance of MF learning highlights a novel DA influence on MB-MF cooperative interactions.

Reward Prediction Errors Drive Declarative Learning Irrespective of Agency

2020 ◽  
Author(s):  
Kate Ergo ◽  
Luna De Vilder ◽  
Esther De Loof ◽  
Tom Verguts
Keyword(s):  
Learning Theory ◽  
Learning Effect ◽  
Steady Increase ◽  
Prediction Errors ◽  
Experimental Paradigm ◽  
Reward Prediction ◽  
Declarative Learning

Recent years have witnessed a steady increase in the number of studies investigating the role of reward prediction errors (RPEs) in declarative learning. Specifically, in several experimental paradigms RPEs drive declarative learning; with larger and more positive RPEs enhancing declarative learning. However, it is unknown whether this RPE must derive from the participant’s own response, or whether instead any RPE is sufficient to obtain the learning effect. To test this, we generated RPEs in the same experimental paradigm where we combined an agency and a non-agency condition. We observed no interaction between RPE and agency, suggesting that any RPE (irrespective of its source) can drive declarative learning. This result holds implications for declarative learning theory.

Emotion prediction errors guide socially adaptive behavior

2021 ◽  
Author(s):  
Joseph Heffner ◽  
Jae-Young Son ◽  
Oriel FeldmanHall
Keyword(s):  
Decision Making ◽  
Real Time ◽  
Adaptive Behavior ◽  
Emotional Response ◽  
New Method ◽  
Prediction Errors ◽  
Emotional Experiences ◽  
Past Work ◽  
Reward Prediction ◽  
Expected Outcomes

People make decisions based on deviations from expected outcomes, known as prediction errors. Past work has focused on reward prediction errors, largely ignoring violations of expected emotional experiences—emotion prediction errors. We leverage a new method to measure real-time fluctuations in emotion as people decide to punish or forgive others. Across four studies (N=1,016), we reveal that emotion and reward prediction errors have distinguishable contributions to choice, such that emotion prediction errors exert the strongest impact during decision-making. We additionally find that a choice to punish or forgive can be decoded in less than a second from an evolving emotional response, suggesting emotions swiftly influence choice. Finally, individuals reporting significant levels of depression exhibit selective impairments in using emotion—but not reward—prediction errors. Evidence for emotion prediction errors potently guiding social behaviors challenge standard decision-making models that have focused solely on reward.

scholarly journals Irritable bowel syndrome and psychological stress

1999 ◽  
Vol 4 (1) ◽  
pp. 19-26 ◽  
Author(s):  
Barbara S Bayne ◽  
Anita D Stuart ◽  
H Gertie Pretorius
Keyword(s):  
Occupational Stress ◽  
Psychological Stress ◽  
The Other ◽  
Theory Building ◽  
Healthy Controls ◽  
Healthy Individuals ◽  
Daily Stress ◽  
Stress Inventory ◽  
Irritable Bowel ◽  
The Relationship

The purpose of this study was twofold. The first aim was to clarify the relationship between psychological stress and lrritable Bowel Syndrome (IBS) by establishing whether individuals suffering from IBS experience minor stress differently from healthy individuals in terms of its frequency or intensity. The second aim was more general and concerns theory building in a field filled with ambiguity and confusion. Two groups, one comprising IBS sufferers and the other healthy controls, completed the Daily Stress lnventory and the Occupational Stress lnventory - questionnaires designed to measure minor daily and occupational stress respectively. The findings indicate that IBS sufferers do not experience more stress than healthy individuals, but they experience the stressors with greater intensity.OpsommingDie doel van die studie was tweeledig. Eerstens is daar gepoog om duidelikheid te kry oor die verband tussen sielkundige stres en Prikkelbare Dermsindroom (PDS), deur te bepaal of individue wat aan PDS ly geringe stres anders ervaar as gesonde individue in terme van gereeldheid of intensiteit. Die tweede doelwit was meer algemeen en spreek die kwessie van teorie ontwikkeling aan in 'n veld gevul met dubbelsinningheid en verwarring. Twee groepe, een bestaande uit PDS lyers en die ander 'n gesonde kontrolegroep, het die "Daily Stress Inventory'' en die "Occupational Stress Inventory" voltooi. Die vraelyste is ontwerp om onderskeidelik daaglikse stres en werkstres te meet. Die resultate dui daarop dat PDS lyers nie meer stres ervaar as die gesonde individue nie, maar dat hulle wel die stressors ervaar met groter intensiteit.

scholarly journals A review of Nadi Parikshan in various Ayurvedic Samhita with its clinical methods

2020 ◽  
Vol 4 (06) ◽  
Author(s):  
Pooja Babaso Kamble
Keyword(s):  
Diagnostic Tool ◽  
Common Factor ◽  
Research Work ◽  
Cost Effective ◽  
The Other ◽  
Diagnostic Tools ◽  
Healthy Individuals ◽  
Medical Field ◽  
Clinical Methods ◽  
Time Region

Nadi Pariksha is the most effective diagnostic tool known in the medical field. It is cost effective,  accurate,  safe,  and gives quick results. We can conduct Nadi Pariksha on healthy individuals as well as all patients irrespective of stage of the disease also,  and even pregnant woman,  children,  elderly can undergo without any harm or side effects. However,  this technique is not being widely practised at present,  because of lack of training,  practise and knowledge about it in the present day among Ayurveda vaidyas. An iconic factor for identification of a physician,  irrespective of the time,  Region,  Nadi Pariksha can be highlighted as a common factor or even System of Medicine or Civilization of the known world. Thus,  we can perceive that Nadi Pariksha or the pulse examination remains as an effective diagnostic tool since ages. Nadi Pariksha was not been discussed among the Brihatrayees of Ayurveda. Acharya Sharangdhara was the first to document in the doctrines of Ayurveda. Thus Acharya Sharangdhara is considered as ‘The Founder of Nadi Pariksha’in Ayurveda. Nadi Pariksha was titled under the Pancha-Nidana by Acharya Sharangdhara and Ashta Sthana Pariksha by Acharya Yogaratnakara. It was the Foremost among all the other diagnostic tools mentioned by him. Later Acharyas like Acharya Bhava Mishra,  Acharya Yogaratnakara,  Acharya Basavaraja,  Acharya Kanada Maharishi,  and Acharya Ravana have contributed in giving more descriptions and importance. In the recent days Dr. Vasant lad and Dr. Sarvadeva Upadhaya’s research work interest and scope of Nadi Pariksha.

scholarly journals Development of a Selective Extinction through Cognitive Evaluation Paradigm

2019 ◽  
Author(s):  
Birthe Macdonald ◽  
Tom Johnstone
Keyword(s):  
Neutral Stimulus ◽  
The Other ◽  
Second Phase ◽  
Extinction Group ◽  
Additional Information ◽  
Cognitive Evaluation ◽  
Skin Conductance Responses ◽  
Within Subjects ◽  
Conditioned Responses ◽  
Selective Extinction

In this study we trialled a novel paradigm that aims to bridge the gap between the research into the extinction of conditioned responses and the instructed regulation of emotion via a prescribed strategy. This was done through a process we called Selective Extinction through Cognitive Evaluation (SECE). Participants were conditioned to associate a previously neutral stimulus (letter, CS+) with an aversive burst of white noise (US) and another letter with no aversive event (CS-). In a second phase, the same letters were presented within words belonging to two distinct categories. One group did not receive any more noise bursts during this phase which lead to the extinction of the conditioned responses (extinction group). The other group (SECE group) was told that the CS+ now only carried a risk of the noise occurring when it was presented in one (dangerous), but not the other word category (safe). Affective responses were assessed using skin conductance responses (SCR). We found overall increased SCR’s in response to CS+ (safe and dangerous) compared to CS- trials in the SECE group, and also increased SCR’s in response to dangerous compared to safe CS+ trials. This suggests that the conditioned response (CR) can be reduced through the cognitive evaluation of additional information and it is possible that extinction mechanisms are involved in this process. We did not find any effects in the extinction group. It is possible that extinction was completed too quickly so that any differences between conditions could not be captured. We therefore conducted a second study to pilot an improved paradigm. We visually amended the trials, amended the reinforcement schedule, and changed to a fully within-subjects design. Here we once again found significantly reduced SCR to safe compared to dangerous CS+ trials. Future experiments will use these results as a basis for an improved paradigm to better capture changes in SCR as well as BOLD fMRI in future experiments.

Sign in / Sign up

Export Citation Format

Share Document