Investigation of reward learning and feedback sensitivity in non-clinical participants with a history of early life stress

Early life stress (ELS) is an important risk factor for the development of depression. Impairments in reward learning and feedback sensitivity are suggested to be an intermediate phenotype in depression aetiology therefore we hypothesised that healthy adults with a history of ELS would exhibit reward processing deficits independent of any current depressive symptoms. We recruited 64 adults with high levels of ELS and no diagnosis of a current mental health disorder and 65 controls. Participants completed the probabilistic reversal learning task and probabilistic reward task followed by depression, anhedonia, social status, and stress scales. Participants with high levels of ELS showed decreased positive feedback sensitivity in the probabilistic reversal learning task compared to controls. High ELS participants also trended towards possessing a decreased model-free learning rate. This was coupled with a decreased learning ability in the acquisition phase of block 1 following the practice session. Neither group showed a reward induced response bias in the probabilistic reward task however high ELS participants exhibited decreased stimuli discrimination. Overall, these data suggest that healthy participants without a current mental health diagnosis but with high levels of ELS show deficits in positive feedback sensitivity and reward learning in the probabilistic reversal learning task that are distinct from depressed patients. These deficits may be relevant to increased depression vulnerability.

Effects of methylphenidate on reinforcement learning depend on working memory capacity

Rationale Brain catecholamines have long been implicated in reinforcement learning, exemplified by catecholamine drug and genetic effects on probabilistic reversal learning. However, the mechanisms underlying such effects are unclear. Objectives and methods Here we investigated effects of an acute catecholamine challenge with methylphenidate (20 mg, oral) on a novel probabilistic reversal learning paradigm in a within-subject, double-blind randomised design. The paradigm was designed to disentangle effects on punishment avoidance from effects on reward perseveration. Given the known large individual variability in methylphenidate’s effects, we stratified our effects by working memory capacity and trait impulsivity, putatively modulating the effects of methylphenidate, in a large sample (n = 102) of healthy volunteers. Results Contrary to our prediction, methylphenidate did not alter performance in the reversal phase of the task. Our key finding is that methylphenidate altered learning of choice-outcome contingencies in a manner that depended on individual variability in working memory span. Specifically, methylphenidate improved performance by adaptively reducing the effective learning rate in participants with higher working memory capacity. Conclusions This finding emphasises the important role of working memory in reinforcement learning, as reported in influential recent computational modelling and behavioural work, and highlights the dependence of this interplay on catecholaminergic function.

Brief Report: Feasibility of the Probabilistic Reversal Learning Task as an Outcome Measure in an Intervention Trial for Individuals with Autism Spectrum Disorder

Cognitive flexibility deficits are a hallmark feature of autism spectrum disorder (ASD), but few evidence-based behavioral interventions have successfully addressed this treatment target. Outcome measurement selection may help account for previous findings. The probabilistic reversal learning task (PRL) is a measure of cognitive flexibility previously validated for use in ASD, but its use as an outcome measure has not yet been assessed. The current study examined the feasibility, reproducibility, and sensitivity of PRL in a within-subjects trial of Regulating Together, a group-based intervention targeting emotion regulation. We demonstrated the PRL is highly feasible, showed test–retest reproducibility, and is sensitive to detect change following the intervention. Our findings demonstrate the PRL task may be a useful outcome measure of cognitive flexibility in future intervention trials in ASD.