A Hierarchical Reinforcement Learning Model Explains Individual Differences in Attentional Set Shifting

Attentional set shifting refers to the ease with which the focus of attention is directed and switched. Cognitive tasks such as CANTAB IED reveal great variation in set shifting ability in the general population, with notable impairments in those with psychiatric diagnoses. The attentional and learning processes underlying this cognitive ability, and how they lead to the observed variation remain unknown. To directly test this, we used a modelling approach on two independent large-scale online general-population samples performing CANTAB IED and psychiatric symptom assessment. We found a hierarchical model that learnt both feature values and dimension attention best explained the data, and that compulsive symptoms were associated with slower learning and higher attentional bias to the first relevant stimulus dimension. This data showcase a new methodology to analyse data from the CANTAB IED task, and suggest a possible mechanistic explanation for the variation in set shifting performance, and its relationship to compulsive symptoms.

No need to choose: independent regulation of cognitive stability and flexibility challenges the stability-flexibility tradeoff

Adaptive behavior requires the ability to focus on a current task and protect it from distraction (cognitive stability) as well as the ability to rapidly switch to another task in light of changing circumstances (cognitive flexibility). Cognitive stability and flexibility have commonly been conceptualized as opposite endpoints on a stability-flexibility tradeoff continuum, implying an obligatory reciprocity between the two: greater flexibility necessitates less stability, and vice versa. Surprisingly, rigorous empirical tests of this critical assumption are lacking, however. Here, we tested this assumption by acquiring simultaneous measurements of cognitive stability (congruency effects) and flexibility (switch costs) while independently varying contextual demands on these functions with block-wise manipulations of the proportion of incongruent trials and task switches, respectively. If cognitive stability and flexibility are reciprocal, an increase in flexibility in response to higher switch rates should lead to a commensurate decrease in stability, and an increase in stability in response to more frequent incongruent trials should result in decreased flexibility. Across three experiments, using classic cued task switching (Experiments 1 and 3) and attentional set shifting (Experiment 2) protocols, we found robust evidence against an obligatory stability-flexibility tradeoff. Although we observed the expected contextual adaptation of stability and flexibility to changing demands, strategic adjustments in stability had no influence on flexibility, and vice versa. These results refute the long-held assumption of a stability-flexibility tradeoff, documenting instead that the cognitive processes mediating these functions can be regulated independently - it is possible to be both stable and flexible at the same time.

Automatic Intra-/Extra-Dimensional Attentional Set-Shifting Task in Adolescent Mice

Adolescence is a developmental period crucial for the maturation of higher-order cognitive functions. Indeed, adolescence deficits in executive functions are strong predictors of increased vulnerability to several mental disabilities later in life. Here, we tested adolescent mice in a fully-automated attentional set-shifting task equivalent to the humans’ Wisconsin Card Sorting Test (WCST) and the Cambridge Neuropsychological Test Automated Battery Intra-/Extra-Dimensional set-shift task (ID/ED). Compared to an adult, adolescent mice required more time to complete the task (≈16 days), and a higher percentage failed to finish the entire task. Nevertheless, adolescent mice completing this demanding task showed an increased effort in solving the extradimensional shift stage (EDS) compared to previous stages. Moreover, we found that this paradigm can be used to detect early cognitive dysfunctions in adolescent genetically modified mice. Thus, this automatic paradigm provides a further tool to assess attentional control in adolescent mice, and the development of dysfunctional executive functions from adolescence to adulthood.

Cannabinoid Modulation of Dopamine Release During Motivation, Periodic Reinforcement, Exploratory Behavior, Habit Formation, and Attention

Motivational and attentional processes energize action sequences to facilitate evolutionary competition and promote behavioral fitness. Decades of neuropharmacology, electrophysiology and electrochemistry research indicate that the mesocorticolimbic DA pathway modulates both motivation and attention. More recently, it was realized that mesocorticolimbic DA function is tightly regulated by the brain’s endocannabinoid system and greatly influenced by exogenous cannabinoids—which have been harnessed by humanity for medicinal, ritualistic, and recreational uses for 12,000 years. Exogenous cannabinoids, like the primary psychoactive component of cannabis, delta-9-tetrahydrocannabinol, produce their effects by acting at binding sites for naturally occurring endocannabinoids. The brain’s endocannabinoid system consists of two G-protein coupled receptors, endogenous lipid ligands for these receptor targets, and several synthetic and metabolic enzymes involved in their production and degradation. Emerging evidence indicates that the endocannabinoid 2-arachidonoylglycerol is necessary to observe concurrent increases in DA release and motivated behavior. And the historical pharmacology literature indicates a role for cannabinoid signaling in both motivational and attentional processes. While both types of behaviors have been scrutinized under manipulation by either DA or cannabinoid agents, there is considerably less insight into prospective interactions between these two important signaling systems. This review attempts to summate the relevance of cannabinoid modulation of DA release during operant tasks designed to investigate either motivational or attentional control of behavior. We first describe how cannabinoids influence DA release and goal-directed action under a variety of reinforcement contingencies. Then we consider the role that endocannabinoids might play in switching an animal’s motivation from a goal-directed action to the search for an alternative outcome, in addition to the formation of long-term habits. Finally, dissociable features of attentional behavior using both the 5-choice serial reaction time task and the attentional set-shifting task are discussed along with their distinct influences by DA and cannabinoids. We end with discussing potential targets for further research regarding DA-cannabinoid interactions within key substrates involved in motivation and attention.

Lost in translation: no effect of repeated optogenetic cortico-striatal stimulation on compulsivity in rats

The orbitofrontal cortex–ventromedial striatum (OFC–VMS) circuitry is widely believed to drive compulsive behavior. Hyperactivating this pathway in inbred mice produces excessive and persistent self-grooming, which has been considered a model for human compulsivity. We aimed to replicate these findings in outbred rats, where there are few reliable compulsivity models. Male Long-Evans rats implanted with optical fibers into VMS and with opsins delivered into OFC received optical stimulation at parameters that produce OFC–VMS plasticity and compulsive grooming in mice. We then evaluated rats for compulsive self-grooming at six timepoints: before, during, immediately after, and 1 h after each stimulation, 1 and 2 weeks after the ending of a 6-day stimulation protocol. To further test for effects of OFC–VMS hyperstimulation, we ran animals in three standard compulsivity assays: marble burying, nestlet shredding, and operant attentional set-shifting. OFC–VMS stimulation did not increase self-grooming or induce significant changes in nestlet shredding, marble burying, or set-shifting in rats. Follow-on evoked potential studies verified that the stimulation protocol altered OFC–VMS synaptic weighting. In sum, although we induced physiological changes in the OFC–VMS circuitry, we could not reproduce in a strongly powered study in rats a model of compulsive behavior previously reported in mice. This suggests possible limitations to translation of mouse findings to species higher on the phylogenetic chain.