Cortical and thalamic influences on striatal involvement in instructed, serial reversal learning; implications for the organisation of flexible behaviour.

Cognitive flexibility is essential for enabling an individual to respond adaptively to changes in their environment. Evidence from human and animal research suggests that the control of cognitive flexibility is dependent on an array of neural architecture. Cortico-basal ganglia circuits have long been implicated in cognitive flexibility. In particular, the role of the striatum is pivotal, acting as an integrative hub for inputs from the prefrontal cortex and thalamus, and modulation by dopamine and acetylcholine. Striatal cholinergic modulation has been implicated in the flexible control of behaviour, driven by input from the centromedian-parafascicular nuclei of the thalamus. However, the role of this system in humans is not clearly defined as much of the current literature is based on animal work. Here, we aim to investigate the roles corticostriatal and thalamostriatal connectivity in serial reversal learning. Functional connectivity between the left centromedian-parafascicular nuclei and the associative dorsal striatum was significantly increased for negative feedback compared to positive feedback. Similar differences in functional connectivity were observed for the right lateral orbitofrontal cortex, but these were localised to when participants switched to using an alternate response strategy following reversal. These findings suggest that connectivity between the centromedian-parafascicular nuclei and the striatum may be used to generally identify potential changes in context based on negative outcomes, and the effect of this signal on striatal output may be influenced by connectivity between the lateral orbitofrontal cortex and the striatum.

Impairments in goal-directed action and reversal learning in a proportion of individuals with psychosis: evidence for differential phenotypes in early and persistent psychosis

Cognitive impairments in psychosis are one of the strongest predictors of functional decline. Cortico-striatal dysfunction may contribute to both psychosis and cognitive impairment in psychotic illnesses. The decision-making processes underlying goal-directed action and serial reversal learning can be measured and are sensitive to changes reflecting cortico-striatal dysfunction. As such, changes in decision-making performance may assist with predicting functional decline in people with psychosis. We assessed decision-making processes in healthy controls (N=34), and those with early psychosis (N=15) and persistent psychosis (N=45). We subclassified subjects based on intact/impaired goal-directed action. Compared with healthy controls (<20%), a large proportion (58%) of those with persistent psychosis displayed impaired goal-directed action, predicting poor serial reversal learning performance. Computational approaches indicated that those with persistent psychosis were less deterministic in their decision-making. Those with impaired goal-directed action had a decreased capacity to rapidly update their prior beliefs in the face of changing contingencies. In contrast, the early psychosis group included a lower proportion of individuals with impaired goal-directed action (20%) and displayed a different cognitive phenotype from those with persistent psychosis. These findings suggest prominent decision-making deficits, indicative of cortico-striatal dysfunction, are present in a large proportion of people with persistent psychosis while those with early psychosis have relatively intact decision-making processes compared to healthy controls. It is unclear if there is a progressive decline in decision-making processes in some individuals with psychosis or if the presence of decision-making processes in early psychosis is predictive of a persistent trajectory of illness.

Basal forebrain-derived acetylcholine encodes valence-free reinforcement prediction error

Acetylcholine (Ach) is released by the cholinergic basal forebrain (CBF) throughout the cortical mantle and is implicated in behavioral functions ranging from arousal to attention to learning. Yet what signal ACh provides to cortex remains unresolved, hindering our understanding of its functional roles. Here we demonstrate that the CBF signals unsigned reinforcement prediction error, in contrast to dopamine (DA) neurons that encode reward prediction error. We show that both CBF neuronal activity and acetylcholine (ACh) release at cortical targets signal reinforcement delivery, acquire responses to predictive stimuli and show diminished responses to expected outcomes, hallmarks of a prediction error. To compare ACh with DA, we simultaneously monitored the activity of both neuromodulators during a serial reversal learning task. ACh tracked learning as swiftly as DA during acquisition but lagged slightly during extinction, suggesting that these neuromodulators play complementary roles in reinforcement as their patterns of innervation, cellular targets, and signaling mechanisms are themselves complementary. Through retrograde viral tracing we show that the cholinergic and dopaminergic systems engage overlapping upstream circuits, accounting for their coordination during learning. This predictive and valence-free signal explains how ACh can proactively and retroactively improve the processing of behaviorally important stimuli, be they good or bad.

Dissociable and Paradoxical Roles of Rat Medial and Lateral Orbitofrontal Cortex in Visual Serial Reversal Learning

ABSTRACT Much evidence suggests that reversal learning is mediated by cortico-striatal circuitries with the orbitofrontal cortex (OFC) playing a prominent role. The OFC is a functionally heterogeneous region, but potential differential roles of lateral (lOFC) and medial (mOFC) portions in visual reversal learning have yet to be determined. We investigated the effects of pharmacological inactivation of mOFC and lOFC on a deterministic serial visual reversal learning task for rats. For reference, we also targeted other areas previously implicated in reversal learning: prelimbic (PrL) and infralimbic (IL) prefrontal cortex, and basolateral amygdala (BLA). Inactivating mOFC and lOFC produced opposite effects; lOFC impairing, and mOFC improving, performance in the early, perseverative phase specifically. Additionally, mOFC inactivation enhanced negative feedback sensitivity, while lOFC inactivation diminished feedback sensitivity in general. mOFC and lOFC inactivation also affected novel visual discrimination learning differently; lOFC inactivation paradoxically improved learning, and mOFC inactivation had no effect. We also observed dissociable roles of the OFC and the IL/PrL. Whereas the OFC inactivation affected only perseveration, IL/PrL inactivation improved learning overall. BLA inactivation did not affect perseveration, but improved the late phase of reversal learning. These results support opponent roles of the rodent mOFC and lOFC in deterministic visual reversal learning.