A role of anterior cingulate cortex in the emergence of worker–parasite relationship

We studied the brain mechanisms underlying action selection in a social dilemma setting in which individuals’ effortful gains are unfairly distributed among group members. A stable “worker–parasite” relationship developed when three individually operant-conditioned rats were placed together in a Skinner box equipped with response lever and food dispenser on opposite sides. Specifically, one rat, the “worker,” engaged in lever-pressing while the other two “parasitic” rats profited from the worker’s effort by crowding the feeder in anticipation of food. Anatomically, c-Fos expression in the anterior cingulate cortex (ACC) was significantly higher in worker rats than in parasite rats. Functionally, ACC inactivation suppressed the worker’s lever-press behavior drastically under social, but only mildly under individual, settings. Transcriptionally, GABAA receptor– and potassium channel–related messenger RNA expressions were reliably lower in the worker’s, relative to parasite’s, ACC. These findings indicate the requirement of ACC activation for the expression of exploitable, effortful behavior, which could be mediated by molecular pathways involving GABAA receptor/potassium channel proteins.

Maintained goal-directed control with overtraining on ratio schedules

It is thought that goal-directed control of actions weakens or becomes masked by habits over time. We tested the opposing hypothesis that goal-directed control becomes stronger over time, and that this growth is modulated by the overall action–outcome contiguity. Despite group differences in action–outcome contiguity early in training, rats trained under random and fixed ratio schedules showed equivalent goal-directed control of lever pressing that appeared to grow over time. We confirmed that goal-directed control was maintained after extended training under another type of ratio schedule—continuous reinforcement—using specific satiety and taste aversion devaluation methods. These results add to the growing literature showing that extensive training does not reliably weaken goal-directed control and that it may strengthen it, or at least maintain it.

Tagging active neurons by soma-targeted Cal-Light

Verifying causal effects of neural circuits is essential for proving direct a circuit-behavior relationship. However, techniques for tagging only active neurons with high spatiotemporal precision remain at the beginning stages. Here we developed the soma-targeted Cal-Light (ST-Cal-Light) which selectively converts somatic calcium rise triggered by action potentials into gene expression. Such modification simultaneously increases the signal-to-noise ratio (SNR) of reporter gene expression and reduces the light requirement for successful labeling. Because of the enhanced efficacy, the ST-Cal-Light enables the tagging of functionally engaged neurons in various forms of behaviors, including context-dependent fear conditioning, lever-pressing choice behavior, and social interaction behaviors. We also targeted kainic acid-sensitive neuronal populations in the hippocampus which subsequently suppressed seizure symptoms, suggesting its applicability in controlling disease-related neurons. Furthermore, the generation of a conditional ST-Cal-Light knock-in (KI) mouse provides an opportunity to tag active neurons in a region- or cell-type specific manner via crossing with other Cre-driver lines. Thus, the versatile ST-Cal-Light system links somatic action potentials to behaviors with high temporal precision, and ultimately allows functional circuit dissection at a single cell resolution.

Dramatic increase in lever-pressing activity in rats after training on the progressive ratio schedule of cocaine self-administration

Transition from the highest rate of lever-pressing activity during the unloading (extinction) phase of a cocaine self-administration session to an extremely low activity rate during the remission phase is in many cases gradual. This makes it difficult to assess the duration of the unloading phase after a fixed ratio 1 (FR1) or breakpoint after a progressive-ratio (PR) self-administration session. In addition, 3–5 days of training under the PR schedule results in a dramatic and persistent increase in the rate of presses during PR sessions and in the unloading phase following FR1 self-administration sessions. The goals of this study were to find the definition of the last press demarcating the border between the unloading and remission phases of the session and to determine if this border was also affected by PR training. Rats were trained to self-administer cocaine under the FR1 schedule and then under the PR schedule of drug delivery. Distributions of inter-press intervals (IPIs) during the unloading phase in sessions before and after PR training were compared. It was found that the distribution of cocaine-induced IPIs during the unloading phase was lognormal, bimodal, and independent of previously injected cocaine unit doses. The first mode represented intervals within the short bouts of stereotypic presses and the second mode represented intervals between bouts. The two modes were approximately 0.7 s and 21 s during unloading prior to and 0.6 s and 1.5 s after PR self-administration training. The total number of presses per unloading phase increased eightfold. When the FR1 schedule was restored, the intervals between bouts remained very short for at least 7–10 days and only then started a gradual increase towards baseline levels. The last unloading press was defined as the press followed by the IPI longer than the defined criterion. PR training resulted in a substantial and long-lasting increase in lever-pressing activity during unloading. The duration of the unloading phase did not depend on the rate of lever-pressing activity.

Metabotropic group II glutamate receptors mediate cue-triggered increases in incentive motivation for reward

RationaleReward-associated cues can acquire incentive motivational properties and invigorate reward-seeking actions via Pavlovian-to-instrumental transfer (PIT). Glutamatergic neurotransmission mediates the appetitive effects of reward-associated cues. We characterized the expression of PIT and its mediation by metabotropic group II glutamate (mGlu2/3) receptor activity in female and male rats.ObjectivesAcross the sexes, we used PIT procedures to determine i) cue-triggered increases in incentive motivation for water reward (Experiment 1), ii) the respective influences of the mGlu2/3 receptor agonist LY379268 and reward devaluation by satiation on this effect (Experiment 2).MethodsWater-restricted male and female Sprague-Dawley rats learned to lever press for water. Separately, they learned that one of two auditory stimuli predicts free water (CS+ vs CS-). On PIT test days, the CS+ and CS- were presented non-contingently, and we measured effects on lever pressing under extinction (no water). In Experiment 1, we characterized PIT across the sexes. In Experiment 2, we measured PIT after systemic LY379268 administration (0, 0.3 and 1 mg/kg), and water satiation, respectively.ResultsFemale and male rats showed similar PIT, with CS+ but not CS- presentations potentiating water-seeking behaviour. LY379268 (1 mg/kg) attenuated CS+ evoked increases in both water-associated lever pressing and conditioned approach to the water port. Reward devaluation attenuated both water-seeking and CS+ evoked conditioned approach behaviour.ConclusionsThe sexes show similar cue-triggered increases in reward ‘wanting’, and water devaluation suppresses both water seeking and cue-triggered anticipation of water reward. Finally, across the sexes, mGlu2/3 receptor activity mediates cue-triggered increases in reward ‘wanting’.

Discordant Effects of Cannabinoid 2 Receptor Antagonism/Inverse Agonism During Adolescence on Pavlovian and Instrumental Reward Learning in Adult Male Rats

The endocannabinoid system is responsible for regulating a spectrum of physiological activities and plays a critical role in the developing brain. During adolescence, the endocannabinoid system is particularly sensitive to external insults that may change the brain’s developmental trajectory. Cannabinoid receptor type 2 (CB2R) was initially thought to predominantly function in the peripheral nervous system, but more recent studies have implicated its role in the mesolimbic pathway, a network largely attributed to reward circuitry and reward motivated behavior, which undergoes extensive changes during adolescence. It is therefore important to understand how CB2R modulation during adolescence can impact reward-related behaviors in adulthood. In this study, adolescent male rats (postnatal days 28–41) were exposed to a low or high dose of the CB2R antagonist/inverse agonist SR144528 and Pavlovian autoshaping and instrumental conditional behavioral outcomes were measured in adulthood. SR144528-treated rats had significantly slower acquisition of the autoshaping task, seen by less lever pressing behavior over time [F(2, 19) = 5.964, p = 0.010]. Conversely, there was no effect of adolescent SR144528 exposure on instrumental conditioning. These results suggest that modulation of the CB2R in adolescence differentially impacts reward-learning behaviors in adulthood.

Ventral pallidum regulates the default mode network, controlling transitions between internally and externally guided behavior

Daily life requires transitions between performance of well-practiced, automatized behaviors reliant upon internalized representations and behaviors requiring external focus. Such transitions involve differential activation of the default mode network (DMN), a group of brain areas associated with inward focus. We asked how optogenetic modulation of the ventral pallidum (VP), a subcortical DMN node, impacts task switching between internally to externally guided lever-pressing behavior in the rat. Excitation of the VP dramatically compromised acquisition of an auditory discrimination task, trapping animals in a DMN state of automatized internally focused behavior and impairing their ability to direct attention to external sensory stimuli. VP inhibition, on the other hand, facilitated task acquisition, expediting escape from the DMN brain state, thereby allowing rats to incorporate the contingency changes associated with the auditory stimuli. We suggest that VP, instant by instant, regulates the DMN and plays a deterministic role in transitions between internally and externally guided behaviors.

Complex Housing, but Not Maternal Deprivation Affects Motivation to Liberate a Trapped Cage-Mate in an Operant Rat Task

Early life environment influences the development of various aspects of social behavior, particularly during sensitive developmental periods. We studied how challenges in the early postnatal period or (early) adolescence affect pro-social behavior. To this end, we designed a lever-operated liberation task, to be able to measure motivation to liberate a trapped conspecific (by progressively increasing required lever pressing for door-opening). Liberation of the trapped rat resulted either in social contact or in liberation into a separate compartment. Additionally, a condition was tested in which both rats could freely move in two separate compartments and lever pressing resulted in social contact. When partners were not trapped, rats were more motivated to press the lever for opening the door than in either of the trapped configurations. Contrary to our expectations, the trapped configuration resulted in a reduced motivation to act. Early postnatal stress (24 h maternal deprivation on postnatal day 3) did not affect behavior in the liberation task. However, rearing rats from early adolescence onwards in complex housing conditions (Marlau cages) reduced the motivation to door opening, both in the trapped and freely moving conditions, while the motivation for a sucrose reward was not affected.

Maintained goal-directed control with overtraining on ratio schedules

It is thought that goal-directed control of actions weakens or becomes masked by habits over time. We tested the opposing hypothesis that goal-directed control becomes stronger over time, and that this growth is modulated by the overall action-outcome contiguity. Despite group differences in action-outcome contiguity early in training, rats trained under random and fixed ratio schedules showed equivalent goal-directed control of lever pressing that grew over time. We confirmed that goal-directed control was maintained over time under another type of ratio schedule—continuous reinforcement—using both specific satiety and taste aversion devaluation methods. These results add to the growing literature showing that extensive training does not always weaken goal-directed control, and can strengthen its expression.