Abrupt, Asynchronous Changes in Action Representations by Anterior Cingulate Cortex Neurons during Trial and Error Learning

2020 ◽  
Vol 30 (8) ◽  
pp. 4336-4345
Author(s):  
Eldon Emberly ◽  
Jeremy K Seamans

Abstract The ability to act on knowledge about the value of stimuli or actions factors into simple foraging behaviors as well as complex forms of decision-making. In striatal regions, action representations are thought to acquire value through a gradual (reinforcement-learning based) process. It is unclear whether this is also true for anterior cingulate cortex (ACC) where neuronal representations tend to change abruptly. We recorded from ensembles of ACC neurons as rats deduced which of 3 levers was rewarded each day. The rat’s lever preferences changed gradually throughout the sessions as they eventually came to focus on the rewarded lever. Most individual neurons changed their responses to both rewarded and nonrewarded lever presses abruptly (<2 trials). These transitions occurred asynchronously across the population but peaked near the point where the rats began to focus on the rewarded lever. Because the individual transitions were asynchronous, the overall change at the population level appeared gradual. Abrupt transitions in action representations of ACC neurons may be part of a mechanism that alters choice strategies as new information is acquired.

2019 ◽  
Author(s):  
Eldon Emberly ◽  
K Seamans Jeremy

AbstractThe ability to acquire knowledge about the value of stimuli or actions factors into simple foraging behaviors as well as complex forms of decision making. The anterior cingulate cortex (ACC) is thought to be involved in these processes, although the manner in which neural representations acquire value is unclear. Here we recorded from ensembles of ACC neurons as rats learned which of 3 levers was rewarded each day through a trial and error process. Action representations remained largely stable during exploration, but there was an abrupt, coordinated and differential change in the representation of rewarded and nonrewarded levers by ACC neurons at the point where the rat realized which lever was rewarded and began to exploit it. Thus, rather than a gradual, incremental process, value learning in ACC can occur in an all-or-none manner and help to initiate strategic shifts in forging behavior.


2021 ◽  
Author(s):  
Anna M. Kazmierowska ◽  
Michal Szczepanik ◽  
Marek Wypych ◽  
Dawid Drozdziel ◽  
Artur Marchewka ◽  
...  

Humans often benefit from social cues when learning about the world. For instance, learning about threats from others can save the individual from dangerous first-hand experiences. Familiarity is believed to increase the effectiveness of social learning, but it is not clear whether it plays a role in learning about threats. Using functional magnetic resonance imaging, we undertook a naturalistic approach and investigated whether there was a difference between observational fear learning from friends and strangers. Participants (observers) witnessed either their friends or strangers (demonstrators) receiving aversive (shock) stimuli paired with colored squares (observational learning stage). Subsequently, participants watched the same squares, but without receiving any shocks (direct-expression stage). We observed a similar pattern of brain activity in both groups of observers. Regions related to threat responses (amygdala, anterior insula, anterior cingulate cortex) and social perception (fusiform gyrus, posterior superior temporal sulcus) were activated during the observational phase, reflecting the fear contagion process. The anterior insula and anterior cingulate cortex were also activated during the subsequent stage, indicating the expression of learned threat. Because there were no differences between participants observing friends and strangers, we argue that social threat learning is independent of the level of familiarity with the demonstrator.


2020 ◽  
Author(s):  
Maya Zhe Wang ◽  
Benjamin Yost Hayden

ABSTRACTDisparity between current and desired information, known as information gap, is an important driver of information-seeking and curiosity. To gain insight into its neural basis, we recorded responses of single neurons in dorsal anterior cingulate cortex (dACC) while rhesus macaques performed a task that induces and quantifies demand for information. We find that enhanced firing rates in dACC before the start of a trial predict a stronger bias towards information-seeking choices. Following choices of uninformative options, firing rates are tonically enhanced until information is delivered. The level of enhancement observed is correlated on a trial-by-trial basis with the value assigned to the prospective information. Finally, variation in this tone is positively correlated with receptiveness to new information, as inferred by preference changes on subsequent trials. These patterns are not observed in a complementary dataset collected in orbitofrontal cortex (OFC), suggesting these effects reflect at least somewhat anatomically localized processing.


2009 ◽  
Vol 61 (4) ◽  
pp. 659-673
Author(s):  
D.M. Pavlovic ◽  
Aleksandra Pavlovic ◽  
Maja Lackovic

The anterior cingulate cortex (ACC) has a role in attention, analysis of sensory information, error recognition, problem solving, detection of novelty, behavior, emotions, social relations, cognitive control, and regulation of visceral functions. This area is active whenever the individual feels some emotions, solves a problem, or analyzes the pros and cons of an action (if it is a right decision). Analogous areas are also found in higher mammals, especially whales, and they contain spindle neurons that enable complex social interactions. Disturbance of ACC activity is found in dementias, schizophrenia, depression, the obsessive-compulsive syndrome, and other neuropsychiatric diseases.


2003 ◽  
Vol 42 (05) ◽  
pp. 197-209 ◽  
Author(s):  
F. M. Mottaghy ◽  
D. Schmidt ◽  
H.-W. Müller ◽  
B. J. Krause ◽  
H. Hautzel

Summary: Aim: In cognitive neuroscience regional cerebral blood flow (rCBF) imaging with positron-emission-tomography (PET) is a powerful tool to characterize different aspects of cognitive processes by using different data analysis approaches. By use of an n-back verbal working memory task (varied from 0- to 3-back) we present cognitive subtraction analysis as basic strategy as well as parametric and covariance analyses and discuss the results. Methods: Correlation analyses were performed using the individual performance rate as an external covariate, computing inter-regional correlations, and as network analysis applying structural equation modelling to evaluate the effective connectivity between the involved brain regions. Results: Subtraction analyses revealed a fronto-parietal neuronal network also including the anterior cingulate cortex and the cerebellum. With higher memory load the parametric analysis evidenced linear rCBF increases in prefrontal, pre-motor and inferior parietal areas including the precuneus as well as in the anterior cingulate cortex. The rCBF correlation with the individual performance as external covariate depicted negative correlations in bilateral prefrontal and inferior parietal regions, in the precuneus and the anterior cingulate cortex. The network analysis demonstrated mainly occipito-frontally directed interactions which were predominantly left-hemispheric. Additionally, strong linkages were found between extrastriate and parietal regions as well as within the parietal cortex. Conclusion: The data analysis approaches presented here contribute to an extended and more elaborated understanding of cognitive processes and their different sub-aspects.


2006 ◽  
Vol 37 (S 1) ◽  
Author(s):  
M Mannerkoski ◽  
H Heiskala ◽  
K Van Leemput ◽  
L Åberg ◽  
R Raininko ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document