scholarly journals Dynamic changes in Anterior Cingulate Cortex ensembles mark the transition from exploration to exploitation

2019 ◽  
Author(s):  
Eldon Emberly ◽  
K Seamans Jeremy

AbstractThe ability to acquire knowledge about the value of stimuli or actions factors into simple foraging behaviors as well as complex forms of decision making. The anterior cingulate cortex (ACC) is thought to be involved in these processes, although the manner in which neural representations acquire value is unclear. Here we recorded from ensembles of ACC neurons as rats learned which of 3 levers was rewarded each day through a trial and error process. Action representations remained largely stable during exploration, but there was an abrupt, coordinated and differential change in the representation of rewarded and nonrewarded levers by ACC neurons at the point where the rat realized which lever was rewarded and began to exploit it. Thus, rather than a gradual, incremental process, value learning in ACC can occur in an all-or-none manner and help to initiate strategic shifts in forging behavior.

2020 ◽  
Vol 30 (8) ◽  
pp. 4336-4345
Author(s):  
Eldon Emberly ◽  
Jeremy K Seamans

Abstract The ability to act on knowledge about the value of stimuli or actions factors into simple foraging behaviors as well as complex forms of decision-making. In striatal regions, action representations are thought to acquire value through a gradual (reinforcement-learning based) process. It is unclear whether this is also true for anterior cingulate cortex (ACC) where neuronal representations tend to change abruptly. We recorded from ensembles of ACC neurons as rats deduced which of 3 levers was rewarded each day. The rat’s lever preferences changed gradually throughout the sessions as they eventually came to focus on the rewarded lever. Most individual neurons changed their responses to both rewarded and nonrewarded lever presses abruptly (<2 trials). These transitions occurred asynchronously across the population but peaked near the point where the rats began to focus on the rewarded lever. Because the individual transitions were asynchronous, the overall change at the population level appeared gradual. Abrupt transitions in action representations of ACC neurons may be part of a mechanism that alters choice strategies as new information is acquired.


2006 ◽  
Vol 37 (S 1) ◽  
Author(s):  
M Mannerkoski ◽  
H Heiskala ◽  
K Van Leemput ◽  
L Åberg ◽  
R Raininko ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document