scholarly journals Corticoinsular circuits encode subjective value expectation and violation for effortful goal-directed behavior

2018 ◽  
Vol 115 (22) ◽  
pp. E5233-E5242 ◽  
Author(s):  
Amanda R. Arulpragasam ◽  
Jessica A. Cooper ◽  
Makiah R. Nuutinen ◽  
Michael T. Treadway

We are presented with choices each day about how to invest our effort to achieve our goals. Critically, these decisions must frequently be made under conditions of incomplete information, where either the effort required or possible reward to be gained is uncertain. Such choices therefore require the development of potential value estimates to guide effortful goal-directed behavior. To date, however, the neural mechanisms for this expectation process are unknown. Here, we used computational fMRI during an effort-based decision-making task where trial-wise information about effort costs and reward magnitudes was presented separately over time, thereby allowing us to model distinct effort/reward computations as choice-relevant information unfolded. We found that ventromedial prefrontal cortex (vmPFC) encoded expected subjective value. Further, activity in dorsal anterior cingulate (dACC) and anterior insula (aI) reflected both effort discounting as well as a subjective value prediction error signal derived from trial history. While prior studies have identified these regions as being involved in effort-based decision making, these data demonstrate their specific role in the formation and maintenance of subjective value estimates as relevant information becomes available.

2018 ◽  
Vol 28 (03) ◽  
pp. 1750031 ◽  
Author(s):  
Li-Yu Huang ◽  
Hsiao-Ching She ◽  
Tzyy-Ping Jung

This study explored the electroencephalography (EEG) dynamics during a chemistry-related decision-making task and further examined whether the correctness of the decision-making performance could be reflected by EEG activity. A total of 66 undergraduate students’ EEG were collected while they participated in a chemistry-related decision-making task in which they had to retrieve the relevant chemistry concepts in order to make correct decisions for each task item. The results showed that it was only in the anterior cingulate cortex (ACC) cluster that distinct patterns in EEG dynamics were displayed for the correct and incorrect responses. The logistic regression results indicated that ACC theta power from 300[Formula: see text]ms to 250[Formula: see text]ms before stimulus onset was the most informative factor for estimating the likelihood of making correct decisions in the chemistry-related decision-making task, while it was the ACC low beta power from 150[Formula: see text]ms to 250[Formula: see text]ms after stimulus onset. The results suggested that the ACC theta augmentation before the stimulus onset serves to actively maintain the relevant information for retrieval from long-term memory, while the ACC low beta augmentation after the stimulus onset may serve the function of mapping the encoded stimulus onto the relevant criteria that the given participant has held within his or her mind to guide the decision-making responses.


2017 ◽  
Author(s):  
Amitai Shenhav ◽  
Mark A. Straccia ◽  
Jonathan D. Cohen ◽  
Matthew M. Botvinick

AbstractDecision-making is typically studied as a sequential process from the selection of what to attend (e.g., between possible tasks, stimuli, or stimulus attributes) to the selection of which actions to take based on the attended information. However, people often gather information across these levels in parallel. For instance, even as they choose their actions, they may continue to evaluate how much to attend other tasks or dimensions of information within a task. We scanned participants while they made such parallel evaluations, simultaneously weighing how much to attend two dynamic stimulus attributes and which response to give based on the attended information. Regions of prefrontal cortex tracked information about the stimulus attributes in dissociable ways, related to either the predicted reward (ventromedial prefrontal cortex) or the degree to which that attribute was being attended (dorsal anterior cingulate, dACC). Within dACC, adjacent regions tracked uncertainty at different levels of the decision, regarding what to attend versus how to respond. These findings bridge research on perceptual and value-based decision-making, demonstrating that people dynamically integrate information in parallel across different levels of decision making.Naturalistic decisions allow an individual to weigh their options within a particular task (e.g., how best to word the introduction to a paper) while also weighing how much to attend other tasks (e.g., responding to e-mails). These different types of decision-making have a hierarchical but reciprocal relationship: Decisions at higher levels inform the focus of attention at lower levels (e.g., whether to select between citations or email addresses) while, at the same time, information at lower levels (e.g., the salience of an incoming email) informs decisions regarding which task to attend. Critically, recent studies suggest that decisions across these levels may occur in parallel, continuously informed by information that is integrated from the environment and from one’s internal milieu1,2.Research on cognitive control and perceptual decision-making has examined how responses are selected when attentional targets are clearly defined (e.g., based on instruction to attend a stimulus dimension), including cases in which responding requires accumulating information regarding a noisy percept (e.g., evidence favoring a left or right response)3-7. Separate research on value-based decision-making has examined how individuals select which stimulus dimension(s) to attend in order to maximize their expected rewards8-11. However, it remains unclear how the accumulation of evidence to select high-level goals and/or attentional targets interacts with the simultaneous accumulation of evidence to select responses according to those goals (e.g., based on the perceptual properties of the stimuli). Recent work has highlighted the importance of such interactions to understanding task selection12-15, multi-attribute decision-making16-18, foraging behavior19-21, cognitive effort22,23, and self-control24-27.While these interactions remain poorly understood, previous research has identified candidate neural mechanisms associated with multi-attribute value-based decision-making11,28,29 and with selecting a response based on noisy information from an instructed attentional target3–5. These research areas have implicated the ventromedial prefrontal cortex (vmPFC) in tracking the value of potential targets of attention (e.g., stimulus attributes)8,11 and the dorsal anterior cingulate cortex (dACC) in tracking an individual’s uncertainty regarding which response to select30–32. It has been further proposed that dACC may differentiate between uncertainty at each of these parallel levels of decision-making (e.g., at the level of task goals or strategies vs. specific motor actions), and that these may be separately encoded at different locations along the dACC’s rostrocaudal axis32,33. However, neural activity within and across these prefrontal regions has not yet been examined in a setting in which information is weighed at both levels within and across trials.Here we use a value-based perceptual decision-making task to examine how people integrate different dynamic sources of information to decide (a) which perceptual attribute to attend and (b) how to respond based on the evidence for that attribute. Participants performed a task in which they regularly faced a conflict between attending the stimulus attribute that offered the greater reward or the attribute that was more perceptually salient (akin to persevering in writing one’s paper when an enticing email awaits). We demonstrate that dACC and vmPFC track evidence for the two attributes in dissociable ways. Across these regions, vmPFC weighs attribute evidence by the reward it predicts and dACC weighs it by its attentional priority (i.e., the degree to which that attribute drives choice). Within dACC, adjacent regions differentiated between uncertainty at the two levels of the decision, regarding what to attend (rostral dACC) versus how to respond (caudal dACC).


2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Ariel X.-A. Goh ◽  
Daniel Bennett ◽  
Stefan Bode ◽  
Trevor T.-J. Chong

AbstractHumans have a striking desire to actively seek new information, even when it is devoid of any instrumental utility. However, the mechanisms that drive individuals’ subjective preference for information remain unclear. Here, we used fMRI to examine the processing of subjective information value, by having participants decide how much effort they were willing to trade-off for non-instrumental information. We showed that choices were best described by a model that accounted for: (1) the variability in individuals’ estimates of uncertainty, (2) their desire to reduce that uncertainty, and (3) their subjective preference for positively valenced information. Model-based analyses revealed the anterior cingulate as a key node that encodes the subjective value of information across multiple stages of decision-making – including when information was prospectively valued, and when the outcome was definitively delivered. These findings emphasise the multidimensionality of information value, and reveal the neurocomputational mechanisms underlying the variability in individuals’ desire to physically pursue informative outcomes.


2018 ◽  
Author(s):  
Xiaoxue Gao ◽  
Hongbo Yu ◽  
Ignacio Saez ◽  
Philip R. Blue ◽  
Lusha Zhu ◽  
...  

AbstractHumans are capable of integrating social contextual information into decision-making processes to adjust their attitudes towards inequity. This context-dependency emerges both when individual is better off (i.e. advantageous inequity) and worse off (i.e. disadvantageous inequity) than others. It is not clear however, whether the context-dependent processing of advantageous and disadvantageous inequity rely on dissociable or shared neural mechanisms. Here, by combining an interpersonal interactive game that gave rise to interpersonal guilt and different versions of the dictator games that enabled us to characterize individual weights on aversion to advantageous and disadvantageous inequity, we investigated the neural mechanisms underlying the two forms of inequity aversion in the interpersonal guilt context. In each round, participants played a dot-estimation task with an anonymous co-player. The co-players received pain stimulation with 50% probability when anyone responded incorrectly. At the end of each round, participants completed a dictator game, which determined payoffs of him/herself and the co-player. Both computational model-based and model-free analyses demonstrated that when inflicting pain upon co-players (i.e., the guilt context), participants cared more about advantageous inequity and became less sensitive to disadvantageous inequity, compared with other social contexts. The contextual effects on two forms of inequity aversion are uncorrelated with each other at the behavioral level. Neuroimaging results revealed that the context-dependent representation of inequity aversion exhibited a spatial gradient in activity within the insula, with anterior parts predominantly involved in the aversion to advantageous inequity and posterior parts predominantly involved in the aversion to disadvantageous inequity. The dissociable mechanisms underlying the two forms of inequity aversion are further supported by the involvement of right dorsolateral prefrontal cortex and dorsomedial prefrontal cortex in advantageous inequity processing, and the involvement of right amygdala and dorsal anterior cingulate cortex in disadvantageous inequity processing. These results extended our understanding of decision-making processes involving inequity and the social functions of inequity aversion.


2019 ◽  
Author(s):  
David Victor Smith ◽  
Mauricio Delgado

Our behavior is inextricably linked to rewards in our environment. This observation has sparked considerable interest in understanding the neural mechanisms that support reward processing in humans. Early neuroimaging studies implicated regions such as the striatum and ventromedial prefrontal cortex (VMPFC) in reward processing, particularly how activation in these regions is modulated by anticipation and receipt of rewards. These findings have been extended in the context of models that account for the representation of subjective value, which influences decision making. Building from these findings, researchers are now beginning to characterize how social information has idiosyncratic influences on reward processing.


2020 ◽  
Vol 117 (44) ◽  
pp. 27719-27730 ◽  
Author(s):  
Patricia L. Lockwood ◽  
Miriam C. Klein-Flügge ◽  
Ayat Abdurahman ◽  
Molly J. Crockett

Moral behavior requires learning how our actions help or harm others. Theoretical accounts of learning propose a key division between “model-free” algorithms that cache outcome values in actions and “model-based” algorithms that map actions to outcomes. Here, we tested the engagement of these mechanisms and their neural basis as participants learned to avoid painful electric shocks for themselves and a stranger. We found that model-free decision making was prioritized when learning to avoid harming others compared to oneself. Model-free prediction errors for others relative to self were tracked in the thalamus/caudate. At the time of choice, neural activity consistent with model-free moral learning was observed in subgenual anterior cingulate cortex (sgACC), and switching after harming others was associated with stronger connectivity between sgACC and dorsolateral prefrontal cortex. Finally, model-free moral learning varied with individual differences in moral judgment. Our findings suggest moral learning favors efficiency over flexibility and is underpinned by specific neural mechanisms.


2021 ◽  
Author(s):  
Huw Jarvis ◽  
Isabelle Stevenson ◽  
Amy Q Huynh ◽  
Emily Babbage ◽  
James P. Coxon ◽  
...  

Humans routinely learn the value of actions by assessing their outcomes. Actions also require effort, and increasing evidence suggests that effort and learning share common neurophysiological substrates. Here, we asked whether effort could modulate teaching signals in a reinforcement learning task. Individuals (N=140) registered their choices by exerting predefined levels of physical force. Our key finding was that effort increased the subjective value of an outcome, regardless of whether that outcome was positive or negative. Moreover, across participants, the extent to which effort reinforced learning correlated with effort discounting, suggesting that effort has a greater effect on learning in those who are more averse to investing it. By integrating models of reinforcement learning with neuroeconomic frameworks of value-based decision-making, we show that learning is shaped by both rewards and the effort required to obtain them, thus revealing how effort and learning operate within a common computational framework.


2017 ◽  
Author(s):  
Lirong Qiu ◽  
Jie Su ◽  
Yinmei Ni ◽  
Yang Bai ◽  
Xiaoli Li ◽  
...  

AbstractDecision-making is usually accompanied by metacognition, through which a decision maker monitors the decision uncertainty and consequently revises the decision, even prior to feedback. However, the neural mechanisms of metacognition remain controversial: one theory proposes that metacognition coincides the decision-making process; and another addresses that it entails an independent neural system in the prefrontal cortex (PFC). Here we devised a novel paradigm of “decision-redecision” to investigate the metacognition process in redecision, in comparison with the decision process. We here found that the anterior PFC, including dorsal anterior cingulate cortex (dACC) and lateral frontopolar cortex (lFPC), were exclusively activated after the initial decisions. dACC was involved in decision uncertainty monitoring, whereas lFPC was involved in decision adjustment controlling, subject to control demands of the tasks. Our findings support that the PFC is essentially involved in metacognition and further suggest that functions of the PFC in metacognition are dissociable.


2021 ◽  
Author(s):  
Atsushi Fujimoto ◽  
Elisabeth A. Murray ◽  
Peter H. Rudebeck

AbstractDecision-making and representations of arousal are intimately linked. Behavioral investigations have classically shown that either too little or too much bodily arousal is detrimental to decision-making, indicating that there is an inverted ‘U’ relationship between bodily arousal and performance. How these processes interact at the level of single neurons as well as the neural circuits involved are unclear. Here we recorded neural activity from orbitofrontal cortex (OFC) and dorsal anterior cingulate cortex (dACC) of macaque monkeys while they made reward-guided decisions. Heart rate (HR) was also recorded as a proxy for bodily arousal. Recordings were made both before and after subjects received excitotoxic lesions of the bilateral amygdala. In intact monkeys, higher HR facilitated reaction times (RTs). Concurrently, a set of neurons in OFC and dACC selectively encoded trial-by-trial variations in HR independent of reward value. After amygdala lesions, HR increased and the relationship between HR and RTs was reversed. Concurrent with this change, there was an increase in the proportion of dACC neurons encoding HR. Applying a novel population-coding analysis, we show that bilateral amygdala lesions skew the balance of encoding in dACC away from signaling either reward value or choice direction towards HR coding around the time that choices are made. Taken together, the present results provide insight into how bodily arousal and decision-making are signaled in frontal cortex. Our findings may shed light on the neural mechanisms underlying some psychiatric disorders linked to amygdala dysfunction that are characterized by heightened arousal and deficits in decision-making.Significance statementHow bodily arousal states influence decision-making has been a central question in psychology, but the neural mechanisms are unclear. We recorded heart rate, a measure of bodily arousal, while simultaneously monitoring neural activity in orbitofrontal cortex (OFC) and dorsal anterior cingulate cortex (dACC) of macaques making reward-guided decisions. In intact macaques higher HR was associated with shorter reaction times. Concurrently, the activity of a set of neurons in OFC and dACC selectively encoded HR. Following amygdala lesions, HR generally increased and now the relationship between HR and reaction times was reversed. At the neural level, the balance of encoding in dACC shifted towards signaling HR, suggesting a specific mechanism through which arousal influences decision-making.


2019 ◽  
Author(s):  
Sangil Lee ◽  
Linda Q. Yu ◽  
Caryn Lerman ◽  
Joseph W. Kable

AbstractAcross many studies, ventromedial prefrontal cortex (vmPFC) activity has been found to correlate with subjective value during value-based decision-making. Recently, however, vmPFC has also been shown to reflect a hexagonal gridlike code during navigation through physical and conceptual space. This raises the possibility that the subjective value correlates previously observed in vmPFC may have actually been a misconstrued gridlike signal. Here, we first show that, in theory, a hexagonal gridlike code of two-dimensional attribute space could mimic vmPFC activity previously attributed to subjective value. However, using fMRI data from a large number of subjects performing an intertemporal choice task, we show clear and unambiguous evidence that subjective value is a better description of vmPFC activity than a hexagonal gridlike code. In fact, we find no significant evidence at all for a hexagonal gridlike code in vmPFC activity during intertemporal choice. This result limits the generality of gridlike modulation as description of vmPFC activity. We suggest that vmPFC may flexibly switch representational schemes so as to encode the most relevant information for the current task.


Sign in / Sign up

Export Citation Format

Share Document