scholarly journals Covert valuation for information sampling and choice

2021 ◽  
Author(s):  
James Lawrence Butler ◽  
Timothy H. Muller ◽  
Sebastijan Veselic ◽  
W.M. Nishantha Malalasekera ◽  
Laurence T Hunt ◽  
...  

We use our eyes to assess the value of objects around us and carefully fixate options that we are about to choose. Neurons in the prefrontal cortex reliably encode the value of fixated options, which is essential for decision making. Yet as a decision unfolds, it remains unclear how prefrontal regions determine which option should be fixated next. Here we show that anterior cingulate cortex (ACC) encodes the value of options in the periphery to guide subsequent fixations during economic choice. In an economic decision-making task involving four simultaneously presented cues, we found rhesus macaques evaluated cues using their peripheral vision. This served two distinct purposes: subjects were more likely to fixate valuable peripheral cues, and more likely to choose valuable options whose cues were never even fixated. ACC, orbitofrontal cortex, dorsolateral pre-frontal cortex, and ventromedial prefrontal cortex neurons all encoded cue value post-fixation. ACC was unique, however, in also encoding the value of cues before fixation and even cues that were never fixated. This pre-saccadic value encoding by ACC predicted which cue was next fixated during the decision process. ACC therefore conducts simultaneous processing of peripheral information to guide information sampling and choice during decision making.

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Luca F. Kaiser ◽  
Theo O. J. Gruendler ◽  
Oliver Speck ◽  
Lennart Luettgau ◽  
Gerhard Jocham

AbstractIn a dynamic world, it is essential to decide when to leave an exploited resource. Such patch-leaving decisions involve balancing the cost of moving against the gain expected from the alternative patch. This contrasts with value-guided decisions that typically involve maximizing reward by selecting the current best option. Patterns of neuronal activity pertaining to patch-leaving decisions have been reported in dorsal anterior cingulate cortex (dACC), whereas competition via mutual inhibition in ventromedial prefrontal cortex (vmPFC) is thought to underlie value-guided choice. Here, we show that the balance between cortical excitation and inhibition (E/I balance), measured by the ratio of GABA and glutamate concentrations, plays a dissociable role for the two kinds of decisions. Patch-leaving decision behaviour relates to E/I balance in dACC. In contrast, value-guided decision-making relates to E/I balance in vmPFC. These results support mechanistic accounts of value-guided choice and provide evidence for a role of dACC E/I balance in patch-leaving decisions.


2018 ◽  
Vol 29 (10) ◽  
pp. 4277-4290 ◽  
Author(s):  
Patrick S Hogan ◽  
Joseph K Galaro ◽  
Vikram S Chib

Abstract The perceived effort level of an action shapes everyday decisions. Despite the importance of these perceptions for decision-making, the behavioral and neural representations of the subjective cost of effort are not well understood. While a number of studies have implicated anterior cingulate cortex (ACC) in decisions about effort/reward trade-offs, none have experimentally isolated effort valuation from reward and choice difficulty, a function that is commonly ascribed to this region. We used functional magnetic resonance imaging to monitor brain activity while human participants engaged in uncertain choices for prospective physical effort. Our task was designed to examine effort-based decision-making in the absence of reward and separated from choice difficulty—allowing us to investigate the brain’s role in effort valuation, independent of these other factors. Participants exhibited subjectivity in their decision-making, displaying increased sensitivity to changes in subjective effort as objective effort levels increased. Analysis of blood-oxygenation-level dependent activity revealed that the ventromedial prefrontal cortex (vmPFC) encoded the subjective valuation of prospective effort, and ACC activity was best described by choice difficulty. These results provide insight into the processes responsible for decision-making regarding effort, partly dissociating the roles of vmPFC and ACC in prospective valuation of effort and choice difficulty.


2009 ◽  
Vol 18 (2) ◽  
pp. 104-106 ◽  
Author(s):  
Marcella Bellani ◽  
Luisa Tomelleri ◽  
Paolo Brambilla

The decision making can be defined as the mental process in which a “choice is made after reflecting on the consequences of that choice” (Bechara & Van Der Linden, 2005; Bechara et al., 1997). It is a complex process that involves cognitive as well as emotion-based functions. In fact human beings make fast adaptive decisions in daily life, and that is based on the skill to relate emotion to contextual stimuli in order to anticipate outcomes through activation of emotional states (Bechara et al., 2005). In this regard, the ventromedial prefrontal cortex (VMPFC) has been widely recognized to play a key role in the emotional decision making process. The VMPFC includes the medial part of the orbitofrontal cortex (OFC), the more ventral sectors of the medial prefrontal cortex and the anterior cingulate cortex (Bechara et al., 1997). In particular the OFC, within the VMPFC, is part of a neural system underpinning decision-making and reward-related behaviours which are thought to be linked to social conduct (Rolls, 2000).


2018 ◽  
Vol 115 (33) ◽  
pp. E7680-E7689 ◽  
Author(s):  
Xiaoxue Gao ◽  
Hongbo Yu ◽  
Ignacio Sáez ◽  
Philip R. Blue ◽  
Lusha Zhu ◽  
...  

Humans can integrate social contextual information into decision-making processes to adjust their responses toward inequity. This context dependency emerges when individuals receive more (i.e., advantageous inequity) or less (i.e., disadvantageous inequity) than others. However, it is not clear whether context-dependent processing of advantageous and disadvantageous inequity involves differential neurocognitive mechanisms. Here, we used fMRI to address this question by combining an interactive game that modulates social contexts (e.g., interpersonal guilt) with computational models that enable us to characterize individual weights on inequity aversion. In each round, the participant played a dot estimation task with an anonymous coplayer. The coplayer would receive pain stimulation with 50% probability when either of them responded incorrectly. At the end of each round, the participant completed a variant of dictator game, which determined payoffs for him/herself and the coplayer. Computational modeling demonstrated the context dependency of inequity aversion: when causing pain to the coplayer (i.e., guilt context), participants cared more about the advantageous inequity and became more tolerant of the disadvantageous inequity, compared with other conditions. Consistently, neuroimaging results suggested the two types of inequity were associated with differential neurocognitive substrates. While the context-dependent processing of advantageous inequity was associated with social- and mentalizing-related processes, involving left anterior insula, right dorsolateral prefrontal cortex, and dorsomedial prefrontal cortex, the context-dependent processing of disadvantageous inequity was primarily associated with emotion- and conflict-related processes, involving left posterior insula, right amygdala, and dorsal anterior cingulate cortex. These results extend our understanding of decision-making processes related to inequity aversion.


2017 ◽  
Author(s):  
Amitai Shenhav ◽  
Mark A. Straccia ◽  
Jonathan D. Cohen ◽  
Matthew M. Botvinick

AbstractDecision-making is typically studied as a sequential process from the selection of what to attend (e.g., between possible tasks, stimuli, or stimulus attributes) to the selection of which actions to take based on the attended information. However, people often gather information across these levels in parallel. For instance, even as they choose their actions, they may continue to evaluate how much to attend other tasks or dimensions of information within a task. We scanned participants while they made such parallel evaluations, simultaneously weighing how much to attend two dynamic stimulus attributes and which response to give based on the attended information. Regions of prefrontal cortex tracked information about the stimulus attributes in dissociable ways, related to either the predicted reward (ventromedial prefrontal cortex) or the degree to which that attribute was being attended (dorsal anterior cingulate, dACC). Within dACC, adjacent regions tracked uncertainty at different levels of the decision, regarding what to attend versus how to respond. These findings bridge research on perceptual and value-based decision-making, demonstrating that people dynamically integrate information in parallel across different levels of decision making.Naturalistic decisions allow an individual to weigh their options within a particular task (e.g., how best to word the introduction to a paper) while also weighing how much to attend other tasks (e.g., responding to e-mails). These different types of decision-making have a hierarchical but reciprocal relationship: Decisions at higher levels inform the focus of attention at lower levels (e.g., whether to select between citations or email addresses) while, at the same time, information at lower levels (e.g., the salience of an incoming email) informs decisions regarding which task to attend. Critically, recent studies suggest that decisions across these levels may occur in parallel, continuously informed by information that is integrated from the environment and from one’s internal milieu1,2.Research on cognitive control and perceptual decision-making has examined how responses are selected when attentional targets are clearly defined (e.g., based on instruction to attend a stimulus dimension), including cases in which responding requires accumulating information regarding a noisy percept (e.g., evidence favoring a left or right response)3-7. Separate research on value-based decision-making has examined how individuals select which stimulus dimension(s) to attend in order to maximize their expected rewards8-11. However, it remains unclear how the accumulation of evidence to select high-level goals and/or attentional targets interacts with the simultaneous accumulation of evidence to select responses according to those goals (e.g., based on the perceptual properties of the stimuli). Recent work has highlighted the importance of such interactions to understanding task selection12-15, multi-attribute decision-making16-18, foraging behavior19-21, cognitive effort22,23, and self-control24-27.While these interactions remain poorly understood, previous research has identified candidate neural mechanisms associated with multi-attribute value-based decision-making11,28,29 and with selecting a response based on noisy information from an instructed attentional target3–5. These research areas have implicated the ventromedial prefrontal cortex (vmPFC) in tracking the value of potential targets of attention (e.g., stimulus attributes)8,11 and the dorsal anterior cingulate cortex (dACC) in tracking an individual’s uncertainty regarding which response to select30–32. It has been further proposed that dACC may differentiate between uncertainty at each of these parallel levels of decision-making (e.g., at the level of task goals or strategies vs. specific motor actions), and that these may be separately encoded at different locations along the dACC’s rostrocaudal axis32,33. However, neural activity within and across these prefrontal regions has not yet been examined in a setting in which information is weighed at both levels within and across trials.Here we use a value-based perceptual decision-making task to examine how people integrate different dynamic sources of information to decide (a) which perceptual attribute to attend and (b) how to respond based on the evidence for that attribute. Participants performed a task in which they regularly faced a conflict between attending the stimulus attribute that offered the greater reward or the attribute that was more perceptually salient (akin to persevering in writing one’s paper when an enticing email awaits). We demonstrate that dACC and vmPFC track evidence for the two attributes in dissociable ways. Across these regions, vmPFC weighs attribute evidence by the reward it predicts and dACC weighs it by its attentional priority (i.e., the degree to which that attribute drives choice). Within dACC, adjacent regions differentiated between uncertainty at the two levels of the decision, regarding what to attend (rostral dACC) versus how to respond (caudal dACC).


2008 ◽  
Vol 66 (2b) ◽  
pp. 436-443 ◽  
Author(s):  
Henrique Cerqueira Guimarães ◽  
Richard Levy ◽  
Antônio Lúcio Teixeira ◽  
Rogério Gomes Beato ◽  
Paulo Caramelli

Apathy is considered the most frequent neuropsychiatric disturbance in dementia and its outcome is generally deleterious. Apathy can be related to a dysfunction of the anatomical-system that supports the generation of voluntary actions, namely the prefrontal cortex and/or the prefrontal-subcortical circuits. In Alzheimer's disease, pathological and neuroimaging data indicate that apathy is likely due to a dysfunction of the medial prefrontal cortex. Accordingly, in this review article, we propose a pathophysiological model to explain apathetic behavior in Alzheimer's disease, combining data from neuroimaging, neuropathology and experimental research on the role of orbito-frontal cortex, anterior cingulate cortex, basal ganglia and dopamine in decision-making neurobiology.


2017 ◽  
Vol 7 (1) ◽  
pp. 44-56
Author(s):  
Torben Larsen

This paper discusses the development of a neuroeconomic model of decision-making (DM). The method used was a review of functional Magnetic Resonance Imaging of game trials on economic choice. Key centers in economic DM are Ventromedial Prefrontal Cortex, Dorsolateral Prefrontal Cortex, Frontopolar Cortex, Orbitofrontal Cortex, Anterior Cingulate Cortex, Amygdala and Ventral Tegmentum. The interaction of these centers determines individual risk-preference (NeM). The validity of NeM is consolidated by lesion-studies. NeM shows that relaxation exercises are complementary to physical fitness in the maintenance of mental health. Further, NeM explains the effect of “Early home-supported discharge” and how chess games support the learning of mathematics.


2010 ◽  
Vol 22 (5) ◽  
pp. 1069-1082 ◽  
Author(s):  
Edmund T. Rolls ◽  
Fabian Grabenhorst ◽  
Benjamin A. Parris

Decision-making about affective value may occur after the reward value of a stimulus is represented and may involve different brain areas to those involved in decision-making about the physical properties of stimuli, such as intensity. In an fMRI study, we delivered two odors separated by a delay, with instructions on different trials to decide which odor was more pleasant or more intense or to rate the pleasantness and intensity of the second odor without making a decision. The fMRI signals in the medial prefrontal cortex area 10 (medial PFC) and in regions to which it projects, including the anterior cingulate cortex (ACC) and insula, were higher when decisions were being made compared with ratings, implicating these regions in decision-making. Decision-making about affective value was related to larger signals in the dorsal part of medial area 10 and the agranular insula, whereas decisions about intensity were related to larger activations in the dorsolateral prefrontal cortex (dorsolateral PFC), ventral premotor cortex, and anterior insula. For comparison, the mid orbitofrontal cortex (OFC) had activations related not to decision-making but to subjective pleasantness ratings, providing a continuous representation of affective value. In contrast, areas such as medial area 10 and the ACC are implicated in reaching a decision in which a binary outcome is produced.


Sign in / Sign up

Export Citation Format

Share Document