scholarly journals Frontoparietal dynamics and value accumulation in intertemporal choice

2020 ◽  
Author(s):  
Qingfang Liu ◽  
Woojong Yi ◽  
Christian A. Rodriguez ◽  
Samuel M. McClure ◽  
Brandon M. Turner
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Time Delay ◽  
Functional Connectivity ◽  
Computational Model ◽  
Intertemporal Choice ◽  
Brain Regions ◽  
Accumulation Process ◽  
Stimulus Processing ◽  
Subjective Value

AbstractIntertemporal choice requires choosing between a smaller reward available after a shorter time delay and a larger reward available after a longer time delay. Previous studies suggest that intertemporal preferences are formed by generating a subjective value of the monetary rewards that depends on reward amount and the associated time delay. Neuroimaging results indicate that this subjective value is tracked by ventral medial prefrontal cortex (vmPFC) and ventral striatum. Subsequently, an accumulation process, subserved by a network including dorsal medial frontal cortex (dmFC), dorsal lateral prefrontal cortex (dlPFC) and posterior parietal cortex (pPC), selects a choice based on the subjective values. The mechanisms of how value accumulation interacts with subjective valuation to make a choice, and how brain regions communicate during decision making are undetermined. We developed and performed an EEG experiment that parametrically manipulated the probability of preferring delayed larger rewards. A computational model equipped with time and reward information transformation, selective attention, and stochastic value accumulation mechanisms was constructed and fit to choice and response time data using a hierarchical Bayesian approach.Phase-based functional connectivity between putative dmFC and pPC was found to be associated with stimulus processing and to resemble the reconstructed accumulation dynamics from the best performing computational model across experimental conditions. By combining computational modeling and phase-based functional connectivity, our results suggest an association between value accumulation, choice competition, and frontoparietal connectivity in intertemporal choice.Author summaryIntertemporal choice is a prominent experimental assay for impulsivity. Behavior in the task involves several cognitive functions including valuation, action selection and self-control. It is unknown how these different functions are temporally implemented during the course of decision making. In the current study, we combined formal computational models of intertemporal choice with a phase-based EEG measure of activity across brain regions to show that functional connectivity between dmFC and pPC reflects cognitive mechanisms of both visual stimulus processing and choice value accumulation. The result supports the notion that dynamic interaction between frontopatietal regions instantiates the critical value accumulation process in intertemporal choice.

scholarly journals Subjective value, not a gridlike code, describes neural activity in ventromedial prefrontal cortex during value-based decision-making

2019 ◽  
Author(s):  
Sangil Lee ◽  
Linda Q. Yu ◽  
Caryn Lerman ◽  
Joseph W. Kable
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Neural Activity ◽  
Intertemporal Choice ◽  
Relevant Information ◽  
Choice Task ◽  
Ventromedial Prefrontal Cortex ◽  
Subjective Value ◽  
Current Task ◽  
Attribute Space

AbstractAcross many studies, ventromedial prefrontal cortex (vmPFC) activity has been found to correlate with subjective value during value-based decision-making. Recently, however, vmPFC has also been shown to reflect a hexagonal gridlike code during navigation through physical and conceptual space. This raises the possibility that the subjective value correlates previously observed in vmPFC may have actually been a misconstrued gridlike signal. Here, we first show that, in theory, a hexagonal gridlike code of two-dimensional attribute space could mimic vmPFC activity previously attributed to subjective value. However, using fMRI data from a large number of subjects performing an intertemporal choice task, we show clear and unambiguous evidence that subjective value is a better description of vmPFC activity than a hexagonal gridlike code. In fact, we find no significant evidence at all for a hexagonal gridlike code in vmPFC activity during intertemporal choice. This result limits the generality of gridlike modulation as description of vmPFC activity. We suggest that vmPFC may flexibly switch representational schemes so as to encode the most relevant information for the current task.

scholarly journals Dissociable Contributions of Imagination and Willpower to the Malleability of Human Patience

2017 ◽  
Vol 28 (7) ◽  
pp. 894-906 ◽  
Author(s):  
Adrianna C. Jenkins ◽  
Ming Hsu
Keyword(s):  
Decision Making ◽  
Functional Connectivity ◽  
Intertemporal Choice ◽  
Framing Effects ◽  
Brain Regions ◽  
Behavioral Experiment ◽  
Neural Responses ◽  
Top Down ◽  
Human Functioning

The ability to exercise patience is important for human functioning. Although it is known that patience can be promoted by using top-down control, or willpower, to override impatient impulses, patience is also malleable—in particular, susceptible to framing effects—in ways that are difficult to explain using willpower alone. So far, the mechanisms underlying framing effects on patience have been elusive. We investigated the role of imagination in these effects. In a behavioral experiment (Experiment 1), a classic framing manipulation (sequence framing) increased self-reported and independently coded imagination during intertemporal choice. In an investigation of neural responses during decision making (Experiment 2), sequence framing increased the extent to which patience was related to activation in brain regions associated with imagination, relative to activation in regions associated with willpower, and increased functional connectivity of brain regions associated with imagination, but not willpower, relative to regions associated with valuation. Our results suggest that sequence framing can increase the role of imagination in decision making without increasing the exertion of willpower.

scholarly journals Hippocampal regenerative medicine: neurogenic implications for addiction and mental disorders

2021 ◽  
Author(s):  
Lee Peyton ◽  
Alfredo Oliveros ◽  
Doo-Sup Choi ◽  
Mi-Hyeon Jang
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Executive Function ◽  
General Population ◽  
Mental Disorders ◽  
Psychiatric Illness ◽  
Neural Circuitry ◽  
Brain Regions ◽  
Neuropsychiatric Disease ◽  
Motivated Behavior

AbstractPsychiatric illness is a prevalent and highly debilitating disorder, and more than 50% of the general population in both middle- and high-income countries experience at least one psychiatric disorder at some point in their lives. As we continue to learn how pervasive psychiatric episodes are in society, we must acknowledge that psychiatric disorders are not solely relegated to a small group of predisposed individuals but rather occur in significant portions of all societal groups. Several distinct brain regions have been implicated in neuropsychiatric disease. These brain regions include corticolimbic structures, which regulate executive function and decision making (e.g., the prefrontal cortex), as well as striatal subregions known to control motivated behavior under normal and stressful conditions. Importantly, the corticolimbic neural circuitry includes the hippocampus, a critical brain structure that sends projections to both the cortex and striatum to coordinate learning, memory, and mood. In this review, we will discuss past and recent discoveries of how neurobiological processes in the hippocampus and corticolimbic structures work in concert to control executive function, memory, and mood in the context of mental disorders.

scholarly journals Uncovering the spatio-temporal dynamics of value-based decision-making in the human brain: a combined fMRI–EEG study

2014 ◽  
Vol 369 (1655) ◽  
pp. 20130473 ◽  
Author(s):  
Tobias Larsen ◽  
John P. O'Doherty
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Temporal Dynamics ◽  
Brain Regions ◽  
Choice Task ◽  
Binary Choice ◽  
Intraparietal Sulcus ◽  
Trial Onset ◽  
Eeg Data ◽  
Spatio Temporal

While there is a growing body of functional magnetic resonance imaging (fMRI) evidence implicating a corpus of brain regions in value-based decision-making in humans, the limited temporal resolution of fMRI cannot address the relative temporal precedence of different brain regions in decision-making. To address this question, we adopted a computational model-based approach to electroencephalography (EEG) data acquired during a simple binary choice task. fMRI data were also acquired from the same participants for source localization. Post-decision value signals emerged 200 ms post-stimulus in a predominantly posterior source in the vicinity of the intraparietal sulcus and posterior temporal lobe cortex, alongside a weaker anterior locus. The signal then shifted to a predominantly anterior locus 850 ms following the trial onset, localized to the ventromedial prefrontal cortex and lateral prefrontal cortex. Comparison signals between unchosen and chosen options emerged late in the trial at 1050 ms in dorsomedial prefrontal cortex, suggesting that such comparison signals may not be directly associated with the decision itself but rather may play a role in post-decision action selection. Taken together, these results provide us new insights into the temporal dynamics of decision-making in the brain, suggesting that for a simple binary choice task, decisions may be encoded predominantly in posterior areas such as intraparietal sulcus, before shifting anteriorly.

scholarly journals Interacting roles of lateral and medial Orbitofrontal cortex in decision-making and learning : A system-level computational model

2019 ◽  
Author(s):  
Bhargav Teja Nallapu ◽  
Frédéric Alexandre
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Computational Model ◽  
Orbitofrontal Cortex ◽  
Temporal Dynamics ◽  
System Level ◽  
Interacting Networks ◽  
Cortical Regions ◽  
Experimental Findings

AbstractIn the context of flexible and adaptive animal behavior, the orbitofrontal cortex (OFC) is found to be one of the crucial regions in the prefrontal cortex (PFC) influencing the downstream processes of decision-making and learning in the sub-cortical regions. Although OFC has been implicated to be important in a variety of related behavioral processes, the exact mechanisms are unclear, through which the OFC encodes or processes information related to decision-making and learning. Here, we propose a systems-level view of the OFC, positioning it at the nexus of sub-cortical systems and other prefrontal regions. Particularly we focus on one of the most recent implications of neuroscientific evidences regarding the OFC - possible functional dissociation between two of its sub-regions : lateral and medial. We present a system-level computational model of decision-making and learning involving the two sub-regions taking into account their individual roles as commonly implicated in neuroscientific studies. We emphasize on the role of the interactions between the sub-regions within the OFC as well as the role of other sub-cortical structures which form a network with them. We leverage well-known computational architecture of thalamo-cortical basal ganglia loops, accounting for recent experimental findings on monkeys with lateral and medial OFC lesions, performing a 3-arm bandit task. First we replicate the seemingly dissociate effects of lesions to lateral and medial OFC during decision-making as a function of value-difference of the presented options. Further we demonstrate and argue that such an effect is not necessarily due to the dissociate roles of both the subregions, but rather a result of complex temporal dynamics between the interacting networks in which they are involved.Author summaryWe first highlight the role of the Orbitofrontal Cortex (OFC) in value-based decision making and goal-directed behavior in primates. We establish the position of OFC at the intersection of cortical mechanisms and thalamo-basal ganglial circuits. In order to understand possible mechanisms through which the OFC exerts emotional control over behavior, among several other possibilities, we consider the case of dissociate roles of two of its topographical subregions - lateral and medial parts of OFC. We gather predominant roles of each of these sub-regions as suggested by numerous experimental evidences in the form of a system-level computational model that is based on existing neuronal architectures. We argue that besides possible dissociation, there could be possible interaction of these sub-regions within themselves and through other sub-cortical structures, in distinct mechanisms of choice and learning. The computational framework described accounts for experimental data and can be extended to more comprehensive detail of representations required to understand the processes of decision-making, learning and the role of OFC and subsequently the regions of prefrontal cortex in general.

scholarly journals Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice

eLife ◽  
2016 ◽  
Vol 5 ◽  
Author(s):  
Sean E Cavanagh ◽  
Joni D Wallis ◽  
Steven W Kennerley ◽  
Laurence T Hunt
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Orbitofrontal Cortex ◽  
Receptive Fields ◽  
Neural Mechanism ◽  
Spike Rate ◽  
Accumulation Process ◽  
Single Neurons ◽  
Evidence Accumulation ◽  
Autocorrelation Structure

Correlates of value are routinely observed in the prefrontal cortex (PFC) during reward-guided decision making. In previous work (Hunt et al., 2015), we argued that PFC correlates of chosen value are a consequence of varying rates of a dynamical evidence accumulation process. Yet within PFC, there is substantial variability in chosen value correlates across individual neurons. Here we show that this variability is explained by neurons having different temporal receptive fields of integration, indexed by examining neuronal spike rate autocorrelation structure whilst at rest. We find that neurons with protracted resting temporal receptive fields exhibit stronger chosen value correlates during choice. Within orbitofrontal cortex, these neurons also sustain coding of chosen value from choice through the delivery of reward, providing a potential neural mechanism for maintaining predictions and updating stored values during learning. These findings reveal that within PFC, variability in temporal specialisation across neurons predicts involvement in specific decision-making computations.

scholarly journals Novel Inferences in a Multidimensional Social Network Use a Grid-like Code

2020 ◽  
Author(s):  
Seongmin A. Park ◽  
Douglas S. Miller ◽  
Erie D. Boorman
Keyword(s):  
Decision Making ◽  
Prefrontal Cortex ◽  
Medial Prefrontal Cortex ◽  
Entorhinal Cortex ◽  
Brain Regions ◽  
Cognitive Map ◽  
General Mechanism ◽  
Temporoparietal Junction ◽  
Flexible Behavior ◽  
Discrete Problems

ABSTRACTGeneralizing experiences to guide decision making in novel situations is a hallmark of flexible behavior. It has been hypothesized such flexibility depends on a cognitive map of an environment or task, but directly linking the two has proven elusive. Here, we find that discretely sampled abstract relationships between entities in an unseen two-dimensional (2-D) social hierarchy are reconstructed into a unitary 2-D cognitive map in the hippocampus and entorhinal cortex. We further show that humans utilize a grid-like code in several brain regions, including entorhinal cortex and medial prefrontal cortex, for inferred direct trajectories between entities in the reconstructed abstract space during discrete decisions. Moreover, these neural grid-like codes in the entorhinal cortex predict neural decision value computations in the medial prefrontal cortex and temporoparietal junction area during choice. Collectively, these findings show that grid-like codes are used by the human brain to infer novel solutions, even in abstract and discrete problems, and suggest a general mechanism underpinning flexible decision making and generalization.

scholarly journals Anomalies: Intertemporal Choice

1989 ◽  
Vol 3 (4) ◽  
pp. 181-193 ◽  
Author(s):  
George Loewenstein ◽  
Richard H Thaler
Keyword(s):  
Decision Making ◽  
Time Delay ◽  
Discount Rate ◽  
Intertemporal Choice ◽  
Discount Rates ◽  
Market Rate ◽  
Money Flows ◽  
Speed Up ◽  
The Way

We examine a number of situations in which people do not appear to discount money flows at the market rate of interest or any other single discount rate. Discount rates observed in both laboratory and field decision-making environments are shown to depend on the magnitude and sign of what is being discounted, on the time delay, on whether the choice is cast in terms of speed-up or delay, on the way in which a choice is framed, and on whether future benefits or costs induce savoring or dread.

scholarly journals Intertemporal choice reflects value comparison rather than self-control: insights from confidence judgments

2021 ◽  
Author(s):  
Adam Bulley ◽  
Karolina Maria Lempert ◽  
Colin Conwell ◽  
Muireann Irish
Keyword(s):  
Decision Making ◽  
Intertemporal Choice ◽  
The Self ◽  
Self Control ◽  
Confidence Judgments ◽  
Adult Participants ◽  
Subjective Value ◽  
The Right ◽  
Intertemporal Decisions ◽  
Intertemporal Choices

Intertemporal decision-making has long been assumed to measure self-control, with prominent theories treating choices of smaller, sooner rewards as failed attempts to override immediate temptation. If this view is correct, people should be more confident in their intertemporal decisions when they “successfully” delay gratification than when they do not. In two pre- registered experiments with built-in replication, adult participants (n=117) made monetary intertemporal choices and rated their confidence in having made the right decisions. Contrary to assumptions of the self-control account, confidence was not higher when participants chose delayed rewards. Rather, participants were more confident in their decisions when possible rewards were further apart in time-discounted subjective value, closer to the present, and larger in magnitude. Demonstrating metacognitive insight, participants were more confident in decisions that better aligned with their independent valuation of possible rewards. Decisions made with less confidence were more prone to changes-of-mind and more susceptible to a patience-enhancing manipulation. Together, our results establish that confidence in intertemporal choice tracks uncertainty in estimating and comparing the value of possible rewards – just as it does in decisions unrelated to self-control. Our findings challenge self- control views and instead cast intertemporal choice as a form of value-based decision-making about future possibilities.

scholarly journals Functional Connectivity of Nucleus Accumbens and Medial Prefrontal Cortex With Other Brain Regions During Early-Abstinence Is Associated With Alcohol Dependence and Relapse: A Resting-Functional Magnetic Resonance Imaging Study

2021 ◽  
Vol 12 ◽  
Author(s):  
Xia Yang ◽  
Ya-jing Meng ◽  
Yu-jie Tao ◽  
Ren-hao Deng ◽  
Hui-yao Wang ◽  
...  
Keyword(s):  
Magnetic Resonance Imaging ◽  
Prefrontal Cortex ◽  
Magnetic Resonance ◽  
Functional Connectivity ◽  
Brain Regions ◽  
Functional Magnetic Resonance ◽  
Resonance Imaging ◽  
Anterior Cortex ◽  
The Right

Background: Alcohol dependence (AD) is a chronic recurrent brain disease that causes a heavy disease burden worldwide, partly due to high relapse rates after detoxification. Verified biomarkers are not available for AD and its relapse, although the nucleus accumbens (NAc) and medial prefrontal cortex (mPFC) may play important roles in the mechanism of addiction. This study investigated AD- and relapse-associated functional connectivity (FC) of the NAc and mPFC with other brain regions during early abstinence.Methods: Sixty-eight hospitalized early-abstinence AD male patients and 68 age- and education-matched healthy controls (HCs) underwent resting-functional magnetic resonance imaging (r-fMRI). Using the NAc and mPFC as seeds, we calculated changes in FC between the seeds and other brain regions. Over a follow-up period of 6 months, patients were measured with the Alcohol Use Disorder Identification Test (AUDIT) scale to identify relapse outcomes (AUDIT ≥ 8).Results: Thirty-five (52.24%) of the AD patients relapsed during the follow-up period. AD displayed lower FC of the left fusiform, bilateral temporal superior and right postcentral regions with the NAc and lower FC of the right temporal inferior, bilateral temporal superior, and left cingulate anterior regions with the mPFC compared to controls. Among these FC changes, lower FC between the NAc and left fusiform, lower FC between the mPFC and left cingulate anterior cortex, and smoking status were independently associated with AD. Subjects in relapse exhibited lower FC of the right cingulate anterior cortex with NAc and of the left calcarine sulcus with mPFC compared to non-relapsed subjects; both of these reductions in FC independently predicted relapse. Additionally, FC between the mPFC and right frontal superior gyrus, as well as years of education, independently predicted relapse severity.Conclusion: This study found that values of FC between selected seeds (i.e., the NAc and the mPFC) and some other reward- and/or impulse-control-related brain regions were associated with AD and relapse; these FC values could be potential biomarkers of AD or for prediction of relapse. These findings may help to guide further research on the neurobiology of AD and other addictive disorders.

Sign in / Sign up

Export Citation Format

Share Document