scholarly journals Adaptive neurons compute confidence in a decision network

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Luozheng Li ◽  
DaHui Wang

AbstractHumans and many animals have the ability to assess the confidence of their decisions. However, little is known about the underlying neural substrate and mechanism. In this study we propose a computational model consisting of a group of ’confidence neurons’ with adaptation, which are able to assess the confidence of decisions by detecting the slope of ramping activities of decision neurons. The simulated activities of ’confidence neurons’ in our simple model capture the typical features of confidence observed in humans and animals experiments. Our results indicate that confidence could be online formed along with the decision formation, and the adaptation properties could be used to monitor the formation of confidence during the decision making.

2021 ◽  
Author(s):  
Luozheng Li ◽  
DaHui Wang

Abstract Human and many animals can asses the confidence of their decisions. However, little has been known about the underlying neural substrate and mechanism. Here we proposed a computational model consisting of one group of ’confidence neurons’ with adaptation, which is able to asses the confidence of decision by detecting the slope of ramping activities of decision neurons. The simulated activities of ’confidence neurons’ in our simple model capture the typical features of confidence in human and animals experiments. Our results indicate that confidence could be online formed along with the decision formation and the adaptation properties could be used to monitor the decision confidence in artificial intelligence.


2019 ◽  
Author(s):  
Bhargav Teja Nallapu ◽  
Frédéric Alexandre

AbstractIn the context of flexible and adaptive animal behavior, the orbitofrontal cortex (OFC) is found to be one of the crucial regions in the prefrontal cortex (PFC) influencing the downstream processes of decision-making and learning in the sub-cortical regions. Although OFC has been implicated to be important in a variety of related behavioral processes, the exact mechanisms are unclear, through which the OFC encodes or processes information related to decision-making and learning. Here, we propose a systems-level view of the OFC, positioning it at the nexus of sub-cortical systems and other prefrontal regions. Particularly we focus on one of the most recent implications of neuroscientific evidences regarding the OFC - possible functional dissociation between two of its sub-regions : lateral and medial. We present a system-level computational model of decision-making and learning involving the two sub-regions taking into account their individual roles as commonly implicated in neuroscientific studies. We emphasize on the role of the interactions between the sub-regions within the OFC as well as the role of other sub-cortical structures which form a network with them. We leverage well-known computational architecture of thalamo-cortical basal ganglia loops, accounting for recent experimental findings on monkeys with lateral and medial OFC lesions, performing a 3-arm bandit task. First we replicate the seemingly dissociate effects of lesions to lateral and medial OFC during decision-making as a function of value-difference of the presented options. Further we demonstrate and argue that such an effect is not necessarily due to the dissociate roles of both the subregions, but rather a result of complex temporal dynamics between the interacting networks in which they are involved.Author summaryWe first highlight the role of the Orbitofrontal Cortex (OFC) in value-based decision making and goal-directed behavior in primates. We establish the position of OFC at the intersection of cortical mechanisms and thalamo-basal ganglial circuits. In order to understand possible mechanisms through which the OFC exerts emotional control over behavior, among several other possibilities, we consider the case of dissociate roles of two of its topographical subregions - lateral and medial parts of OFC. We gather predominant roles of each of these sub-regions as suggested by numerous experimental evidences in the form of a system-level computational model that is based on existing neuronal architectures. We argue that besides possible dissociation, there could be possible interaction of these sub-regions within themselves and through other sub-cortical structures, in distinct mechanisms of choice and learning. The computational framework described accounts for experimental data and can be extended to more comprehensive detail of representations required to understand the processes of decision-making, learning and the role of OFC and subsequently the regions of prefrontal cortex in general.


2021 ◽  
Author(s):  
Rebecca Kazinka ◽  
Iris Vilares ◽  
Angus MacDonald

This study modeled spite sensitivity (the worry that others are willing to incur a loss to hurt you), which is thought to undergird suspiciousness and persecutory ideation. Two samples performed a parametric, non-iterative trust game known as the Minnesota Trust Game (MTG). The MTG is designed to distinguish suspicious decision-making from otherwise rational mistrust by incentivizing the player to trust in certain situations. Individuals who do not trust even under these circumstances are particularly suspicious of their potential partner’s intentions. In Sample 1, 243 undergraduates who completed the MTG showed less trust as the amount of money they could lose increased. However, for choices where partners had a financial disincentive to betray the player, variation in the willingness to trust the partner was associated with suspicious beliefs. To further examine spite sensitivity, we modified the Fehr-Schmidt (1999) inequity aversion model, which compares unequal outcomes in social decision-making tasks, to include the possibility for spite sensitivity. In this case, an anticipated partner’s dislike of advantageous inequity (i.e., guilt) parameter could take on negative values, with negative guilt indicating spite. We hypothesized that the anticipated guilt parameter would be strongly related to suspicious beliefs. Our modification of the Fehr-Schmidt model improved estimation of MTG behavior. We isolated the estimation of partner’s spite-guilt, which was highly correlated with choices most associated with persecutory ideation. We replicated our findings in a second sample, where the estimated spite-guilt parameter correlated with self-reported suspiciousness. The “Suspiciousness” condition, unique to the MTG, can be modeled to isolate spite sensitivity, suggesting that spite sensitivity is separate from inequity aversion or risk aversion, and may provide a means to quantify persecution. The MTG offers promise for future studies to quantify persecutory beliefs in clinical populations.


Author(s):  
D.S. Zhukov

A simple model simulating the redistribution of decision-making functions between the state, business, bureaucracy and regional elites is presented. The methodological basis of the work is system-dynamic modeling. The model is implemented in the specialized program Powersim Studio 10. A diagram of stocks and flows is considered, all elements of which were compared with certain political science concepts. The mathematical apparatus of the model is described. Some results of computer experiments are presented: these results indicate the operability and interpretability of the model.


2019 ◽  
Vol 29 (1) ◽  
pp. 102-109 ◽  
Author(s):  
Kathy T. Do ◽  
Paul B. Sharp ◽  
Eva H. Telzer

Heightened risk taking in adolescence has long been attributed to valuation systems overwhelming the deployment of cognitive control. However, this explanation of why adolescents engage in risk taking is insufficient given increasing evidence that risk-taking behavior can be strategic and involve elevated cognitive control. We argue that applying the expected-value-of-control computational model to adolescent risk taking can clarify under what conditions control is elevated or diminished during risky decision-making. Through this lens, we review research examining when adolescent risk taking might be due to—rather than a failure of—effective cognitive control and suggest compelling ways to test such hypotheses. This effort can resolve when risk taking arises from an immaturity of the control system itself, as opposed to arising from differences in what adolescents value relative to adults. It can also identify promising avenues for channeling cognitive control toward adaptive outcomes in adolescence.


Author(s):  
Andrew Sundstrom ◽  
Eun-Sol Kim ◽  
Damas Limoge ◽  
Vadim Pinskiy ◽  
Matthew C. Putman

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
HanShin Jo ◽  
Chiu-Yueh Chen ◽  
Der-Yow Chen ◽  
Ming-Hung Weng ◽  
Chun-Chia Kung

Abstract One of the typical campus scenes is the social interaction between college couples, and the lesson couples must keep learning is to adapt to each other. This fMRI study investigated the shopping interactions of 30 college couples, one lying inside and the other outside the scanner, beholding the same item from two connected PCs, making preference ratings and subsequent buy/not-buy decisions. The behavioral results showed the clear modulation of significant others’ preferences onto one’s own decisions, and the contrast of the “shop-together vs. shop-alone”, and the “congruent (both liked or disliked the item, 68%) vs. incongruent (one liked but the other disliked, and vice versa)” together trials, both revealed bilateral temporal parietal junction (TPJ) among other reward-related regions, likely reflecting mentalizing during preference harmony. Moreover, when contrasting “own-high/other-low vs. own-low/other-high” incongruent trials, left anterior inferior parietal lobule (l-aIPL) was parametrically mapped, and the “yield (e.g., own-high/not-buy) vs. insist (e.g., own-low/not-buy)” modulation further revealed left lateral-IPL (l-lIPL), together with left TPJ forming a local social decision network that was further constrained by the mediation analysis among left TPJ–lIPL–aIPL. In sum, these results exemplify, via the two-person fMRI, the neural substrate of shopping interactions between couples.


Sign in / Sign up

Export Citation Format

Share Document