Decision making under high complexity: a computational model for the science of muddling through

Author(s):  
Sai Yayavaram ◽  
Sasanka Sekhar Chanda
2019 ◽  
Author(s):  
Bhargav Teja Nallapu ◽  
Frédéric Alexandre

AbstractIn the context of flexible and adaptive animal behavior, the orbitofrontal cortex (OFC) is found to be one of the crucial regions in the prefrontal cortex (PFC) influencing the downstream processes of decision-making and learning in the sub-cortical regions. Although OFC has been implicated to be important in a variety of related behavioral processes, the exact mechanisms are unclear, through which the OFC encodes or processes information related to decision-making and learning. Here, we propose a systems-level view of the OFC, positioning it at the nexus of sub-cortical systems and other prefrontal regions. Particularly we focus on one of the most recent implications of neuroscientific evidences regarding the OFC - possible functional dissociation between two of its sub-regions : lateral and medial. We present a system-level computational model of decision-making and learning involving the two sub-regions taking into account their individual roles as commonly implicated in neuroscientific studies. We emphasize on the role of the interactions between the sub-regions within the OFC as well as the role of other sub-cortical structures which form a network with them. We leverage well-known computational architecture of thalamo-cortical basal ganglia loops, accounting for recent experimental findings on monkeys with lateral and medial OFC lesions, performing a 3-arm bandit task. First we replicate the seemingly dissociate effects of lesions to lateral and medial OFC during decision-making as a function of value-difference of the presented options. Further we demonstrate and argue that such an effect is not necessarily due to the dissociate roles of both the subregions, but rather a result of complex temporal dynamics between the interacting networks in which they are involved.Author summaryWe first highlight the role of the Orbitofrontal Cortex (OFC) in value-based decision making and goal-directed behavior in primates. We establish the position of OFC at the intersection of cortical mechanisms and thalamo-basal ganglial circuits. In order to understand possible mechanisms through which the OFC exerts emotional control over behavior, among several other possibilities, we consider the case of dissociate roles of two of its topographical subregions - lateral and medial parts of OFC. We gather predominant roles of each of these sub-regions as suggested by numerous experimental evidences in the form of a system-level computational model that is based on existing neuronal architectures. We argue that besides possible dissociation, there could be possible interaction of these sub-regions within themselves and through other sub-cortical structures, in distinct mechanisms of choice and learning. The computational framework described accounts for experimental data and can be extended to more comprehensive detail of representations required to understand the processes of decision-making, learning and the role of OFC and subsequently the regions of prefrontal cortex in general.


2021 ◽  
Author(s):  
Rebecca Kazinka ◽  
Iris Vilares ◽  
Angus MacDonald

This study modeled spite sensitivity (the worry that others are willing to incur a loss to hurt you), which is thought to undergird suspiciousness and persecutory ideation. Two samples performed a parametric, non-iterative trust game known as the Minnesota Trust Game (MTG). The MTG is designed to distinguish suspicious decision-making from otherwise rational mistrust by incentivizing the player to trust in certain situations. Individuals who do not trust even under these circumstances are particularly suspicious of their potential partner’s intentions. In Sample 1, 243 undergraduates who completed the MTG showed less trust as the amount of money they could lose increased. However, for choices where partners had a financial disincentive to betray the player, variation in the willingness to trust the partner was associated with suspicious beliefs. To further examine spite sensitivity, we modified the Fehr-Schmidt (1999) inequity aversion model, which compares unequal outcomes in social decision-making tasks, to include the possibility for spite sensitivity. In this case, an anticipated partner’s dislike of advantageous inequity (i.e., guilt) parameter could take on negative values, with negative guilt indicating spite. We hypothesized that the anticipated guilt parameter would be strongly related to suspicious beliefs. Our modification of the Fehr-Schmidt model improved estimation of MTG behavior. We isolated the estimation of partner’s spite-guilt, which was highly correlated with choices most associated with persecutory ideation. We replicated our findings in a second sample, where the estimated spite-guilt parameter correlated with self-reported suspiciousness. The “Suspiciousness” condition, unique to the MTG, can be modeled to isolate spite sensitivity, suggesting that spite sensitivity is separate from inequity aversion or risk aversion, and may provide a means to quantify persecution. The MTG offers promise for future studies to quantify persecutory beliefs in clinical populations.


2019 ◽  
Vol 29 (1) ◽  
pp. 102-109 ◽  
Author(s):  
Kathy T. Do ◽  
Paul B. Sharp ◽  
Eva H. Telzer

Heightened risk taking in adolescence has long been attributed to valuation systems overwhelming the deployment of cognitive control. However, this explanation of why adolescents engage in risk taking is insufficient given increasing evidence that risk-taking behavior can be strategic and involve elevated cognitive control. We argue that applying the expected-value-of-control computational model to adolescent risk taking can clarify under what conditions control is elevated or diminished during risky decision-making. Through this lens, we review research examining when adolescent risk taking might be due to—rather than a failure of—effective cognitive control and suggest compelling ways to test such hypotheses. This effort can resolve when risk taking arises from an immaturity of the control system itself, as opposed to arising from differences in what adolescents value relative to adults. It can also identify promising avenues for channeling cognitive control toward adaptive outcomes in adolescence.


Author(s):  
Andrew Sundstrom ◽  
Eun-Sol Kim ◽  
Damas Limoge ◽  
Vadim Pinskiy ◽  
Matthew C. Putman

2019 ◽  
Vol 236 (8) ◽  
pp. 2513-2525 ◽  
Author(s):  
Cody J. Walters ◽  
Jerrius Jubran ◽  
Ayaka Sheehan ◽  
Matthew T. Erickson ◽  
A. David Redish

2017 ◽  
Vol 44 ◽  
pp. 10-39 ◽  
Author(s):  
José-Antonio Cervantes ◽  
Jonathan-Hernando Rosales ◽  
Sonia López ◽  
Félix Ramos ◽  
Marco Ramos

2019 ◽  
Author(s):  
Giovanni Granato ◽  
Gianluca Baldassarre

Executive functions represent a wide set of goal-directed cognitive processes that rely on integrated cortical-basal ganglia brain systems and are at the basis of human flexible behaviour. Several computational models have been proposed to study cognitive flexibility and the Wisconsin Card Sorting Test (WCST), an important neuropsychological test used for measuring such function. These models clarify important aspects of cognitive flexibility, in particular the processes concerning decision making, motor response, and feedback-dependent learning. However, several studies suggest that categorisation processes, as those involved in the solution of the WCST, also involve a fundamental category representation stage supporting the other processes. Surprisingly, all models of the WCST ignore such fundamental stage and propose that decision making directly triggers actions. Here we propose a novel hypothesis for which the key element of cognitive flexibility resides on the acquisition of suitable representations of percepts, and their top-down internal manipulation, to prepare effective actions. We also propose a neuro-inspired computational model to operationalise the hypothesis. The model is validated by systematically reproducing and interpreting the behaviour of healthy young and old adults, and of frontal and Parkinson pathological patients. The hypothesis and model also allow the proposal of a new version of the WCST that might be used to further investigate the important role of the internal manipulation of representations here proposed to be at the core of flexible goal-directed behaviour.


Sign in / Sign up

Export Citation Format

Share Document