scholarly journals An evolutionary computational theory of prefrontal executive function in decision-making

2014 ◽  
Vol 369 (1655) ◽  
pp. 20130474 ◽  
Author(s):  
Etienne Koechlin

The prefrontal cortex subserves executive control and decision-making, that is, the coordination and selection of thoughts and actions in the service of adaptive behaviour. We present here a computational theory describing the evolution of the prefrontal cortex from rodents to humans as gradually adding new inferential Bayesian capabilities for dealing with a computationally intractable decision problem: exploring and learning new behavioural strategies versus exploiting and adjusting previously learned ones through reinforcement learning (RL). We provide a principled account identifying three inferential steps optimizing this arbitration through the emergence of (i) factual reactive inferences in paralimbic prefrontal regions in rodents; (ii) factual proactive inferences in lateral prefrontal regions in primates and (iii) counterfactual reactive and proactive inferences in human frontopolar regions. The theory clarifies the integration of model-free and model-based RL through the notion of strategy creation. The theory also shows that counterfactual inferences in humans yield to the notion of hypothesis testing, a critical reasoning ability for approximating optimal adaptive processes and presumably endowing humans with a qualitative evolutionary advantage in adaptive behaviour.

2017 ◽  
Author(s):  
Amitai Shenhav ◽  
Mark A. Straccia ◽  
Jonathan D. Cohen ◽  
Matthew M. Botvinick

AbstractDecision-making is typically studied as a sequential process from the selection of what to attend (e.g., between possible tasks, stimuli, or stimulus attributes) to the selection of which actions to take based on the attended information. However, people often gather information across these levels in parallel. For instance, even as they choose their actions, they may continue to evaluate how much to attend other tasks or dimensions of information within a task. We scanned participants while they made such parallel evaluations, simultaneously weighing how much to attend two dynamic stimulus attributes and which response to give based on the attended information. Regions of prefrontal cortex tracked information about the stimulus attributes in dissociable ways, related to either the predicted reward (ventromedial prefrontal cortex) or the degree to which that attribute was being attended (dorsal anterior cingulate, dACC). Within dACC, adjacent regions tracked uncertainty at different levels of the decision, regarding what to attend versus how to respond. These findings bridge research on perceptual and value-based decision-making, demonstrating that people dynamically integrate information in parallel across different levels of decision making.Naturalistic decisions allow an individual to weigh their options within a particular task (e.g., how best to word the introduction to a paper) while also weighing how much to attend other tasks (e.g., responding to e-mails). These different types of decision-making have a hierarchical but reciprocal relationship: Decisions at higher levels inform the focus of attention at lower levels (e.g., whether to select between citations or email addresses) while, at the same time, information at lower levels (e.g., the salience of an incoming email) informs decisions regarding which task to attend. Critically, recent studies suggest that decisions across these levels may occur in parallel, continuously informed by information that is integrated from the environment and from one’s internal milieu1,2.Research on cognitive control and perceptual decision-making has examined how responses are selected when attentional targets are clearly defined (e.g., based on instruction to attend a stimulus dimension), including cases in which responding requires accumulating information regarding a noisy percept (e.g., evidence favoring a left or right response)3-7. Separate research on value-based decision-making has examined how individuals select which stimulus dimension(s) to attend in order to maximize their expected rewards8-11. However, it remains unclear how the accumulation of evidence to select high-level goals and/or attentional targets interacts with the simultaneous accumulation of evidence to select responses according to those goals (e.g., based on the perceptual properties of the stimuli). Recent work has highlighted the importance of such interactions to understanding task selection12-15, multi-attribute decision-making16-18, foraging behavior19-21, cognitive effort22,23, and self-control24-27.While these interactions remain poorly understood, previous research has identified candidate neural mechanisms associated with multi-attribute value-based decision-making11,28,29 and with selecting a response based on noisy information from an instructed attentional target3–5. These research areas have implicated the ventromedial prefrontal cortex (vmPFC) in tracking the value of potential targets of attention (e.g., stimulus attributes)8,11 and the dorsal anterior cingulate cortex (dACC) in tracking an individual’s uncertainty regarding which response to select30–32. It has been further proposed that dACC may differentiate between uncertainty at each of these parallel levels of decision-making (e.g., at the level of task goals or strategies vs. specific motor actions), and that these may be separately encoded at different locations along the dACC’s rostrocaudal axis32,33. However, neural activity within and across these prefrontal regions has not yet been examined in a setting in which information is weighed at both levels within and across trials.Here we use a value-based perceptual decision-making task to examine how people integrate different dynamic sources of information to decide (a) which perceptual attribute to attend and (b) how to respond based on the evidence for that attribute. Participants performed a task in which they regularly faced a conflict between attending the stimulus attribute that offered the greater reward or the attribute that was more perceptually salient (akin to persevering in writing one’s paper when an enticing email awaits). We demonstrate that dACC and vmPFC track evidence for the two attributes in dissociable ways. Across these regions, vmPFC weighs attribute evidence by the reward it predicts and dACC weighs it by its attentional priority (i.e., the degree to which that attribute drives choice). Within dACC, adjacent regions differentiated between uncertainty at the two levels of the decision, regarding what to attend (rostral dACC) versus how to respond (caudal dACC).


1996 ◽  
Vol 351 (1346) ◽  
pp. 1413-1420 ◽  

In this article I discuss a hypothesis, known as the somatic marker hypothesis, which I believe is relevant to the understanding of processes of human reasoning and decision making. The ventromedial sector of the prefrontal cortices is critical to the operations postulated here, but the hypothesis does not necessarily apply to prefrontal cortex as a whole and should not be seen as an attempt to unify frontal lobe functions under a single mechanism. The key idea in the hypothesis is that ‘marker’ signals influence the processes of response to stimuli, at multiple levels of operation, some of which occur overtly (consciously, ‘in mind’) and some of which occur covertly (non-consciously, in a non-minded manner). The marker signals arise in bioregulatory processes, including those which express themselves in emotions and feelings, but are not necessarily confined to those alone. This is the reason why the markers are termed somatic: they relate to body-state structure and regulation even when they do not arise in the body proper but rather in the brain’s representation of the body. Examples of the covert action of ‘marker’ signals are the undeliberated inhibition of a response learned previously; the introduction of a bias in the selection of an aversive or appetitive mode of behaviour, or in the otherwise deliberate evaluation of varied option-outcome scenarios. Examples of overt action include the conscious ‘qualifying’ of certain option-outcome scenarios as dangerous or advantageous. The hypothesis rejects attempts to limit human reasoning and decision making to mechanisms relying, in an exclusive and unrelated manner, on either conditioning alone or cognition alone.


2018 ◽  
Author(s):  
Xiaoxue Gao ◽  
Hongbo Yu ◽  
Ignacio Saez ◽  
Philip R. Blue ◽  
Lusha Zhu ◽  
...  

AbstractHumans are capable of integrating social contextual information into decision-making processes to adjust their attitudes towards inequity. This context-dependency emerges both when individual is better off (i.e. advantageous inequity) and worse off (i.e. disadvantageous inequity) than others. It is not clear however, whether the context-dependent processing of advantageous and disadvantageous inequity rely on dissociable or shared neural mechanisms. Here, by combining an interpersonal interactive game that gave rise to interpersonal guilt and different versions of the dictator games that enabled us to characterize individual weights on aversion to advantageous and disadvantageous inequity, we investigated the neural mechanisms underlying the two forms of inequity aversion in the interpersonal guilt context. In each round, participants played a dot-estimation task with an anonymous co-player. The co-players received pain stimulation with 50% probability when anyone responded incorrectly. At the end of each round, participants completed a dictator game, which determined payoffs of him/herself and the co-player. Both computational model-based and model-free analyses demonstrated that when inflicting pain upon co-players (i.e., the guilt context), participants cared more about advantageous inequity and became less sensitive to disadvantageous inequity, compared with other social contexts. The contextual effects on two forms of inequity aversion are uncorrelated with each other at the behavioral level. Neuroimaging results revealed that the context-dependent representation of inequity aversion exhibited a spatial gradient in activity within the insula, with anterior parts predominantly involved in the aversion to advantageous inequity and posterior parts predominantly involved in the aversion to disadvantageous inequity. The dissociable mechanisms underlying the two forms of inequity aversion are further supported by the involvement of right dorsolateral prefrontal cortex and dorsomedial prefrontal cortex in advantageous inequity processing, and the involvement of right amygdala and dorsal anterior cingulate cortex in disadvantageous inequity processing. These results extended our understanding of decision-making processes involving inequity and the social functions of inequity aversion.


2019 ◽  
Author(s):  
Adam Morris ◽  
Fiery Andrews Cushman

The alignment of habits with model-free reinforcement learning (MF RL) is a success story for computational models of decision making, and MF RL has been applied to explain phasic dopamine responses, working memory gating, drug addiction, moral intuitions, and more. Yet, the role of MF RL has recently been challenged by an alternate model---model-based selection of chained action sequences---that produces similar behavioral and neural patterns. Here, we present two experiments that dissociate MF RL from this prominent alternative, and present unconfounded empirical support for the role of MF RL in human decision making. Our results also demonstrate that people are simultaneously using model-based selection of action sequences, thus demonstrating two distinct mechanisms of habitual control in a common experimental paradigm. These findings clarify the nature of habits and help solidify MF RL's central position in models of human behavior.


2011 ◽  
Vol 4 (4) ◽  
pp. 139-142
Author(s):  
S.PUSHPARANI S.PUSHPARANI ◽  
◽  
Dr.S.SENTHAMILKUMAR Dr.S.SENTHAMILKUMAR

Author(s):  
Lidia K Simanjuntak ◽  
Tessa Y M Sihite ◽  
Mesran Mesran ◽  
Nuning Kurniasih ◽  
Yuhandri Yuhandri

All colleges each year organize the selection of new admissions. Acceptance of prospective students in universities as education providers is done by selecting prospective students based on achievement in school and college entrance selection. To select the best student candidates based on predetermined criteria, then use Multi-Criteria Decision Making (MCDM) or commonly called decision support system. One method in MCDM is the Elimination Et Choix Traduisant la Reality (ELECTRE). The ELECTRE method is the best method of action selection. The ELECTRE method to obtain the best alternative by eliminating alternative that do not fit the criteria and can be applied to the decision SNMPTN invitation path.


Author(s):  
Liza Handayani ◽  
Muhammad Syahrizal ◽  
Kennedi Tampubolon

The head of the environment is an extension of the head of the village head in assisting or providing services to the community both in the administration of administration in the village and to other problems. It is natural for a kepling to be appreciated for their performance during their special tenure in the kecamatan field area. Previously, the selection of a dipling in a sub-district was very inefficient and seemed unfair for this exemplary selection to use a system to produce an accurate value, and no intentional element. To overcome the process of selecting an exemplary kepling that experiences these obstacles by using an application called a Decision Support System. Decision Support System (SPK) is a system that can solve a problem, and this system is also assisted with several methods, namely the Rank Order Centroid (ROC) method that can assign weight values to each of the criteria based on their priority level. And to do the ranking or determine an exemplary set using the Additive Ratio Assessment (ARAS) method, this method provides decision making that takes decisions based on ranking or the highest value.Keywords: Head of Medan Area Subdistrict, SPK, Centroid Rank Order, Additive Ratio Assessment (ARAS).


Author(s):  
Fajar Syahputra ◽  
Mesran Mesran ◽  
Ikhwan Lubis ◽  
Agus Perdana Windarto

The teacher is a major milestone in the world of education, the ability and achievement of students cannot be separated from the role of a teacher in teaching and guiding students. Based on the Law of the Republic of Indonesia No. 14 of 2005 concerning Teachers and Lecturers, in Article 1 explained that teachers are professional educators with the main task of educating, teaching, guiding, directing, training, evaluating, and evaluating students in early childhood education through formal education, basic education and education medium. Whereas in Article 4 of the Act, it is explained that the position of teachers as professionals serves to enhance the dignity and role of teachers as learning agents to function to improve the quality of national education.Decision making is an election process, among various alternatives that aim to meet one or several targets. The decision-making system has 4 phases, namely intelligence, design, choice and implementation. These phases are the basis for decision making, which ends with a recommendation.The Preferences Selection Index (PSI) method is a rarely used decision support system method. This method is a method developed by stevanie and Bhatt (2010) to solve the Multi Criteria Decision Making (MCDM). With the right consideration, this method can be one of the tools to determine policies in decision-making systems, especially the selection of outstanding teachers. Determination of policies taken as a basis for decision making, must use criteria that can be defined clearly and objectively.Keywords: Decision Support System, PSI, Selection of Achieving Teachers


2019 ◽  
Author(s):  
Winda Safitri Caniago ◽  
Hade Afriansyah

Decision making is an action with determine the result in solving problem with choose a rule action between alternative through a mental of process, logic of process and etc. This purpose article is to help make it easier to solve a problem. This article explain some strategy decision making such as optimization model, satisfying model, mixed scanning model, heuristic model, and last the selection of certain model.


2016 ◽  
Vol 7 (1) ◽  
pp. 12-18
Author(s):  
Joko Haryanto ◽  
Seng Hansun

This paper describes the development of decision support system application to assist students who want to enter college so that no one choose the majors incorrectly. This application uses fuzzy logic method because fuzzy logic is very flexible in data which are vague and can be represented as a linguistic variable. The purpose of this application is to assist students to choose available majors at University Multimedia Nusantara which are appropriate with his/her capabilities. This application accepts five kinds of input values i.e. Mathematics, Indonesian, English, Physics, and TIK. Received input will be processed by the calculation of the system for decision-making and the application will generate output that shows how great a match for each majors. With this application, prospective students can find out where the majors that match his/her capabilities. This application has ninety nine percentage of match result accuracy. Index Terms—fuzzy logic, decision support system, UMN, selection of major


Sign in / Sign up

Export Citation Format

Share Document