Affective-Associative Two-Process theory: A neural network investigation of adaptive behaviour in differential outcomes training

2017 ◽  
Vol 25 (1) ◽  
pp. 5-23 ◽  
Author(s):  
Robert Lowe ◽  
Erik Billing
Keyword(s):  
Neural Network ◽  
Decision Making ◽  
Outcome Expectations ◽  
Action Selection ◽  
Process Theory ◽  
Adaptive Behaviour ◽  
Stimulus Response ◽  
Differential Outcomes ◽  
Differential Reward ◽  
Affective Components

In this article we present a novel neural network implementation of Associative Two-Process (ATP) theory based on an Actor–Critic-like architecture. Our implementation emphasizes the affective components of differential reward magnitude and reward omission expectation and thus we model Affective-Associative Two-Process theory (Aff-ATP). ATP has been used to explain the findings of differential outcomes training (DOT) procedures, which emphasize learning differentially valuated outcomes for cueing actions previously associated with those outcomes. ATP hypothesizes the existence of a ‘prospective’ memory route through which outcome expectations can bring to bear on decision making and can even substitute for decision making based on the ‘retrospective’ inputs of standard working memory. While DOT procedures are well recognized in the animal learning literature they have not previously been computationally modelled. The model presented in this article helps clarify the role of ATP computationally through the capturing of empirical data based on DOT. Our Aff-ATP model illuminates the different roles that prospective and retrospective memory can have in decision making (combining inputs to action selection functions). In specific cases, the model’s prospective route allows for adaptive switching (correct action selection prior to learning) following changes in the stimulus–response–outcome contingencies.

scholarly journals A decision underlies phototaxis in an insect

Open Biology ◽  
2016 ◽  
Vol 6 (12) ◽  
pp. 160229 ◽  
Author(s):  
E. Axel Gorostiza ◽  
Julien Colomb ◽  
Björn Brembs
Keyword(s):  
Decision Making ◽  
Biogenic Amines ◽  
Neuronal Activity ◽  
Internal State ◽  
Action Selection ◽  
Behavioural Flexibility ◽  
Stimulus Response ◽  
A Value ◽  
Behavioural Tests

Like a moth into the flame—phototaxis is an iconic example for innate preferences. Such preferences probably reflect evolutionary adaptations to predictable situations and have traditionally been conceptualized as hard-wired stimulus–response links. Perhaps for that reason, the century-old discovery of flexibility in Drosophila phototaxis has received little attention. Here, we report that across several different behavioural tests, light/dark preference tested in walking is dependent on various aspects of flight. If we temporarily compromise flying ability, walking photopreference reverses concomitantly. Neuronal activity in circuits expressing dopamine and octopamine, respectively, plays a differential role in photopreference, suggesting a potential involvement of these biogenic amines in this case of behavioural flexibility. We conclude that flies monitor their ability to fly, and that flying ability exerts a fundamental effect on action selection in Drosophila . This work suggests that even behaviours which appear simple and hard-wired comprise a value-driven decision-making stage, negotiating the external situation with the animal's internal state, before an action is selected.

scholarly journals A decision underlies phototaxis in an insect

2015 ◽  
Author(s):  
E. Axel Gorostiza ◽  
Julien Colomb ◽  
Björn Brembs
Keyword(s):  
Decision Making ◽  
Biogenic Amines ◽  
Neuronal Activity ◽  
Internal State ◽  
Behavioral Flexibility ◽  
Action Selection ◽  
Behavioral Tests ◽  
Stimulus Response ◽  
A Value

AbstractLike a moth into the flame - Phototaxis is an iconic example for innate preferences. Such preferences likely reflect evolutionary adaptations to predictable situations and have traditionally been conceptualized as hard-wired stimulus-response links. Perhaps therefore, the century-old discovery of flexibility in Drosophila phototaxis has received little attention. Here we report that across several different behavioral tests, light/dark preference tested in walking is dependent on various aspects of flight. If we temporarily compromise flying ability, walking photopreference reverses concomitantly. Neuronal activity in circuits expressing dopamine and octopamine, respectively, plays a differential role in photopreference, suggesting a potential involvement of these biogenic amines in this case of behavioral flexibility. We conclude that flies monitor their ability to fly, and that flying ability exerts a fundamental effect on action selection in Drosophila. This work suggests that even behaviors which appear simple and hard-wired comprise a value-driven decision-making stage, negotiating the external situation with the animal’s internal state, before an action is selected.

Sistem Pendukung Keputusan SNMPTN Jalur Undangan Dengan Metode Electre

2018 ◽  
Vol 3 ◽  
pp. 14
Author(s):  
Lidia K Simanjuntak ◽  
Tessa Y M Sihite ◽  
Mesran Mesran ◽  
Nuning Kurniasih ◽  
Yuhandri Yuhandri
Keyword(s):  
Decision Making ◽  
Decision Support ◽  
Decision Support System ◽  
Support System ◽  
Action Selection ◽  
Multi Criteria Decision Making ◽  
Prospective Students ◽  
College Entrance ◽  
Electre Method ◽  
Selection Of

All colleges each year organize the selection of new admissions. Acceptance of prospective students in universities as education providers is done by selecting prospective students based on achievement in school and college entrance selection. To select the best student candidates based on predetermined criteria, then use Multi-Criteria Decision Making (MCDM) or commonly called decision support system. One method in MCDM is the Elimination Et Choix Traduisant la Reality (ELECTRE). The ELECTRE method is the best method of action selection. The ELECTRE method to obtain the best alternative by eliminating alternative that do not fit the criteria and can be applied to the decision SNMPTN invitation path.

Research on sports aided teaching and training decision system oriented to deep convolutional neural network

2021 ◽  
pp. 1-15
Author(s):  
Qinyu Mei ◽  
Ming Li
Keyword(s):  
Neural Network ◽  
Decision Making ◽  
Control System ◽  
Convolutional Neural Network ◽  
Force Control ◽  
Control Experiment ◽  
Deep Convolutional Neural Network ◽  
Flexible Cable ◽  
Cable Force ◽  
And Training

Aiming at the construction of the decision-making system for sports-assisted teaching and training, this article first gives a deep convolutional neural network model for sports-assisted teaching and training decision-making. Subsequently, In order to meet the needs of athletes to assist in physical exercise, a squat training robot is built using a self-developed modular flexible cable drive unit, and its control system is designed to assist athletes in squatting training in sports. First, the human squat training mechanism is analyzed, and the overall structure of the robot is determined; second, the robot force servo control strategy is designed, including the flexible cable traction force planning link, the lateral force compensation link and the establishment of a single flexible cable passive force controller; In order to verify the effect of robot training, a single flexible cable force control experiment and a man-machine squat training experiment were carried out. In the single flexible cable force control experiment, the suppression effect of excess force reached more than 50%. In the squat experiment under 200 N, the standard deviation of the system loading force is 7.52 N, and the dynamic accuracy is above 90.2%. Experimental results show that the robot has a reasonable configuration, small footprint, stable control system, high loading accuracy, and can assist in squat training in physical education.

scholarly journals Heart and Mind: Essential Components in Sound Decision-Making

2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 364-364
Author(s):  
Michaela Clark ◽  
Julie Hicks Patrick ◽  
Michaela Reardon
Keyword(s):  
Decision Making ◽  
Decision Quality ◽  
Cluster Solution ◽  
Cognitive Resources ◽  
Cluster Membership ◽  
Essential Components ◽  
Decision Making Processes ◽  
Affective Components ◽  
Heart And Mind

Abstract Consumer tasks permit an ecologically-valid context in which to examine the contributions of affective and cognitive resources to decision-making processes and outcomes. Although previous work shows that cognitive factors are important when individuals make decisions (Patrick et al., 2013; Queen et al.), the role of affective components is less clear. We examine these issues in two studies. Study 1 used data from 1000+ adults to inform a cluster analysis examining affective aspects (importance, meaningfulness) of making different types of decisions. A 4-cluster solution resulted. In Study 2, we used affective cluster membership and cognitive performance as predictors of experimental decision-making outcomes among a subset of participants (N = 60). Results of the regression (F(2, 40) = 6.51, p < .01, R2 = .25.) revealed that both the affective clusters (b = .37, p = .01) and cognitive ability (b = -.30, p = .04) uniquely contributed to the variance explained in decision quality. Age did not uniquely contribute. Results are discussed in the context of developing measures that enable us to move the field forward.

scholarly journals Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy

2016 ◽  
Vol 113 (31) ◽  
pp. E4531-E4540 ◽  
Author(s):  
Braden A. Purcell ◽  
Roozbeh Kiani
Keyword(s):  
Decision Making ◽  
Neural Mechanism ◽  
Decision Processes ◽  
Response Strategy ◽  
Limited Information ◽  
Decision Strategy ◽  
Stimulus Response ◽  
Hierarchical Decision ◽  
The Right ◽  
High Level

Decision-making in a natural environment depends on a hierarchy of interacting decision processes. A high-level strategy guides ongoing choices, and the outcomes of those choices determine whether or not the strategy should change. When the right decision strategy is uncertain, as in most natural settings, feedback becomes ambiguous because negative outcomes may be due to limited information or bad strategy. Disambiguating the cause of feedback requires active inference and is key to updating the strategy. We hypothesize that the expected accuracy of a choice plays a crucial rule in this inference, and setting the strategy depends on integration of outcome and expectations across choices. We test this hypothesis with a task in which subjects report the net direction of random dot kinematograms with varying difficulty while the correct stimulus−response association undergoes invisible and unpredictable switches every few trials. We show that subjects treat negative feedback as evidence for a switch but weigh it with their expected accuracy. Subjects accumulate switch evidence (in units of log-likelihood ratio) across trials and update their response strategy when accumulated evidence reaches a bound. A computational framework based on these principles quantitatively explains all aspects of the behavior, providing a plausible neural mechanism for the implementation of hierarchical multiscale decision processes. We suggest that a similar neural computation—bounded accumulation of evidence—underlies both the choice and switches in the strategy that govern the choice, and that expected accuracy of a choice represents a key link between the levels of the decision-making hierarchy.

scholarly journals An Extended Model of Behavioural Process in Consumer Decision Making

2016 ◽  
Vol 8 (4) ◽  
pp. 87 ◽  
Author(s):  
Nagasimha Balakrishna Kanagal
Keyword(s):  
Decision Making ◽  
Consumer Products ◽  
Extended Model ◽  
Response Model ◽  
Consumer Decision Making ◽  
Consumer Decision ◽  
Stimulus Response ◽  
Economic Decision Making ◽  
Buying Behaviour ◽  
The Impact

<p>The stimulus response model of consumer behaviour is useful to understand the buying behaviour of individual consumers in the context of individuals buying consumer products. An extended stimulus-response model of behavioural processes in consumer decision making is proposed that serves to integrate the influences and interlinkages of buyer psychology, various buyer characteristics, and the impact of the buyer decision process on consumer decision making. The model proposes that the behavioural process of consumer decision making be as a result of the interaction of three aspects of individual buyer behaviour: communication sensitivity; enculturated individuality; and rational / economic decision making. The paper addresses the flip side of the consumer decision making process in terms of the five stages of decision making from need recognition to post-purchase satisfaction. An aggregate level framework of behavioural process in consumer decision making has been provided, that could lead to a richer analysis of micro level factors and relationships influencing consumer decision behaviour.</p>

Research on BIT Intelligence Maintenance Decision of Weapon Materiel

2011 ◽  
Vol 128-129 ◽  
pp. 224-228
Author(s):  
Jian Xin Huang ◽  
Ya Qin Bian
Keyword(s):  
Neural Network ◽  
Decision Making ◽  
Fault Diagnosis ◽  
Expert System ◽  
System Organization ◽  
System Structure ◽  
Concurrent Design ◽  
Intelligence Theory ◽  
Maintenance Decision ◽  
Organization Framework

Considering the weapon materiel maintenance condition, intelligence theory and method such as expert system and neural network is introduced in BIT technology. BIT intelligence maintenance decision in materiel maintenance field is discussed. The realization of materiel intelligence BIT reflects the concurrent design concept of system exploitation. Level integrated intelligence BIT system organization framework is adopted. BIT comprehensive decision-making and maintenance expert system structure is designed, and its implementation plan based on BIT is offered, which can enhance the fault diagnosis capability of modern complicated weapon materiel.

Sign in / Sign up

Export Citation Format

Share Document