An experimental study of action selection mechanisms to create an entertaining opponent

Author(s):  
Nick Sephton ◽  
Peter I. Cowling ◽  
Nicholas H. Slaven
2020 ◽  
Author(s):  
Ryan Smith ◽  
Philipp Schwartenbeck ◽  
Jennifer Stewart ◽  
Rayus Kuplicki ◽  
Hamed Ekhtiari ◽  
...  

Background: Substance use disorders (SUDs) are a major public health risk. However, mechanisms accounting for continued patterns of poor choices in the face of negative life consequences remain poorly understood. Methods: We use a computational (active inference) modeling approach, combined with multiple regression and hierarchical Bayesian group analyses, to examine how treatment-seeking individuals with one or more SUDs (alcohol, cannabis, sedatives, stimulants, hallucinogens, and/or opioids; N = 147) and healthy controls (HCs; N = 54) make choices to resolve uncertainty within a gambling task. A subset of SUDs (n = 49) and HCs (n = 51) propensity-matched on age, sex, and verbal IQ were also compared to replicate larger group findings. Results: Results indicate that: (a) SUDs show poorer task performance than HCs (p=.03, Cohen’s d = .33), with model estimates revealing less precise action selection mechanisms (p=.004, d = .43), a lower learning rate from losses (p=.02, d = .36), and a greater learning rate from gains (p=.04, d = .31); and (b) groups do not differ significantly in goal-directed information seeking. Conclusions: Findings suggest a pattern of inconsistent behavior in response to positive outcomes in SUDs combined with a tendency to attribute negative outcomes to chance. Specifically, individuals with SUDs fail to settle on a behavior strategy despite sufficient evidence of its success. These learning impairments could help account for difficulties in adjusting behavior and maintaining optimal decision making during and after treatment.


2007 ◽  
Vol 362 (1485) ◽  
pp. 1559-1571 ◽  
Author(s):  
Frederick L Crabbe

Among the many properties suggested for action-selection mechanisms, a prominent one is the ability to select compromise actions, i.e. actions that are not the best to satisfy any active goal in isolation, but rather compromise between multiple goals. This paper briefly reviews the history of compromise behaviour and presents experimental analyses of it in an attempt to determine how much compromise behaviour aids an agent. It concludes that optimal compromise behaviour has a surprisingly small benefit over non-compromise behaviour in the experiments performed, and presents some reasons why this may be true and hypothesizes cases where compromise behaviour is truly useful. In particular, it hypothesizes that a crucial factor is the level at which an action is taken (low-level actions are specific, such as ‘move left leg’; high-level actions are vague, such as ‘forage for food’). This paper hypothesizes that compromise behaviour is more beneficial for high- than low-level actions.


Author(s):  
Norio Baba ◽  
Norihiko Ichise ◽  
Syunya Watanabe

The tilted beam illumination method is used to improve the resolution comparing with the axial illumination mode. Using this advantage, a restoration method of several tilted beam images covering the full azimuthal range was proposed by Saxton, and experimentally examined. To make this technique more reliable it seems that some practical problems still remain. In this report the restoration was attempted and the problems were considered. In our study, four problems were pointed out for the experiment of the restoration. (1) Accurate beam tilt adjustment to fit the incident beam to the coma-free axis for the symmetrical beam tilting over the full azimuthal range. (2) Accurate measurements of the optical parameters which are necessary to design the restoration filter. Even if the spherical aberration coefficient Cs is known with accuracy and the axial astigmatism is sufficiently compensated, at least the defocus value must be measured. (3) Accurate alignment of the tilt-azimuth series images.


1962 ◽  
Vol 5 (4) ◽  
pp. 387-394 ◽  
Author(s):  
Bruce Quarrington ◽  
Jerome Conway ◽  
Nathan Siegel
Keyword(s):  

1974 ◽  
Vol 126 (2) ◽  
pp. 243-248
Author(s):  
A WAKABAYASHI ◽  
T KUBO ◽  
K CHARNEY ◽  
Y NAKAMURA ◽  
J CONNOLLY

1963 ◽  
Vol 45 (3) ◽  
pp. 374-383 ◽  
Author(s):  
Donald C. McIlrath ◽  
George A. Hallenbeck ◽  
Hubert A. Allen ◽  
Charles V. Mann ◽  
Edward J. Baldes ◽  
...  
Keyword(s):  

1958 ◽  
Vol 34 (1) ◽  
pp. 11-20 ◽  
Author(s):  
Henry D. Janowitz ◽  
Vernon A. Weinstein ◽  
Rhoda G. Shaer ◽  
James F. Cereghini ◽  
Franklin Hollander

Sign in / Sign up

Export Citation Format

Share Document