scholarly journals Computational modeling of epiphany learning

2017 ◽  
Vol 114 (18) ◽  
pp. 4637-4642 ◽  
Author(s):  
Wei James Chen ◽  
Ian Krajbich

Models of reinforcement learning (RL) are prevalent in the decision-making literature, but not all behavior seems to conform to the gradual convergence that is a central feature of RL. In some cases learning seems to happen all at once. Limited prior research on these “epiphanies” has shown evidence of sudden changes in behavior, but it remains unclear how such epiphanies occur. We propose a sequential-sampling model of epiphany learning (EL) and test it using an eye-tracking experiment. In the experiment, subjects repeatedly play a strategic game that has an optimal strategy. Subjects can learn over time from feedback but are also allowed to commit to a strategy at any time, eliminating all other options and opportunities to learn. We find that the EL model is consistent with the choices, eye movements, and pupillary responses of subjects who commit to the optimal strategy (correct epiphany) but not always of those who commit to a suboptimal strategy or who do not commit at all. Our findings suggest that EL is driven by a latent evidence accumulation process that can be revealed with eye-tracking data.

2017 ◽  
Author(s):  
Gabriel Tillman

Most current sequential sampling models have random between-trial variability in their parameters. These sources of variability make the models more complex in order to fit response time data, do not provide any further explanation to how the data were generated, and have recently been criticised for allowing infinite flexibility in the models. To explore and test the need of between-trial variability parameters we develop a simple sequential sampling model of N-choice speeded decision making: the racing diffusion model. The model makes speeded decisions from a race of evidence accumulators that integrate information in a noisy fashion within a trial. The racing diffusion does not assume that any evidence accumulation process varies between trial, and so, the model provides alternative explanations of key response time phenomena, such as fast and slow error response times relative to correct response times. Overall, our paper gives good reason to rethink including between-trial variability parameters in sequential sampling models


2021 ◽  
Vol 18 (2) ◽  
pp. 1-17
Author(s):  
Shannon P. Devlin ◽  
Jennifer K. Byham ◽  
Sara Lu Riggs

Changes in task demands can have delayed adverse impacts on performance. This phenomenon, known as the workload history effect, is especially of concern in dynamic work domains where operators manage fluctuating task demands. The existing workload history literature does not depict a consistent picture regarding how these effects manifest, prompting research to consider measures that are informative on the operator's process. One promising measure is visual attention patterns, due to its informativeness on various cognitive processes. To explore its ability to explain workload history effects, participants completed a task in an unmanned aerial vehicle command and control testbed where workload transitioned gradually and suddenly. The participants’ performance and visual attention patterns were studied over time to identify workload history effects. The eye-tracking analysis consisted of using a recently developed eye-tracking metric called coefficient K , as it indicates whether visual attention is more focal or ambient. The performance results found workload history effects, but it depended on the workload level, time elapsed, and performance measure. The eye-tracking analysis suggested performance suffered when focal attention was deployed during low workload, which was an unexpected finding. When synthesizing these results, they suggest unexpected visual attention patterns can impact performance immediately over time. Further research is needed; however, this work shows the value of including a real-time visual attention measure, such as coefficient K , as a means to understand how the operator manages varying task demands in complex work environments.


2016 ◽  
Vol 11 (1) ◽  
pp. 77-98 ◽  
Author(s):  
Nubia Evertsson

This article reports the results of a nested analysis conducted to evaluate whether or not electoral donations are considered legal bribes. Introduced by Lieberman, nested analysis brings together the strengths of the regression analysis and the case study research by integrating large- N approaches (LNA) with small- N approaches (SNA). The nested analysis uses a sequential sampling model (QUANTITATIVE → QUALITATIVE) and a nested sampling design (case selection “on/off the line”). Here, Lieberman’s original model was extended to deal with an apparent paradox that emerged from the analysis. This inquiry included a cross-national examination among 78 countries, denoted as LNA, followed by an intranational analysis conducted in Colombia, where an SNA survey with 302 respondents and an SNA case study were carried out.


2021 ◽  
Author(s):  
Miguel Barretto Garcia ◽  
Marcus Grueschow ◽  
Marius Moisa ◽  
Rafael Polania ◽  
Christian Carl Ruff

Humans and animals can flexibly choose their actions based on different information, ranging from objective states of the environment (e.g., apples are bigger than cherries) to subjective preferences (e.g., cherries are tastier than apples). Whether the brain instantiates these different choices by recruiting either specialized or shared neural circuitry remains debated. Specifically, domain-general theories of prefrontal cortex (PFC) function propose that prefrontal areas flexibly process either perceptual or value-based evidence depending on what is required for the present choice, whereas domain-specific theories posit that PFC sub- areas, such as the left superior frontal sulcus (SFS), selectively integrate evidence relevant for perceptual decisions. Here we comprehensively test the functional role of the left SFS for choices based on perceptual and value-based evidence, by combining fMRI with a behavioural paradigm, computational modelling, and transcranial magnetic stimulation. Confirming predictions by a sequential sampling model, we show that TMS-induced excitability reduction of the left SFS selectively changes the processing of decision-relevant perceptual information and associated neural processes. In contrast, value-based decision making and associated neural processes remain unaffected. This specificity of SFS function is evident at all levels of analysis (behavioural, computational, and neural, including functional connectivity), demonstrating that the left SFS causally contributes to evidence integration for  perceptual but not value-based decisions.


Science ◽  
2020 ◽  
Vol 367 (6484) ◽  
pp. 1362-1366 ◽  
Author(s):  
A. Westbrook ◽  
R. van den Bosch ◽  
J. I. Määttä ◽  
L. Hofmans ◽  
D. Papadopetraki ◽  
...  

Stimulants such as methylphenidate are increasingly used for cognitive enhancement but precise mechanisms are unknown. We found that methylphenidate boosts willingness to expend cognitive effort by altering the benefit-to-cost ratio of cognitive work. Willingness to expend effort was greater for participants with higher striatal dopamine synthesis capacity, whereas methylphenidate and sulpiride, a selective D2 receptor antagonist, increased cognitive motivation more for participants with lower synthesis capacity. A sequential sampling model informed by momentary gaze revealed that decisions to expend effort are related to amplification of benefit-versus-cost information attended early in the decision process, whereas the effect of benefits is strengthened with higher synthesis capacity and by methylphenidate. These findings demonstrate that methylphenidate boosts the perceived benefits versus costs of cognitive effort by modulating striatal dopamine signaling.


2016 ◽  
Vol 26 (6) ◽  
pp. 751-772 ◽  
Author(s):  
Jeremy Trevelyan Burman

Jean Piaget’s research program—which involved the study of child development as a central feature (viz. “stages”), but which can be understood more broadly as advancing a constructive theory of knowledge (i.e., “genetic epistemology”)—is thought by many contemporary developmentalists to have been guided by a coherent, complete, and unchanging meta-theoretical framework: “equilibration.” While this is correct philosophically, it is incorrect historically. Briefly put: the formal meaning of equilibration changed over time, and thus so too did the entirety of the theory that relied upon it. To focus in on one specific change of particular importance, this article examines how Piaget appealed to the changing ideas of Kurt Gödel and their interpretations by French-speaking logicians. This historical analysis (a Foucauldian archaeology) thereby excavates a “neo-Gödelian turn” in Piaget’s research program. The resulting framework is then sketched in outline: the updated formal meta-theory that made possible “Piaget’s new theory.”


2020 ◽  
Vol 4 (Supplement_1) ◽  
Author(s):  
Lauren Bateman ◽  
Preethi Rao ◽  
Thomas Hugh Jones ◽  
Daniel Marcus Kelly

Abstract Testosterone deficiency is prevalent in men with type 2 diabetes (T2D) and is associated with greatly elevated risk of cardiovascular mortality. Testosterone replacement has beneficial effects on surrogate markers and risk factors of atherosclerosis including inflammation, cholesterol and insulin resistance improving survival in men with T2D. The underlying mechanisms of this action remain poorly understood. Inflammation is a central feature to both T2D and atherosclerosis and is driven by monocyte/macrophages, placing these immune cells at the crossroads of disease pathology. The recruitment of immune cells to atherosclerosis-prone areas of the vasculature is influenced by many factors including the inflammatory status of the circulating monocytes. The present study investigates the influence of testosterone replacement on monocyte inflammatory markers in a randomised double blinded placebo controlled clinical trial. 65 men with poorly controlled diabetes (HbA1c between 53 and 80 mmol/mol) and confirmed hypogonadism via early morning [0800−1200h] total testosterone ≤12 nmol/L or calculated free testosterone ≤255 pmol/L on two occasions ≥1 week apart, with at least two symptoms of hypogonadism were included in the study. Patients were randomly assigned to either placebo or treatment (depot testosterone undecanoate, 6 weekly followed by 3 monthly intramuscular injections) for 6 months. Monocytes were isolated from whole blood collected at baseline, 3 and 6 month visits followed by gene expression of key inflammatory targets IL-1β, IL-6, IL-10, TNFα, ICAM1, TLR2, TLR4, SCARB1 and MCP1 assessed via qPCR. Pro-inflammatory targets TNFα and MCP1 were significantly reduced over time in monocytes from patients treated with testosterone between 3 and 6 months (1.39±0.39 Vs 0.68±0.09, P<0.01; 15.36±7.79 Vs 1.88±0.93, P<0.01 respectively) and TNFα at 6 months compared to the start of the study (1.00±0.00 Vs 0.68±0.09, P<0.001) when normalised to baseline. TNFα expression was also significantly reduced compared to placebo treated patient monocytes at 6 months (0.68±0.09 Vs 3.45±1.50, P<0.01). Other targets were not significantly altered over time or between treatment groups. These findings importantly indicate for the first time that testosterone influences monocyte inflammatory activation in type 2 diabetic men by altering expression of the most potent atherogenic chemokine MCP1 and potent pro-inflammatory cytokine TNFα, as a potential mechanism to protect against atherosclerotic plaque development in hypogonadism.


2021 ◽  
Author(s):  
Tess Forest ◽  
Noam Siegelman ◽  
Amy Finn

Our environments are saturated with learnable information. What determines which of this information gets prioritized for limited attentional resources? While previous studies suggest that learners prefer medium complexity information, here we argue that what counts as medium should change as someone learns an input's structure. Specifically, we examined the hypothesis that attention is directed towards more complicated structures as learners gain more experience with the environment. Participants watched four simultaneous streams of information which varied in complexity. Reaction times to intermittent search trials (Ex. 1, N=75) and eye-tracking (Ex. 2, N=45) indexed where participants attended over the experiment. Using a subject- and trial-specific measure of complexity, we demonstrated that participants attended to increasingly complex streams over time. Individual differences in structure learning also modulated attention allocation, with better learners attending to complex structures from earlier in learning, suggesting the ability to prioritize different information over time gates structure learning success.


2012 ◽  
Vol 5 (2) ◽  
Author(s):  
Pascaline Neveu ◽  
Matthieu Philippe ◽  
Anne-Emmanuelle Priot ◽  
Philippe Fuchs ◽  
Corinne Roumes

Oculomotor conflict induced between the accommodative and vergence components in stereoscopic displays represents an unnatural viewing condition. There is now some evidence that stereoscopic viewing may induce discomfort and changes in oculomotor parameters. The present study sought to measure oculomotor performance during stereoscopic viewing. Using a 3D stereo setup and an eye-tracker, vergence responses were measured during 20-min exposure to a virtual visual target oscillating in depth, which participants had to track. The results showed a significant decline in the amplitude of the in-depth oscillatory vergence response over time. We propose that eye-tracking provides a useful tool to objectively assess the timevarying alterations of the vergence system when using stereoscopic displays.


Sign in / Sign up

Export Citation Format

Share Document