EXPRESS: Evidence for two attentional mechanisms during learning

2021 ◽  
pp. 174702182110193
Author(s):  
David Torrents-Rodas ◽  
Stephan Koenig ◽  
Metin Uengoer ◽  
Harald Lachnit
Keyword(s):  
Eye Movements ◽  
Associative Learning ◽  
Hybrid Model ◽  
Prediction Error ◽  
The Other ◽  
Prediction Errors ◽  
Second Stage ◽  
Initial Stage ◽  
Attentional Mechanism ◽  
Attentional Mechanisms

We sought to provide evidence for a combined effect of two attentional mechanisms during associative learning. Participants’ eye movements were recorded as they predicted the outcomes following different pairs of cues. Across the trials of an initial stage, a relevant cue in each pair was consistently followed by one of two outcomes, while an irrelevant cue was equally followed by either of them. Thus, the relevant cue should have been associated with small relative prediction errors, compared to the irrelevant cue. In a later stage, each pair came to be followed by one outcome on a random half of the trials and by the other outcome on the remaining half, and thus there should have been a rise in the overall prediction error. Consistent with an attentional mechanism based on relative prediction error, an attentional advantage for the relevant cue was evident in the first stage. On the other hand, in accordance with a mechanism linked to overall prediction error, the attention paid to both types of cues increased at the beginning of the second stage. These results showed up in both dwell times and within-trial patterns of fixations, and they were predicted by a hybrid model of attention.

The Associative Learning Prediction Error Feedback Loop as Reversible Driving Belt of the Bioenergetics of Longevity

2021 ◽  
Author(s):  
Matthew S Price
Keyword(s):  
Associative Learning ◽  
Prediction Error ◽  
Feedback Loop ◽  
Telomerase Activity ◽  
Behavioral Strategy ◽  
Prediction Errors ◽  
Error Feedback ◽  
Treatment Expectations ◽  
Telomere Shortening ◽  
Inhibitory Learning

Leukocyte telomere shortening is a useful biomarker of biological and cellular age that occurs at an accelerated rate in anxiety disorders and posttraumatic stress disorder (PTSD). Intriguingly, inhibitory learning — the systematic exposure to noxious stimuli that serves as a basis for many treatments for anxiety, phobia, and PTSD —reduces relative telomeres attrition rates and increases protective telomerase activity in a manner predictive of treatment response. How does inhibitory learning, a behavioral strategy, modulate organismal chromosomal activity? Inhibitory learning may induce repeated mismatch between treatment expectations, intrasession states, and eventual outcome. Nevertheless, inhibitory learning can incentivize repetition of the behavior. Thus, this paper aims to conceptualize inhibitory learning as involving a ‘prediction error feedback loop’, i.e., a series of self-perpetuating prediction errors — mismatches between expectations and outcomes — that enhances neural inhibitory regulation to effectuate extinction. Inhibitory learning is necessarily predicated upon an opposing process – excitatory learning – that may be conceptualized as a prediction error feedback loop that operates in reverse to inhibitory learning and enhances neural excitability as arousal. Together, excitatory and inhibitory learning may be elements of an associative learning prediction error feedback loop responsible for modulating neural bioenergetic rates, leading to changes in downstream cellular signaling that could explain reduced or increased rates of leukocyte telomere shortening and telomerase activity from each behavioral strategy, respectively.

scholarly journals Dopamine transients delivered in learning contexts do not act as model-free prediction errors

2019 ◽  
Author(s):  
Melissa J. Sharpe ◽  
Hannah M. Batchelor ◽  
Lauren E. Mueller ◽  
Chun Yun Chang ◽  
Etienne J.P. Maes ◽  
...  
Keyword(s):  
Reinforcement Learning ◽  
Associative Learning ◽  
Prediction Error ◽  
Error Term ◽  
Neural Correlates ◽  
Dopamine Neurons ◽  
Prediction Errors ◽  
Model Free ◽  
Reward Prediction ◽  
Excess Value

AbstractDopamine neurons fire transiently in response to unexpected rewards. These neural correlates are proposed to signal the reward prediction error described in model-free reinforcement learning algorithms. This error term represents the unpredicted or ‘excess’ value of the rewarding event. In model-free reinforcement learning, this value is then stored as part of the learned value of any antecedent cues, contexts or events, making them intrinsically valuable, independent of the specific rewarding event that caused the prediction error. In support of equivalence between dopamine transients and this model-free error term, proponents cite causal optogenetic studies showing that artificially induced dopamine transients cause lasting changes in behavior. Yet none of these studies directly demonstrate the presence of cached value under conditions appropriate for associative learning. To address this gap in our knowledge, we conducted three studies where we optogenetically activated dopamine neurons while rats were learning associative relationships, both with and without reward. In each experiment, the antecedent cues failed to acquired value and instead entered into value-independent associative relationships with the other cues or rewards. These results show that dopamine transients, constrained within appropriate learning situations, support valueless associative learning.

scholarly journals Dopamine transients do not act as model-free prediction errors during associative learning

2020 ◽  
Vol 11 (1) ◽  
Author(s):  
Melissa J. Sharpe ◽  
Hannah M. Batchelor ◽  
Lauren E. Mueller ◽  
Chun Yun Chang ◽  
Etienne J. P. Maes ◽  
...  
Keyword(s):  
Reinforcement Learning ◽  
Associative Learning ◽  
Prediction Error ◽  
Intrinsic Value ◽  
Learning Algorithms ◽  
Dopamine Neurons ◽  
Prediction Errors ◽  
Model Free ◽  
Reward Prediction ◽  
Excess Value

AbstractDopamine neurons are proposed to signal the reward prediction error in model-free reinforcement learning algorithms. This term represents the unpredicted or ‘excess’ value of the rewarding event, value that is then added to the intrinsic value of any antecedent cues, contexts or events. To support this proposal, proponents cite evidence that artificially-induced dopamine transients cause lasting changes in behavior. Yet these studies do not generally assess learning under conditions where an endogenous prediction error would occur. Here, to address this, we conducted three experiments where we optogenetically activated dopamine neurons while rats were learning associative relationships, both with and without reward. In each experiment, the antecedent cues failed to acquire value and instead entered into associations with the later events, whether valueless cues or valued rewards. These results show that in learning situations appropriate for the appearance of a prediction error, dopamine transients support associative, rather than model-free, learning.

scholarly journals Dopamine neuron ensembles signal the content of sensory prediction errors

eLife ◽  
2019 ◽  
Vol 8 ◽  
Author(s):  
Thomas A Stalnaker ◽  
James D Howard ◽  
Yuji K Takahashi ◽  
Samuel J Gershman ◽  
Thorsten Kahnt ◽  
...  
Keyword(s):  
Associative Learning ◽  
Prediction Error ◽  
Sensory Information ◽  
Dopamine Neurons ◽  
Prediction Errors ◽  
Bold Response ◽  
Dopamine System ◽  
Sensory Event ◽  
Specific Teaching ◽  
Sensory Prediction

Dopamine neurons respond to errors in predicting value-neutral sensory information. These data, combined with causal evidence that dopamine transients support sensory-based associative learning, suggest that the dopamine system signals a multidimensional prediction error. Yet such complexity is not evident in the activity of individual neurons or population averages. How then do downstream areas know what to learn in response to these signals? One possibility is that information about content is contained in the pattern of firing across many dopamine neurons. Consistent with this, here we show that the pattern of firing across a small group of dopamine neurons recorded in rats signals the identity of a mis-predicted sensory event. Further, this same information is reflected in the BOLD response elicited by sensory prediction errors in human midbrain. These data provide evidence that ensembles of dopamine neurons provide highly specific teaching signals, opening new possibilities for how this system might contribute to learning.

scholarly journals Context dependency as a Function of Prediction Error-Based Attention

2019 ◽  
Vol 40 (2) ◽  
pp. 34-45 ◽  
Author(s):  
Juan M. Rosas ◽  
James Byron Nelson
Keyword(s):  
Prediction Error ◽  
Context Dependence ◽  
Context Dependency ◽  
Prediction Errors ◽  
Context Switch ◽  
Selective Review ◽  
Relevant Role ◽  
High Prediction ◽  
Attentional Mechanism

AbstractContext dependence of information has been shown to be based, at least in part, on the attention contexts received at the time of training. Recent research suggests that attention to irrelevant contexts may be a byproduct of the activation of a general exploratory attentional mechanism prompted by high prediction errors associated with situations of uncertainty. Alternatively, low prediction errors may engage an attentional mechanism of exploitation in situations in which contexts play a relevant role. A selective review discusses the potential of this approach to explain context switch effects from an attentional perspective.

Visual asymmetries during face encoding Increased dwell time and fixations in the upper and left hemifields

2018 ◽  
Author(s):  
Fatima Maria Felisberti
Keyword(s):  
Face Recognition ◽  
Eye Movements ◽  
Visual Field ◽  
Face Processing ◽  
Dwell Time ◽  
The Other ◽  
Environmental Cues ◽  
Reading Habits ◽  
The Right

Visual field asymmetries (VFA) in the encoding of groups rather than individual faces has been rarely investigated. Here, eye movements (dwell time (DT) and fixations (Fix)) were recorded during the encoding of three groups of four faces tagged with cheating, cooperative, or neutral behaviours. Faces in each of the three groups were placed in the upper left (UL), upper right (UR), lower left (LL), or lower right (LR) quadrants. Face recognition was equally high in the three groups. In contrast, the proportion of DT and Fix were higher for faces in the left than the right hemifield and in the upper rather than the lower hemifield. The overall time spent looking at the UL was higher than in the other quadrants. The findings are relevant to the understanding of VFA in face processing, especially groups of faces, and might be linked to environmental cues and/or reading habits.

Which One of Two Ectopic Mandibular Canines will erupt to a Normal Position in the Dental Arch

2018 ◽  
Author(s):  
M Svanholt ◽  
P Svanholt ◽  
Inger Kjær
Keyword(s):  
The Other ◽  
Mixed Dentition ◽  
Dental Arch ◽  
Horizontal Position ◽  
Normal Position ◽  
Initial Stage ◽  
Mandibular Canine ◽  
The One

The purpose of this paper is to demonstrate 4 cases with bi-lateral ectopic mandibular canines and to demonstrate in each case which one of the two canines erupted to a normal position in the dental arch. The canines are observed from Orthopantomograms from 4 children (aged 8-13 years of age) in the mixed dentitions stages. Of these children 2 were males and 2 were females. From each child there was between 3-5 Orthopantomograms. These were observed over 3-4 years period. In each of the 4 cases with bi-lateral ectopia of the mandibular canines the one mandibular canine erupted into a normal position, while the other one declined into a horizontal position during the mixed dentition period. These 4 cases demonstrated that the inclination of the canines were important to observe and diagnose from the initial stage (first ortopantomogram). The cases presented, demonstrated that the unsuccessfully erupted canines ending in a horizontal position, were the canines which inclined slightly more that the contra lateral canine already from the initial stage.

scholarly journals Gender differences in refraction prediction error of five formulas for cataract surgery

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Yibing Zhang ◽  
Tingyang Li ◽  
Aparna Reddy ◽  
Nambi Nallasamy
Keyword(s):  
Gender Differences ◽  
Cataract Surgery ◽  
Prediction Error ◽  
Statistical Difference ◽  
Independent Predictor ◽  
Study Data ◽  
Prediction Errors ◽  
Optical Biometry ◽  
Iol Power ◽  
Lens Power

Abstract Objectives To evaluate gender differences in optical biometry measurements and lens power calculations. Methods Eight thousand four hundred thirty-one eyes of five thousand five hundred nineteen patients who underwent cataract surgery at University of Michigan’s Kellogg Eye Center were included in this retrospective study. Data including age, gender, optical biometry, postoperative refraction, implanted intraocular lens (IOL) power, and IOL formula refraction predictions were gathered and/or calculated utilizing the Sight Outcomes Research Collaborative (SOURCE) database and analyzed. Results There was a statistical difference between every optical biometry measure between genders. Despite lens constant optimization, mean signed prediction errors (SPEs) of modern IOL formulas differed significantly between genders, with predictions skewed more hyperopic for males and myopic for females for all 5 of the modern IOL formulas tested. Optimization of lens constants by gender significantly decreased prediction error for 2 of the 5 modern IOL formulas tested. Conclusions Gender was found to be an independent predictor of refraction prediction error for all 5 formulas studied. Optimization of lens constants by gender can decrease refraction prediction error for certain modern IOL formulas.

scholarly journals Energy-Related Behaviour of Consumers from the Silesia Province (Poland)—Towards a Low-Carbon Economy

Energies ◽  
2021 ◽  
Vol 14 (8) ◽  
pp. 2218
Author(s):  
Sylwia Słupik ◽  
Joanna Kos-Łabędowicz ◽  
Joanna Trzęsiok
Keyword(s):  
Classification Model ◽  
Attitudes And Beliefs ◽  
Low Carbon ◽  
Low Carbon Economy ◽  
The Public ◽  
Second Stage ◽  
Initial Stage ◽  
Low Emission ◽  
Energy Behaviour ◽  
Carbon Economy

The issue of energy behaviour among Polish consumers, and especially the motives and attitudes they manifest, is relatively under-researched. This article attempts to identify individual attitudes and beliefs of energy consumers using the example of the residents of the province of Silesia (Poland). The authors conducted the expert segmentation of respondents in terms of their motivation for saving energy, based on the results of their proprietary survey. The second stage of the study involved using a classification model that allowed for the characterisation of the obtained groups. Psychological and financial factors were of greatest significance, which is confirmed by the results of other studies. Nonetheless, the obtained results explicitly indicate the specificity of the region, which requires transformation towards a low-emission economy. Despite the initial stage of changes both in the awareness of the consumers and the public interventions of the authorities, it should be emphasized that a majority of the respondents—at least to a basic extent—declared taking energy-saving measures. Financial motives are predominant among the respondents, although pro-environmental motives can also be noticed, which might translate into increased involvement and concern for the environment and climate.

A semi-hybrid model for malaria with limited superinfection

1998 ◽  
Vol 30 (04) ◽  
pp. 1027-1057 ◽  
Author(s):  
Philippe Picard
Keyword(s):  
Stochastic Model ◽  
Population Size ◽  
Hybrid Model ◽  
Human Population ◽  
Threshold Level ◽  
The Other ◽  
The Difference ◽  
The One

Modelling malaria with consistency necessitates the introduction of at least two families of interconnected processes. Even in a Markovian context the simplest fully stochastic model is intractable and is usually transformed into a hybrid model, by supposing that these two families are stochastically independent and linked only through two deterministic connections. A model closer to the fully stochastic model is presented here, where one of the two families is subordinated to the other and just a unique deterministic connection is required. For this model a threshold theorem can be proved but the threshold level is not the one obtained in a hybrid model. The difference disappears only when the human population size approaches infinity.

Sign in / Sign up

Export Citation Format

Share Document