scholarly journals Representing uncertainty in the Rescorla-Wagner model: blocking, the redundancy effect, and outcome base rate

2021 ◽  
Author(s):  
Stuart Spicer ◽  
Andy Wills ◽  
Peter M Jones ◽  
Chris Mitchell ◽  
Lenard Dome

It is generally assumed that the Rescorla and Wagner (1972) model adequately accommodates the full results of simple cue competition experiments in humans (e.g. Dickinson et al., 1984), while the Bush and Mosteller (1951) model cannot. We present simulations that demonstrate this assumption is wrong in at least some circumstances. The Rescorla-Wagner model, as usually applied, fits the full results of a simple forward cue-competition experiment no better than the Bush-Mosteller model. Additionally, we present a novel finding, where letting the associative strength of all cues start at an intermediate value (rather than zero), allows this modified model to provide a better account of the experimental data than the (equivalently modified) Bush-Mosteller model. This modification also allows the Rescorla-Wagner model to account for a redundancy effect experiment (Uengoer et al., 2013); something that the unmodified model is not able to do. Furthermore, the modified Rescorla-Wagner model can accommodate the effect of varying the proportion of trials on which the outcome occurs (i.e. the base rate) on the redundancy effect (Jones et al., 2019). Interestingly, the initial associative strength of cues varies in line with the outcome base rate. We propose that this modification provides a simple way of mathematically representing uncertainty about the causal status of novel cues within the confines of the Rescorla-Wagner model. The theoretical implications of this modification are discussed. We also briefly introduce free and open resources to support formal modelling in associative learning.

2021 ◽  
pp. 14-21
Author(s):  
Stuart G. Spicer ◽  
Andy J. Wills ◽  
Peter M. Jones ◽  
Chris J. Mitchell ◽  
Lenard Dome

It is generally assumed that the Rescorla and Wagner (1972) model adequately accommodates the full results of simple cue competition experiments in humans (e.g. Dickinson et al., 1984), while the Bush and Mosteller (1951) model cannot. We present simulations that demonstrate this assumption is wrong in at least some circumstances. The Rescorla-Wagner model, as usually applied, fits the full results of a simple forward cue-competition experiment no better than the Bush-Mosteller model. Additionally, we present a novel finding, where letting the associative strength of all cues start at an intermediate value (rather than zero), allows this modified model to provide a better account of the experimental data than the (equivalently modified) Bush-Mosteller model. This modification also allows the Rescorla-Wagner model to account for a redundancy effect experiment (Uengoer et al., 2013); something that the unmodified model is not able to do. Furthermore, the modified Rescorla-Wagner model can accommodate the effect of varying the proportion of trials on which the outcome occurs (i.e. the base rate) on the redundancy effect (Jones et al., 2019). Interestingly, the initial associative strength of cues varies in line with the outcome base rate. We propose that this modification provides a simple way of mathematically representing uncertainty about the causal status of novel cues within the confines of the Rescorla-Wagner model. The theoretical implications of this modification are discussed. We also briefly introduce free and open resources to support formal modelling in associative learning. Keywords: associative learning, prediction error, uncertainty, modelling, blocking, redundancy effect, open science.


2019 ◽  
Vol 73 (2) ◽  
pp. 260-278
Author(s):  
Tara Zaksaite ◽  
Peter M Jones

Rescorla and Wagner’s model of learning describes excitation and inhibition as symmetrical opposites. However, tasks used in human causal learning experiments, such as the allergist task, generally involve learning about cues leading to the presence or absence of the outcome, which may not reflect this assumption. This is important when considering learning effects which provide a challenge to this model, such as the redundancy effect. The redundancy effect describes higher causal ratings for the blocked cue X than for the uncorrelated cue Y in the design A+/AX+/BY+/CY–, the opposite pattern to that predicted by the Rescorla–Wagner model, which predicts higher associative strength for Y than for X. Crucially, this prediction depends on cue C gaining some inhibitory associative strength. In this article, we used a task in which cues could have independent inhibitory effects on the outcome, to investigate whether a lack of inhibition was related to the redundancy effect. In Experiment 1, inhibition for C was not detected in the allergist task, supporting this possibility. Three further experiments using the alternative task showed that a lack of inhibition was related to the redundancy effect: the redundancy effect was smaller when C was rated as inhibitory. Individual variation in the strength of inhibition for C also determined the size of the redundancy effect. Given that weak inhibition was detected in the alternative scenario but not in the allergist task, we recommend carefully choosing the type of task used to investigate associative learning phenomena, as it may influence results.


Author(s):  
PAO-LIEN WEI ◽  
JEN-HUNG HUANG ◽  
GWO-HSHIUNG TZENG ◽  
SHWU-ING WU

Causal analysis greatly affects the efficiency of decision-making. Scholars usually adopt structural equation modeling (SEM) to establish a causal model recently. However, statistical data allow researchers to modify the model frequently to arrive at good model fitness, and SEM is often misapplied when the data are merely fitted to an SEM and the theory is then extended from the analytical result based on presumed hypotheses. This paper proposed SEM modified by DEMATEL technique, taking causal model of Web-advertising effects for example. Having revealed that the new model is the one that conforms to actual data and is better than initial model, the results confirm that the DEMATEL technique can be an efficient, complementary, and confident approach for reprioritization of the amended modes in a SEM model. In addition, the most important factor affecting the Web-advertising effects may be found via the modified model, which benefits the manager for making strategic marketing plans.


2013 ◽  
Vol 303-306 ◽  
pp. 2790-2793
Author(s):  
Zhong Min Wan ◽  
Ka Lin Su ◽  
Zu Yi Zheng ◽  
Jun Hua Wan ◽  
Jing Liu ◽  
...  

It is essential to investigate the vibration properties of piping system in air conditioner. Finite Element Method is used to build the virtual prototype model of the air conditioner, and the dynamic responding analysis was conducted using ANSYS software. The modal analysis and harmonic response analysis was conducted for different modals and the results was compared. The simulation results showed that the vibration characteristics of modified model is better than that of the original model, thus resonance phenomenon could be avoided.


2005 ◽  
Vol 62 (2) ◽  
pp. 476-491 ◽  
Author(s):  
Christos M. Mitas ◽  
Walter A. Robinson

Abstract An empirical modification of conventional barotropic dynamics is implemented to study the low-frequency variability (LFV) of the upper troposphere. Using the conservation of potential vorticity, generalized spectral barotropic operators that apply at single isentropic levels are constructed. In initial value calculations the empirical model shows improvement in skill compared to the conventional barotropic model, but it does not do significantly better than persistence. For short times, however, the empirically modified model shows a much closer resemblance to the observed streamfunction tendency. Overall, it is a significantly more accurate representation of the atmosphere than the conventional barotropic model. Normal, optimal, and singular modes of the modified model are calculated. The modes of the empirically modified model are more stable and more difficult to excite than those of the barotropic model. These results are consistent with previous studies that found barotropic dynamics deficient for the quantitative description of LFV. The singular modes of the modified operator have very similar patterns but explain less variance than those of the barotropic operator, which is consistent with the difficulty in detecting optimal patterns in observations. The modified barotropic operator is also more normal than the barotropic operator, and thus less variable.


2018 ◽  
Vol 764 ◽  
pp. 219-224
Author(s):  
Chun Ling Li ◽  
Chang Hou Lu ◽  
Jian Mei Li

To evaluate the quality of the laser direct part marked Data Matrix symbols on titanium alloy substrates, the quality assessment methods at home and abroad were compared. A new quality assessment method of combining the effect of the laser on substrate materials and symbol grade of laser marked Data Matrix was put forward. Depending on previous research works, orthogonal experiment results were analyzed again and a modified nonlinear mathematics model was established. Analysis results indicate that this modified model can explain 90.6% of symbol contrast change and it is statistically significant. So it is better than previous linear regression model and can be used to estimate the quality of laser marked Data Matrix symbols on titanium alloy substrates. The nonlinear mathematics model can also explain the laser parameters influence on the symbol contrast.


1977 ◽  
Vol 8 (1) ◽  
pp. 15-22 ◽  
Author(s):  
Alice Draheim Peters

The use of positive reinforcement for 30-second intervals of speech fluency resulted in a marked decrease in the number of disfluencies demonstrated by two third-grade male stutterers. The program was accomplished in a public school setting during short sessions, with a minimum of equipment. A follow-up session one month after the study, as well as subjective reports of parents and teachers, indicated maintenance of fluency at better than base-rate levels.


2000 ◽  
Vol 87 (2) ◽  
pp. 413-414 ◽  
Author(s):  
Makoto Yamaguchi

The author recently showed that it is not always necessary to perform simulations to derive predictions from the Rescorla-Wagner model, and presented an alternative method. In this article, the method is applied to an influential experimental paradigm: base-rate neglect.


1982 ◽  
Vol 19 (3) ◽  
pp. 312-323 ◽  
Author(s):  
Robert F. Lusch ◽  
James R. Brown

A modified model for examining power and its sources in marketing channels is developed and tested. The results of testing this model indicate that its predictive ability is no better than that of previous approaches. Some unexpected results obtained in this and other studies are discussed in the context of an overall framework of power sources and their consequences in marketing channels.


Sign in / Sign up

Export Citation Format

Share Document