scholarly journals A theory of actions and habits: The interaction of rate correlation and contiguity systems in free-operant behavior.

2020 ◽  
Vol 127 (6) ◽  
pp. 945-971
Author(s):  
Omar D. Perez ◽  
Anthony Dickinson

2019 ◽  
Author(s):  
Omar D. Perez ◽  
Anthony Dickinson

Contemporary theories of instrumental performance assume that responding can be controlled by two behavioral systems, one goal-directed that encodes the outcome of an action, and one habitual that reinforces the response strength of the same action. Here we present a model of free-operant behavior in which goal-directed control is determined by the correlation between the rates of the action and the outcome whereas the total prediction error generated by contiguous reinforcement by the outcome controls habitual response strength. The outputs of these two systems summate to generate a total response strength. This cooperative model addresses the difference in the behavioral impact of ratio and interval schedules, the transition from goal-directed to habitual control with extended training, the persistence of goal-directed control under choice procedures and following extinction, among other phenomena. In these respects, this dual-system model is unique in its account of free-operant behavior.



2015 ◽  
Vol 41 (1) ◽  
pp. 81-90 ◽  
Author(s):  
Mark E. Bouton ◽  
Scott T. Schepers




2007 ◽  
Vol 40 (1) ◽  
pp. 89-103 ◽  
Author(s):  
Louis P. Hagopian ◽  
Jennifer L. Bruzek ◽  
Lynn G. Bowman ◽  
Heather K. Jennett


2020 ◽  
Author(s):  
Omar David Perez

Recent theories of instrumental conditioning postulate that the correlation between responses and outcome rates is a critical factor in instrumental free-operant performance and goal-directed control. However, it is still not clear whether human performance can be sensitive to such variable. Using a novel within-subject design, participants were trained under ratio and interval contingencies of reinforcement matching both outcome probability and outcome rates. The impact of rate correlation on performance was evident in the higher performance observed under ratio contingencies for both types of matching. Moreover, there was no difference in performance between two classes of interval schedules with similar correlational properties but different reward probabilities. The result discussed in terms of a recent dual-system model of instrumental behavior.





Sign in / Sign up

Export Citation Format

Share Document