Effect of Reward Sequence on Extinction and Spontaneous Recovery

1972 ◽  
Vol 35 (2) ◽  
pp. 668-670
Author(s):  
William N. Boyer ◽  
Henry A. Cross

Rats were tested in an alley to determine the effect of reward sequence on the extinction and spontaneous recovery of latency and time. Daily, half of the Ss received a small reward on Trial 1 and a large reward on Trial 2 (SL), while the other half received the opposite sequence of rewards (LS). Resistance to extinction and spontaneous recovery were greater when a large reward fallowed a small reward than when a small reward followed a large reward. The results were discussed in terms of Capaldi's (1967) sequential learning hypothesis.

1963 ◽  
Vol 12 (2) ◽  
pp. 343-347 ◽  
Author(s):  
Abigail B. Capaldi ◽  
E. J. Capaldi

Six groups of Ss were trained to guess whether or not a second light would be illuminated following the illumination of a first light. Two consistent groups, two 50% partial groups, and two patterns in sequence groups were employed. In one sequence group consistent training followed partial training and in the other the opposite sequence of patterns was employed. All groups received extinction training. It was found that the sequence groups differed from each other in extinction and from the consistent and partial control groups.


1998 ◽  
Vol 41 (6) ◽  
pp. 1265-1281 ◽  
Author(s):  
Ludo Max ◽  
Anthony J. Caruso

This study is part of a series investigating the hypothesis that stuttering adaptation is a result of motor learning. Previous investigations indicate that nonspeech motor learning typically is associated with an increase in speed of performance. Previous investigations of stuttering, on the other hand, indicate that improvements in fluency during most fluency-enhancing conditions or after stuttering treatment tend to be associated with decreased speech rate, increased duration of specific acoustic segments, and decreased vowel duration variability. The present acoustic findings, obtained from 8 individuals who stutter, reveal that speech adjustments occurring during adaptation differ from those reported for other fluency-enhancing conditions or stuttering treatment. Instead, the observed changes are consistent with those occurring during skill improvements for nonspeech motor tasks and, thus, with a motor learning hypothesis of stuttering adaptation. During the last of 6 repeated readings, a statistically significant increase in articulation rate was observed, together with a decrease in word duration, vowel duration, and consonant-vowel (CV) transition extent. Other adjustments showing relatively consistent trends across individual subjects included decreased CV transition rate and duration, and increased variability of both CV transition extent and vowel duration.


1970 ◽  
Vol 26 (2) ◽  
pp. 495-500
Author(s):  
Patrick E. Campbell ◽  
George M. Batsch ◽  
Kim McNabb ◽  
Stephen B. Knouse

30 rats were trained in a runway for 16 days at 5 trials a day. During acquisition (10 days) Ss were trained on an irregular 50% partially delayed reward schedule. The duration of delay was 30 sec. and 2 pellets of reward were given on all delayed trials. The magnitude of immediate reward was varied over three levels (2, 10, 24 pellets) as a between-groups factor. Although the larger rewards developed somewhat faster acquisition speeds than the small reward the results did not reach statistical reliability. During extinction, however, the larger magnitudes of reward significantly increased resistance to extinction. These results were discussed in terms of aftereffects, frustration, and dissonance theories of extinction.


1964 ◽  
Vol 15 (2) ◽  
pp. 571-576 ◽  
Author(s):  
Milton D. Suboski ◽  
Vincent di Lollo ◽  
I. Gormezano

The effects of the presentation, prior to acquisition training of (1) “no stimulation,” (2) CS alone trials, (3) UCS alone trials, and (4) CS-UCS unpaired trials were investigated in conditioning and extinction of the nictitating membrane response. The principal findings were: (a) significantly higher blink rates in adaptation for the groups receiving the UCS, (b) no differences among groups in acquisition, (c) greater resistance to extinction by groups receiving the CS in adaptation, as evidenced by significant differences in spontaneous recovery, and (d) a significant over-all increase in UCR magnitude in adaptation and acquisition.


2019 ◽  
Vol 23 (1) ◽  
pp. 121-130 ◽  
Author(s):  
L. Luo ◽  
I. Reimert ◽  
E. A. M. Graat ◽  
S. Smeets ◽  
B. Kemp ◽  
...  

Abstract Animals in a negative affective state seem to be more sensitive to reward loss, i.e. an unexpected decrease in reward size. The aim of this study was to investigate whether early-life and current enriched vs. barren housing conditions affect the sensitivity to reward loss in pigs using a successive negative contrast test. Pigs (n = 64 from 32 pens) were housed in barren or enriched conditions from birth onwards, and at 7 weeks of age experienced either a switch in housing conditions (from barren to enriched or vice versa) or not. Allotting pigs to the different treatments was balanced for coping style (proactive vs. reactive). One pig per pen was trained to run for a large reward and one for a small reward. Reward loss was introduced for pigs receiving the large reward after 11 days (reward downshift), i.e. from then onwards, they received the small reward. Pigs housed in barren conditions throughout life generally had a lower probability and higher latency to get the reward than other pigs. Proactive pigs ran overall slower than reactive pigs. After the reward downshift, all pigs ran slower. Nevertheless, reward downshift increased the latency and reduced the probability to get to the reward, but only in pigs exposed to barren conditions in early life, which thus were more sensitive to reward loss than pigs from enriched early life housing. In conclusion, barren housed pigs seemed overall less motivated for the reward, and early life housing conditions had long-term effects on the sensitivity to reward loss.


1963 ◽  
Vol 13 (3) ◽  
pp. 679-686 ◽  
Author(s):  
A. B. Paige ◽  
H. J. McNamara

The purposes of this experiment are further investigation of: the discrimination hypothesis vs secondary reinforcement positions with respect to resistance to extinction; the role of explicit vs non-explicit discrimination training in resistance to extinction. One group of 32 rats was given explicit discrimination training in an L-type runway involving two goal boxes of different brightness. A second group of 32 Ss had non-explicit discrimination training, i.e., an unfastened card in the goal box entrances concealed the cues until S entered the goal box. Ss were always reinforced in the goal box of one brightness and never reinforced in the goal box of the other brightness. During extinction 16 Ss in each of the above groups were extinguished with the positive cue and 16 with the negative cue. Half of these positive cue and negative cue Ss encountered a card in the goal box entrance, and the rest did not. The results showed no significant difference in alley-running or arm-running times in extinction between the positive and negative cue Ss. Using number of trials to a criterion of two successive running times, Ss extinguished with the positive cue showed greater resistance to extinction. The type of discrimination training did not influence extinction results significantly, using running time or number of trials as a criterion. The results were interpreted as generally incompatible with the discrimination hypothesis prediction and only partially in support of a secondary reinforcement position.


1964 ◽  
Vol 14 (1) ◽  
pp. 199-202
Author(s):  
Douglas L. Grimsley ◽  
Robert D. McDonald

Runway speed was investigated in 3 groups of water-deprived rats ( n = 14 per group) given one trial per day for 100 days. No statistically significant differences were found between Ss continuously receiving 0.8 cc (large reward group) or 0.1 cc (small reward group) of water and those given 0.8 cc and 0.1 cc (varied reward group) semirandomly. These data are not consistent with a position derived from a micromolar theory holding that continuous reinforcement training results in better performance than varied reinforcement training.


1958 ◽  
Vol 104 (436) ◽  
pp. 860-864 ◽  
Author(s):  
A. A. Baker ◽  
J. A. Game ◽  
J. G. Thorpe

In spite of the enthusiasm with which schizophrenic patients have been treated by physical methods over the past twenty years, there is surprisingly little evidence enabling us to compare the results of one physical treatment with another, or the physical treatments themselves with the treatments they replaced. Some writers (Polonio and Slater, 1954; Rees, 1949) point out a significant improvement over the spontaneous recovery rate with the use of insulin, while others (Jensen, 1952) find no such improvement. Bourne (1953) and Notkin et al. (1939) go so far as to claim that any improvements of insulin-treated patients are due to the extra care and attention they receive, and the work of Ackner and his colleagues (1957) may support this conclusion. Linford Rees (1949) comparing electrical treatment with insulin concluded that electro-shock therapy was far less effective than deep insulin therapy in the treatment of schizophrenia—a conclusion in line with that of Finiefs (1948). On the other hand Impastato and Almansi found very little difference between E.C.T. and insulin treatment in this respect.


2017 ◽  
Vol 117 (4) ◽  
pp. 1499-1511 ◽  
Author(s):  
Marvin L. Leathers ◽  
Carl R. Olson

Neurons in the lateral intraparietal (LIP) area of macaque monkey parietal cortex respond to cues predicting rewards and penalties of variable size in a manner that depends on the motivational salience of the predicted outcome (strong for both large reward and large penalty) rather than on its value (positive for large reward and negative for large penalty). This finding suggests that LIP mediates the capture of attention by salient events and does not encode value in the service of value-based decision making. It leaves open the question whether neurons elsewhere in the brain encode value in the identical task. To resolve this issue, we recorded neuronal activity in the amygdala in the context of the task employed in the LIP study. We found that responses to reward-predicting cues were similar between areas, with the majority of reward-sensitive neurons responding more strongly to cues that predicted large reward than to those that predicted small reward. Responses to penalty-predicting cues were, however, markedly different. In the amygdala, unlike LIP, few neurons were sensitive to penalty size, few penalty-sensitive neurons favored large over small penalty, and the dependence of firing rate on penalty size was negatively correlated with its dependence on reward size. These results indicate that amygdala neurons encoded cue value under circumstances in which LIP neurons exhibited sensitivity to motivational salience. However, the representation of negative value, as reflected in sensitivity to penalty size, was weaker than the representation of positive value, as reflected in sensitivity to reward size. NEW & NOTEWORTHY This is the first study to characterize amygdala neuronal responses to cues predicting rewards and penalties of variable size in monkeys making value-based choices. Manipulating reward and penalty size allowed distinguishing activity dependent on motivational salience from activity dependent on value. This approach revealed in a previous study that neurons of the lateral intraparietal (LIP) area encode motivational salience. Here, it reveals that amygdala neurons encode value. The results establish a sharp functional distinction between the two areas.


2019 ◽  
Author(s):  
Daniel Pearson ◽  
Poppy Watson ◽  
Phillip Cheng ◽  
Mike Le Pelley

Salient-but-irrelevant distractors can automatically capture attention and eye-gaze in visualsearch. However, recent findings have suggested that attention to salient-but-irrelevant stimulican be suppressed when observers use a specific target template to guide their search (i.e.,feature search). A separate line of research has indicated that attentional selection isinfluenced by factors other than the physical salience of a stimulus and the observer’s goals.For instance, pairing a stimulus with reward has been shown to increase the extent to which itcaptures attention and gaze (as though it has become more physically salient), even when suchcapture has negative consequences for the observer. Here we used eye-tracking with arewarded visual search task to investigate whether capture by reward can be suppressed in thesame way as capture by physical salience. When participants were encouraged to use featuresearch, attention to a distractor paired with relatively small reward was suppressed. However,under the same conditions attention was captured by a distractor paired with large reward,even when such capture resulted in reward omission. These findings suggest thatreward-related stimuli are given special priority within the visual attention system over andabove physically-salient stimuli, and have implications for our understanding of real-worldbiases to reward-related stimuli, such as those seen in addiction.


Sign in / Sign up

Export Citation Format

Share Document