The persistence of learned behaviors in humans as a function of changes in reinforcement schedule and response

1988 ◽  
Vol 19 (3) ◽  
pp. 300-316 ◽  
Author(s):  
David J. Pittenger ◽  
William B. Pavlik ◽  
Steve R. Flora ◽  
Julie M. Kontos
Keyword(s):  
Reinforcement Schedule ◽  
Learned Behaviors

Selective Action of Pentobarbital on Component Behaviors of a Reinforcement Schedule

Science ◽  
1956 ◽  
Vol 124 (3217) ◽  
pp. 367-368 ◽  
Author(s):  
R. J. HERRNSTEIN ◽  
W. H. MORSE
Keyword(s):  
Reinforcement Schedule ◽  
Selective Action

“Freeloading” in a Runway as a Function of Amount of Training and Type of Reinforcement Schedule

1968 ◽  
Vol 22 (1) ◽  
pp. 211-214 ◽  
Author(s):  
Calvin M. Leung ◽  
Glen D. Jensen ◽  
Richard P. Tapley
Keyword(s):  
Reinforcement Schedule ◽  
Schedule Of Reinforcement ◽  
Single Pellet ◽  
Skinner Box

2 groups of 60 rats received either 75 or 285 runs in a runway before being given a choice between freeloading from a dish of pellets in the start box or running the maze for a single pellet. The 285-trial Ss showed less willingness to perform the operant than the 75-trial Ss. This is opposite to what Jensen (1963) had found in the Skinner box. Schedule of reinforcement (100 vs 50%) during training did not significantly affect freeloading scores.

Noncontingent Nonreinforcement of a Response as the Aversive Event in a Cer Paradigm

1971 ◽  
Vol 29 (3_suppl) ◽  
pp. 1196-1198 ◽  
Author(s):  
Richard S. Calef ◽  
Richard A. Kaufman ◽  
Ronald N. Bone ◽  
Steven A. Werk
Keyword(s):  
Reinforcement Schedule ◽  
Present Experiment ◽  
High Density ◽  
High Rate ◽  
Aversive Event ◽  
Necessary Condition ◽  
Facilitation Effect ◽  
Response Facilitation ◽  
Early Training ◽  
Low Rate

The present experiment investigated the effects of noncontingent nonreinforcement as the aversive event in a CER paradigm. The results showed a significant response-facilitation effect during early training, but none during later training with a high rate-producing, high-density reinforcement schedule. The present results imply that a low rate-producing, high-density reinforcement schedule is not a necessary condition for response facilitation.

scholarly journals An Avian Basal Ganglia-Forebrain Circuit Contributes Differentially to Syllable Versus Sequence Variability of Adult Bengalese Finch Song

2009 ◽  
Vol 101 (6) ◽  
pp. 3235-3245 ◽  
Author(s):  
Cara M. Hampton ◽  
Jon T. Sakata ◽  
Michael S. Brainard
Keyword(s):  
Basal Ganglia ◽  
Syllable Structure ◽  
Skill Learning ◽  
Behavioral Variability ◽  
Neural Pathways ◽  
Sequence Variability ◽  
Social Modulation ◽  
The Social ◽  
Learned Behaviors ◽  
Magnocellular Nucleus

Behavioral variability is important for motor skill learning but continues to be present and actively regulated even in well-learned behaviors. In adult songbirds, two types of song variability can persist and are modulated by social context: variability in syllable structure and variability in syllable sequencing. The degree to which the control of both types of adult variability is shared or distinct remains unknown. The output of a basal ganglia-forebrain circuit, LMAN (the lateral magnocellular nucleus of the anterior nidopallium), has been implicated in song variability. For example, in adult zebra finches, neurons in LMAN actively control the variability of syllable structure. It is unclear, however, whether LMAN contributes to variability in adult syllable sequencing because sequence variability in adult zebra finch song is minimal. In contrast, Bengalese finches retain variability in both syllable structure and syllable sequencing into adulthood. We analyzed the effects of LMAN lesions on the variability of syllable structure and sequencing and on the social modulation of these forms of variability in adult Bengalese finches. We found that lesions of LMAN significantly reduced the variability of syllable structure but not of syllable sequencing. We also found that LMAN lesions eliminated the social modulation of the variability of syllable structure but did not detect significant effects on the modulation of sequence variability. These results show that LMAN contributes differentially to syllable versus sequence variability of adult song and suggest that these forms of variability are regulated by distinct neural pathways.

scholarly journals A Bio-inspired Motivational Decision Making System for Social Robots Based on the Perception of the User

Sensors ◽  
2018 ◽  
Vol 18 (8) ◽  
pp. 2691 ◽  
Author(s):  
Marcos Maroto-Gómez ◽  
Álvaro Castro-González ◽  
José Castillo ◽  
María Malfaz ◽  
Miguel Salichs
Keyword(s):  
Decision Making ◽  
Human Robot Interaction ◽  
Learning Mechanisms ◽  
Biologically Inspired ◽  
Robot Interaction ◽  
Detection Mechanism ◽  
Learned Behaviors ◽  
Decision Making System ◽  
Real Robot ◽  
Self Learning

Nowadays, many robotic applications require robots making their own decisions and adapting to different conditions and users. This work presents a biologically inspired decision making system, based on drives, motivations, wellbeing, and self-learning, that governs the behavior of the robot considering both internal and external circumstances. In this paper we state the biological foundations that drove the design of the system, as well as how it has been implemented in a real robot. Following a homeostatic approach, the ultimate goal of the robot is to keep its wellbeing as high as possible. In order to achieve this goal, our decision making system uses learning mechanisms to assess the best action to execute at any moment. Considering that the proposed system has been implemented in a real social robot, human-robot interaction is of paramount importance and the learned behaviors of the robot are oriented to foster the interactions with the user. The operation of the system is shown in a scenario where the robot Mini plays games with a user. In this context, we have included a robust user detection mechanism tailored for short distance interactions. After the learning phase, the robot has learned how to lead the user to interact with it in a natural way.

scholarly journals The Importance of Trials

2019 ◽  
Author(s):  
Justin Harris
Keyword(s):  
Reinforcement Schedule ◽  
Partial Reinforcement ◽  
Continuous Learning ◽  
Reinforcement History ◽  
The Us ◽  
History Information ◽  
Temporal Intervals ◽  
Learning As A Process ◽  
Stored Information ◽  
The Relationship

Many theories of conditioning describe learning as a process by which stored information about the relationship between a conditioned stimulus (CS) and unconditioned stimulus (US) is progressively updated upon each occasion (trial) that the CS occurs with, or without, the US. These simple trial-based descriptions can provide a powerful and efficient means of extracting information about the correlation between two events, but they fail to explain how animals learn about the timing of events. This failure has motivated models of conditioning in which animals learn continuously, either by explicitly representing temporal intervals between events, or by sequentially updating an array of associations between temporally distributed elements of the CS and US. Here, I review evidence that some aspects of conditioning are not the consequence of a continuous learning process but reflect a trial-based process. In particular, the way that animals learn about the absence of a predicted US during extinction suggests that they encode and remember trials as single complete episodes rather than as a continuous experience of unfulfilled expectation of the US. These memories allow the animal to recognise repeated instances of non-reinforcement and encode these as a sequence which, in the case of a partial reinforcement schedule, can become associated with the US. The animal is thus able to remember details about the pattern of a CS’s reinforcement history, information that affects how long the animal continues to respond to the CS when all reinforcement ceases.

scholarly journals Training protocol for touchscreen-based visual discrimination in mice

2020 ◽  
Author(s):  
Kazuhiro Goto ◽  
Yuya Hataji
Keyword(s):  
Visual Discrimination ◽  
Reinforcement Schedule ◽  
Discrimination Performance ◽  
Magazine Training ◽  
Stimulus Position ◽  
Continuous Reinforcement Schedule ◽  
Continuous Reinforcement ◽  
Contrast Discrimination ◽  
And Behavior ◽  
Training Protocol

Automated touchscreen-based tasks are increasingly being used to explore a broad range of issues in learning and behavior in mice. Researchers usually report how they train mice before acquiring the target task concisely, and shaping protocols at this stage are typically flexible. In this report, we described a training protocol, developed in our laboratory, for mice acquiring a simultaneous discrimination performance using visual stimuli. C57BL/6N mice were first given magazine training. Nosepoke responses were then authoshaped and maintained on a continuous reinforcement schedule. Self-start response was then introduced in order to measure response time to complete each trial. The stimulus position was also varied across trials. We finally examined the contrast discrimination performance. Mice were tested with four different contrast ratios. Target stimuli were white and black targets and the brightness of distractors had values between targets and background. All mice successfully went through all training stages, confirming that this training protocol is promising for shaping appropriate discriminative behaviors in mice.

Generalization and Maintenance

2018 ◽  
pp. 93-100
Author(s):  
Karen Bearss ◽  
Cynthia R. Johnson ◽  
Benjamin L. Handen ◽  
Eric Butter ◽  
Luc Lecavalier ◽  
...  
Keyword(s):  
Behavioral Changes ◽  
Data Sheet ◽  
Learned Behaviors

This chapter provides the in-session activity sheets, homework data sheet, and parent handout for the Generalization and Maintenance Session. This session reviews the concepts of generalization and maintenance. These strategies promote continuation of behavioral changes and the extension of learned behaviors from one context to another.

Sign in / Sign up

Export Citation Format

Share Document