Pavlovian and Instrumental Conditioning

2021 ◽  
Author(s):  
Federico Sanabria
Keyword(s):  
Conditional Probability ◽  
Positive Reinforcement ◽  
Negative Reinforcement ◽  
Instrumental Conditioning ◽  
Prior Experience ◽  
Time Interval ◽  
Inhibitory Conditioning ◽  
The Difference ◽  
Contextual Stimuli ◽  
Societal Problems

Conditioning is the change in the response to a stimulus either because of the relation of that stimulus to other stimuli (Pavlovian conditioning), or because of the relation between the response and other stimuli (instrumental conditioning). These relations are formulated in terms of differences in conditional probability known as contingencies. Pavlovian contingencies refer to the difference in the conditional probability of one stimulus (the outcome, or O) given the presence vs. the absence of another stimulus (the conditioned stimulus, or CS). A conditioned response (CR) may be strengthened by a positive Pavlovian contingency (excitatory conditioning) or it may be weakened by a negative Pavlovian contingency (inhibitory conditioning). CRs are anticipatory or modified responses to the O, so their topography depends on the nature of the O (appetitive vs. aversive); the proximity between and congruency of O and CS; prior experience with the CS, O, and their contingency; the magnitude of their contingency; and the characteristics of other stimuli in the environment. Instrumental contingencies refer to the relation between one stimulus (the discriminative stimulus, or SD), a response (or operant, R), and the outcome of that response (O). The nature of the O and of its contingency with the R determines whether the O strengthens or weakens the R: Os that introduce an appetitive stimulus (positive reinforcement) or remove an aversive stimulus (negative reinforcement) strengthen the R. Positive reinforcement is typically arranged on a subset of one or more Rs following a set of rules known as a schedule of reinforcement. The probability that an R is reinforced may depend on the number of Rs (ratio schedules) or the amount of time (interval schedules) since the last reinforcer. The topography and strength of instrumental Rs depend on variables that are analogous to those that affect Pavlovian CRs: the amount and nature of prior experience with the O; the proximity, congruency, and contingency of R and O; and characteristics of other stimuli in past and present environments. Contemporary quantitative models of Pavlovian and instrumental conditioning recognize the importance of contextual stimuli that compete for cognitive and behavioral resources, constraining and shaping the expression of target responses. These models have guided the bulk of recent empirical research and conceptual developments, leading to a progressively unified view of learning and motivation processes. Along the way, Pavlovian and instrumental research have demonstrated their utility in addressing a broad range of consequential societal problems.

scholarly journals Emotional State and Feedback-Related Negativity Induced by Positive, Negative, and Combined Reinforcement

2021 ◽  
Vol 12 ◽  
Author(s):  
Shuyuan Xu ◽  
Yuyan Sun ◽  
Min Huang ◽  
Yanhong Huang ◽  
Jing Han ◽  
...  
Keyword(s):  
Positive Reinforcement ◽  
Negative Reinforcement ◽  
Learning Task ◽  
Dopamine System ◽  
Feedback Processing ◽  
Difference Wave ◽  
Avoidance Motivation ◽  
Before And After ◽  
The Difference ◽  
Midbrain Dopamine

Reinforcement learning relies on the reward prediction error (RPE) signals conveyed by the midbrain dopamine system. Previous studies showed that dopamine plays an important role in both positive and negative reinforcement. However, whether various reinforcement processes will induce distinct learning signals is still unclear. In a probabilistic learning task, we examined RPE signals in different reinforcement types using an electrophysiology index, namely, the feedback-related negativity (FRN). Ninety-four participants were randomly assigned into four groups: base (no money incentive), positive reinforcement (presentation of money rewards), negative reinforcement (removal of money losses), and combined reinforcement (money rewards and removal of money losses) groups. In addition, in order to evaluate the engagement of emotional activity in the different reinforcement processes, Positive and Negative Affect Schedule-Expanded Form (PANAS-X) scales were applied before and after the experiment to detect the emotional changes. The results showed that there was no difference between groups in the dopamine-related learning bias. However, compared to the other three groups, negative reinforcement elicited smaller FRN (the difference-wave measure) during the learning, stronger positive affect and joviality, and less fatigue after the learning, in which the difference between the negative and positive reinforcement groups was smaller. The results indicated that pure avoidance motivation may induce distinct emotional fluctuations, which influence the feedback processing.

scholarly journals A scoping review of chronotype and temporal patterns of eating of adults: Tools used, findings, and future directions

2021 ◽  
pp. 1-51
Author(s):  
Yan Yin Phoi ◽  
Michelle Rogers ◽  
Maxine P. Bonham ◽  
Jillian Dorrian ◽  
Alison M. Coates
Keyword(s):  
Energy Intake ◽  
Scoping Review ◽  
Assessment Tool ◽  
Temporal Patterns ◽  
Time Interval ◽  
Dark Cycle ◽  
Future Directions ◽  
Meal Skipping ◽  
Optimal Health ◽  
The Difference

Abstract Circadian rhythms, metabolic processes, and dietary intake are inextricably linked. Timing of food intake is a modifiable temporal cue for the circadian system and may be influenced by numerous factors, including individual chronotype—an indicator of an individual’s circadian rhythm in relation to the light-dark cycle. This scoping review examines temporal patterns of eating across chronotypes and assesses tools that have been used to collect data on temporal patterns of eating and chronotype. A systematic search identified thirty-six studies in which aspects of temporal patterns of eating including meal timings; meal skipping; energy distribution across the day; meal frequency; time interval between meals, or meals and wake/sleep times; midpoint of food/energy intake; meal regularity; and duration of eating window were presented in relation to chronotype. Findings indicate that compared to morning chronotypes, evening chronotypes tend to skip meals more frequently, have later mealtimes, and distribute greater energy intake towards later times of the day. More studies should explore the difference in meal regularity and duration of eating window amongst chronotypes. Currently, tools used in collecting data on chronotype and temporal patterns of eating are varied, limiting the direct comparison of findings between studies. Development of a standardised assessment tool will allow future studies to confidently compare findings to inform the development and assessment of guidelines that provide recommendations on temporal patterns of eating for optimal health.

scholarly journals Two maize cultivars of contrasting leaf size show different leaf elongation rates with identical patterns of extension dynamics and coordination

AoB Plants ◽  
2021 ◽  
Author(s):  
Tiphaine Vidal ◽  
Hafssa Aissaoui ◽  
Sabrina Rehali ◽  
Bruno Andrieu
Keyword(s):  
Genotypic Variation ◽  
Leaf Size ◽  
High Rate ◽  
Time Interval ◽  
Extension Rate ◽  
Leaf Production ◽  
Maize Cultivars ◽  
Plant Environment ◽  
The Difference ◽  
Leaf Extension

Abstract Simulating leaf development from initiation to maturity opens new possibilities to model plant–environment interactions and the plasticity of plant architecture. This study analyses the dynamics of leaf production and extension along a maize (Zea mays) shoot to assess important modelling choices. Maize plants from two cultivars originating from the same inbred line, yet differing in the length of mature leaves were used in this study. We characterised the dynamics of the blade and sheath lengths of all phytomers by dissecting plants every 2–3 days. We analysed how differences in leaf size were built up and we examined the coordination between the emergence of organs and phases of their extension. Leaf extension rates were higher in the cultivar with longer leaves than in the cultivar with shorter leaves; no differences were found in other aspects. We found that (i) first post-embryonic leaves were initiated at a markedly higher rate than upper leaves; (ii) below ear position, sheaths were initiated at a time intermediate between tip emergence and appearance, while above the ear position, sheaths were initiated at a high rate, such that the time interval between the blade and sheath initiations decreased for these leaves; and (iii) ear position also marked a change in the correlation in size between successive phytomers with little correlation of size between upper and lower leaves. Our results identified leaf extension rate as the reason for the difference in size between the two cultivars. The two cultivars shared the same pattern for the timing of initiation events, which was more complex than previously thought. The differences described here may explain some inaccuracies reported in functional-structural plant models. We speculate that genotypic variation in behaviour for leaf and sheath initiation exists, which has been little documented in former studies.

Inhibitory Conditioning Resulting from a Reduction in the Magnitude of Reinforcement

1982 ◽  
Vol 34 (3b) ◽  
pp. 163-180 ◽  
Author(s):  
M. M. Cotton ◽  
Glyn Goodall ◽  
N. J. Mackintosh
Keyword(s):  
Stimulus Control ◽  
Shock Intensity ◽  
Conditioned Suppression ◽  
Summation Test ◽  
Control Group ◽  
Conditioned Inhibitor ◽  
Inhibitory Conditioning ◽  
Experimental Subjects ◽  
The Difference

Five experiments, all employing conditioned suppression in rats, studied inhibitory conditioning to a stimulus signalling a reduction in shock intensity. Experimental subjects were conditioned to a tone signalling a 1·0 mA shock and to a tone-light compound signalling a 0·4 mA shock. On a summation test in which it alleviated the suppression maintained by a third stimulus also associated with the 1·0 mA shock, the light was established as a conditioned inhibitor. Retardation tests gave ambiguous results: the light was relatively slow to condition when paired, either alone or in conjunction with another stimulus, with the 0·4 mA shock, but the difference from a novel stimulus control group was not significant. Two final experiments found no evidence at all of inhibition on a summation test in which the light was presented in conjunction with a stimulus that had itself been associated with the 0·4 mA shock. The results of these experiments have implications for the question of what animals learn during the course of inhibitory conditioning.

LONG‐TIME RESPONSE PREDICTED BY EXACT ELASTIC RAY THEORY

Geophysics ◽  
1965 ◽  
Vol 30 (3) ◽  
pp. 363-368 ◽  
Author(s):  
T. W. Spencer
Keyword(s):  
Formal Solution ◽  
Intermediate Stage ◽  
Time Limit ◽  
Time Interval ◽  
Individual Response ◽  
Axially Symmetric ◽  
Long Time ◽  
The Difference ◽  
The Individual ◽  
Significant Figures

The formal solution for an axially symmetric radiation field in a multilayered, elastic system can be expanded in an infinite series. Each term in the series is associated with a particular raypath. It is shown that in the long‐time limit the individual response functions produced by a step input in particle velocity are given by polynomials in odd powers of the time. For rays which suffer m reflections, the degree of the polynomials is 2m+1. The total response is obtained by summing all rays which contribute in a specified time interval. When the rays are selected indiscriminately, the difference between the magnitude of the partial sum at an intermediate stage of computation and the magnitude of the correct total sum may be greater than the number of significant figures carried by the computer. A prescription is stated for arranging the rays into groups. Each group response function varies linearly in the long‐time limit and goes to zero when convolved with a physically realizable source function.

Contiguous Approach Conditioning: A Model for Negative Reinforcement

1975 ◽  
Vol 37 (3) ◽  
pp. 851-856 ◽  
Author(s):  
Ernest G. Maples ◽  
Phillip D. Tomporowski ◽  
Maury M. Haraway
Keyword(s):  
Test Trial ◽  
Negative Reinforcement ◽  
Shock Termination ◽  
Single Test ◽  
Empirical Basis ◽  
Equivalent Number ◽  
The Difference

The study was designed to provide an empirical basis for Denny's account of negative reinforcement by showing that stimuli contiguously paired with shock termination can become conditioned elicitors of approach. 20 experimental Ss received 15 trials in which the onset of a 6-w light was paired with the termination of a 30-sec., 1-ma. scrambled shock, independently of Ss' behavior. 20 control Ss received an equivalent number of light and shock presentations, but these were unpaired. On a single test trial, S was exposed to a 6 w light in one arm (randomly selected) of a modified T-maze. 17 of 20 experimental Ss approached the light whereas only 11 of 20 control Ss approached the light. The difference between proportions was significant ( p = .05).

scholarly journals The reproducibility of subjective appetite scores

1995 ◽  
Vol 73 (4) ◽  
pp. 517-530 ◽  
Author(s):  
Anne Raben ◽  
ANNA TAGLIABUE ◽  
Arne Astrup
Keyword(s):  
Visual Analogue Scale ◽  
Food Consumption ◽  
Analogue Scale ◽  
Prior Experience ◽  
Random Noise ◽  
Normal Weight ◽  
Vas Scores ◽  
The Mean ◽  
The Difference ◽  
Mean Differences

Although subjective appetite scores are widely used, studies on the reproducibility of this method are scarce. In the present study nine healthy, normal weight, young men recorded their subjective appetite sensations before and during 5 h after two different test meals A and B. The subjects tested each meal twice and in randomized order. Visual analogue scale (VAS) scores, 10 cm in length, were used to assess hunger, satiety, fullness, prospective food consumption and palatability of the meals. Plasma glucose and lactate concentrations were determined concomitantly. The repeatability was investigated for fasting values, Δ-mean 5 h and mean 5 h values, Δ-peak/nadir and peak/nadir values. Although the profiles of the postprandial responses were similar, the coefficients of repeatability (CR = 2SD) on the mean differences were large, ranging from 2·86 to 5.24 cm for fasting scores, 1·36 to 1·88 cm for mean scores, 2·98 to 5·42 cm for Δ-mean scores, and 3·16 to 6·44 cm for peak and Δ-peak scores. For palatability ratings the CK values varied more, ranging from 2·38 (taste) to 8·70 cm (aftertaste). Part of the difference in satiety ratings could be explained by the differences in palatability ratings. However, the low reproducibility may also be caused by a conditioned satiation or hunger due to the subjects' prior experience of the meals and therefore not just be a reflection of random noise. It is likely, however, that the variation in appetite ratings is due both to methodological day-to-day variation and to biological day-to-day variation in subjective appetite sensations.

Synchronization of cardiac-related discharges of sympathetic nerves with inputs from widely separated spinal segments

1995 ◽  
Vol 268 (6) ◽  
pp. R1472-R1483 ◽  
Author(s):  
G. L. Gebber ◽  
S. Zhong ◽  
S. M. Barman
Keyword(s):  
Phase Angle ◽  
Cervical Spinal Cord ◽  
Sympathetic Nerves ◽  
Time Interval ◽  
Renal Nerve ◽  
Cardiac Nerve ◽  
Spinal Segments ◽  
The Difference ◽  
Decerebrate Cats ◽  
Inferior Cardiac Nerve

We used phase spectral analysis to study the relationships between the cardiac-related discharges of pairs of postganglionic sympathetic nerves in urethan-anesthetized or decerebrate cats. Phase angle when converted to a time interval should equal the difference in conduction times from the brain to the nerves (i.e., transportation lag) if their cardiac-related discharges have a common central source. Transportation lag was estimated as the difference in the onset latencies of activation of the nerves by electrical stimulation of the medulla or cervical spinal cord. The phase angle for the cardiac-related discharges of two nerves was not always equivalent in time to the transportation lag. For example, in some cases the cardiac-related discharges of the renal nerve were coincident with or led those of the inferior cardiac nerve. In contrast, the electrically evoked responses of the renal nerve lagged those of the inferior cardiac nerve by > or = 32 ms. These observations are consistent with a model of multiple and dynamically coupled brain stem generators of the cardiac-related rhythm, each controlling a different sympathetic nerve or exerting nonuniform influences on different portions of the spinal sympathetic outflow.

scholarly journals The effect of diminazene aceturate on cholinesterase activity in dogs with canine babesiosis

1997 ◽  
Vol 68 (4) ◽  
Author(s):  
R.J. Milner ◽  
F. Reyers ◽  
J.H. Taylor ◽  
J.S. Van den Berg
Keyword(s):  
Treatment Group ◽  
Underlying Mechanism ◽  
Time Interval ◽  
Control Groups ◽  
Canine Babesiosis ◽  
Diminazene Aceturate ◽  
Time Intervals ◽  
Significant Depression ◽  
The Difference ◽  
And Control

A clinical trial was designed to evaluate the effects of diminazene aceturate and its stabiliser antipyrine on serum pseudocholinesterase (PChE) and red blood cell acetylcholinesterase (RBC AChE) in dogs with babesiosis. The trial was conducted on naturally occurring, uncomplicated cases of babesiosis (n = 20) that were randomly allocated to groups receiving a standard therapeutic dose of diminazene aceturate with antipyrine stabiliser (n = 10) or antipyrine alone (n = 10). Blood was drawn immediately before and every 15 minutes for 1 hour after treatment. Plasma PChE showed a 4 % decrease between 0 and 60 min within the treatment group (p < 0.05). No statistically significant differences were found between the treatment and control groups at any of the time intervals for PChE. There was an increase in RBC AChE activity at 15 min in the treatment group (p < 0.05). No significant differences were found between the treatment and control groups at any time interval for RBC AChE. In view of the difference in PChE, samples from additional, new cases (n = 10) of canine babesiosis were collected to identify the affect of the drug over 12 hours. No significant depression was identified over this time interval. The results suggests that the underlying mechanism in producing side-effects, when they do occur, is unlikely to be through cholinesterase depression.

Sign in / Sign up

Export Citation Format

Share Document