scholarly journals Emphasizing the “positive” in positive reinforcement: using nonbinary rewarding for training monkeys on cognitive tasks

2018 ◽  
Vol 120 (1) ◽  
pp. 115-128 ◽  
Author(s):  
Benjamin Fischer ◽  
Detlef Wegener

Nonhuman primates constitute an indispensable model system for studying higher brain functions at the neurophysiological level. Studies involving these animals elucidated the neuronal mechanisms of various cognitive and executive functions, such as visual attention, working memory, and decision-making. Positive reinforcement training (PRT) constitutes the gold standard for training animals on the cognitive tasks employed in these studies. In the laboratory, PRT is usually based on application of a liquid reward as the reinforcer to strengthen the desired behavior and absence of the reward if the animal’s response is wrong. By trial and error, the monkey may adapt its behavior and successfully reduce the number of error trials, and eventually learn even very sophisticated tasks. However, progress and success of the training strongly depend on reasonable error rates. If errors get too frequent, they may cause a drop in the animal’s motivation to cooperate or its adaptation to high error rates and poor overall performance. We introduce in this report an alternative training regime to minimize errors and base the critical information for learning on graded rewarding. For every new task rule, the feedback to the animal is provided by different amounts of reward to distinguish the desired, optimal behavior from less optimal behavior. We applied this regime in different situations during training of visual attention tasks and analyzed behavioral performance and reaction times to evaluate its effectiveness. For both simple and complex behaviors, graded rewarding was found to constitute a powerful technique allowing for effective training without trade-off in accessible task difficulty or task performance. NEW & NOTEWORTHY Laboratory training of monkeys usually builds on providing a fixed amount of reward for the desired behavior, and no reward otherwise. We present a nonbinary, graded reward schedule to emphasize the positive, desired behavior and to keep errors on a moderate level. Using data from typical training situations, we demonstrate that graded rewards help to effectively guide the animal by success rather than errors and provide a powerful new tool for positive reinforcement training.

2017 ◽  
Author(s):  
Benjamin Fischer ◽  
Detlef Wegener

AbstractNon-human primates constitute an indispensable model system for studying higher brain functions at the neurophysiological level. They can be trained on highly demanding cognitive tasks, and studies involving these animals elucidated the neuronal mechanisms of various cognitive and executive functions, such as visual attention, working memory, and decision-making. The training of behavioral tasks used to study these processes builds on reinforcement learning and involves many discrete stages. It may takes several months, but frequently lasts a year or longer. The training is usually based on applying a liquid reward as the reinforcer to strengthen the desired behavior, and absence of the reward if the animal’s response was wrong. We here propose an alternative, non-binary rewarding scheme that aims to minimize unrewarded behavior. We show the potential of this alternative scheme to significantly speed up the training of an animal at various stages, without trade-off in accessible task difficulty or task performance.


Author(s):  
Claus Bundesen ◽  
Thomas Habekost

The theory of visual attention introduced by Bundesen (1990) is reviewed. The authors first describe TVA as a formal computational theory of visual attention and summarize applications of TVA to psychological studies of performance (reaction times and error rates) in healthy human subjects. They then explain their neurophysiological interpretation of TVA, NTVA, and exemplify how NTVA accounts for findings from single-cell studies in primates. Finally the authors review how TVA has been applied to study attentional functions in neuropsychological, pharmacological, and genetic research.


PeerJ ◽  
2018 ◽  
Vol 6 ◽  
pp. e4443 ◽  
Author(s):  
Xiuwen Sun ◽  
Xiaoling Li ◽  
Lingyu Ji ◽  
Feng Han ◽  
Huifen Wang ◽  
...  

Based on the existing research on sound symbolism and crossmodal correspondence, this study proposed an extended research on cross-modal correspondence between various sound attributes and color properties in a group of non-synesthetes. In Experiment 1, we assessed the associations between each property of sounds and colors. Twenty sounds with five auditory properties (pitch, roughness, sharpness, tempo and discontinuity), each varied in four levels, were used as the sound stimuli. Forty-nine colors with different hues, saturation and brightness were used to match to those sounds. Result revealed that besides pitch and tempo, roughness and sharpness also played roles in sound-color correspondence. Reaction times of sound-hue were a little longer than the reaction times of sound-lightness. In Experiment 2, a speeded target discrimination task was used to assess whether the associations between sound attributes and color properties could invoke natural cross-modal correspondence and improve participants’ cognitive efficiency in cognitive tasks. Several typical sound-color pairings were selected according to the results of Experiment 1. Participants were divided into two groups (congruent and incongruent). In each trial participants had to judge whether the presented color could appropriately be associated with the sound stimuli. Result revealed that participants responded more quickly and accurately in the congruent group than in the incongruent group. It was also found that there was no significant difference in reaction times and error rates between sound-hue and sound-lightness. The results of Experiment 1 and 2 indicate the existence of a robust crossmodal correspondence between multiple attributes of sound and color, which also has strong influence on cognitive tasks. The inconsistency of the reaction times between sound-hue and sound-lightness in Experiment 1 and 2 is probably owing to the difference in experimental protocol, which indicates that the complexity of experiment design may be an important factor in crossmodal correspondence phenomena.


1993 ◽  
Vol 16 (3) ◽  
pp. 553-567 ◽  
Author(s):  
B. Fischer ◽  
H. Weber

AbstractOne of the most intriguing and controversial observations in oculomotor research in recent years is the phenomenon of express saccades in monkeys and man. These are saccades with such short reaction times (100 msec in man, 70 msec in monkeys) that some experts on eye movements still regard them as artifacts or as anticipatory reactions that do not need any further explanation. On the other hand, some research groups consider them not only authentic but also a valuable means of investigating the mechanisms of saccade generation, the coordination of vision and eye movements, and the mechanisms of visual attention.This target article puts together pieces of experimental evidence in oculomotor and related research – with special emphasis on the express saccade – to enhance our present understanding of the coordination of vision, visual attention, and the eye movements subserving visual perception and cognition.We hypothesize that an optomotor reflex is responsible for the occurrence of express saccades, one that is controlled by higher brain functions involved in disengaged visual attention and decision making. We propose a neural network as the basis for more elaborate mathematical models or computer simulations of the optomotor system in primates.


2004 ◽  
Vol 9 (1) ◽  
pp. 24-31 ◽  
Author(s):  
Sybille Rockstroh ◽  
Karl Schweizer

Effects of four retest-practice sessions separated by 2 h intervals on the relationship between general intelligence and four reaction time tasks (two memory tests: Sternberg's memory scanning, Posner's letter comparison; and two attention tests: continuous attention, attention switching) were examined in a sample of 83 male participants. Reaction times on all tasks were shortened significantly. The effects were most pronounced with respect to the Posner paradigm and smallest with respect to the Sternberg paradigm. The relationship to general intelligence changed after practice for two reaction time tasks. It increased to significance for continuous attention and decreased for the Posner paradigm. These results indicate that the relationship between psychometric intelligence and elementary cognitive tasks depends on the ability of skill acquisition. In the search for the cognitive roots of intelligence the concept of learning seems to be of importance.


2009 ◽  
Vol 40 (3) ◽  
pp. 433-440 ◽  
Author(s):  
H. W. Chase ◽  
M. J. Frank ◽  
A. Michael ◽  
E. T. Bullmore ◽  
B. J. Sahakian ◽  
...  

BackgroundCentral to understanding of the behavioural consequences of depression has been the theory that the disorder is accompanied by an increased sensitivity to negative compared with positive reinforcement (negative bias), whereas other theorists have emphasized a global reduction in sensitivity to reinforcement in depression (blunting).MethodIn this study, we used a probabilistic selection task that was designed to examine independently rates of learning to predict both positive and negative reinforcement. Twenty-three depressed out-patients and 23 healthy controls from the local population participated in the study.ResultsNo evidence for a negative bias was observed on the task, either during acquisition of the task or during generalization of the learned information. Depressed patients responded slower on the task than controls but showed a similar modulation of reaction times (RTs) as controls following reinforcement. Evidence for blunting was observed on the training phase, as reflected in reduced trial-by-trial adjustment during this phase. However, this effect was related specifically to the severity of anhedonia, as measured by the Snaith–Hamilton Pleasure Scale (SHAPS), and was independent of overall depression severity.ConclusionsWe argue that the observation of a negative bias or blunting in a group of depressed patients may be dependent on the neuropsychological task and the symptoms of the patients tested. Our results provide insight into how these theories might be further tested.


Author(s):  
David A. Atchison ◽  
Carol A. Pedersen ◽  
Stephen J. Dain ◽  
Joanne M. Wood

We investigated the effect of color-vision deficiency on reaction times and accuracy of identification of traffic light signals. Participants were 20 color-normal and 49 color-deficient males, the latter divided into subgroups of different severity and type. Participants performed a tracking task. At random intervals, stimuli simulating standard traffic light signals were presented against a white background at 5° to right or left. Participants identified stimulus color (red/yellow/green) by pressing an appropriate response button. Mean response times for color normals were 525, 410, and 450 ms for red, yellow, and green lights, respectively. For color deficients, response times to red lights increased with increase in severity of color deficiency, with deutans performing worse than protans of similar severity: response times of deuteranopes and protanopes were 53% and 35% longer than those of color normals. A similar pattern occurred for yellow lights, with deuteranopes and protanopes having increased response times of 85% and 53%, respectively. For green lights, response times of all groups were similar. Error rates showed patterns similar to those of response times. Contrary to previous studies, deutans performed much worse than protans of similar severity. Actual or potential applications of this research include traffic signal design and driver licensing.


PeerJ ◽  
2016 ◽  
Vol 4 ◽  
pp. e2184 ◽  
Author(s):  
Jim Lumsden ◽  
Andy Skinner ◽  
Andy T. Woods ◽  
Natalia S. Lawrence ◽  
Marcus Munafò

Computerised cognitive assessments are a vital tool in the behavioural sciences, but participants often view them as effortful and unengaging. One potential solution is to add gamelike elements to these tasks in order to make them more intrinsically enjoyable, and some researchers have posited that a more engaging task might produce higher quality data. This assumption, however, remains largely untested. We investigated the effects of gamelike features and test location on the data and enjoyment ratings from a simple cognitive task. We tested three gamified variants of the Go-No-Go task, delivered both in the laboratory and online. In the first version of the task participants were rewarded with points for performing optimally. The second version of the task was framed as a cowboy shootout. The third version was a standard Go-No-Go task, used as a control condition. We compared reaction time, accuracy and subjective measures of enjoyment and engagement between task variants and study location. We found points to be a highly suitable game mechanic for gamified cognitive testing because they did not disrupt the validity of the data collected but increased participant enjoyment. However, we found no evidence that gamelike features could increase engagement to the point where participant performance improved. We also found that while participants enjoyed the cowboy themed task, the difficulty of categorising the gamelike stimuli adversely affected participant performance, increasing No-Go error rates by 28% compared to the non-game control. Responses collected online vs. in the laboratory had slightly longer reaction times but were otherwise very similar, supporting other findings that online crowdsourcing is an acceptable method of data collection for this type of research.


2020 ◽  
Author(s):  
Jeff Miller

Contrary to the warning of Miller (1988), Rousselet and Wilcox (2020) argued that it is better to summarize each participant’s single-trial reaction times (RTs) in a given condition with the median than with the mean when comparing the central tendencies of RT distributions across experimental conditions. They acknowledged that median RTs can produce inflated Type I error rates when conditions differ in the number of trials tested, consistent with Miller’s warning, but they showed that the bias responsible for this error rate inflation could be eliminated with a bootstrap bias correction technique. The present simulations extend their analysis by examining the power of bias-corrected medians to detect true experimental effects and by comparing this power with the power of analyses using means and regular medians. Unfortunately, although bias-corrected medians solve the problem of inflated Type I error rates, their power is lower than that of means or regular medians in many realistic situations. In addition, even when conditions do not differ in the number of trials tested, the power of tests (e.g., t-tests) is generally lower using medians rather than means as the summary measures. Thus, the present simulations demonstrate that summary means will often provide the most powerful test for differences between conditions, and they show what aspects of the RT distributions determine the size of the power advantage for means.


Sign in / Sign up

Export Citation Format

Share Document