Associative Reactivation of Place–Reward Information in the Hippocampal–Ventral Striatal Circuitry

2014 ◽  
pp. 81-104
Author(s):  
Carien S. Lansink ◽  
Cyriel M. A. Pennartz
Keyword(s):  
Reward Information

scholarly journals Salience-driven value construction for adaptive choice under risk

2018 ◽  
Author(s):  
Mehran Spitmaan ◽  
Emily Chu ◽  
Alireza Soltani
Keyword(s):  
Reward Magnitude ◽  
Human Subjects ◽  
Real Life ◽  
Individual Outcomes ◽  
Single Piece ◽  
Differential Weighting ◽  
Adaptive Choice ◽  
Plausible Mechanism ◽  
Reward Information ◽  
Adaptive Decision Making

Decisions we face in real life are inherently risky and can result in one of many possible outcomes. However, most of what we know about choice under risk is based on studies that use options with only two possible outcomes (simple gambles), so it remains unclear how the brain constructs reward values for more complex risky options faced in real life. To address this question, we combined experimental and modeling approaches to examine choice between pairs of simple gambles and pairs of three-outcome gambles in male and female human subjects. We found that subjects evaluated individual outcomes of three-outcome gambles by multiplying functions of reward magnitude and probability. To construct the overall value of each gamble, however, most subjects differentially weighted possible outcomes based on either reward magnitude or probability. These results reveal a novel dissociation between how reward information is processed when evaluating complex gambles: valuation of each outcome is based on an integrated value whereas combination of possible outcomes relies on a single piece of reward information. We show that differential weighting of possible outcomes enabled subjects to make decisions more easily and quickly. Together, these findings reveal a plausible mechanism for how salience, in terms of possible reward magnitude or probability, can influence the construction of subjective values for complex gambles. They also point to separable neural mechanisms for how reward value controls choice and attention in order to allow for more adaptive decision making.

scholarly journals Testing differential use of payoff-biased social learning strategies in children and chimpanzees

2017 ◽  
Vol 284 (1868) ◽  
pp. 20171751 ◽  
Author(s):  
Gillian L. Vale ◽  
Emma G. Flynn ◽  
Jeremy Kendal ◽  
Bruce Rawlings ◽  
Lydia M. Hopper ◽  
...  
Keyword(s):  
Social Learning ◽  
Learning Strategies ◽  
Cultural Transmission ◽  
The Difference ◽  
Beneficial Traits ◽  
Children’S Behaviour ◽  
Social Exposure ◽  
Reward Information ◽  
Social Learning Strategies ◽  
Exchange Behaviour

Various non-human animal species have been shown to exhibit behavioural traditions. Importantly, this research has been guided by what we know of human culture, and the question of whether animal cultures may be homologous or analogous to our own culture. In this paper, we assess whether models of human cultural transmission are relevant to understanding biological fundamentals by investigating whether accounts of human payoff-biased social learning are relevant to chimpanzees ( Pan troglodytes ). We submitted 4- and 5-year-old children ( N = 90) and captive chimpanzees ( N = 69) to a token–reward exchange task. The results revealed different forms of payoff-biased learning across species and contexts. Specifically, following personal and social exposure to different tokens, children's exchange behaviour was consistent with proportional imitation, where choice is affected by both prior personally acquired and socially demonstrated token–reward information. However, when the socially derived information regarding token value was novel, children's behaviour was consistent with proportional observation; paying attention to socially derived information and ignoring their prior personal experience. By contrast, chimpanzees' token choice was governed by their own prior experience only, with no effect of social demonstration on token choice, conforming to proportional reservation. We also find evidence for individual- and group-level differences in behaviour in both species. Despite the difference in payoff strategies used, both chimpanzees and children adopted beneficial traits when available. However, the strategies of the children are expected to be the most beneficial in promoting flexible behaviour by enabling existing behaviours to be updated or replaced with new and often superior ones.

Orbitofrontal cortex output pathways: cingulate cortex, basal ganglia, and dopamine

2019 ◽  
pp. 145-164
Author(s):  
Edmund T. Rolls
Keyword(s):  
Orbitofrontal Cortex ◽  
Instrumental Learning ◽  
Cingulate Cortex ◽  
Reward Processing ◽  
Dopamine Neurons ◽  
Anterior Cingulate ◽  
Stimulus Response ◽  
Related Information ◽  
Outcome Information ◽  
Reward Information

The medial orbitofrontal cortex projects reward-related information to the pregenual cingulate cortex, and the lateral orbitofrontal cortex projects punishment and non-reward information to the supracallosal anterior cingulate cortex. These projections provide the reward outcome information needed for action-outcome goal value dependent instrumental learning by the cingulate cortex. The orbitofrontal cortex also projects reward-related information to the striatum for stimulus-response habit learning. Via the striatal route, and further in part via the habenula, the orbitofrontal cortex provides information about rewards and non-rewards that reached the brainstem dopamine neurons, some of which respond to positive reward prediction error, and the serotonin (5HT) neurons. The orbitofrontal cortex is therefore perhaps the key brain region involved in reward processing in the brain. The orbitofrontal cortex also has projections that can influence autonomic function, in part via the insula.

scholarly journals Flexible combination of reward information across primates

2019 ◽  
Vol 3 (11) ◽  
pp. 1215-1224 ◽  
Author(s):  
Shiva Farashahi ◽  
Christopher H. Donahue ◽  
Benjamin Y. Hayden ◽  
Daeyeol Lee ◽  
Alireza Soltani
Keyword(s):  
Reward Information

Spatial representations of self and other in the hippocampus

Science ◽  
2018 ◽  
Vol 359 (6372) ◽  
pp. 213-218 ◽  
Author(s):  
Teruko Danjo ◽  
Taro Toyoizumi ◽  
Shigeyoshi Fujisawa
Keyword(s):  
Receptive Fields ◽  
Pyramidal Cells ◽  
Spatial Location ◽  
The Self ◽  
The Other ◽  
Spatial Representations ◽  
Self And Other ◽  
Ca1 Pyramidal Cells ◽  
Ca1 Region ◽  
Reward Information

An animal’s awareness of its location in space depends on the activity of place cells in the hippocampus. How the brain encodes the spatial position of others has not yet been identified. We investigated neuronal representations of other animals’ locations in the dorsal CA1 region of the hippocampus with an observational T-maze task in which one rat was required to observe another rat’s trajectory to successfully retrieve a reward. Information reflecting the spatial location of both the self and the other was jointly and discretely encoded by CA1 pyramidal cells in the observer rat. A subset of CA1 pyramidal cells exhibited spatial receptive fields that were identical for the self and the other. These findings demonstrate that hippocampal spatial representations include dimensions for both self and nonself.

scholarly journals A neuronal reward inequity signal in primate striatum

2016 ◽  
Vol 115 (1) ◽  
pp. 68-79 ◽  
Author(s):  
Raymundo Báez-Mendoza ◽  
Charlotte R. van Coeverden ◽  
Wolfram Schultz
Keyword(s):  
Social Interactions ◽  
Rhesus Monkeys ◽  
Response Times ◽  
Decision Variable ◽  
Striatal Neurons ◽  
Sensitivity To Reward ◽  
Neuronal Mechanisms ◽  
Behavioral Sensitivity ◽  
Reward Information ◽  
Goal Directed Behavior

Primates are social animals, and their survival depends on social interactions with others. Especially important for social interactions and welfare is the observation of rewards obtained by other individuals and the comparison with own reward. The fundamental social decision variable for the comparison process is reward inequity, defined by an asymmetric reward distribution among individuals. An important brain structure for coding reward inequity may be the striatum, a component of the basal ganglia involved in goal-directed behavior. Two rhesus monkeys were seated opposite each other and contacted a touch-sensitive table placed between them to obtain specific magnitudes of reward that were equally or unequally distributed among them. Response times in one of the animals demonstrated differential behavioral sensitivity to reward inequity. A group of neurons in the striatum showed distinct signals reflecting disadvantageous and advantageous reward inequity. These neuronal signals occurred irrespective of, or in conjunction with, own reward coding. These data demonstrate that striatal neurons of macaque monkeys sense the differences between other's and own reward. The neuronal activities are likely to contribute crucial reward information to neuronal mechanisms involved in social interactions.

scholarly journals I judge you by your profit: Judgments of effort exerted by self and others are influenced by received rewards

2018 ◽  
Author(s):  
Max Rollwage ◽  
Franziska Pannach ◽  
Caedyn Stinson ◽  
Ulf Toelch ◽  
Igor Kagan ◽  
...  
Keyword(s):  
Decision Making ◽  
Adaptive Learning ◽  
Major Part ◽  
Information Sources ◽  
Computational Modelling ◽  
Cost Benefit ◽  
Social Contexts ◽  
The Other ◽  
Reward Information ◽  
Effort Rating

AbstractEffort constitutes a major part of cost-benefit calculations underlying decision making. Therefore, estimating the effort someone has spent on a task is a core dimension for evaluating own and others’ actions. It has been previously shown that self-judgments of effort are influenced by the magnitude of obtained rewards. It is unclear, however, whether the influence of reward on effort estimations is limited to self-judgments or whether reward incorporation represents a general computational principle when judging effort. Here we show that people also integrate reward magnitude when judging the effort exerted by others. Participants (N=48) performed an effortful sensorimotor task interleaved with a partner, while rating either their own or the other person’s effort. After each trial but before the effort rating, both participants were informed about the obtained reward. We found that higher rewards led to higher estimations of exerted effort, in self-as well as other-judgments, and this effect was more pronounced for other-judgments. In both types of judgment, computational modelling revealed that reward information and the perceived level of exertion were combined in a Bayes optimal manner to form effort estimates. Remarkably, the extent to which rewards influenced effort judgments was positively correlated with conservative world-views, indicating that the basic computations underlying this behavioural phenomenon might be related to more general beliefs about the association between effort and reward in the society. The integration of reward information into retrospective effort judgments underscores the convergence of multiple information sources that supports adaptive learning and decision making in social contexts.

scholarly journals Orthogonal Representations of Reward Magnitude, Certainty, and Volatility in the Macaque Orbitofrontal Cortex

2018 ◽  
Author(s):  
Tianming Yang ◽  
Elisabeth A. Murray
Keyword(s):  
Reward Magnitude ◽  
Orbitofrontal Cortex ◽  
Stimulus Presentation ◽  
Two Dimensions ◽  
Foraging Strategies ◽  
General Role ◽  
Decision Variables ◽  
Categorical Knowledge ◽  
Reward Information ◽  
The Brain

AbstractCategorical knowledge about the probabilistic and volatile nature of resource availability can improve foraging strategies, yet we have little understanding of how the brain represents such knowledge. Neurons in the orbitofrontal cortex (OFC) of macaques encode several decision variables (e.g., reward magnitude, probability) that could influence choice behavior. Here we investigated whether OFC neurons also represent two aspects of reward predictability: certainty and volatility. Rhesus monkeys performed a visual stimulus-reward association task in which a set of simple shapes preceded the delivery of reward, and they learned the nature of each shape’s reward association along two dimensions. One involved the certainty of a reward outcome; rewards can be either deterministic (and therefore certain) or probabilistic (uncertain). A second dimension reflected the volatility of an outcome; reward schedules can be either stable over time or volatile. During stimulus presentation, the activity of OFC neurons reflected both categorical certainty and categorical volatility, in addition to reward magnitude. These three characteristics were represented orthogonally by three distinct neural populations of similar size. These findings point to a more general role for OFC in processing reward information than one restricted to encoding parametric valuations such as reward magnitude and probability.

Sign in / Sign up

Export Citation Format

Share Document