scholarly journals A neurocomputational model for intrinsic reward

2019 ◽  
Author(s):  
Benjamin Chew ◽  
Bastien Blain ◽  
Raymond J Dolan ◽  
Robb B Rutledge
Keyword(s):  
Neural Activity ◽  
Affective State ◽  
Computational Modelling ◽  
Well Being ◽  
Learning Performance ◽  
Extrinsic Rewards ◽  
Intrinsic Rewards ◽  
Intrinsic Reward ◽  
Reward Value ◽  
Affective Dynamics

SUMMARYStandard economic indicators provide an incomplete picture of what we value both as individuals and as a society. Furthermore, canonical macroeconomic measures, such as GDP, do not account for non-market activities (e.g., cooking, childcare) that nevertheless impact well-being. Here, we introduce a computational tool that measures the subjective reward value of experiences (e.g., playing a musical instrument without errors). We go on to validate this tool with neural data, using fMRI to measure neural activity in subjects performing a reinforcement learning task that incorporated periodic ratings of subjective affective state. Learning performance determined level of payment (i.e., extrinsic reward). Crucially, the task also incorporated a skilled performance component (i.e., intrinsic reward) which did not influence payment. Both extrinsic and intrinsic rewards influenced affective dynamics, and their relative influence could be captured in our computational model. Individuals for whom intrinsic rewards had a greater influence on affective state than extrinsic rewards had greater ventromedial prefrontal cortex (vmPFC) activity for intrinsic than extrinsic rewards. Thus, we show that computational modelling of affective dynamics can index the subjective value of intrinsic relative to extrinsic rewards, a ‘computational hedonometer’ that reflects both behavior and neural activity that quantifies the subjective reward value of experience.

scholarly journals A neural link between affective understanding and interpersonal attraction

2016 ◽  
Vol 113 (16) ◽  
pp. E2248-E2257 ◽  
Author(s):  
Silke Anders ◽  
Roos de Jong ◽  
Christian Beck ◽  
John-Dylan Haynes ◽  
Thomas Ethofer
Keyword(s):  
Neural Activity ◽  
Interpersonal Attraction ◽  
Affective State ◽  
Neural Mechanism ◽  
Reward System ◽  
Mental States ◽  
Neural Representation ◽  
Affective Behavior ◽  
Intrinsic Reward ◽  
Social Encounters

Being able to comprehend another person’s intentions and emotions is essential for successful social interaction. However, it is currently unknown whether the human brain possesses a neural mechanism that attracts people to others whose mental states they can easily understand. Here we show that the degree to which a person feels attracted to another person can change while they observe the other’s affective behavior, and that these changes depend on the observer’s confidence in having correctly understood the other’s affective state. At the neural level, changes in interpersonal attraction were predicted by activity in the reward system of the observer’s brain. Importantly, these effects were specific to individual observer–target pairs and could not be explained by a target’s general attractiveness or expressivity. Furthermore, using multivoxel pattern analysis (MVPA), we found that neural activity in the reward system of the observer’s brain varied as a function of how well the target’s affective behavior matched the observer’s neural representation of the underlying affective state: The greater the match, the larger the brain’s intrinsic reward signal. Taken together, these findings provide evidence that reward-related neural activity during social encounters signals how well an individual’s “neural vocabulary” is suited to infer another person’s affective state, and that this intrinsic reward might be a source of changes in interpersonal attraction.

scholarly journals Mega-Reward: Achieving Human-Level Play without Extrinsic Rewards

2020 ◽  
Vol 34 (04) ◽  
pp. 5826-5833
Author(s):  
Yuhang Song ◽  
Jianyi Wang ◽  
Thomas Lukasiewicz ◽  
Zhenghua Xu ◽  
Shangtong Zhang ◽  
...  
Keyword(s):  
State Of The Art ◽  
Experimental Studies ◽  
Superior Performance ◽  
Human Intelligence ◽  
Transition Model ◽  
Extrinsic Rewards ◽  
Intrinsic Rewards ◽  
Intrinsic Reward ◽  
Level Performance

Intrinsic rewards were introduced to simulate how human intelligence works; they are usually evaluated by intrinsically-motivated play, i.e., playing games without extrinsic rewards but evaluated with extrinsic rewards. However, none of the existing intrinsic reward approaches can achieve human-level performance under this very challenging setting of intrinsically-motivated play. In this work, we propose a novel megalomania-driven intrinsic reward (called mega-reward), which, to our knowledge, is the first approach that achieves human-level performance in intrinsically-motivated play. Intuitively, mega-reward comes from the observation that infants' intelligence develops when they try to gain more control on entities in an environment; therefore, mega-reward aims to maximize the control capabilities of agents on given entities in a given environment. To formalize mega-reward, a relational transition model is proposed to bridge the gaps between direct and latent control. Experimental studies show that mega-reward (i) can greatly outperform all state-of-the-art intrinsic reward approaches, (ii) generally achieves the same level of performance as Ex-PPO and professional human-level scores, and (iii) has also a superior performance when it is incorporated with extrinsic rewards.

Liderança e Programas de Recompensas: limites e possibilidades.

2009 ◽  
Vol 13 (3) ◽  
pp. 26
Author(s):  
Dione Fagundes Nunes Gomes ◽  
Maria Cristina Sanches Amorim
Keyword(s):  
Business Administration ◽  
Leadership Team ◽  
Reward Systems ◽  
Critical Reading ◽  
Extrinsic Rewards ◽  
Intrinsic Rewards ◽  
Intrinsic Reward ◽  
Reward Programs ◽  
Prolific Authors

There are many theories about leadership that converge on the importance of motivation as an attribution to the leader. There are two models of motivation: intrinsic and extrinsic. Although both of them deal with rewards, their execution is not the same. The aim of this study is to analyze the limits and possibilities of the reward programs used by the leadership team within organizations. According to some non-behaviorist’s authors, the extrinsic rewards are translated as manipulating ways or bribes, in order to favor those who hold the power. To some behaviorists, the organization of extrinsic and intrinsic reward systems is the method of choice to motivate, which should be used by the leader. Our thoughts point to the possibilities of a balanced and planned use of the extrinsic and intrinsic rewards, taking into consideration the context, goals and the duration of the group. We used as methodology the study of very prolific authors within the business administration courses, focusing on placing our contribution for the critical reading of this public.

scholarly journals Investigating ‘Fear of Missing Out’ (FOMO) as an extrinsic motive affecting sport event consumer’s behavioral intention and FOMO-driven consumption’s influence on intrinsic rewards, extrinsic rewards, and consumer satisfaction

PLoS ONE ◽  
2020 ◽  
Vol 15 (12) ◽  
pp. e0243744
Author(s):  
Jeeyoon Kim ◽  
Younghan Lee ◽  
Mi-Lyang Kim
Keyword(s):  
Consumer Satisfaction ◽  
Structural Constraints ◽  
Extrinsic Rewards ◽  
Sport Event ◽  
Intrinsic Rewards ◽  
Fear Of Missing Out ◽  
Sport Media ◽  
Intrinsic Reward ◽  
Consumption Experience ◽  
Negative Effect

This study posits that Fear of Missing Out (FOMO) can function as an extrinsic motive stimulating sport event consumption by inducing consumers to overcome leisure constraints. Also, FOMO-driven consumption is proposed to affect consumption experience for being grounded on extrinsic than intrinsic rewards. In Study 1, the moderation of FOMO between intrapersonal and structural constraints and sport media viewing intention are tested. In Study 2, the relations among FOMO-driven consumption, intrinsic rewards (i.e., enjoyment), extrinsic rewards (i.e., social adherence), and consumer satisfaction are assessed. Study 1 results support the notion that FOMO can boost sport media viewing intention through two mechanisms: by directly stimulating intention and by lifting the negative effect of constraints on intention. In Study 2, FOMO-driven consumption shows a stronger link to extrinsic than intrinsic rewards, extrinsic reward is marginally but negatively associated with intrinsic reward, and intrinsic reward is a stronger predictor of satisfaction. Overall, FOMO is identified as a meaningful extrinsic motive for sport event consumption though its effects on consumer satisfaction are arguable. Implications for FOMO-driven marketing are discussed.

An Investigation on Extrinsic and Intrinsic Rewards on Employee Retention among Gen Y: A Study in Malaysian Manufacturing Companies

2020 ◽  
Vol 3 (1) ◽  
Keyword(s):  
Regression Analysis ◽  
Employee Retention ◽  
Future Research ◽  
Manufacturing Companies ◽  
Extrinsic Reward ◽  
Intrinsic Rewards ◽  
Gen Y ◽  
Intrinsic Reward ◽  
Factors Influencing ◽  
The Relationship

The aim of this study is to investigate the relationship between extrinsic and intrinsic reward on retention among Gen Y employees in Malaysian manufacturing companies. The data was collected from 113 respondents worked in manufacturing companies located in Seri Kembangan, Selangor using questionnaires. Multiple regression analysis was conducted to test the hypotheses. The results showed both extrinsic and intrinsic reward are the factors influencing retaining Gen Y in manufacturing companies. The discussion on the analysis, limitation of the study, recommendation for future research and conclusion were discussed at the end of this study. In a nutshell, it was proven extrinsic reward and intrinsic reward has contributed to the retention of Gen Y employees.

scholarly journals Embitterment as a Specific Mental Health Reaction during the Coronavirus Pandemic

2021 ◽  
pp. 1-10
Author(s):  
Beate Muschalla ◽  
Clio Vollborn ◽  
Anke Sondhof
Keyword(s):  
Mental Health ◽  
Mental Illness ◽  
Online Survey ◽  
Mental Health Problems ◽  
Affective State ◽  
Well Being ◽  
Health Problems ◽  
Social Consequences ◽  
High Rate ◽  
Perceived Injustice

<b><i>Introduction:</i></b> Embitterment can occur as a reaction to perceived injustice. During the pandemic and restrictions in daily living due to infection risk management, a range of many smaller or severe injustices have occurred. <b><i>Objective:</i></b> The aim of this study is to investigate what characterizes persons with high embitterment, mental illness, embitterment and mental illness, and those without embitterment or mental health problems. <b><i>Methods:</i></b> We conducted an online survey including persons from the general population in November 2020 and December 2020, the phase during which a second lockdown took place, with closed shops, restaurants, cultural and activity sites. 3,208 participants (mean age 47 years) gave self-ratings on their present well-being, burdens experienced during the pandemic, embitterment, wisdom, and resilience. <b><i>Results:</i></b> Embitterment occurred among 16% of the sample, which is a high rate in comparison with 4% during pre-pandemic times. Embitterment was weakly correlated with unspecific mental well-being. There were more persons with embitterment than those with embitterment and a mental health problem. Persons with embitterment reported less coronavirus-related anxiety than persons without embitterment. However, embittered persons reported more social and economic burdens and more frequent experiences of losses (job loss and canceling of medical treatments). Embittered persons perceive their own wisdom competencies on a similar level as persons with mental health problems or persons without mental health problems. <b><i>Conclusion:</i></b> Embitterment is a specific potentially alone-standing affective state, which is distinguishable from general mental health and coping capacities (here: wisdom). The economic and social consequences of pandemic management should be carefully recognized and prevented by policy.

scholarly journals How can work be designed to be intrinsically rewarding? Qualitative insights from South African non-profit employees

2016 ◽  
Vol 42 (1) ◽  
Author(s):  
Michelle Renard ◽  
Robin J. Snelgar
Keyword(s):  
Performance Management ◽  
South African ◽  
Structured Interviews ◽  
Extrinsic Rewards ◽  
Intrinsic Rewards ◽  
Non Profit ◽  
Performance Management Systems ◽  
Managerial Implications ◽  
Value Add ◽  
Traditional Performance

Orientation: Intrinsic rewards are personal, psychological responses to the work thatemployees perform, which stem from the manner in which their work is designed.Research purpose: This study sought to discover in what ways non-profit employees arepsychologically rewarded by the nature of their work tasks. The use of a qualitative approachto data collection and analysis ensured that in-depth responses from participants were gained.Motivation for the study: Intrinsic rewards are of particular importance to non-profitemployees, who tend to earn below-market salaries. This implies that their motivationoriginates predominantly from intrinsic as opposed to extrinsic rewards; yet, research into thisarea of rewards is lacking.Research approach, design and method: In-depth, semi-structured interviews were conductedusing a sample of 15 extrinsically rewarded non-profit employees working within South Africa.Thematic analysis was utilised in order to generate codes which led to the formation of fiveintrinsic rewards categories.Main findings: Intrinsic rewards were classified into five categories, namely (1) MeaningfulWork, (2) Flexible Work, (3) Challenging Work, (4) Varied Work and (5) Enjoyable Work.These rewards each comprise of various subcategories, which provide insight into why suchwork is rewarding to non-profit employees.Practical/managerial implications: Traditional performance management systems shouldbe re-evaluated in the non-profit sector to shift focus towards intrinsic rewards, asopposed to focusing only on the use of extrinsic rewards such as incentives to motivateemployees.Contribution/value-add: The study provides a qualitative understanding of how extrinsicallyrewarded non-profit employees perceive their work to be intrinsically rewarding, whichbridges the empirical gap pertaining to intrinsic rewards within this sector.

scholarly journals Associations between Dairy Herds’ Qualitative Behavior and Aspects of Herd Health, Stockperson and Farm Factors—A Cross-Sectional Exploration

Animals ◽  
2022 ◽  
Vol 12 (2) ◽  
pp. 182
Author(s):  
Asja Ebinghaus ◽  
Katharina Matull ◽  
Ute Knierim ◽  
Silvia Ivemeyer
Keyword(s):  
Dairy Cows ◽  
Affective State ◽  
Principal Component ◽  
Well Being ◽  
Living Environment ◽  
Qualitative Behavior ◽  
Herd Health ◽  
Farm Animal Welfare ◽  
Cross Sectional ◽  
Human Animal

The affective state is an integrated aspect of farm animal welfare, which is understood as the animals’ perception of their living environment and of their internal biological functioning. The aim of this cross-sectional study was to explore animal-internal and external factors potentially influencing dairy cows’ affective state. For this purpose, qualitative behavior assessments (QBA) describing the animals’ body language were applied at herd level on 25 dairy farms. By means of principal component analysis (PCA), scores of PC1 (QBAscores) were determined for further analyses. From monthly milk recordings (MR) one year retrospectively, prevalences of udder and metabolic health impairments were calculated. Factors of housing, management, and human-animal contact were recorded via interviews and observations. A multivariable regression was calculated following a univariable preselection of factors. No associations were found between MR indicators and QBAscores. However, more positive QBAscores were associated with bedded cubicles or straw yards compared to raised cubicles, increased voluntary stockperson contact with the cows, and fixation of cows during main feeding times, the latter contributing to the explanatory model, but not being significant. These results underline the importance of lying comfort, positive human-animal relationship and reduction of competition during feeding for the well-being of dairy cows.

scholarly journals Separable Dorsal Raphe Dopamine Projections Mediate Sociability and Valence

2021 ◽  
Author(s):  
Kay Tye ◽  
Gillian Matthews ◽  
Mackenzie Lemieux ◽  
Elizabeth Brewer ◽  
Raymundo Miranda ◽  
...  
Keyword(s):  
Basolateral Amygdala ◽  
Ex Vivo ◽  
Affective State ◽  
Well Being ◽  
Dorsal Raphe ◽  
Receptor Expression ◽  
Dopamine Neurons ◽  
Bed Nucleus ◽  
Distributed Target ◽  
Dorsal Raphé

Abstract Affiliative social connections facilitate well-being and survival in numerous species. Engaging in social interactions requires positive and negative motivational drive, elicited through coordinated activity across neural circuits. However, the identity, interconnectivity, and functional encoding of social information within these circuits remains poorly understood. Here, we focused on downstream projections of dorsal raphe nucleus (DRN) dopamine neurons (DRNDAT), which we previously implicated in ‘negative drive’-induced social motivation. We show that three prominent DRNDAT projections – to the bed nucleus of the stria terminalis (BNST), central amygdala (CeA), and posterior basolateral amygdala (BLP) – play separable roles in behavior, despite substantial collateralization. Photoactivation of the DRNDAT-CeA projection promoted social behavior and photoactivation of the DRNDAT-BNST projection promoted exploratory behavior, while the DRNDAT-BLP projection supported place avoidance, suggesting a negative affective state. Downstream regions showed diverse, region-specific, receptor expression, poising DRNDAT neurons to act through dopamine, neuropeptide, and glutamate transmission. Furthermore, we show ex vivo that the effect of DRNDAT photostimulation on downstream neuron excitability was predicted by baseline cell properties, suggesting cell-type-specific modulation. Collectively, these data indicate that DRNDAT neurons may bias behavior via precise modulation of cellular activity in broadly-distributed target structures.

scholarly journals Towards High-Level Intrinsic Exploration in Reinforcement Learning

2020 ◽  
Author(s):  
Nicolas Bougie ◽  
Ryutaro Ichise
Keyword(s):  
Reinforcement Learning ◽  
Time Horizon ◽  
State Of The Art ◽  
Experimental Results ◽  
Prior Work ◽  
Extrinsic Rewards ◽  
Intrinsic Reward ◽  
Long Time ◽  
End To End ◽  
High Level

Deep reinforcement learning (DRL) methods traditionally struggle with tasks where environment rewards are sparse or delayed, which entails that exploration remains one of the key challenges of DRL. Instead of solely relying on extrinsic rewards, many state-of-the-art methods use intrinsic curiosity as exploration signal. While they hold promise of better local exploration, discovering global exploration strategies is beyond the reach of current methods. We propose a novel end-to-end intrinsic reward formulation that introduces high-level exploration in reinforcement learning. Our curiosity signal is driven by a fast reward that deals with local exploration and a slow reward that incentivizes long-time horizon exploration strategies. We formulate curiosity as the error in an agent’s ability to reconstruct the observations given their contexts. Experimental results show that this high-level exploration enables our agents to outperform prior work in several Atari games.

Sign in / Sign up

Export Citation Format

Share Document