scholarly journals Neural and computational mechanisms of momentary fatigue and persistence in effort-based choice

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Tanja Müller ◽  
Miriam C. Klein-Flügge ◽  
Sanjay G. Manohar ◽  
Masud Husain ◽  
Matthew A. J. Apps
Keyword(s):  
Computational Modelling ◽  
Bold Response ◽  
Computational Framework ◽  
Mechanisms Of Persistence ◽  
Hidden States ◽  
The Brain ◽  
Striatal System

AbstractFrom a gym workout, to deciding whether to persevere at work, many activities require us to persist in deciding that rewards are ‘worth the effort’ even as we become fatigued. However, studies examining effort-based decisions typically assume that the willingness to work is static. Here, we use computational modelling on two effort-based tasks, one behavioural and one during fMRI. We show that two hidden states of fatigue fluctuate on a moment-to-moment basis on different timescales but both reduce the willingness to exert effort for reward. The value of one state increases after effort but is ‘recoverable’ by rests, whereas a second ‘unrecoverable’ state gradually increases with work. The BOLD response in separate medial and lateral frontal sub-regions covaried with these states when making effort-based decisions, while a distinct fronto-striatal system integrated fatigue with value. These results provide a computational framework for understanding the brain mechanisms of persistence and momentary fatigue.

ANALYSIS OF SOME NEUROTRANSMITTER MECHANISMS OF THE BRAIN NIGRO-STRIATAL SYSTEM IN REGULATION OF MOTOR ACTIVITY

Abstracts ◽  
1978 ◽  
pp. 640
Author(s):  
A.I. Balakleevsky ◽  
N.P. Bobrova ◽  
A.K. Dastchinsky ◽  
I.V. Maslova ◽  
A.I. Khomenko ◽  
...  
Keyword(s):  
Motor Activity ◽  
The Brain ◽  
Striatal System

scholarly journals Auditory and visual scene analysis: an overview

2017 ◽  
Vol 372 (1714) ◽  
pp. 20160099 ◽  
Author(s):  
Hirohito M. Kondo ◽  
Anouk M. van Loon ◽  
Jun-Ichiro Kawahara ◽  
Brian C. J. Moore
Keyword(s):  
Scene Perception ◽  
Computational Modelling ◽  
Visual Scene ◽  
Scene Analysis ◽  
Theoretical Approaches ◽  
Visual Inputs ◽  
Sensory Modalities ◽  
Stimulus Features ◽  
The Brain ◽  
Selection Of

We perceive the world as stable and composed of discrete objects even though auditory and visual inputs are often ambiguous owing to spatial and temporal occluders and changes in the conditions of observation. This raises important questions regarding where and how ‘scene analysis’ is performed in the brain. Recent advances from both auditory and visual research suggest that the brain does not simply process the incoming scene properties. Rather, top-down processes such as attention, expectations and prior knowledge facilitate scene perception. Thus, scene analysis is linked not only with the extraction of stimulus features and formation and selection of perceptual objects, but also with selective attention, perceptual binding and awareness. This special issue covers novel advances in scene-analysis research obtained using a combination of psychophysics, computational modelling, neuroimaging and neurophysiology, and presents new empirical and theoretical approaches. For integrative understanding of scene analysis beyond and across sensory modalities, we provide a collection of 15 articles that enable comparison and integration of recent findings in auditory and visual scene analysis. This article is part of the themed issue ‘Auditory and visual scene analysis’.

scholarly journals Precision-weighting of superior frontal cortex unsigned prediction error signals benefits learning, is mediated by dopamine, and is impaired in psychosis

2019 ◽  
Author(s):  
J. Haarsma ◽  
P.C. Fletcher ◽  
J.D. Griffin ◽  
H.J. Taverne ◽  
H. Ziauddeen ◽  
...  
Keyword(s):  
Prediction Error ◽  
Computational Modelling ◽  
Anterior Cingulate ◽  
Prediction Errors ◽  
Healthy Individuals ◽  
Cortical Function ◽  
Dopaminergic Modulation ◽  
Hierarchical Bayesian Inference ◽  
The Brain ◽  
Superior Frontal Cortex

AbstractRecent theories of cortical function construe the brain as performing hierarchical Bayesian inference. According to these theories, the precision of cortical unsigned prediction error (i.e., surprise) signals plays a key role in learning and decision-making, to be controlled by dopamine, and to contribute to the pathogenesis of psychosis. To test these hypotheses, we studied learning with variable outcome-precision in healthy individuals after dopaminergic modulation and in patients with early psychosis. Behavioural computational modelling indicated that precision-weighting of unsigned prediction errors benefits learning in health, and is impaired in psychosis. FMRI revealed coding of unsigned prediction errors relative to their precision in bilateral superior frontal gyri and dorsal anterior cingulate, which was perturbed by dopaminergic modulation, impaired in psychosis, and associated with task performance and schizotypy. We conclude that precision-weighting of cortical prediction error signals is a key mechanism through which dopamine modulates inference and contributes to the pathogenesis of psychosis.

scholarly journals The Neural Basis of Shared Preference Learning

2019 ◽  
Author(s):  
Harry Farmer ◽  
Uri Hertz ◽  
Antonia Hamilton
Keyword(s):  
Social Interactions ◽  
Computational Modelling ◽  
Brain Regions ◽  
The Self ◽  
Neural Activation ◽  
Neural Basis ◽  
Daily Lives ◽  
Neural Processes ◽  
Specific Manner ◽  
The Brain

AbstractDuring our daily lives, we often learn about the similarity of the traits and preferences of others to our own and use that information during our social interactions. However, it is unclear how the brain represents similarity between the self and others. One possible mechanism is to track similarity to oneself regardless of the identity of the other (Similarity account); an alternative is to track each confederate in terms of consistency of the similarity to the self, with respect to the choices they have made before (consistency account). Our study combined fMRI and computational modelling of reinforcement learning (RL) to investigate the neural processes that underlie learning about preference similarity. Participants chose which of two pieces of artwork they preferred and saw the choices of one confederate who usually shared their preference and another who usually did not. We modelled neural activation with RL models based on the similarity and consistency accounts. Data showed more brain regions whose activity pattern fits with the consistency account, specifically, areas linked to reward and social cognition. Our findings suggest that impressions of other people can be calculated in a person-specific manner which assumes that each individual behaves consistently with their past choices.

scholarly journals Bayesian Comparison of Explicit and Implicit Causal Inference Strategies in Multisensory Heading Perception

2017 ◽  
Author(s):  
Luigi Acerbi ◽  
Kalpana Dokka ◽  
Dora E. Angelaki ◽  
Wei Ji Ma
Keyword(s):  
Causal Inference ◽  
Discrimination Task ◽  
Model Comparison ◽  
Inference Process ◽  
Computational Framework ◽  
Bayesian Model Comparison ◽  
Vestibular Cues ◽  
Multisensory Cues ◽  
The Brain ◽  
Rule Out

AbstractThe precision of multisensory heading perception improves when visual and vestibular cues arising from the same cause, namely motion of the observer through a stationary environment, are integrated. Thus, in order to determine how the cues should be processed, the brain must infer the causal relationship underlying the multisensory cues. In heading perception, however, it is unclear whether observers follow the Bayesian strategy, a simpler non-Bayesian heuristic, or even perform causal inference at all. We developed an efficient and robust computational framework to perform Bayesian model comparison of causal inference strategies, which incorporates a number of alternative assumptions about the observers. With this framework, we investigated whether human observers’ performance in an explicit cause attribution and an implicit heading discrimination task can be modeled as a causal inference process. In the explicit inference task, all subjects accounted for cue disparity when reporting judgments of common cause, although not necessarily all in a Bayesian fashion. By contrast, but in agreement with previous findings, data from the heading discrimination task only could not rule out that several of the same observers were adopting a forced-fusion strategy, whereby cues are integrated regardless of disparity. Only when we combined evidence from both tasks we were able to rule out forced-fusion in the heading discrimination task. Crucially, findings were robust across a number of variants of models and analyses. Our results demonstrate that our proposed computational framework allows researchers to ask complex questions within a rigorous Bayesian framework that accounts for parameter and model uncertainty.

scholarly journals Neuro-computational account of arbitration between imitation and emulation during human observational learning

2019 ◽  
Author(s):  
Caroline C. Charpentier ◽  
Kiyohito Iigaya ◽  
John P. O’Doherty
Keyword(s):  
Prefrontal Cortex ◽  
Observational Learning ◽  
Computational Modelling ◽  
Neural Correlates ◽  
Fundamental Question ◽  
Behavioral Task ◽  
Reliable Prediction ◽  
Ventrolateral Prefrontal Cortex ◽  
Temporoparietal Junction ◽  
The Brain

AbstractIn observational learning (OL), organisms learn from observing the behavior of others. There are at least two distinct strategies for OL. Imitation involves learning to repeat the previous actions of other agents, while in emulation, learning proceeds from inferring the goals and intentions of others. While putative neural correlates for these forms of learning have been identified, a fundamental question remains unaddressed: how does the brain decides which strategy to use in a given situation? Here we developed a novel computational model in which arbitration between the strategies is determined by the predictive reliability, such that control over behavior is adaptively weighted toward the strategy with the most reliable prediction. To test the theory, we designed a novel behavioral task in which our experimental manipulations produced dissociable effects on the reliability of the two strategies. Participants performed this task while undergoing fMRI in two independent studies (the second a pre-registered replication of the first). Behavior manifested patterns consistent with both emulation and imitation and flexibly changed between the two strategies as expected from the theory. Computational modelling revealed that behavior was best described by an arbitration model, in which the reliability of the emulation strategy determined the relative weights allocated to behavior for each strategy. Emulation reliability - the model’s arbitration signal - was encoded in the ventrolateral prefrontal cortex, temporoparietal junction and rostral cingulate cortex. Being replicated across two fMRI studies, these findings suggest a neuro-computational mechanism for allocating control between emulation and imitation during observational learning.

scholarly journals Developmental Computational Psychiatry

2018 ◽  
Author(s):  
Tobias U. Hauser ◽  
Geert-Jan Will ◽  
Magda Dubois ◽  
Raymond J Dolan
Keyword(s):  
Cognitive Development ◽  
Psychiatric Disorders ◽  
Cognitive Processes ◽  
Computational Modelling ◽  
Brain Maturation ◽  
Childhood And Adolescence ◽  
Social Evaluation ◽  
Computational Psychiatry ◽  
Underlying Mechanisms ◽  
The Brain

Most psychiatric disorders emerge during childhood and adolescence. This is also a period when the brain undergoes substantial growth and reorganisation. However, it remains unclear how a heightened vulnerability to psychiatric disorder relates to brain maturation, and what the underlying mechanisms might be. Here, we propose ‘developmental computational psychiatry’ as a framework for linking brain maturation to cognitive development. We propose that through modelling some of the brain’s fundamental cognitive computations and relating them to brain development, we can bridge the gap between brain and cognitive development. This in turn can lead to a richer understanding of the ontogeny of psychiatric disorders. We illustrate this perspective by taking examples from reinforcement learning (RL) and dopamine function, showing how computational modelling deepens an understanding of how cognitive processes, such as reward learning, effort learning, and social evaluation might go awry in psychiatric disorders. Finally, we formulate testable hypotheses and sketch the potential and limitations of developmental computational psychiatry.

scholarly journals Computational modelling of social cognition and behaviour—a reinforcement learning primer

2020 ◽  
Author(s):  
Patricia L Lockwood ◽  
Miriam C Klein-Flügge
Keyword(s):  
Reinforcement Learning ◽  
Social Cognition ◽  
Observational Learning ◽  
Impression Formation ◽  
Computational Models ◽  
Computational Modelling ◽  
Neural Systems ◽  
Neural Basis ◽  
The Past ◽  
The Brain

Abstract Social neuroscience aims to describe the neural systems that underpin social cognition and behaviour. Over the past decade, researchers have begun to combine computational models with neuroimaging to link social computations to the brain. Inspired by approaches from reinforcement learning theory, which describes how decisions are driven by the unexpectedness of outcomes, accounts of the neural basis of prosocial learning, observational learning, mentalizing and impression formation have been developed. Here we provide an introduction for researchers who wish to use these models in their studies. We consider both theoretical and practical issues related to their implementation, with a focus on specific examples from the field.

Essentials and Perspectives of Computational Modelling Assistance for CNS-oriented Nanoparticle-based Drug Delivery Systems

2019 ◽  
Vol 25 (42) ◽  
pp. 5894-5913
Author(s):  
Joanna Kisała ◽  
Kinga I. Hęclik ◽  
Krzysztof Pogocki ◽  
Dariusz Pogocki
Keyword(s):  
Brain Function ◽  
Computational Simulation ◽  
Computational Modelling ◽  
Black Box ◽  
Selective Transport ◽  
Drug Candidates ◽  
Basic Understanding ◽  
The Brain ◽  
Physical Principles ◽  
Brain Homeostasis

The blood-brain barrier (BBB) is a complex system controlling two-way substances traffic between circulatory (cardiovascular) system and central nervous system (CNS). It is almost perfectly crafted to regulate brain homeostasis and to permit selective transport of molecules that are essential for brain function. For potential drug candidates, the CNSoriented neuropharmaceuticals as well as for those of primary targets in the periphery, the extent to which a substance in the circulation gains access to the CNS seems crucial. With the advent of nanopharmacology, the problem of the BBB permeability for drug nano-carriers gains new significance. Compared to some other fields of medicinal chemistry, the computational science of nano-delivery is still premature to offer the black-box type solutions, especially for the BBB-case. However, even its enormous complexity can spell out the physical principles, and as such subjected to computation. The basic understanding of various physicochemical parameters describing the brain uptake is required to take advantage of their usage for the BBB-nano delivery. This mini-review provides a sketchy introduction of essential concepts allowing application of computational simulation to the BBB-nano delivery design.

scholarly journals Computational Modelling of Pathogenic Protein Behaviour-Governing Mechanisms in the Brain

2018 ◽  
pp. 532-539
Author(s):  
Konstantinos Georgiadis ◽  
Alexandra L. Young ◽  
Michael Hütel ◽  
Adeel Razi ◽  
Carla Semedo ◽  
...  
Keyword(s):  
Computational Modelling ◽  
The Brain
Sign in / Sign up

Export Citation Format

Share Document