scholarly journals Value and probability coding in a feedback-based learning task utilizing food rewards

2015 ◽  
Vol 113 (1) ◽  
pp. 4-13 ◽  
Author(s):  
Elizabeth Tricomi ◽  
Karolina M. Lempert

For the consequences of our actions to guide behavior, the brain must represent different types of outcome-related information. For example, an outcome can be construed as negative because an expected reward was not delivered or because an outcome of low value was delivered. Thus behavioral consequences can differ in terms of the information they provide about outcome probability and value. We investigated the role of the striatum in processing probability-based and value-based negative feedback by training participants to associate cues with food rewards and then employing a selective satiety procedure to devalue one food outcome. Using functional magnetic resonance imaging, we examined brain activity related to receipt of expected rewards, receipt of devalued outcomes, omission of expected rewards, omission of devalued outcomes, and expected omissions of an outcome. Nucleus accumbens activation was greater for rewarding outcomes than devalued outcomes, but activity in this region did not correlate with the probability of reward receipt. Activation of the right caudate and putamen, however, was largest in response to rewarding outcomes relative to expected omissions of reward. The dorsal striatum (caudate and putamen) at the time of feedback also showed a parametric increase correlating with the trialwise probability of reward receipt. Our results suggest that the ventral striatum is sensitive to the motivational relevance, or subjective value, of the outcome, while the dorsal striatum codes for a more complex signal that incorporates reward probability. Value and probability information may be integrated in the dorsal striatum, to facilitate action planning and allocation of effort.

2011 ◽  
Vol 23 (11) ◽  
pp. 3620-3636 ◽  
Author(s):  
David B. Miele ◽  
Tor D. Wager ◽  
Jason P. Mitchell ◽  
Janet Metcalfe

Judgments of agency refer to people's self-reflective assessments concerning their own control: their assessments of the extent to which they themselves are responsible for an action. These self-reflective metacognitive judgments can be distinguished from action monitoring, which involves the detection of the divergence (or lack of divergence) between observed states and expected states. Presumably, people form judgments of agency by metacognitively reflecting on the output of their action monitoring and then consciously inferring the extent to which they caused the action in question. Although a number of previous imaging studies have been directed at action monitoring, none have assessed judgments of agency as a potentially separate process. The present fMRI study used an agency paradigm that not only allowed us to examine the brain activity associated with action monitoring but that also enabled us to investigate those regions associated with metacognition of agency. Regarding action monitoring, we found that being “out of control” during the task (i.e., detection of a discrepancy between observed and expected states) was associated with increased brain activity in the right TPJ, whereas being “in control” was associated with increased activity in the pre-SMA, rostral cingulate zone, and dorsal striatum (regions linked to self-initiated action). In contrast, when participants made self-reflective metacognitive judgments about the extent of their own control (i.e., judgments of agency) compared with when they made judgments that were not about control (i.e., judgments of performance), increased activity was observed in the anterior PFC, a region associated with self-reflective processing. These results indicate that action monitoring is dissociable from people's conscious self-attributions of control.


2021 ◽  
Author(s):  
Brendan Williams ◽  
Anastasia Christakou

Cognitive flexibility is essential for enabling an individual to respond adaptively to changes in their environment. Evidence from human and animal research suggests that the control of cognitive flexibility is dependent on an array of neural architecture. Cortico-basal ganglia circuits have long been implicated in cognitive flexibility. In particular, the role of the striatum is pivotal, acting as an integrative hub for inputs from the prefrontal cortex and thalamus, and modulation by dopamine and acetylcholine. Striatal cholinergic modulation has been implicated in the flexible control of behaviour, driven by input from the centromedian-parafascicular nuclei of the thalamus. However, the role of this system in humans is not clearly defined as much of the current literature is based on animal work. Here, we aim to investigate the roles corticostriatal and thalamostriatal connectivity in serial reversal learning. Functional connectivity between the left centromedian-parafascicular nuclei and the associative dorsal striatum was significantly increased for negative feedback compared to positive feedback. Similar differences in functional connectivity were observed for the right lateral orbitofrontal cortex, but these were localised to when participants switched to using an alternate response strategy following reversal. These findings suggest that connectivity between the centromedian-parafascicular nuclei and the striatum may be used to generally identify potential changes in context based on negative outcomes, and the effect of this signal on striatal output may be influenced by connectivity between the lateral orbitofrontal cortex and the striatum.


KREA-TIF ◽  
2018 ◽  
Vol 6 (1) ◽  
pp. 48
Author(s):  
Idrus Jamalulael ◽  
Budi Susetyo

<h1 align="center"><strong>Abstrak</strong></h1><p>Pentingnya peranan pesantren yang berada di KabupatenBogor menjadi motivasi untuk memecahkan masalah seperti sulitnya mencari letak pesantren dengan merancang dan membuat sebuah sistem yang dapat digunakan untuk mencari letak pesantren serta informasi lain yang terkait. Penerapan Sistem Informasi Geografis (SIG) merupakan langkah yang tepat untuk mengetahui lokasi pondok pesantren yang terdapat di Kabupaten Bogor bagian barat karena SIG mempunyai kemampuan yang sangat luas, baik dalam proses pemetaan dan analisis sehingga teknologi tersebut sering dipakai dalam proses perencanaan tata ruang.Pendekatan sistem berbasis spasial dalam melakukan analisis kinerja pesantren, diharapkan mempermudah dalam pencarian pesantren yang telah diidentifikasi tingkat optimalisasi kinerja pondok pesantren dengan menggunakan metode pendekatan AHP (Analytical Hierarchy Process) dan CPI (Composite Performance Index) yang dibedakan menggunakan teknik natural bricks, hanya ada dua pesantren di Kabupaten Bogor wilayah barat yang memiliki nilai optimal yaitu pesantren ummul quro al islami dan pesantren sahid. Hal ini disebabkan kedua pesantren  tersebut memiliki luas lahan yang sangat luas sehingga berpotensi unduk dapat dikembangkan membangun sarana dan prasarana yang dibutuhkan pesantren tersebut.</p><p align="center"><strong><em>Abstract</em></strong></p><p><em>The importance of the role of Islamic boarding schools in Bogor Regency is a motivation to solve problems such as the difficulty of finding the location of pesantren by designing and creating a system that can be used to find the location of pesantren and other related information. The application of Geographic Information Systems (GIS) is the right step to find out the location of Islamic boarding schools in the western part of Bogor Regency because GIS has very broad capabilities, both in the process of mapping and analysis so that the technology is often used in the spatial planning process. Spatial based analysis of Islamic boarding school performance is expected to facilitate the search for Islamic boarding schools that have identified the level of optimization of Islamic boarding schools' performance using the Analytical Hierarchy Process and CPI (Composite Performance Index) methods that are distinguished by natural bricks, there are only two Islamic boarding schools. The western region of Bogor Regency has optimal values, namely ummul quro al Islamic boarding schools and sahid Islamic boarding schools. This is due to the fact that the two pesantren have a very large land area so that the potential of the Islamic boarding school can be developed to build the facilities and infrastructure needed by the </em><em>islamic boarding school</em><em>.</em></p>


2021 ◽  
Author(s):  
Florian Destoky ◽  
Julie Bertels ◽  
Maxime Niesen ◽  
Vincent Wens ◽  
Marc Vander Ghinst ◽  
...  

Dyslexia is a frequent developmental disorder in which reading acquisition is delayed and that is usually associated with difficulties understanding speech in noise. At the neuronal level, children with dyslexia were reported to display abnormal cortical tracking of speech (CTS) at phrasal rate. Here, we aimed to determine if abnormal tracking is a cause or a consequence of dyslexia and if it is modulated by the severity of dyslexia or the presence of acoustic noise. We included 26 school-age children with dyslexia, 26 age-matched controls and 26 reading-level matched controls. All were native French speakers. Children's brain activity was recorded with magnetoencephalography while they listened to continuous speech in noiseless and multiple noise conditions. CTS values were compared between groups, conditions and hemispheres, and also within groups, between children with best and worse reading performance. Syllabic CTS was significantly reduced in the right superior temporal gyrus in children with dyslexia compared with controls matched for age but not for reading level. Among children with dyslexia, phrasal CTS tended to lateralize to the left hemisphere in severe dyslexia and lateralized to the right hemisphere in children with mild dyslexia and in all control groups. Finally, phrasal CTS was lower in children with dyslexia compared with age-matched controls, but only in informational noise conditions. No such effect was seen in comparison with reading-level matched controls. Overall, our results confirmed the finding of altered neuronal basis of speech perception in noiseless and babble noise conditions in dyslexia compared with age-matched peers. However, the absence of alteration in comparison with reading-level matched controls suggests that such alterations are a consequence of reduced reading experience rather than a cause of dyslexia.


2015 ◽  
Vol 12 (03) ◽  
pp. 192-200 ◽  
Author(s):  
L. Galushko ◽  
O. Graf ◽  
W. Gaebel ◽  
J. Zielasek

Summary Background: To clarify the role of cognitive and neurobiologic factors in the aetiopathogenesis of specific phobia, a systematic review of studies investigating these factors was performed. MEDLINE, PsycINFO, EMBASE, and Cochrane Central were searched up to March 23, 2012. Method: Thirty-four studies were analyzed in detail for this systematic review. Results: Persons with specific phobia differed from healthy persons in their reaction to the exposure to phobia-related stimuli due to biased attentional, memory and interpretational processes. Longer reaction times, increased recall and recognition performances for threat-related information, and a tendency to misinterpret ambiguous stimuli were found in persons with specific phobia. Regarding brain activity measures as indicators of neurobiologic factors following exposure to fear-related stimuli, amygdala, anterior cingulated cortex, insula, fusiform gyrus, and dorsomedial prefrontal cortex activities were most commonly reported to be increased in persons with specific phobia. Other studies revealed increased amplitudes of event-related potentials (N100, P300, and late positive potentials) in persons with specific phobia.


2021 ◽  
Vol 11 (5) ◽  
pp. 560
Author(s):  
Marion Criaud ◽  
Jean-Luc Anton ◽  
Bruno Nazarian ◽  
Marieke Longcamp ◽  
Elise Metereau ◽  
...  

The basal ganglia (BG) have long been known for contributing to the regulation of motor behaviour by means of a complex interplay between tonic and phasic inhibitory mechanisms. However, after having focused for a long time on phasic reactive mechanisms, it is only recently that psychological research in healthy humans has modelled tonic proactive mechanisms of control. Mutual calibration between anatomo-functional and psychological models is still needed to better understand the unclear role of the BG in the interplay between proactive and reactive mechanisms of control. Here, we implemented an event-related fMRI design allowing proper analysis of both the brain activity preceding the target-stimulus and the brain activity induced by the target-stimulus during a simple go/nogo task, with a particular interest in the ambiguous role of the basal ganglia. Post-stimulus activity was evoked in the left dorsal striatum, the subthalamus nucleus and internal globus pallidus by any stimulus when the situation was unpredictable, pinpointing its involvement in reactive, non-selective inhibitory mechanisms when action restraint is required. Pre-stimulus activity was detected in the ventral, not the dorsal, striatum, when the situation was unpredictable, and was associated with changes in functional connectivity with the early visual, not the motor, cortex. This suggests that the ventral striatum supports modulatory influence over sensory processing during proactive control.


PeerJ ◽  
2018 ◽  
Vol 6 ◽  
pp. e4516 ◽  
Author(s):  
Yanzhu Fan ◽  
Xizi Yue ◽  
Fei Xue ◽  
Steven E. Brauth ◽  
Yezhong Tang ◽  
...  

BackgroundPrevious studies have shown that the mammalian thalamus is a key structure for anesthesia-induced unconsciousness and anesthesia-awakening regulation. However, both the dynamic characteristics and probable lateralization of thalamic functioning during anesthesia-awakening regulation are not fully understood, and little is known of the evolutionary basis of the role of the thalamus in anesthesia-awakening regulation.MethodsAn amphibian species, the South African clawed frog (Xenopus laevis) was used in the present study. The frogs were immersed in triciane methanesulfonate (MS-222) for general anesthesia. Electroencephalogram (EEG) signals were recorded continuously from both sides of the telencephalon, diencephalon (thalamus) and mesencephalon during the pre-anesthesia stage, administration stage, recovery stage and post-anesthesia stage. EEG data was analyzed including calculation of approximate entropy (ApEn) and permutation entropy (PE).ResultsBoth ApEn and PE values differed significantly between anesthesia stages, with the highest values occurring during the awakening period and the lowest values during the anesthesia period. There was a significant correlation between the stage durations and ApEn or PE values during anesthesia-awakening cycle primarily for the right diencephalon (right thalamus). ApEn and PE values for females were significantly higher than those for males.DiscussionApEn and PE measurements are suitable for estimating depth of anesthesia and complexity of amphibian brain activity. The right thalamus appears physiologically positioned to play an important role in anesthesia-awakening regulation in frogs indicating an early evolutionary origin of the role of the thalamus in arousal and consciousness in land vertebrates. Sex differences exist in the neural regulation of general anesthesia in frogs.


Author(s):  
Andrea Scalabrini ◽  
Clara Mucci ◽  
Rosy Esposito

Starting with Freud and Jung, dreams have always been considered a core source of information for psychoanalysis. Nowadays, neuroscientific findings suggest that dreams are related especially to limbic and right emotional brain circuit, and that during REM stages they engage self-related and visual internally generated processing. These neuroscientific findings together with contemporary psychoanalysis suggest that dreams are related to the sense of self and serve the purpose of re-integrating and re-structuring the integrity of the psyche. However, while dreams are still viewed as ‘the via regia to the unconscious’, it is the unconscious that has been reconsidered. The repressed unconscious seems to be related with left brain activity while the unrepressed unconscious based on dissociation seems to be associated with limbic and cortical areas of the right hemisphere. This notion of the unconscious might be seen as an implicit self-system encoded in the right brain that evolves in the interaction with a primary caregiver developing through preverbal and bodily stages of maturation enhanced by signals of dual communication. What kind of dreams for which unconscious? What are the differences regarding the capacity to dream for neurotic and borderline personality organizations? Our research aims to integrate psychodynamics, infant research, and neuroscientific findings to better understand the role of dreams in the assessment and treatment of, especially, traumatized and borderline patients. The capacity to dream is here proposed as a sort of enacted manifestation of emotional memories for the development of a more cohesive, coherent and symbolic vs fragmented, diffuse and alexithymic sense of self.


2008 ◽  
Vol 20 (1) ◽  
pp. 170-181 ◽  
Author(s):  
Gorana Pobric ◽  
Nira Mashal ◽  
Miriam Faust ◽  
Michal Lavidor

Previous research suggests that the right hemisphere (RH) may contribute uniquely to the processing of metaphoric language. However, causal relationships between local brain activity in the RH and metaphors comprehension were never established. In addition, most studies have focused on familiar metaphoric expressions which might be processed similarly to any conventional word combination. The present study was designed to overcome these two problems by employing repetitive transcranial magnetic stimulation (rTMS) to examine the role of the RH in processing novel metaphoric expressions taken from poetry. Right-handed participants were presented with four types of word pairs, literal, conventional metaphoric and novel metaphoric expressions, and unrelated word pairs, and were asked to perform a semantic judgment task. rTMS of the right posterior superior temporal sulcus disrupted processing of novel but not conventional metaphors, whereas rTMS over the left inferior frontal gyrus selectively impaired processing of literal word pairs and conventional but not novel metaphors (Experiment 1). In a further experiment, we showed that these effects were due to right-left asymmetries rather than posterior-anterior differences (Experiment 2). This is the first demonstration of TMS-induced impairment in processing novel metaphoric expressions, and as such, confirms the specialization of the RH in the activation of a broader range of related meanings than the left hemisphere, including novel, nonsalient meanings. The findings thus suggest that the RH may be critically involved in at least one important component of novel metaphor comprehension, the integration of the individual meanings of two seemingly unrelated concepts into a meaningful metaphoric expression.


2005 ◽  
Vol 11 (3) ◽  
pp. 237-248 ◽  
Author(s):  
MARIA MORAN ◽  
MICHAEL SEIDENBERG ◽  
DAVE SABSEVITZ ◽  
SARA SWANSON ◽  
BRUCE HERMANN

Thirty unilateral anterior temporal lobectomy (ATL) subjects (15 right and 15 left) and 15 controls were presented a multitrial learning task in which unfamiliar faces were paired with biographical information (occupation, city location, and a person's name). Face recognition hits were similar between groups, but the right ATL group committed more false-positive errors to face foils. Both left and right ATL groups were impaired relative to controls in acquiring biographical information, but the deficit was more pronounced for the left ATL group. Recall levels also varied for the different types of biographical information; occupation was most commonly recalled followed by city name and person name. In addition, city and person name recall was more likely when occupation was also recalled. Overall, recall of biographical information was positively correlated with clinical measures of anterograde episodic memory. Findings are discussed in terms of the role of the temporal lobe and associative learning ability in the successful acquisition of new face semantic (biographical) representations. (JINS, 2005,11, 237–248.)


Sign in / Sign up

Export Citation Format

Share Document