scholarly journals Neural encoding of task-dependent errors during adaptive learning

eLife ◽  
2020 ◽  
Vol 9 ◽  
Author(s):  
Chang-Hao Kao ◽  
Sangil Lee ◽  
Joshua I Gold ◽  
Joseph W Kable

Effective learning requires using errors in a task-dependent manner, for example adjusting to errors that result from unpredicted environmental changes but ignoring errors that result from environmental stochasticity. Where and how the brain represents errors in a task-dependent manner and uses them to guide behavior are not well understood. We imaged the brains of human participants performing a predictive-inference task with two conditions that had different sources of errors. Their performance was sensitive to this difference, including more choice switches after fundamental changes versus stochastic fluctuations in reward contingencies. Using multi-voxel pattern classification, we identified task-dependent representations of error magnitude and past errors in posterior parietal cortex. These representations were distinct from representations of the resulting behavioral adjustments in dorsomedial frontal, anterior cingulate, and orbitofrontal cortex. The results provide new insights into how the human brain represents errors in a task-dependent manner and guides subsequent adaptive behavior.

2020 ◽  
Author(s):  
Chang-Hao Kao ◽  
Sangil Lee ◽  
Joshua I. Gold ◽  
Joseph W. Kable

AbstractEffective learning requires using errors in a task-dependent manner, for example adjusting to errors that result from unpredicted environmental changes but ignoring errors that result from environmental stochasticity. Where and how the brain represents errors in a task-dependent manner and uses them to guide behavior are not well understood. We imaged the brains of human participants performing a predictive-inference task with two conditions that had different sources of errors. Their performance was sensitive to this difference, including more choice switches after fundamental changes versus stochastic fluctuations in reward contingencies. Using multi-voxel pattern classification, we identified task-dependent representations of error magnitude and past errors in posterior parietal cortex. These representations were distinct from representations of the resulting behavioral adjustments in dorsomedial frontal, anterior cingulate, and orbitofrontal cortex. The results provide new insights into how the human brain represents errors in a task-dependent manner and guides subsequent adaptive behavior.


2021 ◽  
Vol 7 (1) ◽  
Author(s):  
Azusa Nakamoto ◽  
Masashi Harada ◽  
Reiko Mitsuhashi ◽  
Kimiyuki Tsuchiya ◽  
Alexey P. Kryukov ◽  
...  

AbstractQuaternary environmental changes fundamentally influenced the genetic diversity of temperate-zone terrestrial animals, including those in the Japanese Archipelago. The genetic diversity of present-day populations is taxon- and region-specific, but its determinants are poorly understood. Here, we analyzed cytochrome b gene (Cytb) sequences (1140 bp) of mitochondrial DNA (mtDNA) to elucidate the factors determining the genetic variation in three species of large moles: Mogera imaizumii and Mogera wogura, which occur in central and southern mainland Japan (Honshu, Shikoku, and Kyushu), and Mogera robusta, which occurs on the nearby Asian continent. Network construction with the Cytb sequences revealed 10 star-shaped clusters with apparent geographic affinity. Mismatch distribution analysis showed that modes of pairwise nucleotide differences (τ values) were grouped into five classes in terms of the level, implying the occurrence of five stages for rapid expansion. It is conceivable that severe cold periods and subsequent warm periods during the late Quaternary were responsible for the population expansion events. The first and third oldest events included island-derived haplotypes, indicative of the involvement of land bridge formation between remote islands, hence suggesting an association of the ends of the penultimate (PGM, ca. 130,000 years ago) and last (LGM, ca. 15,000 years ago) glacial maxima, respectively. Since the third event was followed by the fourth, it is plausible that the termination of the Younger Dryas and subsequent abrupt warming ca. 11,500 years ago facilitated the fourth expansion event. The second event most likely corresponded to early marine isotope stage (MIS) 3 (ca. 53,000 years ago) when the glaciation and subsequent warming period were predicted to have influenced biodiversity. Utilization of the critical times of 130,000, 53,000, 15,000, and 11,500 years ago as calibration points yielded evolutionary rates of 0.03, 0.045, 0.10 and 0.10 substitutions/site/million years, respectively, showing a time-dependent manner whose pattern was similar to that seen in small rodents reported in our previous studies. The age of the fifth expansion event was calculated to be 5800 years ago with a rate of 0.10 substitutions/site/million years ago during the mid-Holocene, suggestive of the influence of humans or other unspecified reasons, such as the Jomon marine transgression.


2013 ◽  
Vol 10 (87) ◽  
pp. 20130559 ◽  
Author(s):  
Adam Lampert ◽  
Alan Hastings

Critical population phase transitions, in which a persistent population becomes extinction-prone owing to environmental changes, are fundamentally important in ecology, and their determination is a key factor in successful ecosystem management. To persist, a species requires a suitable environment in a sufficiently large spatial region. However, even if this condition is met, the species does not necessarily persist, owing to stochastic fluctuations. Here, we develop a model that allows simultaneous investigation of extinction due to either stochastic or deterministic reasons. We find that even classic birth–death processes in spatially extended ecosystems exhibit phase transitions between extinction-prone and persistent populations. Sometimes these are first-order transitions, which means that environmental changes may result in irreversible population collapse. Moreover, we find that higher migration rates not only lead to higher robustness to stochastic fluctuations, but also result in lower sustainability in heterogeneous environments by preventing efficient selection for suitable habitats. This demonstrates that intermediate migration rates are optimal for survival. At low migration rates, the dynamics are reduced to metapopulation dynamics, whereas at high migration rates, the dynamics are reduced to a multi-type branching process. We focus on species persistence, but our results suggest a unique method for finding phase transitions in spatially extended stochastic systems in general.


2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Brian Silston ◽  
Toby Wise ◽  
Song Qi ◽  
Xin Sui ◽  
Peter Dayan ◽  
...  

AbstractNatural observations suggest that in safe environments, organisms avoid competition to maximize gain, while in hazardous environments the most effective survival strategy is to congregate with competition to reduce the likelihood of predatory attack. We probed the extent to which survival decisions in humans follow these patterns, and examined the factors that determined individual-level decision-making. In a virtual foraging task containing changing levels of competition in safe and hazardous patches with virtual predators, we demonstrate that human participants inversely select competition avoidant and risk diluting strategies depending on perceived patch value (PPV), a computation dependent on reward, threat, and competition. We formulate a mathematically grounded quantification of PPV in social foraging environments and show using multivariate fMRI analyses that PPV is encoded by mid-cingulate cortex (MCC) and ventromedial prefrontal cortices (vMPFC), regions that integrate action and value signals. Together, these results suggest humans utilize and integrate multidimensional information to adaptively select patches highest in PPV, and that MCC and vMPFC play a role in adapting to both competitive and predatory threats in a virtual foraging setting.


2020 ◽  
Author(s):  
Joshua M. Carlson ◽  
Lin Fang

AbstractIn a sample of highly anxious individuals, the relationship between gray matter volume brain morphology and attentional bias to threat was assessed. Participants performed a dot-probe task of attentional bias to threat and gray matter volume was acquired from whole brain structural T1-weighted MRI scans. The results replicate previous findings in unselected samples that elevated attentional bias to threat is linked to greater gray matter volume in the anterior cingulate cortex, middle frontal gyrus, and striatum. In addition, we provide novel evidence that elevated attentional bias to threat is associated with greater gray matter volume in the right posterior parietal cortex, cerebellum, and other distributed regions. Lastly, exploratory analyses provide initial evidence that distinct sub-regions of the right posterior parietal cortex may contribute to attentional bias in a sex-specific manner. Our results illuminate how differences in gray matter volume morphology relate to attentional bias to threat in anxious individuals. This knowledge could inform neurocognitive models of anxiety-related attentional bias to threat and targets of neuroplasticity in anxiety interventions such as attention bias modification.


2003 ◽  
Vol 77 (22) ◽  
pp. 12122-12131 ◽  
Author(s):  
Prasith Baccam ◽  
Robert J. Thompson ◽  
Yuxing Li ◽  
Wendy O. Sparks ◽  
Michael Belshan ◽  
...  

ABSTRACT Lentiviruses exist in vivo as a population of related, nonidentical genotypes, commonly referred to as quasispecies. The quasispecies structure is characteristic of complex adaptive systems and contributes to the high rate of evolution in lentiviruses that confounds efforts to develop effective vaccines and antiviral therapies. Here, we describe analyses of genetic data from longitudinal studies of genetic variation in a lentivirus regulatory protein, Rev, over the course of disease in ponies experimentally infected with equine infectious anemia virus. As observed with other lentivirus data, the Rev variants exhibited a quasispecies character. Phylogenetic and partition analyses suggested that the Rev quasispecies comprised two distinct subpopulations that coexisted during infection. One subpopulation appeared to accumulate changes in a linear, time-dependent manner, while the other evolved radially from a common variant. Over time, the two subpopulations cycled in predominance coincident with changes in the disease state, suggesting that the two groups differed in selective advantage. Transient expression assays indicated the two populations differed significantly in Rev nuclear export activity. Chimeric proviral clones containing Rev genotypes representative of each population differed in rate and overall level of virus replication in vitro. The coexistence of genetically distinct viral subpopulations that differ in phenotype provides great adaptability to environmental changes within the infected host. A quasispecies model with multiple subpopulations may provide additional insight into the nature of lentivirus reservoirs and the evolution of antigenic and drug-resistant variants.


2020 ◽  
Vol 10 (12) ◽  
pp. 906
Author(s):  
Max Schneider ◽  
Immanuel G. Elbau ◽  
Teachawidd Nantawisarakul ◽  
Dorothee Pöhlchen ◽  
Tanja Brückl ◽  
...  

Depression is a debilitating disorder with high prevalence and socioeconomic cost, but the brain-physiological processes that are altered during depressive states are not well understood. Here, we build on recent findings in macaques that indicate a direct causal relationship between pupil dilation and anterior cingulate cortex mediated arousal during anticipation of reward. We translated these findings to human subjects with concomitant pupillometry/fMRI in a sample of unmedicated participants diagnosed with major depression and healthy controls. We could show that the upregulation and maintenance of arousal in anticipation of reward was disrupted in patients in a symptom-load dependent manner. We could further show that the failure to maintain reward anticipatory arousal showed state-marker properties, as it tracked the load and impact of depressive symptoms independent of prior diagnosis status. Further, group differences of anticipatory arousal and continuous correlations with symptom load were not traceable only at the level of pupillometric responses, but were mirrored also at the neural level within salience network hubs. The upregulation and maintenance of arousal during reward anticipation is a novel translational and well-traceable process that could prove a promising gateway to a physiologically informed patient stratification and targeted interventions.


2020 ◽  
Vol 10 (6) ◽  
pp. 395
Author(s):  
Paola Feraco ◽  
Salvatore Nigro ◽  
Luca Passamonti ◽  
Alessandro Grecucci ◽  
Maria Eugenia Caligiuri ◽  
...  

(1) Background: Recently, a series of clinical neuroimaging studies on fibromyalgia (FM) have shown a reduction in cortical volume and abnormally high glutamate (Glu) and glutamate + glutamine (Glx) levels in regions associated with pain modulation. However, it remains unclear whether the volumetric decreases and increased Glu levels in FM are related each other. We hypothesized that higher Glu levels are related to decreases in cortical thickness (CT) and volume in FM patients. (2) Methods: Twelve females with FM and 12 matched healthy controls participated in a session of combined 3.0 Tesla structural magnetic resonance imaging (MRI) and single-voxel MR spectroscopy focused on the thalami and ventrolateral prefrontal cortices (VLPFC). The thickness of the cortical and subcortical gray matter structures and the Glu/Cr and Glx/Cr ratios were estimated. Statistics included an independent t-test and Spearman’s test. (3) Results: The Glu/Cr ratio of the left VLPFC was negatively related to the CT of the left inferior frontal gyrus (pars opercularis (p = 0.01; r = −0.75) and triangularis (p = 0.01; r = −0.70)). Moreover, the Glx/Cr ratio of the left VLPFC was negatively related to the CT of the left middle anterior cingulate gyrus (p = 0.003; r = −0.81). Significantly lower CTs in FM were detected in subparts of the cingulate gyrus on both sides and in the right inferior occipital gyrus (p < 0.001). (4) Conclusions: Our findings are in line with previous observations that high glutamate levels can be related, in a concentration-dependent manner, to the morphological atrophy described in FM patients.


2004 ◽  
Vol 92 (3) ◽  
pp. 1892-1903 ◽  
Author(s):  
Dana M. Small ◽  
Joel Voss ◽  
Y. Erica Mak ◽  
Katharine B. Simmons ◽  
Todd Parrish ◽  
...  

Flavor perception arises from the central integration of peripherally distinct sensory inputs (taste, smell, texture, temperature, sight, and even sound of foods). The results from psychophysical and neuroimaging studies in humans are converging with electrophysiological findings in animals and a picture of the neural correlates of flavor processing is beginning to emerge. Here we used event-related fMRI to evaluate brain response during perception of flavors (i.e., taste/odor liquid mixtures not differing in temperature or texture) compared with the sum of the independent presentation of their constituents (taste and/or odor). All stimuli were presented in liquid form so that olfactory stimulation was by the retronasal route. Mode of olfactory delivery is important because neural suppression has been observed in chemosensory regions during congruent taste–odor pairs when the odors are delivered by the orthonasal route and require subjects to sniff. There were 2 flavors. One contained a familiar/congruent taste–odor pair (vanilla/sweet) and the other an unfamiliar/incongruent taste–odor pair (vanilla/salty). Three unimodal stimuli, including 2 tastes (sweet and salty) and one odor (vanilla), as well as a tasteless/odorless liquid (baseline) were presented. Superadditive responses during the perception of the congruent flavor compared with the sum of its constituents were observed in the anterior cingulate cortex (ACC), dorsal insula, anterior ventral insula extending into the caudal orbitofrontal cortex (OFC), frontal operculum, ventral lateral prefrontal cortex, and posterior parietal cortex. These regions were not present in a similar analysis of the incongruent flavor compared with the sum of its constituents. All of these regions except the ventrolateral prefrontal cortex were also isolated in a direct contrast of congruent − incongruent. Additionally, the anterior cingulate, posterior parietal cortex, frontal operculum, and ventral insula/caudal OFC were also more active in vanilla + salty minus incongruent, suggesting that delivery of an unfamiliar taste–odor combination may lead to suppressed neural responses. Taken together with previous findings in the literature, these results suggest that the insula, OFC, and ACC are key components of the network underlying flavor perception and that taste–smell integration within these and other regions is dependent on 1) mode of olfactory delivery and 2) previous experience with taste/smell combinations.


2020 ◽  
Vol 10 (3) ◽  
pp. 136 ◽  
Author(s):  
Claudio Imperatori ◽  
Chiara Massullo ◽  
Giuseppe Alessio Carbone ◽  
Angelo Panno ◽  
Marta Giacchini ◽  
...  

An increasing body of experimental data have suggested that aberrant functional interactions between large-scale networks may be the most plausible explanation of psychopathology across multiple mental disorders, including substance-related and addictive disorders. In the current research, we have investigated the association between problematic cannabis use (PCU) and triple-network electroencephalographic (EEG) functional connectivity. Twelve participants with PCU and 24 non-PCU participants were included in the study. EEG recordings were performed during resting state (RS). The exact Low-Resolution Electromagnetic Tomography software (eLORETA) was used for all EEG analyses. Compared to non-PCU, PCU participants showed an increased delta connectivity between the salience network (SN) and central executive network (CEN), specifically, between the dorsal anterior cingulate cortex and right posterior parietal cortex. The strength of delta connectivity between the SN and CEN was positively and significantly correlated with higher problematic patterns of cannabis use after controlling for age, sex, educational level, tobacco use, problematic alcohol use, and general psychopathology (rp = 0.40, p = 0.030). Taken together, our results show that individuals with PCU could be characterized by a specific dysfunctional interaction between the SN and CEN during RS, which might reflect the neurophysiological underpinnings of attentional and emotional processes of cannabis-related thoughts, memories, and craving.


Sign in / Sign up

Export Citation Format

Share Document