Saliency-based Rhythmic Coordination of Perceptual Predictions

2020 ◽  
Vol 32 (2) ◽  
pp. 201-211 ◽  
Author(s):  
Qiaoli Huang ◽  
Huan Luo

Objects, shown explicitly or held in mind internally, compete for limited processing resources. Recent studies have demonstrated that attention samples locations and objects rhythmically. Interestingly, periodic sampling not only operates over objects in the same scene but also occurs for multiple perceptual predictions that are held in attention for incoming inputs. However, how the brain coordinates perceptual predictions that are endowed with different levels of bottom–up saliency information remains unclear. To address the issue, we used a fine-grained behavioral measurement to investigate the temporal dynamics of processing of high- and low-salient visual stimuli, which have equal possibility to occur within experimental blocks. We demonstrate that perceptual predictions associated with different levels of saliency are organized via a theta-band rhythmic course and are optimally processed in different phases within each theta-band cycle. Meanwhile, when the high- and low-salient stimuli are presented in separate blocks and thus not competing with each other, the periodic behavioral profile is no longer present. In summary, our findings suggest that attention samples and coordinates multiple perceptual predictions through a theta-band rhythm according to their relative saliency. Our results, in combination with previous studies, advocate the rhythmic nature of attentional process.

2018 ◽  
Vol 119 (4) ◽  
pp. 1356-1366 ◽  
Author(s):  
Shen-Mou Hsu ◽  
Yu-Fang Yang

An important issue facing the empirical study of consciousness concerns how the contents of incoming stimuli gain access to conscious processing. According to classic theories, facial stimuli are processed in a hierarchical manner. However, it remains unclear how the brain determines which level of stimulus content is consciously accessible when facing an incoming facial stimulus. Accordingly, with a magnetoencephalography technique, this study aims to investigate the temporal dynamics of the neural mechanism mediating which level of stimulus content is consciously accessible. Participants were instructed to view masked target faces at threshold so that, according to behavioral responses, their perceptual awareness alternated from consciously accessing facial identity in some trials to being able to consciously access facial configuration features but not facial identity in other trials. Conscious access at these two levels of facial contents were associated with a series of differential neural events. Before target presentation, different patterns of phase angle adjustment were observed between the two types of conscious access. This effect was followed by stronger phase clustering for awareness of facial identity immediately during stimulus presentation. After target onset, conscious access to facial identity, as opposed to facial configural features, was able to elicit more robust late positivity. In conclusion, we suggest that the stages of neural events, ranging from prestimulus to stimulus-related activities, may operate in combination to determine which level of stimulus contents is consciously accessed. Conscious access may thus be better construed as comprising various forms that depend on the level of stimulus contents accessed. NEW & NOTEWORTHY The present study investigates how the brain determines which level of stimulus contents is consciously accessible when facing an incoming facial stimulus. Using magnetoencephalography, we show that prestimulus activities together with stimulus-related activities may operate in combination to determine conscious face detection or identification. This finding is distinct from the previous notion that conscious face detection precedes identification and provides novel insights into the temporal dynamics of different levels of conscious face perception.


2019 ◽  
Vol 121 (5) ◽  
pp. 1588-1590 ◽  
Author(s):  
Luca Casartelli

Neural, oscillatory, and computational counterparts of multisensory processing remain a crucial challenge for neuroscientists. Converging evidence underlines a certain efficiency in balancing stability and flexibility of sensory sampling, supporting the general idea that multiple parallel and hierarchically organized processing stages in the brain contribute to our understanding of the (sensory/perceptual) world. Intriguingly, how temporal dynamics impact and modulate multisensory processes in our brain can be investigated benefiting from studies on perceptual illusions.


2020 ◽  
Vol 319 (3) ◽  
pp. R366-R375
Author(s):  
Hugo F. Posada-Quintero ◽  
Youngsun Kong ◽  
Kimberly Nguyen ◽  
Cara Tran ◽  
Luke Beardslee ◽  
...  

We have tested the feasibility of thermal grills, a harmless method to induce pain. The thermal grills consist of interlaced tubes that are set at cool or warm temperatures, creating a painful “illusion” (no tissue injury is caused) in the brain when the cool and warm stimuli are presented collectively. Advancement in objective pain assessment research is limited because the gold standard, the self-reporting pain scale, is highly subjective and only works for alert and cooperative patients. However, the main difficulty for pain studies is the potential harm caused to participants. We have recruited 23 subjects in whom we induced electric pulses and thermal grill (TG) stimulation. The TG effectively induced three different levels of pain, as evidenced by the visual analog scale (VAS) provided by the subjects after each stimulus. Furthermore, objective physiological measurements based on electrodermal activity showed a significant increase in levels as stimulation level increased. We found that VAS was highly correlated with the TG stimulation level. The TG stimulation safely elicited pain levels up to 9 out of 10. The TG stimulation allows for extending studies of pain to ranges of pain in which other stimuli are harmful.


2015 ◽  
Vol 370 (1668) ◽  
pp. 20140170 ◽  
Author(s):  
Riitta Hari ◽  
Lauri Parkkonen

We discuss the importance of timing in brain function: how temporal dynamics of the world has left its traces in the brain during evolution and how we can monitor the dynamics of the human brain with non-invasive measurements. Accurate timing is important for the interplay of neurons, neuronal circuitries, brain areas and human individuals. In the human brain, multiple temporal integration windows are hierarchically organized, with temporal scales ranging from microseconds to tens and hundreds of milliseconds for perceptual, motor and cognitive functions, and up to minutes, hours and even months for hormonal and mood changes. Accurate timing is impaired in several brain diseases. From the current repertoire of non-invasive brain imaging methods, only magnetoencephalography (MEG) and scalp electroencephalography (EEG) provide millisecond time-resolution; our focus in this paper is on MEG. Since the introduction of high-density whole-scalp MEG/EEG coverage in the 1990s, the instrumentation has not changed drastically; yet, novel data analyses are advancing the field rapidly by shifting the focus from the mere pinpointing of activity hotspots to seeking stimulus- or task-specific information and to characterizing functional networks. During the next decades, we can expect increased spatial resolution and accuracy of the time-resolved brain imaging and better understanding of brain function, especially its temporal constraints, with the development of novel instrumentation and finer-grained, physiologically inspired generative models of local and network activity. Merging both spatial and temporal information with increasing accuracy and carrying out recordings in naturalistic conditions, including social interaction, will bring much new information about human brain function.


Author(s):  
Ehsan T. Esfahani ◽  
Shrey Pareek ◽  
Pramod Chembrammel ◽  
Mostafa Ghobadi ◽  
Thenkurussi Kesavadas

Recognition of user’s mental engagement is imperative to the success of robotic rehabilitation. The paper explores the novel paradigm in robotic rehabilitation of using Passive BCI as opposed to the conventional Active ones. We have designed experiments to determine a user’s level of mental engagement. In our experimental study, we record the brain activity of 3 healthy subjects during multiple sessions where subjects need to navigate through a maze using a haptic system with variable resistance/assistance. Using the data obtained through the experiments we highlight the drawbacks of using conventional workload metrics as indicators of human engagement, thus asserting that Motor and Cognitive Workloads be differentiated. Additionally we propose a new set of features: differential PSD of Cz-Poz at alpha, Beta and Sigma band, (Mental engagement) and relative C3-C4 at beta (Motor Workload) to distinguish Normal Cases from those instances when haptic where applied with an accuracy of 92.93%. Mental engagement is calculated using the power spectral density of the Theta band (4–7 Hz) in the parietal-midline (Pz) with respect to the central midline (Cz). The above information can be used to adjust robotic rehabilitation parameters I accordance with the user’s needs. The adjustment may be in the force levels, difficulty level of the task or increasing the speed of the task.


PLoS Biology ◽  
2021 ◽  
Vol 19 (11) ◽  
pp. e3001465
Author(s):  
Ambra Ferrari ◽  
Uta Noppeney

To form a percept of the multisensory world, the brain needs to integrate signals from common sources weighted by their reliabilities and segregate those from independent sources. Previously, we have shown that anterior parietal cortices combine sensory signals into representations that take into account the signals’ causal structure (i.e., common versus independent sources) and their sensory reliabilities as predicted by Bayesian causal inference. The current study asks to what extent and how attentional mechanisms can actively control how sensory signals are combined for perceptual inference. In a pre- and postcueing paradigm, we presented observers with audiovisual signals at variable spatial disparities. Observers were precued to attend to auditory or visual modalities prior to stimulus presentation and postcued to report their perceived auditory or visual location. Combining psychophysics, functional magnetic resonance imaging (fMRI), and Bayesian modelling, we demonstrate that the brain moulds multisensory inference via 2 distinct mechanisms. Prestimulus attention to vision enhances the reliability and influence of visual inputs on spatial representations in visual and posterior parietal cortices. Poststimulus report determines how parietal cortices flexibly combine sensory estimates into spatial representations consistent with Bayesian causal inference. Our results show that distinct neural mechanisms control how signals are combined for perceptual inference at different levels of the cortical hierarchy.


2019 ◽  
Author(s):  
Ulrik Beierholm ◽  
Tim Rohe ◽  
Ambra Ferrari ◽  
Oliver Stegle ◽  
Uta Noppeney

AbstractTo form the most reliable percept of the environment, the brain needs to represent sensory uncertainty. Current theories of perceptual inference assume that the brain computes sensory uncertainty instantaneously and independently for each stimulus.In a series of psychophysics experiments human observers localized auditory signals that were presented in synchrony with spatially disparate visual signals. Critically, the visual noise changed dynamically over time with or without intermittent jumps. Our results show that observers integrate audiovisual inputs weighted by sensory reliability estimates that combine information from past and current signals as predicted by an optimal Bayesian learner or approximate strategies of exponential discountingOur results challenge classical models of perceptual inference where sensory uncertainty estimates depend only on the current stimulus. They demonstrate that the brain capitalizes on the temporal dynamics of the external world and estimates sensory uncertainty by combining past experiences with new incoming sensory signals.


2019 ◽  
Author(s):  
Dick R Nässel ◽  
Dennis Pauls ◽  
Wolf Huetteroth

Neuropeptides constitute a large and diverse class of signaling molecules that are produced by many types of neurons, neurosecretory cells, endocrines and other cells. Many neuropeptides display pleiotropic actions either as neuromodulators, co-transmitters or circulating hormones, while some play these roles concurrently. Here, we highlight pleiotropic functions of neuropeptides and different levels of neuropeptide signaling in the brain, from context-dependent orchestrating signaling by higher order neurons, to local executive modulation in specific circuits. Additionally, orchestrating neurons receive peptidergic signals from neurons conveying organismal internal state cues and relay these to executive circuits. We exemplify these levels of signaling with four neuropeptides, SIFamide, short neuropeptide F, allatostatin-A and leucokinin, each with a specific expression pattern and level of complexity in signaling.


Algorithms ◽  
2021 ◽  
Vol 14 (10) ◽  
pp. 290
Author(s):  
Kai Ma ◽  
Ming-Jun Nie ◽  
Sen Lin ◽  
Jianlei Kong ◽  
Cheng-Cai Yang ◽  
...  

Accurate identification of insect pests is the key to improve crop yield and ensure quality and safety. However, under the influence of environmental conditions, the same kind of pests show obvious differences in intraclass representation, while the different kinds of pests show slight similarities. The traditional methods have been difficult to deal with fine-grained identification of pests, and their practical deployment is low. In order to solve this problem, this paper uses a variety of equipment terminals in the agricultural Internet of Things to obtain a large number of pest images and proposes a fine-grained identification model of pests based on probability fusion network FPNT. This model designs a fine-grained feature extractor based on an optimized CSPNet backbone network, mining different levels of local feature expression that can distinguish subtle differences. After the integration of the NetVLAD aggregation layer, the gated probability fusion layer gives full play to the advantages of information complementarity and confidence coupling of multi-model fusion. The comparison test shows that the PFNT model has an average recognition accuracy of 93.18% for all kinds of pests, and its performance is better than other deep-learning methods, with the average processing time drop to 61 ms, which can meet the needs of fine-grained image recognition of pests in the Internet of Things in agricultural and forestry practice, and provide technical application reference for intelligent early warning and prevention of pests.


2021 ◽  
Author(s):  
Ivan Abraham ◽  
Bahar Shahsavarani ◽  
Ben Zimmerman ◽  
Fatima Husain ◽  
yuliy baryshnikov

Fine-grained information about dynamic structure of cortical networks is crucial in unpacking brain function. Here,we introduced a novel analytical method to characterize the dynamic interaction between distant brain regions,based on cyclicity analysis, and applied it to data from the Human Connectome Project. Resting-state fMRI time series are aperiodic and, hence, lack a base frequency. Cyclicity analysis, which is time-reparametrization invariant, is effective in recovering dynamic temporal ordering of such time series along a circular trajectory without assuming any time scale. Our analysis detected the propagation of slow cortical waves across thebrain with consistent shifts in lead-lag relationships between specific brain regions. We also observed short bursts of strong temporal ordering that dominated overall lead-lag relationships between pairs of regions in the brain, which were modulated by tasks. Our results suggest the possible role played by slow waves of ordered information between brain regions that underlie emergent cognitive function.


Sign in / Sign up

Export Citation Format

Share Document