Effects of Selective and Divided Attention on Audiovisual Interaction

2013 ◽  
pp. 311-319
Author(s):  
Weiping Yang ◽  
Yulin Gao ◽  
Jinglong Wu
Keyword(s):  
Everyday Life ◽  
Neural Activity ◽  
Divided Attention ◽  
Sensory Information ◽  
Audiovisual Integration ◽  
Neural Activities ◽  
Attention System ◽  
The Brain ◽  
Audiovisual Interaction

In everyday life, visual and auditory are the most common forms of sensory information. Therefore, audiovisual interaction in the brain plays an important role in performance and perception. In addition, our attention system allows us to dynamically select and enhance the processing of objects and events that are the most relevant at each moment. Some studies suggest that attention can modulate audiovisual integration. However, different neural activity of multimodal audiovisual integration can be seen in different attention conditions. This review focuses on the question of what affects selective and divided attention in audiovisual interaction. Neural activities of audiovisual under selective and divided attention conditions are also discussed. This review aims to bring together and summarize previous studies on the interactions between attention and audiovisual integration.

Decision making by urgency gating: theory and experimental support

2012 ◽  
Vol 108 (11) ◽  
pp. 2912-2930 ◽  
Author(s):  
David Thura ◽  
Julie Beauregard-Racine ◽  
Charles-William Fradet ◽  
Paul Cisek
Keyword(s):  
Decision Making ◽  
Neural Activity ◽  
Time Window ◽  
Sensory Information ◽  
Natural Conditions ◽  
Accuracy Criterion ◽  
Sensory Evidence ◽  
Dot Motion ◽  
The Brain ◽  
Random Dot Motion

It is often suggested that decisions are made when accumulated sensory information reaches a fixed accuracy criterion. This is supported by many studies showing a gradual build up of neural activity to a threshold. However, the proposal that this build up is caused by sensory accumulation is challenged by findings that decisions are based on information from a time window much shorter than the build-up process. Here, we propose that in natural conditions where the environment can suddenly change, the policy that maximizes reward rate is to estimate evidence by accumulating only novel information and then compare the result to a decreasing accuracy criterion. We suggest that the brain approximates this policy by multiplying an estimate of sensory evidence with a motor-related urgency signal and that the latter is primarily responsible for neural activity build up. We support this hypothesis using human behavioral data from a modified random-dot motion task in which motion coherence changes during each trial.

TOWARDS A DYNAMIC MODEL OF ASSOCIATIVE SEMANTIC MEMORY

1994 ◽  
Vol 02 (03) ◽  
pp. 401-411 ◽  
Author(s):  
L. RODET ◽  
G. TIBERGHIEN
Keyword(s):  
Neural Networks ◽  
Neural Activity ◽  
Single Neuron ◽  
Mental Representations ◽  
Single Stimulus ◽  
Neural Activities ◽  
Or Groups ◽  
Multiple Levels ◽  
Concept Activation ◽  
The Brain

When we analyze a particular stimulus, a number of neurons in the brain are specifically activated. The recognition of a visual pattern can be interpreted as the activation of a particular group of such neurons, in a particular way. Some recent results [5] have shown that a group of neurons may respond to a stimulus with a coupled activity. This notion of coupled neural activity can be used to understand the multiple levels of parallelism in the brain. It is known that, in response to a single stimulus, many mental representations are activated in parallel [1]. Our objective is to examine how coupled activity of groups of neurons can explain this parallelism of concept activation in the brain. The neural activity of a single neuron or groups of neurons is simulated. Simple neural networks combining groups of neurons could also be used to simulate the synchronization of neural activities.

Relation Between Level of Prefrontal Activity and Subject's Performance

1999 ◽  
Vol 13 (2) ◽  
pp. 117-125 ◽  
Author(s):  
Laurence Casini ◽  
Françoise Macar ◽  
Marie-Hélène Giard
Keyword(s):  
Brain Activity ◽  
Sensory Information ◽  
Practice Phase ◽  
Trained Subjects ◽  
Anagram Task ◽  
Economic Information ◽  
Long Duration ◽  
Level Of Activity ◽  
The Brain ◽  
Processing Mechanism

Abstract The experiment reported here was aimed at determining whether the level of brain activity can be related to performance in trained subjects. Two tasks were compared: a temporal and a linguistic task. An array of four letters appeared on a screen. In the temporal task, subjects had to decide whether the letters remained on the screen for a short or a long duration as learned in a practice phase. In the linguistic task, they had to determine whether the four letters could form a word or not (anagram task). These tasks allowed us to compare the level of brain activity obtained in correct and incorrect responses. The current density measures recorded over prefrontal areas showed a relationship between the performance and the level of activity in the temporal task only. The level of activity obtained with correct responses was lower than that obtained with incorrect responses. This suggests that a good temporal performance could be the result of an efficacious, but economic, information-processing mechanism in the brain. In addition, the absence of this relation in the anagram task results in the question of whether this relation is specific to the processing of sensory information only.

Measuring the World

2018 ◽  
Author(s):  
Ann-Sophie Barwich
Keyword(s):  
Sensory Information ◽  
Network Models ◽  
Model System ◽  
Stimulus Input ◽  
Expectancy Effects ◽  
Neural Network Models ◽  
Perceptual Object ◽  
External Objects ◽  
The Common ◽  
The Brain

How much does stimulus input shape perception? The common-sense view is that our perceptions are representations of objects and their features and that the stimulus structures the perceptual object. The problem for this view concerns perceptual biases as responsible for distortions and the subjectivity of perceptual experience. These biases are increasingly studied as constitutive factors of brain processes in recent neuroscience. In neural network models the brain is said to cope with the plethora of sensory information by predicting stimulus regularities on the basis of previous experiences. Drawing on this development, this chapter analyses perceptions as processes. Looking at olfaction as a model system, it argues for the need to abandon a stimulus-centred perspective, where smells are thought of as stable percepts, computationally linked to external objects such as odorous molecules. Perception here is presented as a measure of changing signal ratios in an environment informed by expectancy effects from top-down processes.

scholarly journals fNIRS Signal Classification Based on Deep Learning in Rock-Paper-Scissors Imagery Task

2021 ◽  
Vol 11 (11) ◽  
pp. 4922
Author(s):  
Tengfei Ma ◽  
Wentian Chen ◽  
Xin Li ◽  
Yuting Xia ◽  
Xinhua Zhu ◽  
...  
Keyword(s):  
Deep Learning ◽  
Total Duration ◽  
Signal Classification ◽  
Imagery Task ◽  
Neural Activities ◽  
Computer Interfaces ◽  
Acquisition Device ◽  
The Time Domain ◽  
The Brain

To explore whether the brain contains pattern differences in the rock–paper–scissors (RPS) imagery task, this paper attempts to classify this task using fNIRS and deep learning. In this study, we designed an RPS task with a total duration of 25 min and 40 s, and recruited 22 volunteers for the experiment. We used the fNIRS acquisition device (FOIRE-3000) to record the cerebral neural activities of these participants in the RPS task. The time series classification (TSC) algorithm was introduced into the time-domain fNIRS signal classification. Experiments show that CNN-based TSC methods can achieve 97% accuracy in RPS classification. CNN-based TSC method is suitable for the classification of fNIRS signals in RPS motor imagery tasks, and may find new application directions for the development of brain–computer interfaces (BCI).

Coding of Temporally Varying Signals in Networks of Spiking Neurons with Global Delayed Feedback

2005 ◽  
Vol 17 (10) ◽  
pp. 2139-2175 ◽  
Author(s):  
Naoki Masuda ◽  
Brent Doiron ◽  
André Longtin ◽  
Kazuyuki Aihara
Keyword(s):  
Information Processing ◽  
Stimulus Frequency ◽  
Spiking Neurons ◽  
Feedforward Networks ◽  
Dynamical Characteristics ◽  
Neural Activities ◽  
Inherent Frequency ◽  
Types Of Information ◽  
The Brain

Oscillatory and synchronized neural activities are commonly found in the brain, and evidence suggests that many of them are caused by global feedback. Their mechanisms and roles in information processing have been discussed often using purely feedforward networks or recurrent networks with constant inputs. On the other hand, real recurrent neural networks are abundant and continually receive information-rich inputs from the outside environment or other parts of the brain. We examine how feedforward networks of spiking neurons with delayed global feedback process information about temporally changing inputs. We show that the network behavior is more synchronous as well as more correlated with and phase-locked to the stimulus when the stimulus frequency is resonant with the inherent frequency of the neuron or that of the network oscillation generated by the feedback architecture. The two eigenmodes have distinct dynamical characteristics, which are supported by numerical simulations and by analytical arguments based on frequency response and bifurcation theory. This distinction is similar to the class I versus class II classification of single neurons according to the bifurcation from quiescence to periodic firing, and the two modes depend differently on system parameters. These two mechanisms may be associated with different types of information processing.

scholarly journals The emulation theory of representation: Motor control, imagery, and perception

2004 ◽  
Vol 27 (3) ◽  
pp. 377-396 ◽  
Author(s):  
Rick Grush
Keyword(s):  
Motor Control ◽  
Sensory Feedback ◽  
Sensory Input ◽  
Neural Circuits ◽  
Sensory Information ◽  
The Body ◽  
Feedback Delay ◽  
Run Off ◽  
Effects Of Feedback ◽  
The Brain

The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language.

scholarly journals Perceptual decisions are biased toward relevant prior choices

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Helen Feigin ◽  
Shira Baror ◽  
Moshe Bar ◽  
Adam Zaidel
Keyword(s):  
Sensory Information ◽  
Irrelevant Stimulus ◽  
Stimulus Feature ◽  
Serial Dependence ◽  
Low Level ◽  
Subsequent Test ◽  
Key Factor ◽  
High Level ◽  
Motor Actions ◽  
The Brain

AbstractPerceptual decisions are biased by recent perceptual history—a phenomenon termed 'serial dependence.' Here, we investigated what aspects of perceptual decisions lead to serial dependence, and disambiguated the influences of low-level sensory information, prior choices and motor actions. Participants discriminated whether a brief visual stimulus lay to left/right of the screen center. Following a series of biased ‘prior’ location discriminations, subsequent ‘test’ location discriminations were biased toward the prior choices, even when these were reported via different motor actions (using different keys), and when the prior and test stimuli differed in color. By contrast, prior discriminations about an irrelevant stimulus feature (color) did not substantially influence subsequent location discriminations, even though these were reported via the same motor actions. Additionally, when color (not location) was discriminated, a bias in prior stimulus locations no longer influenced subsequent location discriminations. Although low-level stimuli and motor actions did not trigger serial-dependence on their own, similarity of these features across discriminations boosted the effect. These findings suggest that relevance across perceptual decisions is a key factor for serial dependence. Accordingly, serial dependence likely reflects a high-level mechanism by which the brain predicts and interprets new incoming sensory information in accordance with relevant prior choices.

scholarly journals Harmonic Brain Modes: A Unifying Framework for Linking Space and Time in Brain Dynamics

2017 ◽  
Vol 24 (3) ◽  
pp. 277-293 ◽  
Author(s):  
Selen Atasoy ◽  
Gustavo Deco ◽  
Morten L. Kringelbach ◽  
Joel Pearson
Keyword(s):  
Neural Activity ◽  
Brain Activity ◽  
Activity Patterns ◽  
Structural Connectivity ◽  
Building Blocks ◽  
Mental States ◽  
Brain Dynamics ◽  
Space And Time ◽  
Wide Range ◽  
The Brain

A fundamental characteristic of spontaneous brain activity is coherent oscillations covering a wide range of frequencies. Interestingly, these temporal oscillations are highly correlated among spatially distributed cortical areas forming structured correlation patterns known as the resting state networks, although the brain is never truly at “rest.” Here, we introduce the concept of harmonic brain modes—fundamental building blocks of complex spatiotemporal patterns of neural activity. We define these elementary harmonic brain modes as harmonic modes of structural connectivity; that is, connectome harmonics, yielding fully synchronous neural activity patterns with different frequency oscillations emerging on and constrained by the particular structure of the brain. Hence, this particular definition implicitly links the hitherto poorly understood dimensions of space and time in brain dynamics and its underlying anatomy. Further we show how harmonic brain modes can explain the relationship between neurophysiological, temporal, and network-level changes in the brain across different mental states ( wakefulness, sleep, anesthesia, psychedelic). Notably, when decoded as activation of connectome harmonics, spatial and temporal characteristics of neural activity naturally emerge from the interplay between excitation and inhibition and this critical relation fits the spatial, temporal, and neurophysiological changes associated with different mental states. Thus, the introduced framework of harmonic brain modes not only establishes a relation between the spatial structure of correlation patterns and temporal oscillations (linking space and time in brain dynamics), but also enables a new dimension of tools for understanding fundamental principles underlying brain dynamics in different states of consciousness.

scholarly journals The restless brain: how intrinsic activity organizes brain function

2015 ◽  
Vol 370 (1668) ◽  
pp. 20140172 ◽  
Author(s):  
Marcus E. Raichle
Keyword(s):  
Brain Function ◽  
Functional Organization ◽  
Sensory Information ◽  
Intrinsic Activity ◽  
Systems Neuroscience ◽  
Brain Functions ◽  
Molecular Neuroscience ◽  
Constant State ◽  
Health And Disease ◽  
The Brain

Traditionally studies of brain function have focused on task-evoked responses. By their very nature such experiments tacitly encourage a reflexive view of brain function. While such an approach has been remarkably productive at all levels of neuroscience, it ignores the alternative possibility that brain functions are mainly intrinsic and ongoing, involving information processing for interpreting, responding to and predicting environmental demands. I suggest that the latter view best captures the essence of brain function, a position that accords well with the allocation of the brain's energy resources, its limited access to sensory information and a dynamic, intrinsic functional organization. The nature of this intrinsic activity, which exhibits a surprising level of organization with dimensions of both space and time, is revealed in the ongoing activity of the brain and its metabolism. As we look to the future, understanding the nature of this intrinsic activity will require integrating knowledge from cognitive and systems neuroscience with cellular and molecular neuroscience where ion channels, receptors, components of signal transduction and metabolic pathways are all in a constant state of flux. The reward for doing so will be a much better understanding of human behaviour in health and disease.

Sign in / Sign up

Export Citation Format

Share Document