scholarly journals Characterizing the effects of feature salience and top-down attention in the early visual system

2017 ◽  
Vol 118 (1) ◽  
pp. 564-573 ◽  
Author(s):  
Sonia Poltoratski ◽  
Sam Ling ◽  
Devin McCormack ◽  
Frank Tong
Keyword(s):  
Visual System ◽  
Spatial Attention ◽  
Visual Processing ◽  
Visual Pathway ◽  
Additive Effects ◽  
Voluntary Attention ◽  
Top Down ◽  
Motion Direction ◽  
Bottom Up ◽  
Visual Areas

The visual system employs a sophisticated balance of attentional mechanisms: salient stimuli are prioritized for visual processing, yet observers can also ignore such stimuli when their goals require directing attention elsewhere. A powerful determinant of visual salience is local feature contrast: if a local region differs from its immediate surround along one or more feature dimensions, it will appear more salient. We used high-resolution functional MRI (fMRI) at 7T to characterize the modulatory effects of bottom-up salience and top-down voluntary attention within multiple sites along the early visual pathway, including visual areas V1–V4 and the lateral geniculate nucleus (LGN). Observers viewed arrays of spatially distributed gratings, where one of the gratings immediately to the left or right of fixation differed from all other items in orientation or motion direction, making it salient. To investigate the effects of directed attention, observers were cued to attend to the grating to the left or right of fixation, which was either salient or nonsalient. Results revealed reliable additive effects of top-down attention and stimulus-driven salience throughout visual areas V1–hV4. In comparison, the LGN exhibited significant attentional enhancement but was not reliably modulated by orientation- or motion-defined salience. Our findings indicate that top-down effects of spatial attention can influence visual processing at the earliest possible site along the visual pathway, including the LGN, whereas the processing of orientation- and motion-driven salience primarily involves feature-selective interactions that take place in early cortical visual areas. NEW & NOTEWORTHY While spatial attention allows for specific, goal-driven enhancement of stimuli, salient items outside of the current focus of attention must also be prioritized. We used 7T fMRI to compare salience and spatial attentional enhancement along the early visual hierarchy. We report additive effects of attention and bottom-up salience in early visual areas, suggesting that salience enhancement is not contingent on the observer’s attentional state.

scholarly journals The relative coding strength of object identity and nonidentity features in human occipito-temporal cortex and convolutional neural networks

2020 ◽  
Author(s):  
Yaoda Xu ◽  
Maryam Vaziri-Pashkam
Keyword(s):  
Visual Processing ◽  
Visual Pathway ◽  
Feature Representation ◽  
Object Categorization ◽  
Object Identity ◽  
Visual Areas ◽  
Ventral Visual Pathway ◽  
Identity Representation ◽  
The Brain ◽  
Early Human

ABSTRACTAny given visual object input is characterized by multiple visual features, such as identity, position and size. Despite the usefulness of identity and nonidentity features in vision and their joint coding throughout the primate ventral visual processing pathway, they have so far been studied relatively independently. Here we document the relative coding strength of object identity and nonidentity features in a brain region and how this may change across the human ventral visual pathway. We examined a total of four nonidentity features, including two Euclidean features (position and size) and two non-Euclidean features (image statistics and spatial frequency content of an image). Overall, identity representation increased and nonidentity feature representation decreased along the ventral visual pathway, with identity outweighed the non-Euclidean features, but not the Euclidean ones, in higher levels of visual processing. A similar analysis was performed in 14 convolutional neural networks (CNNs) pretrained to perform object categorization with varying architecture, depth, and with/without recurrent processing. While the relative coding strength of object identity and nonidentity features in lower CNN layers matched well with that in early human visual areas, the match between higher CNN layers and higher human visual regions were limited. Similar results were obtained regardless of whether a CNN was trained with real-world or stylized object images that emphasized shape representation. Together, by measuring the relative coding strength of object identity and nonidentity features, our approach provided a new tool to characterize feature coding in the human brain and the correspondence between the brain and CNNs.SIGNIFICANCE STATEMENTThis study documented the relative coding strength of object identity compared to four types of nonidentity features along the human ventral visual processing pathway and compared brain responses with those of 14 CNNs pretrained to perform object categorization. Overall, identity representation increased and nonidentity feature representation decreased along the ventral visual pathway, with the coding strength of the different nonidentity features differed at higher levels of visual processing. While feature coding in lower CNN layers matched well with that of early human visual areas, the match between higher CNN layers and higher human visual regions were limited. Our approach provided a new tool to characterize feature coding in the human brain and the correspondence between the brain and CNNs.

Top-Down Predictions Determine Perceptions

2017 ◽  
Author(s):  
Martin V. Butz ◽  
Esther F. Kutter
Keyword(s):  
Graphical Models ◽  
Information Integration ◽  
Visual Processing ◽  
Visual Information ◽  
Generative Models ◽  
Sources Of Information ◽  
Multiple Sources ◽  
Top Down ◽  
Bottom Up ◽  
The Brain

While bottom-up visual processing is important, the brain integrates this information with top-down, generative expectations from very early on in the visual processing hierarchy. Indeed, our brain should not be viewed as a classification system, but rather as a generative system, which perceives something by integrating sensory evidence with the available, learned, predictive knowledge about that thing. The involved generative models continuously produce expectations over time, across space, and from abstracted encodings to more concrete encodings. Bayesian information processing is the key to understand how information integration must work computationally – at least in approximation – also in the brain. Bayesian networks in the form of graphical models allow the modularization of information and the factorization of interactions, which can strongly improve the efficiency of generative models. The resulting generative models essentially produce state estimations in the form of probability densities, which are very well-suited to integrate multiple sources of information, including top-down and bottom-up ones. A hierarchical neural visual processing architecture illustrates this point even further. Finally, some well-known visual illusions are shown and the perceptions are explained by means of generative, information integrating, perceptual processes, which in all cases combine top-down prior knowledge and expectations about objects and environments with the available, bottom-up visual information.

Visual Attention With Cognitive Aging

2019 ◽  
Author(s):  
David J. Madden ◽  
Zachary A. Monge
Keyword(s):  
Visual Attention ◽  
Visual Processing ◽  
Cognitive Aging ◽  
Brain Regions ◽  
Object Identification ◽  
Features Selection ◽  
Top Down ◽  
Bottom Up ◽  
Attentional Functioning ◽  
Age Related

Age-related decline occurs in several aspects of fluid, speed-dependent cognition, particularly those related to attention. Empirical research on visual attention has determined that attention-related effects occur across a range of information processing components, including the sensory registration of features, selection of information from working memory, controlling motor responses, and coordinating multiple perceptual and cognitive tasks. Thus, attention is a multifaceted construct that is relevant at virtually all stages of object identification. A fundamental theme of attentional functioning is the interaction between the bottom-up salience of visual features and top-down allocation of processing based on the observer’s goals. An underlying age-related slowing is prominent throughout visual processing stages, which in turn contributes to age-related decline in some aspects of attention, such as the inhibition of irrelevant information and the coordination of multiple tasks. However, some age-related preservation of attentional functioning is also evident, particularly the top-down allocation of attention. Neuroimaging research has identified networks of frontal and parietal brain regions relevant for top-down and bottom-up attentional processing. Disconnection among these networks contributes to an age-related decline in attention, but preservation and perhaps even increased patterns of functional brain activation and connectivity also contribute to preserved attentional functioning.

scholarly journals Age-Related Changes in the Neural Dynamics of Bottom-Up and Top-Down Processing During Visual Object Recognition: An Electrophysiological Investigation

2019 ◽  
Author(s):  
Leslie Y. Lai ◽  
Romy Frömer ◽  
Elena K. Festa ◽  
William C. Heindel
Keyword(s):  
Object Recognition ◽  
Visual Processing ◽  
Semantic Integration ◽  
Object Identification ◽  
Neural Dynamics ◽  
Visual Object ◽  
Elderly Adults ◽  
Top Down ◽  
Bottom Up ◽  
Increased Sensitivity

ABSTRACTWhen recognizing objects in our environments, we rely on both what we see and what we know. While elderly adults have been found to display increased sensitivity to top-down influences of contextual information during object recognition, the locus of this increased sensitivity remains unresolved. To address this issue, we examined the effects of aging on the neural dynamics of bottom-up and top-down visual processing during rapid object recognition. Specific EEG ERP components indexing bottom-up and top-down processes along the visual processing stream were assessed while systematically manipulating the degree of object ambiguity and scene context congruity. An increase in early attentional feedback mechanisms (as indexed by N1) as well as a functional reallocation of executive attentional resources (as indexed by P200) prior to object identification were observed in elderly adults, while post-perceptual semantic integration (as indexed by N400) remained intact. These findings suggest that compromised bottom-up perceptual processing of visual input in healthy aging leads to an increased involvement of top-down processes to resolve greater perceptual ambiguity during object recognition.

scholarly journals Exploring Bottom-Up Visual Processing and Visual Hallucinations in Parkinson's Disease With Dementia

2021 ◽  
Vol 11 ◽  
Author(s):  
Nicholas Murphy ◽  
Alison Killen ◽  
Rajnish Kumar Gupta ◽  
Sara Graziadio ◽  
Lynn Rochester ◽  
...  
Keyword(s):  
Parkinson’S Disease ◽  
Parkinson's Disease ◽  
Visual System ◽  
Visual Processing ◽  
Pattern Reversal ◽  
Common Symptom ◽  
Visual Hallucinations ◽  
Bottom Up ◽  
Parkinson’S Disease With Dementia ◽  
System Physiology

Visual hallucinations (VH) are a common symptom of Parkinson's disease with dementia (PDD), affecting up to 65% of cases. Integrative models of their etiology posit that a decline in executive control of the visuo-perceptual system is a primary mechanism of VH generation. The role of bottom-up processing in the manifestation of VH in this condition is still not clear although visual evoked potential (VEP) differences have been associated with VH at an earlier stage of PD. Here we compared the amplitude and latency pattern reversal VEPs in healthy controls (n = 21) and PDD patients (n = 34) with a range of VH severities. PDD patients showed increased N2 latency relative to controls, but no significant differences in VEP measures were found for patients reporting complex VH (CVH) (n = 17) compared to those without VH. Our VEP findings support previous reports of declining visual system physiology in PDD and some evidence of visual system differences between patients with and without VH. However, we did not replicate previous findings of a major relationships between the integrity of the visual pathway and VH.

Voluntary and Stimulus-Induced Attention Detected as Motion Sensation

Perception ◽  
1993 ◽  
Vol 22 (5) ◽  
pp. 517-526 ◽  
Author(s):  
Okihide Hikosaka ◽  
Satoru Miyauchi ◽  
Shinsuke Shimojo
Keyword(s):  
Information Processing ◽  
Response Bias ◽  
Visual Information ◽  
Stimulus Change ◽  
Early Stage ◽  
Visual Information Processing ◽  
Salient Object ◽  
Voluntary Attention ◽  
Top Down ◽  
Bottom Up

Attention may be drawn passively to a visually salient object. We may also actively direct attention to an object of interest. Do the two kinds of attention, passive and active, interact and jointly influence visual information processing at some neural level? What happens if the passive and active attentions come into conflict? These questions were addressed with the aid of a novel psychophysical technique which reveals an attentional gradient as a sensation of motion in a line which is presented instantaneously. The subjects were asked to direct attention with voluntary effort: to the side opposite to a stimulus change, to an object with a predetermined colour, and to an object moving smoothly. In every case the same motion sensation was induced in the line from the attended side to the unattended side. This voluntary attention, however, can easily and quickly be distracted by a change in the periphery, though it can be regained within a period of 200 to 500 ms. The results suggest that the line motion can be induced in voluntary (top-down) as well as stimulus-driven (bottom-up) situations, thus indicating the truly attentional nature of the effect, rather than it being some kind of retinotopic sensory artifact or response bias. The results also suggest that these two kinds of attention have facilitatory effects acting together on a relatively early stage of visual information processing.

scholarly journals Spatial specificity and inheritance of adaptation in human visual cortex

2015 ◽  
Vol 114 (2) ◽  
pp. 1211-1226 ◽  
Author(s):  
Jonas Larsson ◽  
Sarah J. Harrison
Keyword(s):  
Visual Cortex ◽  
Visual Processing ◽  
Visual Motion ◽  
Downstream Processing ◽  
Selective Adaptation ◽  
Motion Direction ◽  
Visual Areas ◽  
Spatial Specificity ◽  
Fmri Adaptation ◽  
The Impact

Adaptation at early stages of sensory processing can be propagated to downstream areas. Such inherited adaptation is a potential confound for functional magnetic resonance imaging (fMRI) techniques that use selectivity of adaptation to infer neuronal selectivity. However, the relative contributions of inherited and intrinsic adaptation at higher cortical stages, and the impact of inherited adaptation on downstream processing, remain unclear. Using fMRI, we investigated how adaptation to visual motion direction and orientation influences visually evoked responses in human V1 and extrastriate visual areas. To dissociate inherited from intrinsic adaptation, we quantified the spatial specificity of adaptation for each visual area as a measure of the receptive field sizes of the area where adaptation originated, predicting that adaptation originating in V1 should be more spatially specific than adaptation intrinsic to extrastriate visual cortex. In most extrastriate visual areas, the spatial specificity of adaptation did not differ from that in V1, suggesting that adaptation originated in V1. Only in one extrastriate area—MT—was the spatial specificity of direction-selective adaptation significantly broader than in V1, consistent with a combination of inherited V1 adaptation and intrinsic MT adaptation. Moreover, inherited adaptation effects could be both facilitatory and suppressive. These results suggest that adaptation at early visual processing stages can have widespread and profound effects on responses in extrastriate visual areas, placing important constraints on the use of fMRI adaptation techniques, while also demonstrating a general experimental strategy for systematically dissociating inherited from intrinsic adaptation by fMRI.

Sign in / Sign up

Export Citation Format

Share Document