scholarly journals Mechanisms of Feature Selectivity and Invariance in Primary Visual Cortex

2020 ◽  
Author(s):  
Ali Almasi ◽  
Hamish Meffin ◽  
Shaun L. Cloherty ◽  
Yan Wong ◽  
Molis Yunzab ◽  
...  

AbstractVisual object identification requires both selectivity for specific visual features that are important to the object’s identity and invariance to feature manipulations. For example, a hand can be shifted in position, rotated, or contracted but still be recognised as a hand. How are the competing requirements of selectivity and invariance built into the early stages of visual processing? Typically, cells in the primary visual cortex are classified as either simple or complex. They both show selectivity for edge-orientation but complex cells develop invariance to edge position within the receptive field (spatial phase). Using a data-driven model that extracts the spatial structures and nonlinearities associated with neuronal computation, we show that the balance between selectivity and invariance in complex cells is more diverse than thought. Phase invariance is frequently partial, thus retaining sensitivity to brightness polarity, while invariance to orientation and spatial frequency are more extensive than expected. The invariance arises due to two independent factors: (1) the structure and number of filters and (2) the form of nonlinearities that act upon the filter outputs. Both vary more than previously considered, so primary visual cortex forms an elaborate set of generic feature sensitivities, providing the foundation for more sophisticated object processing.

2020 ◽  
Vol 30 (9) ◽  
pp. 5067-5087
Author(s):  
Ali Almasi ◽  
Hamish Meffin ◽  
Shaun L Cloherty ◽  
Yan Wong ◽  
Molis Yunzab ◽  
...  

Abstract Visual object identification requires both selectivity for specific visual features that are important to the object’s identity and invariance to feature manipulations. For example, a hand can be shifted in position, rotated, or contracted but still be recognized as a hand. How are the competing requirements of selectivity and invariance built into the early stages of visual processing? Typically, cells in the primary visual cortex are classified as either simple or complex. They both show selectivity for edge-orientation but complex cells develop invariance to edge position within the receptive field (spatial phase). Using a data-driven model that extracts the spatial structures and nonlinearities associated with neuronal computation, we quantitatively describe the balance between selectivity and invariance in complex cells. Phase invariance is frequently partial, while invariance to orientation and spatial frequency are more extensive than expected. The invariance arises due to two independent factors: (1) the structure and number of filters and (2) the form of nonlinearities that act upon the filter outputs. Both vary more than previously considered, so primary visual cortex forms an elaborate set of generic feature sensitivities, providing the foundation for more sophisticated object processing.


2014 ◽  
Vol 111 (10) ◽  
pp. E962-E971 ◽  
Author(s):  
Assaf Harel ◽  
Dwight J. Kravitz ◽  
Chris I. Baker

Perception reflects an integration of “bottom-up” (sensory-driven) and “top-down” (internally generated) signals. Although models of visual processing often emphasize the central role of feed-forward hierarchical processing, less is known about the impact of top-down signals on complex visual representations. Here, we investigated whether and how the observer’s goals modulate object processing across the cortex. We examined responses elicited by a diverse set of objects under six distinct tasks, focusing on either physical (e.g., color) or conceptual properties (e.g., man-made). Critically, the same stimuli were presented in all tasks, allowing us to investigate how task impacts the neural representations of identical visual input. We found that task has an extensive and differential impact on object processing across the cortex. First, we found task-dependent representations in the ventral temporal and prefrontal cortex. In particular, although object identity could be decoded from the multivoxel response within task, there was a significant reduction in decoding across tasks. In contrast, the early visual cortex evidenced equivalent decoding within and across tasks, indicating task-independent representations. Second, task information was pervasive and present from the earliest stages of object processing. However, although the responses of the ventral temporal, prefrontal, and parietal cortex enabled decoding of both the type of task (physical/conceptual) and the specific task (e.g., color), the early visual cortex was not sensitive to type of task and could only be used to decode individual physical tasks. Thus, object processing is highly influenced by the behavioral goal of the observer, highlighting how top-down signals constrain and inform the formation of visual representations.


NeuroImage ◽  
2012 ◽  
Vol 63 (3) ◽  
pp. 1464-1477 ◽  
Author(s):  
Andreas A. Ioannides ◽  
Vahe Poghosyan ◽  
Lichan Liu ◽  
George A. Saridis ◽  
Marco Tamietto ◽  
...  

2017 ◽  
Vol 117 (1) ◽  
pp. 388-402 ◽  
Author(s):  
Michael A. Cohen ◽  
George A. Alvarez ◽  
Ken Nakayama ◽  
Talia Konkle

Visual search is a ubiquitous visual behavior, and efficient search is essential for survival. Different cognitive models have explained the speed and accuracy of search based either on the dynamics of attention or on similarity of item representations. Here, we examined the extent to which performance on a visual search task can be predicted from the stable representational architecture of the visual system, independent of attentional dynamics. Participants performed a visual search task with 28 conditions reflecting different pairs of categories (e.g., searching for a face among cars, body among hammers, etc.). The time it took participants to find the target item varied as a function of category combination. In a separate group of participants, we measured the neural responses to these object categories when items were presented in isolation. Using representational similarity analysis, we then examined whether the similarity of neural responses across different subdivisions of the visual system had the requisite structure needed to predict visual search performance. Overall, we found strong brain/behavior correlations across most of the higher-level visual system, including both the ventral and dorsal pathways when considering both macroscale sectors as well as smaller mesoscale regions. These results suggest that visual search for real-world object categories is well predicted by the stable, task-independent architecture of the visual system. NEW & NOTEWORTHY Here, we ask which neural regions have neural response patterns that correlate with behavioral performance in a visual processing task. We found that the representational structure across all of high-level visual cortex has the requisite structure to predict behavior. Furthermore, when directly comparing different neural regions, we found that they all had highly similar category-level representational structures. These results point to a ubiquitous and uniform representational structure in high-level visual cortex underlying visual object processing.


2018 ◽  
Author(s):  
Andreea Lazar ◽  
Chris Lewis ◽  
Pascal Fries ◽  
Wolf Singer ◽  
Danko Nikolić

SummarySensory exposure alters the response properties of individual neurons in primary sensory cortices. However, it remains unclear how these changes affect stimulus encoding by populations of sensory cells. Here, recording from populations of neurons in cat primary visual cortex, we demonstrate that visual exposure enhances stimulus encoding and discrimination. We find that repeated presentation of brief, high-contrast shapes results in a stereotyped, biphasic population response consisting of a short-latency transient, followed by a late and extended period of reverberatory activity. Visual exposure selectively improves the stimulus specificity of the reverberatory activity, by increasing the magnitude and decreasing the trial-to-trial variability of the neuronal response. Critically, this improved stimulus encoding is distributed across the population and depends on precise temporal coordination. Our findings provide evidence for the existence of an exposure-driven optimization process that enhances the encoding power of neuronal populations in early visual cortex, thus potentially benefiting simple readouts at higher stages of visual processing.


Author(s):  
Gustavo Torres ◽  
Karina Jaime ◽  
Félix Ramos

Visual memory identification is a key cognitive process for intelligent virtual agents living on virtual environments. This process allows the virtual agents to develop an internal representation of the environment for the posterior production of intelligent responses. There are many architectures based on memory modules for environment visual elements identification, as if they were invariant, this way of processing a visual scene is different from the one that real humans use. This document presents the description of a visual memory identification model based on current neuroscience state of art. Furthermore; the proposed model considers memory as a system that treats information in three stages: to encode, store and retrieve acquired knowledge about the environment. On the other hand, the authors validate the implementation of their approach with two identification tasks: when the stimulus is known and when it is unknown. Actually, this work is part of a proposal for a cognitive architecture that will let the authors create virtual agents with more credible human behaviors.


2012 ◽  
Vol 1470 ◽  
pp. 17-23 ◽  
Author(s):  
Zhen Liang ◽  
Hongxin Li ◽  
Yun Yang ◽  
Guangxing Li ◽  
Yong Tang ◽  
...  

2005 ◽  
Vol 43 (14) ◽  
pp. 2101-2108 ◽  
Author(s):  
Christian F. Altmann ◽  
Wolfgang Grodd ◽  
Zoe Kourtzi ◽  
Heinrich H. Bülthoff ◽  
Hans-Otto Karnath

Perception ◽  
1997 ◽  
Vol 26 (1_suppl) ◽  
pp. 23-23
Author(s):  
E Vandenbussche ◽  
P Stiers ◽  
M Haers ◽  
B M van den Hout ◽  
L S de Vries ◽  
...  

We investigated whether neonatal brain damage can give rise to visual perceptual deficits, in addition to the well-documented impairments in visual acuity. To this end, forty-one children (age 5.02 to 5.89 years) were given four visual object identification tasks and three visuo-constructive tasks. These subjects were neonatal at risk owing to prematurity or birth asphyxia. From neonatal ultrasound scans, the occurrence of intracranial hemorrhage (ICH, N = 17), periventricular leukomalacia (PVL, N = 15), and/or white matter damage due to either of these conditions (WMD, N = 9) was determined for each subject. Scans were normal in fourteen of them. The number of subjects performing at or below Pc10 of same-age normal children was significantly above 10% for each task (range 27% – 49%). This was still true when mental instead of chronological age was used for comparison, as shown by the results of nine subjects for which intelligence data were available. This high incidence of impairment is not attributable to loss of visual acuity, since grating acuity was reduced in only four subjects (14 – 19 cycles deg−1). The frequency of scores < Pc10 correlated significantly with WMD in six tasks, with PVL in 4 tasks, but not with ICH. We conclude that neonatal at risk children are more likely to develop impaired visual perceptual skills, independent of mental disability and visual acuity loss. On ultrasound permanent white matter abnormalities are most strongly associated with visual perceptual deficit, whereas intracranial hemorrhage is unrelated.


2005 ◽  
Vol 94 (2) ◽  
pp. 1336-1345 ◽  
Author(s):  
Bartlett D. Moore ◽  
Henry J. Alitto ◽  
W. Martin Usrey

The activity of neurons in primary visual cortex is influenced by the orientation, contrast, and temporal frequency of a visual stimulus. This raises the question of how these stimulus properties interact to shape neuronal responses. While past studies have shown that the bandwidth of orientation tuning is invariant to stimulus contrast, the influence of temporal frequency on orientation-tuning bandwidth is unknown. Here, we investigate the influence of temporal frequency on orientation tuning and direction selectivity in area 17 of ferret visual cortex. For both simple cells and complex cells, measures of orientation-tuning bandwidth (half-width at half-maximum response) are ∼20–25° across a wide range of temporal frequencies. Thus cortical neurons display temporal-frequency invariant orientation tuning. In contrast, direction selectivity is typically reduced, and occasionally reverses, at nonpreferred temporal frequencies. These results show that the mechanisms contributing to the generation of orientation tuning and direction selectivity are differentially affected by the temporal frequency of a visual stimulus and support the notion that stability of orientation tuning is an important aspect of visual processing.


Sign in / Sign up

Export Citation Format

Share Document