Processing of Visual Statistics of Naturalistic Videos in Macaque Visual Areas V1 and V4

Author(s):  
Gaku Hatanaka ◽  
Mikio Inagakai ◽  
Ryosuke F Takeuchi ◽  
Shinji Nishimoto ◽  
Koji Ikezoe ◽  
...  

Abstract Natural scenes are characterized by diverse image statistics, including various parameters of the luminance histogram, outputs of Gabor-like filters, and pairwise correlations between the filter outputs of different positions, orientations, and scales (Potilla-Simoncelli statistics). Some of these statistics capture the response properties of visual neurons. However, it remains unclear to what extent such statistics can explain neural responses to natural scenes and how neurons that are tuned to these statistics are distributed across the cortex. By using two-photon calcium imaging and an encoding-model approach, we addressed these issues in macaque visual areas V1 and V4. For each imaged neuron, we constructed an encoding model to mimic its responses to naturalistic videos. By extracting Potilla-Simoncelli statistics through outputs of both filters and filter correlations, and by computing an optimally weighted sum of these outputs, the model successfully reproduced responses in a subpopulation of neurons. We evaluated the selectivities of these neurons by quantifying the contributions of each statistic to visual responses. Neurons whose responses were mainly determined by Gabor-like filter outputs (low-level statistics) were abundant at most imaging sites in V1. In V4, the relative contribution of higher-order statistics, such as cross-scale correlation, was increased, and the neuronal selectivities varied markedly across sites; many sites included numerous neurons sensitive to luminance histogram parameters and/or correlation statistics, whereas some sites were dominated by neurons responding to low-level statistics. The results indicate that natural scene analysis progresses from V1 to V4, and neurons sharing preferred image statistics are locally clustered in V4.

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Noor Seijdel ◽  
Sara Jahfari ◽  
Iris I. A. Groen ◽  
H. Steven Scholte

1996 ◽  
Vol 75 (4) ◽  
pp. 1673-1686 ◽  
Author(s):  
H. D. Critchley ◽  
E. T. Rolls

1. The primate orbitofrontal cortex is the site of convergence of information from primary taste and primary olfactory cortical regions. In addition, it receives projections from temporal lobe visual areas concerned with the representation of objects such as foods. Previous work has shown that the responses of gustatory neurons in the secondary taste area within the orbitofrontal cortex are modulated by hunger and satiety, in that they stop responding to the taste of a food on which an animal has been fed to behavioral satiation, yet may continue to respond to the taste of other foods. 2. This study demonstrates a similar modulation of the responses of olfactory and visual orbitofrontal cortex neurons after feeding to satiety. Seven of nine olfactory neurons that were responsive to the odors of foods, such as blackcurrant juice, were found to decrease their responses to the odor of the satiating food in a selective and statistically significant manner. 3. It also was found for eight of nine neurons that had selective responses to the sight of food, that they demonstrated a sensory-specific reduction in their visual responses to foods after satiation. 4. The responses of orbitofrontal cortex neurons selective for foods in more than one modality also were analyzed before and after feeding to satiation. Satiety often affected the responses of these multimodal neurons across all modalities, but a sensory-specific effect was not always demonstrable for both modalities. 5. These findings show that the olfactory and visual representations of food, as well as the taste representation of food, in the primate orbitofrontal cortex are modulated by hunger. Usually a component related to sensory-specific satiety can be demonstrated. The findings link at least part of the processing of olfactory and visual information in this brain region to the control of feeding-related behavior.


2006 ◽  
Vol 23 (9) ◽  
pp. 2085 ◽  
Author(s):  
Rain G. Bosworth ◽  
Marian Stewart Bartlett ◽  
Karen R. Dobkins

2018 ◽  
Author(s):  
Yueyang Xu ◽  
Ashish Raj ◽  
Jonathan Victor ◽  

AbstractAn important heuristic in developing image processing technologies is to mimic the computational strategies used by humans. Relevant to this, recent studies have shown that the human brain’s processing strategy is closely matched to the characteristics of natural scenes, both in terms of global and local image statistics. However, structural MRI images and natural scenes have fundamental differences: the former are two-dimensional sections through a volume, the latter are projections. MRI image formation is also radically different from natural image formation, involving acquisition in Fourier space, followed by several filtering and processing steps that all have the potential to alter image statistics. As a consequence, aspects of the human visual system that are finely-tuned to processing natural scenes may not be equally well-suited for MRI images, and identification of the differences between MRI images and natural scenes may lead to improved machine analysis of MRI.With these considerations in mind, we analyzed spectra and local image statistics of MRI images in several databases including T1 and FLAIR sequence types and of simulated MRI images,[1]–[6] and compared this analysis to a parallel analysis of natural images[7] and visual sensitivity[7][8]. We found substantial differences between the statistical features of MRI images and natural images. Power spectra of MRI images had a steeper slope than that of natural images, indicating a lack of scale invariance. Independent of this, local image statistics of MRI and natural images differed: compared to natural images, MRI images had smaller variations in their local two-point statistics and larger variations in their local three-point statistics – to which the human visual system is relatively insensitive. Our findings were consistent across MRI databases and simulated MRI images, suggesting that they result from brain geometry at the scale of MRI resolution, rather than characteristics of specific imaging and reconstruction methods.


2017 ◽  
Author(s):  
Amelia J. Christensen ◽  
Jonathan W. Pillow

Running profoundly alters stimulus-response properties in mouse primary visual cortex (V1), but its effects in higher-order visual cortex remain unknown. Here we systematically investigated how locomotion modulates visual responses across six visual areas and three cortical layers using a massive dataset from the Allen Brain Institute. Although running has been shown to increase firing in V1, we found that it suppressed firing in higher-order visual areas. Despite this reduction in gain, visual responses during running could be decoded more accurately than visual responses during stationary periods. We show that this effect was not attributable to changes in noise correlations, and propose that it instead arises from increased reliability of single neuron responses during running.


2018 ◽  
Author(s):  
Tamar I. Regev ◽  
Jonathan Winawer ◽  
Edden M. Gerber ◽  
Robert T. Knight ◽  
Leon Y. Deouell

AbstractMuch of what is known about the timing of visual processing in the brain is inferred from intracranial studies in monkeys, with human data limited to mainly non-invasive methods with lower spatial resolution. Here, we estimated visual onset latencies from electrocorticographic (ECoG) recordings in a patient who was implanted with 112 sub-dural electrodes, distributed across the posterior cortex of the right hemisphere, for pre-surgical evaluation of intractable epilepsy. Functional MRI prior to surgery was used to determine boundaries of visual areas. The patient was presented with images of objects from several categories. Event Related Potentials (ERPs) were calculated across all categories excluding targets, and statistically reliable onset latencies were determined using a bootstrapping procedure over the single trial baseline activity in individual electrodes. The distribution of onset latencies broadly reflected the known hierarchy of visual areas, with the earliest cortical responses in primary visual cortex, and higher areas showing later responses. A clear exception to this pattern was robust, statistically reliable and spatially localized, very early responses on the bank of the posterior intra-parietal sulcus (IPS). The response in the IPS started nearly simultaneously with responses detected in peristriate visual areas, around 60 milliseconds post-stimulus onset. Our results support the notion of early visual processing in the posterior parietal lobe, not respecting traditional hierarchies, and give direct evidence for the upper limit of onset times of visual responses across the human cortex.


2016 ◽  
Author(s):  
Chih-Yang Chen ◽  
Ziad M. Hafed

AbstractSaccadic eye movements cause rapid retinal-image shifts that go perceptually unnoticed several times per second. The mechanisms for perceptual saccadic suppression have been controversial, in part due to sparse understanding of neural substrates. Here we uncovered an unexpectedly specific neural locus for saccadic suppression in the primate superior colliculus (SC). We first developed a sensitive behavioral measure of perceptual suppression in two male macaque monkeys (Macaca mulatta), demonstrating known selectivity to low spatial frequencies. We then investigated visual responses in either purely visual SC neurons or anatomically-deeper visual-motor neurons, which are also involved in saccade generation commands. Surprisingly, visual-motor neurons showed the strongest visual suppression, and the suppression was dependent on spatial frequency like in perception. Most importantly, visual-motor neuron suppression selectivity was highly predictive of behavioral suppression effects in each individual animal, with our recorded population explaining up to ~74% of behavioral variance even on completely different experimental sessions. In contrast, purely visual SC neurons only had mild and unselective suppression (only explaining up to ~48% of behavioral variance). These results run contrary to a hypothesized SC mechanism for saccadic suppression, in which a motor command in the visual-motor and motor neurons is relayed to the more superficial purely visual neurons to suppress them, and to then potentially be fed back to cortex. Instead, our results indicate that an extra-retinal modulatory signal mediating perceptual suppression is already established in visual-motor neurons.New & NoteworthySaccades, which repeatedly re-align the line of sight, introduce spurious signals in retinal images that normally go unnoticed. In part, this happens because of peri-saccadic suppression of visual sensitivity. Here we discovered that a specific sub-type of superior colliculus (SC) neurons may play a critical role in saccadic suppression. Curiously, it is the neurons that help mediate the saccadic command itself that exhibit perceptually-relevant changes in visual sensitivity, not the previously hypothesized purely visual neurons.


2019 ◽  
Author(s):  
E. Mika Diamanti ◽  
Charu Bai Reddy ◽  
Sylvia Schröder ◽  
Tomaso Muzzu ◽  
Kenneth D. Harris ◽  
...  

During navigation, the visual responses of neurons in primary visual cortex (V1) are modulated by the animal’s spatial position. Here we show that this spatial modulation is similarly present across multiple higher visual areas but largely absent in the main thalamic pathway into V1. Similar to hippocampus, spatial modulation in visual cortex strengthens with experience and requires engagement in active behavior. Active navigation in a familiar environment, therefore, determines spatial modulation of visual signals starting in the cortex.


2021 ◽  
Author(s):  
Georgios Michail ◽  
Daniel Senkowski ◽  
Martin Holtkamp ◽  
Bettina Wächter ◽  
Julian Keil

The combination of signals from different sensory modalities can enhance perception and facilitate behavioral responses. While previous research described crossmodal influences in a wide range of tasks, it remains unclear how such influences drive performance enhancements. In particular, the neural mechanisms underlying performance-relevant crossmodal influences, as well as the latency and spatial profile of such influences are not well understood. Here, we examined data from high-density electroencephalography (N = 30) and electrocorticography (N = 4) recordings to characterize the oscillatory signatures of crossmodal facilitation of response speed, as manifested in the speeding of visual responses by concurrent task-irrelevant auditory information. Using a data-driven analysis approach, we found that individual gains in response speed correlated with reduced beta power (13-25 Hz) in the audiovisual compared with the visual condition, starting within 80 ms after stimulus onset in multisensory association and secondary visual areas. In addition, the electrocorticography data revealed a beta power suppression in audiovisual compared with visual trials in the superior temporal gyrus (STG). Our data suggest that the crossmodal facilitation of response speed is associated with early beta power in multisensory association and secondary visual areas, presumably reflecting the enhancement of early sensory processing through selective attention. This finding furthers our understanding of the neural correlates underlying crossmodal response speed facilitation and highlights the critical role of beta oscillations in mediating behaviorally relevant audiovisual processing.


2020 ◽  
Vol 77 (5) ◽  
pp. 1699-1721 ◽  
Author(s):  
Brett Roberts ◽  
Ming Xue ◽  
Daniel T. Dawson

Abstract A suite of six idealized supercell simulations is performed in which the surface drag coefficient Cd is varied over a range of values from 0 to 0.05 to represent a variety of water and land surfaces. The experiments employ a new technique for enforcing a three-force balance among the pressure gradient, Coriolis, and frictional forces so that the environmental wind profile can remain unchanged throughout the simulation. The initial low-level mesocyclone lowers toward the ground, intensifies, and produces a tornado in all experiments with Cd ≥ 0.002, with the intensification occurring earlier for larger Cd. In the experiment with Cd = 0, the low-level mesocyclone remains comparatively weak throughout the simulation and does not produce a tornado. Vertical cross sections through the simulated tornadoes reveal an axial downdraft that reaches the ground only in experiments with smaller Cd, as well as stronger corner flow in experiments with larger Cd. Material circuits are initialized enclosing the low-level mesocyclone in each experiment and traced backward in time. Circulation budgets for these circuits implicate surface drag acting in the inflow sector of the supercell as having generated important positive circulation, and its relative contribution increases with Cd. However, the circulation generation is similar in magnitude for the experiments with Cd = 0.02 and 0.05, and the tornado in the latter experiment is weaker. This suggests the possible existence of an optimal range of Cd values for promoting intense tornadoes within our experimental configuration.


Sign in / Sign up

Export Citation Format

Share Document