Visual Discomfort and Variations in Chromaticity in Art and Nature

Visual discomfort is related to the statistical regularity of visual images. The contribution of luminance contrast to visual discomfort is well understood and can be framed in terms of a theory of efficient coding of natural stimuli, and linked to metabolic demand. While color is important in our interaction with nature, the effect of color on visual discomfort has received less attention. In this study, we build on the established association between visual discomfort and differences in chromaticity across space. We average the local differences in chromaticity in an image and show that this average is a good predictor of visual discomfort from the image. It accounts for part of the variance left unexplained by variations in luminance. We show that the local chromaticity difference in uncomfortable stimuli is high compared to that typical in natural scenes, except in particular infrequent conditions such as the arrangement of colorful fruits against foliage. Overall, our study discloses a new link between visual ecology and discomfort whereby discomfort arises when adaptive perceptual mechanisms are overstimulated by specific classes of stimuli rarely found in nature.

Composite receptive fields in the mouse auditory cortex

A central question in sensory neuroscience is how neurons represent complex natural stimuli. This process involves multiple steps of feature extraction to obtain a condensed, categorical representation useful for classification and behavior. It has previously been shown that central auditory neurons in the starling have composite receptive fields composed of multiple features when probed with conspecific songs. Whether this property is an idiosyncratic characteristic of songbirds, a group of highly specialized vocal learners, or a generic characteristic of central auditory systems in different animals is, however, unknown. To address this question, we have recorded responses from auditory cortical neurons in mice, and characterized their receptive fields using mouse ultrasonic vocalizations (USVs) as a natural and ethologically relevant stimulus and pitch-shifted starling songs as a natural but ethologically irrelevant control stimulus. We have found that auditory cortical neurons in the mouse display composite receptive fields with multiple excitatory and inhibitory subunits. Moreover, this was the case with either the conspecific or the heterospecific vocalizations. We then trained the sparse filtering algorithm on both classes of natural stimuli to obtain statistically optimal features, and compared the natural and artificial features using UMAP, a dimensionality-reduction algorithm previously used to analyze mouse USVs and birdsongs. We have found that the receptive-field features obtained with the mouse USVs and those obtained with the pitch-shifted starling songs clustered together, as did the sparse-filtering features. However, the natural and artificial receptive-field features clustered mostly separately. These results indicate that composite receptive fields are likely a generic property of central auditory systems in different classes of animals. They further suggest that the quadratic receptive-field features of the mouse auditory cortical neurons are natural-stimulus invariant.

Scene statistics and noise determine the relative arrangement of receptive field mosaics

Many sensory systems utilize parallel ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways consist of ensembles or grids of ON and OFF detectors spanning sensory space. Yet, encoding by opponent pathways raises a question: How should grids of ON and OFF detectors be arranged to optimally encode natural stimuli? We investigated this question using a model of the retina guided by efficient coding theory. Specifically, we optimized spatial receptive fields and contrast response functions to encode natural images given noise and constrained firing rates. We find that the optimal arrangement of ON and OFF receptive fields exhibits a transition between aligned and antialigned grids. The preferred phase depends on detector noise and the statistical structure of the natural stimuli. These results reveal that noise and stimulus statistics produce qualitative shifts in neural coding strategies and provide theoretical predictions for the configuration of opponent pathways in the nervous system.

Texture Perception

Texture perception is a rich subdomain of vision science that focuses on how the visual system encodes and interprets images that can be defined in terms of self-similarity over space. The field’s understanding of the computational and neural bases of texture perception has advanced, drawing upon key results from psychophysics, cognitive neuroscience, and visual development. The relevance of texture representations to a broader set of visual mechanisms supporting “statistical vision” is also discussed, with an emphasis on the challenges and potential rewards of studying texture perception in the context of natural stimuli and ecologically relevant tasks.

Rat sensitivity to multipoint statistics is predicted by efficient coding of natural scenes

Efficient processing of sensory data requires adapting the neuronal encoding strategy to the statistics of natural stimuli. Humans, for instance, are most sensitive to multipoint correlations that vary the most across natural images. Here we show that rats possess the same sensitivity ranking to multipoint statistics as humans, thus extending a classic demonstration of efficient coding to a species where neuronal and developmental processes can be interrogated and causally manipulated.

Perception of the bilabial-labiodental contrast in the approximant consonants of the Chilean Spanish

Until recently, the consensus was that labiodental realizations of Spanish /b/ did not exist, and that consequently this variation in place of articulation could be safely disregarded. However, new evidence emerged showing that labiodental variants of /b/ do exist in relatively high numbers, at least in some dialects such as in Chilean Spanish. This study set out to determine whether Chilean Spanish listeners are able to perceive the differences between bilabial and labiodental approximant variants of Spanish /b/ (i.e., [β̞] versus [ʋ]). In order to test this, natural and synthetic stimuli were presented to 31 native listeners in identification and discrimination tasks. Results showed that, while the identification task with natural stimuli provided mixed evidence of sensitivity to the contrast, the identification and discrimination tasks with synthetic stimuli provided no evidence of listeners perceiving the phonetic contrast categorically. In sum, listeners do no seem able to perceive the acoustic differences between the two segments, and thus it is unlikely that this phonetic contrast could be employed to encode sociolinguistic information.

The optimal spatial arrangement of ON and OFF receptive fields

Many sensory systems utilize parallel ON and OFF pathways that signal stimulus increments and decrements, respectively. These pathways consist of ensembles or grids of ON and OFF detectors spanning sensory space. Yet encoding by opponent pathways raises a question: How should grids of ON and OFF detectors be arranged to optimally encode natural stimuli? We investigated this question using a model of the retina guided by efficient coding theory. Specifically, we optimized spatial receptive fields and contrast response functions to encode natural images given noise and constrained firing rates. We find that the optimal arrangement of ON and OFF receptive fields exhibits a second-order phase transition between aligned and anti-aligned grids. The preferred phase depends on detector noise and the statistical structure of the natural stimuli. These results reveal that noise and stimulus statistics produce qualitative shifts in neural coding strategies and provide novel theoretical predictions for the configuration of opponent pathways in the nervous system.