Masking, crowding and grouping: Connecting low and mid-level vision

An important task for vision science is to build a unitary framework of low and mid-level vision. As a step on this way, our study examined differences and commonalities between masking, crowding and grouping – three processes that occur through spatial interactions between neighbouring elements. We measured contrast thresholds as functions of inter-element spacing and eccentricity for Gabor detection, discrimination, contour integration, using a common stimulus grid consisting of 9 Gabor elements. From these thresholds, we derived a) the baseline contrast necessary to perform each task and b) the spatial extent over which task performance was stable. This spatial window can be taken as an indicator of field size, where elements that fall within a putative field are readily combined. We found that contrast thresholds were universally modulated by inter-element distance, with a shallower and inverted effect for grouping compared to masking and crowding. Baseline contrasts for detecting stimuli and discriminating their properties were positively linked across the tested retinal locations (parafovea and near periphery), whereas those for integrating elements and discriminating their properties were negatively linked. Meanwhile, masking and crowding spatial windows remained uncorrelated across eccentricity, although they were correlated across participants. This suggests that the computation performed by each type of visual field operates over different distances that co-varies across observers, but not across retinal locations. Contrast-processing units may thus lie at the core of the shared idiosyncrasies across tasks reported in many previous studies, despite the fundamental differences in the extent of their spatial windows.

Ensemble perception: extracting the average of perceptual vs numerical stimuli

Recent research has established that humans can extract average of perceptual features from sets of briefly and simultaneously presented elements or the average of rapid temporal sequences of numerical values. Here we compare the extraction of the average of simultaneously presented sets of perceptual features (orientations) and of numerical values (1-9 digits), using an identical experimental design. Arrays of Gabor elements or digits are simultaneously presented for 300 ms and the observers are required to estimate the average on a continuous response scale. In each trial the elements were sampled from normal distributions (of various means) and we varied the set-size (4-12), in order to compare the averaging mechanism in terms of its efficiency or capacity (the number of items one can pool from). We find that while for orientation the averaging precision remained constant with set-size, for numbers it decreased with set-size. Using computational modeling we extracted capacity parameters. Despite marked heterogeneity between the observers, the capacity was larger for orientations compared with numbers (which was close to WM-limitation of 3-4). This supports the idea that numbers more than perceptual features are subject to attentional limitations at encoding.

Interocular Differences in Spatial Frequency Influence the Pulfrich Effect

The Pulfrich effect is a stereo-motion phenomenon. When the two eyes are presented with visual targets moving in fronto-parallel motion at different luminances or contrasts, the perception is of a target moving-in-depth. It is thought that this percept of motion-in-depth occurs because lower luminance or contrast delays the speed of visual processing. Spatial properties of an image such as spatial frequency and size have also been shown to influence the speed of visual processing. In this study, we use a paradigm to measure interocular delay based on the Pulfrich effect where a structure-from-motion defined cylinder, composed of Gabor elements displayed at different interocular phases, rotates in depth. This allows us to measure any relative interocular processing delay while independently manipulating the spatial frequency and size of the micro elements (i.e., Gabor patches). We show that interocular spatial frequency differences, but not interocular size differences of image features, produce interocular processing delays.

Shape Saliency Modulates Contextual Processing in the Human Lateral Occipital Complex

Visual context influences our perception of target objects in natural scenes. However, little is known about the analysis of context information and its role in shape perception in the human brain. We investigated whether the human lateral occipital complex (LOC), known to be involved in the visual analysis of shapes, also processes information about the context of shapes within cluttered scenes. We employed an fMRI adaptation paradigm in which fMRI responses are lower for two identical than for two different stimuli presented consecutively. The stimuli consisted of closed target contours defined by aligned Gabor elements embedded in a background of randomly oriented Gabors. We measured fMRI adaptation in the LOC across changes in the context of the target shapes by manipulating the position and orientation of the background elements. No adaptation was observed across context changes when the background elements were presented in the same plane as the target elements. However, adaptation was observed when the grouping of the target elements was enhanced in a bottom-up (i.e., grouping by disparity or motion) or top-down (i.e., shape priming) manner and thus the saliency of the target shape increased. These findings suggest that the LOC processes information not only about shapes, but also about their context. This processing of context information in the LOC is modulated by figure–ground segmentation and grouping processes. That is, neural populations in the LOC encode context information when relevant to the perception of target shapes, but represent salient targets independent of context changes.

How long range is contour integration in human color vision?

We quantified and compared the effect of element spacing on contour integration between the achromatic (Ach), red–green (RG), and blue–yellow (BY) mechanisms. The task requires the linking of orientation across space to detect a contour in a stimulus composed of randomly oriented Gabor elements (1.5 cpd, σ = 0.17 deg), measured using a temporal 2AFC method. A contour of ten elements was pasted into a 10 × 10 cells array, and background elements were randomly positioned within the available cells. The effect of element spacing was investigated by varying the mean interelement distance between two and six times the period of the Gabor elements (λ = 0.66 deg) while the total number of elements was fixed. Contour detection was measured as a function of its curvature for jagged contours and for closed contours. At all curvatures, we found that performance for chromatic mechanisms declines more steeply with the increase in element separation than does performance for the achromatic mechanism. Averaged critical element separations were 4.6 ± 0.7, 3.6 ± 0.4, and 2.9 ± 0.2 deg for Ach, BY, and RG mechanisms, respectively. These results suggest that contour integration by the chromatic mechanisms relies more on short-range interactions in comparison to the achromatic mechanism. In a further experiment, we looked at the combined effect of element size and element separation in contour integration for the Ach mechanism.