Working Memory Load Effects on the Tilt Aftereffect

Prolonged exposure to an oriented stimulus causes a subsequent test stimulus to be perceived as tilted in the opposite direction, a phenomenon referred to as the tilt aftereffect (TAE). Previous studies have demonstrated that high-level cognitive functions such as attention can modulate the TAE, which is generally well-known as a low-level perceptual process. However, it is unclear whether working memory load, another high-level cognitive function, could modulate the TAE. To address this issue, here we developed a new paradigm by combining a working memory load task with a TAE task. Participants firstly remembered a stream of digits (Experiment 1) or four color-shape conjunctions (Experiment 2) under high/low load conditions, and then recognized the probe stimuli (digits or a color-shape conjunction), which were presented at the center of an adapting grating. After the recognition task (i.e., the adaptation stage), participants performed an orientation judgment task to measure their TAEs. The result of Experiment 1, where the load stimuli were digits, showed that the magnitude of the TAEs were reduced under the condition of the high working memory load compared to that of the low working memory load. However, we failed to replicate the finding in Experiment 2, where the load stimuli were color-shape conjunctions. Together, our two experiments provided mixed evidence regarding the working memory load effects on the TAE and further replications are needed in future work.

The Yin-yang of Serial Dependence Effects: Every Response is both an Attraction to the Prior Response and a Repulsion from the Prior Stimulus

Visual perceptual decisions can be altered by recent experience. In the “serial dependence” effect, participants’ responses to visual stimuli appear to be biased toward (i.e., attracted to) recently encountered stimuli. Fischer and Whitney (2014) proposed that serial dependence reflects a “continuity field” that promotes visual stability by biasing perception toward the recent past. However, when participants are relatively accurate on the prior trial, there is no discernible difference between attraction to the prior stimulus and attraction to the prior response. To tease apart these alternative explanations of the attraction effect, we developed two complementary analysis techniques that rely on participants’ naturally occurring errors on a trial-by-trial basis, identifying any effect of the prior stimulus and, separately, any effect of the prior response (i.e., each effect could be attractive, repulsive, or absent). Applying these techniques to serial dependence data from a new experiment and four previously published studies, including Fischer and Whitney’s, we found that serial dependencies reflect an attraction to the previous response and repulsion from the previous stimulus, with these effects cancelling each other to different degrees for different experiments. In no case did we find evidence of an attraction to the prior stimulus. These results are consistent with literatures that predate the serial dependence effect: Attraction to prior responses is routinely observed in a wide variety of paradigms and repulsion from prior stimuli is ubiquitous, such as in the tilt aftereffect.

A decision-time account of individual variability in context-dependent orientation estimation

Following exposure to an oriented stimulus, the perceived orientation is slightly shifted, a phenomenon termed the tilt aftereffect (TAE). This estimation bias, as well as other context-dependent biases, is speculated to reflect statistical mechanisms of inference that optimize visual processing. Importantly, although measured biases are extremely robust in the population, the magnitude of individual bias can be extremely variable. For example, measuring different individuals may result in TAE magnitudes that differ by a factor of 5. Such findings appear to challenge the accounts of bias in terms of learned statistics: is inference so different across individuals? Here, we found that a strong correlation exists between reaction time and TAE, with slower individuals having much less TAE. In the tilt illusion, the spatial analogue of the TAE, we found a similar, though weaker, correlation. These findings can be explained by a theory predicting that bias, caused by a change in the initial conditions of evidence accumulation (e.g., prior), decreases with decision time (Dekel & Sagi, 2019b). We contend that the context-dependence of visual processing is more homogeneous in the population than was previously thought, with the measured variability of perceptual bias explained, at least in part, by the flexibility of decision-making. Homogeneity in processing might reflect the similarity of the learned statistics.HighlightsThe tilt aftereffect (TAE) exhibits large individual differences.Reduced TAE magnitudes are found in slower individuals.Reduced TAE in slower decisions can be explained by the reduced influence of prior.Therefore, individual variability can reflect decision making flexibility.

Interaction of contexts in context-dependent orientation estimation

The processing of a visual stimulus is known to be influenced by the statistics in recent visual history and by the stimulus’ visual surround. Such contextual influences lead to perceptually salient phenomena, such as the tilt aftereffect and the tilt illusion. Despite much research on the influence of an isolated context, it is not clear how multiple, possibly competing sources of contextual influence interact. Here, using psychophysical methods, we compared the combined influence of multiple contexts to the sum of the isolated context influences. The results showed large deviations from linear additivity for adjacent or overlapping contexts, and remarkably, clear additivity when the contexts were sufficiently separated. Specifically, for adjacent or overlapping contexts, the combined effect was often lower than the sum of the isolated component effects (sub-additivity), or was more influenced by one component than another (selection). For contexts that were separated in time (600 ms), the combined effect measured the exact sum of the isolated component effects (in degrees of bias). Overall, the results imply an initial compressive transformation during visual processing, followed by selection between the processed parts.HighlightsNon-linear sub-additivity for increased context area or contrastNon-linear selection between overlapping or adjacent, dissimilar contextsLinear additivity for combinations of temporally separated contexts

Border ownership-dependent tilt aftereffect for shape defined by binocular disparity and motion parallax

Discerning objects from their surrounds (i.e., figure-ground segmentation) in a way that guides adaptive behaviors is a fundamental task of the brain. Neurophysiological work has revealed a class of cells in the macaque visual cortex that may be ideally suited to support this neural computation: border ownership cells (Zhou H, Friedman HS, von der Heydt R. J Neurosci 20: 6594–6611, 2000). These orientation-tuned cells appear to respond conditionally to the borders of objects. A behavioral correlate supporting the existence of these cells in humans was demonstrated with two-dimensional luminance-defined objects (von der Heydt R, Macuda T, Qiu FT. J Opt Soc Am A Opt Image Sci Vis 22: 2222–2229, 2005). However, objects in our natural visual environments are often signaled by complex cues, such as motion and binocular disparity. Thus for border ownership systems to effectively support figure-ground segmentation and object depth ordering, they must have access to information from multiple depth cues with strict depth order selectivity. Here we measured in humans (of both sexes) border ownership-dependent tilt aftereffects after adaptation to figures defined by either motion parallax or binocular disparity. We find that both depth cues produce a tilt aftereffect that is selective for figure-ground depth order. Furthermore, we find that the effects of adaptation are transferable between cues, suggesting that these systems may combine depth cues to reduce uncertainty (Bülthoff HH, Mallot HA. J Opt Soc Am A 5: 1749–1758, 1988). These results suggest that border ownership mechanisms have strict depth order selectivity and access to multiple depth cues that are jointly encoded, providing compelling psychophysical support for their role in figure-ground segmentation in natural visual environments. NEW & NOTEWORTHY Figure-ground segmentation is a critical function that may be supported by “border ownership” neural systems that conditionally respond to object borders. We measured border ownership-dependent tilt aftereffects to figures defined by motion parallax or binocular disparity and found aftereffects for both cues. These effects were transferable between cues but selective for figure-ground depth order, suggesting that the neural systems supporting figure-ground segmentation have strict depth order selectivity and access to multiple depth cues that are jointly encoded.

Border-ownership-dependent tilt aftereffect for shape defined by binocular disparity and motion parallax

ABSTRACTDiscerning objects from their surrounds (i.e., figure-ground segmentation) in a way that guides adaptive behaviours is a fundamental task of the brain. Neurophysiological work has revealed a class of cells in the macaque visual cortex that may be ideally suited to support this neural computation: border-ownership cells (Zhou, Friedman, & von der Heydt, 2000). These orientation-tuned cells appear to respond conditionally to the borders of objects. A behavioural correlate supporting the existence of these cells in humans was demonstrated using two-dimensional luminance defined objects (von der Heydt, Macuda, & Qiu, 2005). However, objects in our natural visual environments are often signalled by complex cues, such as motion and depth order. Thus, for border-ownership systems to effectively support figure-ground segmentation and object depth ordering, they must have access to information from multiple depth cues with strict depth order selectivity. Here we measure in humans (of both sexes) border-ownership-dependent tilt aftereffects after adapting to figures defined by either motion parallax or binocular disparity. We find that both depth cues produce a tilt aftereffect that is selective for figure-ground depth order. Further, we find the effects of adaptation are transferable between cues, suggesting that these systems may combine depth cues to reduce uncertainty (Bülthoff & Mallot, 1988). These results suggest that border-ownership mechanisms have strict depth order selectivity and access to multiple depth cues that are jointly encoded, providing compelling psychophysical support for their role in figure-ground segmentation in natural visual environments.SIGNIFICANCE STATEMENTSegmenting a visual object from its surrounds is a critical function that may be supported by “border-ownership” neural systems that conditionally respond to object borders. Psychophysical work indicates these systems are sensitive to objects defined by luminance contrast. To effectively support figure-ground segmentation, however, neural systems supporting border-ownership must have access to information from multiple depth cues and depth order selectivity. We measured border-ownership-dependent tilt aftereffects to figures defined by either motion parallax or binocular disparity and found aftereffects for both depth cues. These effects were transferable between cues, but selective for figure-ground depth order. Our results suggest that the neural systems supporting figure-ground segmentation have strict depth order selectivity and access to multiple depth cues that are jointly encoded.