Illusion of visual stability through active perceptual serial dependence

Visual stability is achieved through an active serial dependence mechanism that continuously biases perception toward the past.

Paradoxical stabilization of relative position in moving frames

To capture where things are and what they are doing, the visual system may extract the position and motion of each object relative to its surrounding frame of reference [K. Duncker, Routledge and Kegan Paul, London 161–172 (1929) and G. Johansson, Acta Psychol (Amst.) 7, 25–79 (1950)]. Here we report a particularly powerful example where a paradoxical stabilization is produced by a moving frame. We first take a frame that moves left and right and we flash its right edge before, and its left edge after, the frame’s motion. For all frame displacements tested, the two edges are perceived as stabilized, with the left edge on the left and right edge on the right, separated by the frame’s width as if the frame were not moving. This stabilization is paradoxical because the motion of the frame itself remains visible, albeit much reduced. A second experiment demonstrated that unlike other motion-induced position shifts (e.g., flash lag, flash grab, flash drag, or Fröhlich), the illusory shift here is independent of speed and is set instead by the distance of the frame’s travel. In this experiment, two probes are flashed inside the frame at the same physical location before and after the frame moves. Despite being physically superimposed, the probes are perceived widely separated, again as if they were seen in the frame’s coordinates and the frame were stationary. This paradoxical stabilization suggests a link to visual stability across eye movements where the displacement of the entire visual scene may act as a frame to stabilize the perception of relative locations.

Multistable Perception in Older Adults: Constructing a Whole from Fragments

Visual perception is constructive in nature; that is, a coherent whole is generated from ambiguous fragments that are encountered in dynamic visual scenes. Creating this coherent whole from fragmented sensory inputs requires one to detect, identify, distinguish and organize sensory input. The organization of fragments into a coherent whole is facilitated by the continuous interactions between lower level sensory inputs and higher order processes. However, age-related declines are found in both neural structures and cognitive processes (e.g., attention and inhibition). The impact of these declines on the constructive nature of visual processing was the focus of this study. Here we asked younger adults, young-old (65–79 years), and old-old adults (80+ years) to view a multistable figure (i.e., Necker cube) under four conditions (free, priming, volition, and adaptation) and report, via a button press, when percepts spontaneously changed. The oldest-olds, unlike young-olds and younger adults, were influenced by priming, had less visual stability during volition and showed less ability to adapt to multistable stimuli. These results suggest that the ability to construct a coherent whole from fragments declines with age. More specifically, vision is constructed differently in the old-olds, which might influence environmental interpretations and navigational abilities in this age group.

Multistable Perception in Older Adults: Constructing a Whole from Fragments

Visual perception is constructive in nature; that is, a coherent whole is generated from ambiguous fragments that are encountered in dynamic visual scenes. Creating this coherent whole from fragmented sensory inputs requires one to detect, identify, distinguish and organize sensory input. The organization of fragments into a coherent whole is facilitated by the continuous interactions between lower level sensory inputs and higher order processes. However, age-related declines are found in both neural structures and cognitive processes (e.g., attention and inhibition). The impact of these declines on the constructive nature of visual processing was the focus of this study. Here we asked younger adults, young-old (65–79 years), and old-old adults (80+ years) to view a multistable figure (i.e., Necker cube) under four conditions (free, priming, volition, and adaptation) and report, via a button press, when percepts spontaneously changed. The oldest-olds, unlike young-olds and younger adults, were influenced by priming, had less visual stability during volition and showed less ability to adapt to multistable stimuli. These results suggest that the ability to construct a coherent whole from fragments declines with age. More specifically, vision is constructed differently in the old-olds, which might influence environmental interpretations and navigational abilities in this age group.

Attention Trade-Off for Localization and Saccadic Remapping

Predictive remapping may be the principal mechanism of maintaining visual stability, and attention is crucial for this process. We aimed to investigate the role of attention in predictive remapping in a dual task paradigm with two conditions, with and without saccadic remapping. The first task was to remember the clock hand position either after a saccade to the clock face (saccade condition requiring remapping) or after the clock being displaced to the fixation point (fixation condition with no saccade). The second task was to report the remembered location of a dot shown peripherally in the upper screen for 1 s. We predicted that performance in the two tasks would interfere in the saccade condition, but not in the fixation condition, because of the attentional demands needed for remapping with the saccade. For the clock estimation task, answers in the saccadic trials tended to underestimate the actual position by approximately 37 ms while responses in the fixation trials were closer to veridical. As predicted, the findings also revealed significant interaction between the two tasks showing decreased predicted accuracy in the clock task for increased error in the localization task, but only for the saccadic condition. Taken together, these results point at the key role of attention in predictive remapping.

The Yin-yang of Serial Dependence Effects: Every Response is both an Attraction to the Prior Response and a Repulsion from the Prior Stimulus

Visual perceptual decisions can be altered by recent experience. In the “serial dependence” effect, participants’ responses to visual stimuli appear to be biased toward (i.e., attracted to) recently encountered stimuli. Fischer and Whitney (2014) proposed that serial dependence reflects a “continuity field” that promotes visual stability by biasing perception toward the recent past. However, when participants are relatively accurate on the prior trial, there is no discernible difference between attraction to the prior stimulus and attraction to the prior response. To tease apart these alternative explanations of the attraction effect, we developed two complementary analysis techniques that rely on participants’ naturally occurring errors on a trial-by-trial basis, identifying any effect of the prior stimulus and, separately, any effect of the prior response (i.e., each effect could be attractive, repulsive, or absent). Applying these techniques to serial dependence data from a new experiment and four previously published studies, including Fischer and Whitney’s, we found that serial dependencies reflect an attraction to the previous response and repulsion from the previous stimulus, with these effects cancelling each other to different degrees for different experiments. In no case did we find evidence of an attraction to the prior stimulus. These results are consistent with literatures that predate the serial dependence effect: Attraction to prior responses is routinely observed in a wide variety of paradigms and repulsion from prior stimuli is ubiquitous, such as in the tilt aftereffect.

The behavioural preview effect with faces is susceptible to statistical regularities: Evidence for predictive processing across the saccade

The world around us appears stable and continuous despite saccadic eye movements. This apparent visual stability is achieved by trans-saccadic perception leading at the behavioural level to preview effects: performance in processing a foveal stimulus is better if the stimulus remained unchanged (valid) compared to when it changed (invalid) during the saccade that brought it into focus. Trans-saccadic perception is known to predictively adapt to the statistics of the environment. Here, we asked whether the behavioural preview effect shows the same characteristics, employing a between-participants training design. Participants made saccades to faces which could change their orientation (upright/inverted) during the saccade. In addition, the post-saccadic face was slightly tilted and participants reported this tilt upon fixation. In a training phase, one group of participants conducted only invalid trials whereas another group conducted only valid trials. In a subsequent test phase with 50% valid and 50% invalid trials, we measured the preview effect. Invalid training reduced the preview effect. With a mixed-model analysis, we could show how this training effect gradually declines in the course of the test phase. These results show that the behavioural preview effect adapts to the statistics of the environment suggesting that it results from predictive processes.

Behavioural preview effect with faces

The world around us appears stable and continuous despite saccadic eye movements. This apparent visual stability is achieved by trans-saccadic perception leading at the behavioural level to preview effects: Performance in processing a foveal stimulus is better if the stimulus remained unchanged (valid) compared to when it changed (invalid) during the saccade that brought it into focus. Trans-saccadic perception is known to predictively adapt to the statistics of the environment. Here, we asked whether the behavioural preview effect shows the same characteristics, employing a between-participants training design. Participants made saccades to faces which could change their orientation (upright/inverted) during the saccade. In addition, the post-saccadic face was slightly tilted and participants reported this tilt upon fixation. In a training phase, one group of participants conducted only invalid trials whereas another group conducted only valid trials. In a subsequent test phase with 50% valid and 50% invalid trials, we measured the preview effect. Invalid training eliminated the preview effect. With a mixed-model analysis, we could show how this training effect gradually declines in the course of the test phase. These results show that the behavioural preview effect adapts to the statistics of the environment suggesting that it results from predictive processes.