Microsaccades mediate perceptual alternations in Monet’s “Impression, sunrise”

Troxler fading, the perceptual disappearance of stationary images upon sustained fixation, is common for objects with equivalent luminance to that of the background. Previous work showed that variations in microsaccadic rates underlie the perceptual vanishing and intensification of simple stimuli, such as Gabor patches. Here, we demonstrate that microsaccade dynamics also contribute to Troxler fading and intensification during the viewing of representational art. Participants fixated a small spot while viewing either a Gabor patch on a blank background, or Monet’s painting “Impression, Sunrise.” They continuously reported, via button press/release, whether the Gabor patch, or the sun in Monet’s painting, was fading versus intensifying, while their eye movements were recorded with high precision. Microsaccade rates peaked before reports of increased visibility, and dropped before reports of decreased visibility or fading, both when viewing Gabor patches and Monet’s sun. These results reveal that the relationship between microsaccade production and the reversal and prevention of Troxler fading applies not only to the viewing of contrived stimuli, but also to the observation of “Impression, Sunrise.” Whether or not perceptual fading was consciously intended by Monet, our findings indicate that observers’ oculomotor dynamics are a contributor to the cornerstone of Impressionism.

Perceived Congruency in Audiovisual Stimuli Consisting of Gabor Patches and AM and FM Tones

Experiments that focus on how humans perceive temporal, spatial or synaesthetic congruency in audiovisual sensory information have often employed stimuli consisting of a Gabor patch and an amplitude (AM) or frequency (FM)-modulated sound. Introducing similarity between the static and dynamic features of the Gabor patch and the (carrier) frequency or modulation frequency of the sound is often assumed to be effective enough to induce congruency. However, comparative empirical data on perceived congruency of various stimulus parameters are not readily available, and in particular with respect to sound modulation, it is still not clear which type (AM or FM) induces perceived congruency best in tandem with various patch parameters. In two experiments, we examined Gabor patches of various spatial frequencies with flickering (2, 3 and 4 flickers/s) or drifting (0.5, 1.0 and 1.5 degrees/s) gratings in combinations with AM or FM tones of 2-, 3- and 4-Hz modulation and 500-, 1000- and 2000-Hz carrier frequencies. Perceived congruency ratings were obtained by asking participants to rate stimulus (in)congruency from 1 (incongruent) to 7 (congruent). The data showed that varying the spatial frequency of the Gabor patch and the carrier frequency of the modulated tone had comparatively little impact on perceived congruency. Similar to previous findings, similarity between the temporal frequency of the Gabor patch and the modulated tone effectively promoted perceived congruency. Furthermore, direct comparisons convincingly showed that AM tones in combination with flickering Gabor patches received significantly higher audiovisual congruency ratings compared to FM tones.

Motor Responses Influence Perceptual Awareness Judgements

Perception and action are tightly related, but what is the relation between perceptual awareness and action? In this study we tested the hypothesis that motor response influences perceptual awareness judgements. We design a procedure in which participants were asked to decide whether Gabor grating was oriented towards the left or the right. Presentation of the stimuli was immediately followed by a cue requiring motor response that was irrelevant to the task but could be the same, opposite or neutral to the correct response to the Gabor patch. After responding to the cue participants were asked to rate their stimulus awareness using Perceptual Awareness Scale and then to report their discrimination decision.The results showed that participants reported a higher level of stimulus awareness after carrying out responses that were either congruent or incongruent with a response required by a stimulus, compared to the neutral condition. The results suggest that directional motor response (congruent or incongruent with correct response to the stimulus) provides information about the decision process and its outcome increasing reported awareness of a stimulus.

The right temporoparietal junction plays a causal role in maintaining the internal representation of verticality

Perception of the visual vertical is strongly based on our ability to match visual inflow with vestibular, proprioceptive, tactile, and even visceral information that contributes to maintaining an internal representation of the vertical. An important cortical region implicated in multisensory integration is the right temporoparietal junction (rTPJ), which also is involved in higher order forms of body- and space-related cognition. To test whether this region integrates body-related multisensory information necessary for establishing the subjective visual vertical, we combined a psychophysical task (the rod-and-frame test) with transient inhibition of the rTPJ via continuous theta burst stimulation (cTBS). A Gabor patch visual detection task was used as a control visual task. cTBS of early visual cortex (V1–V3) was used to test whether early visual cortices played any role in verticality estimation. We show that inhibition of rTPJ activity selectively impairs the ability to evaluate the rod's verticality when no contextual visual information, such as a frame surrounding the rod, is provided. Conversely, transient inhibition of V1–V3 selectively disrupts the ability to visually detect Gabor patch orientation. This anatomofunctional dissociation supports the idea that the rTPJ plays a causal role in integrating egocentric sensory information encoded in different reference systems (i.e., vestibular and somatic) to maintain an internal representation of verticality.

The Functional Benefits of Tilt Adaptation

Many have argued that effects of adaptation, such as aftereffects from motion or tilt, reflect that the visual system hones its responses in on the characteristics of the adapting stimulus. This view entails that on average, the discrimination of the characteristics of an adapting stimulus should become easier as viewing time increases since the variation in the response gradually adapts to the range and variation in the stimulus. Here this was tested for adaptation to tilt. Observers viewed a Gabor patch which varied in contrast from 0 to 74% at a rate of 0.6 Hz, for 4, 8, 16 or 32 s, after which the Gabor patch changed orientation (at the point when contrast was 0). The results show that the longer the observers adapt to the dynamic Gabor, the better they become at discriminating between clockwise (CW) or counterclockwise (CCW) changes in tilt (orientation) of the same patch. Experiment 2 confirms that both the direct and indirect tilt aftereffects are seen with this contrast varying Gabor patch and Experiment 3 shows that the aftereffects are only slightly smaller than in other studies with stimuli such as lines and sinusoidal gratings. These results show that adaptation to tilt leads to better discrimination around the orientation of the adapting stimulus itself, and that discrimination performance improves steadily with increased adaptation time. The results support proposals that the visual system adjusts its response characteristics to the properties of the visual input at a given time.

Sounds can affect visual perception mediated primarily by the parvocellular pathway

We investigated the effect of auditory–visual sensory integration on visual tasks that were predominantly dependent on parvocellular processing. These tasks were (i) detecting metacontrast-masked targets and (ii) discriminating orientation differences between high spatial frequency Gabor patch stimuli. Sounds that contained no information relevant to either task were presented before, synchronized with, or after the visual targets, and the results were compared to conditions with no sound. Both tasks used a two-alternative forced choice technique. For detecting metacontrast-masked targets, one interval contained the visual target and both (or neither) intervals contained a sound. Sound–target synchrony within 50 ms lowered luminance thresholds for detecting the presence of a target compared to when no sound occurred or when sound onset preceded target onset. Threshold angles for discriminating the orientation of a Gabor patch consistently increased in the presence of a sound. These results are compatible with sound-induced activity in the parvocellular visual pathway increasing the visibility of flashed targets and hindering orientation discrimination.