The Importance of Attention in the Twinkle Goes Effect

How do we perceive the location of moving objects? The position and motion literature is currently divided. Predictive accounts of object tracking propose that the position of moving objects is anticipated ahead of sensory signals, whilst non-predictive accounts claim that an anticipatory mechanism is not necessary. A novel illusion called the twinkle goes effect, describing a forward shift in the perceived final location of a moving object in the presence of dynamic noise, presents a novel opportunity to disambiguate these accounts. Across three experiments, we compared the predictions of predictive and non-predictive theories of object tracking by combining the twinkle goes paradigm with a multiple object tracking task. Specifically, we tested whether the size of the twinkle goes illusion would be smaller with greater attentional load (as entailed by the non-predictive, tracking continuation theory) or whether it would not be affected by attentional load (as entailed by predictive extrapolation theory). Our results failed to align with either of these theories of object localisation and tracking. Instead, we found evidence that the twinkle goes effect may be stronger with greater attentional load. We discuss whether this result may be a consequence of an essential, but previously unexplored relationship between the twinkle goes effect and representational momentum. In addition, this study was the first to reveal critical individual differences in the experience of the twinkle goes effect, and in the mislocalisation of moving objects. Together, our results continue to demonstrate the complexity of position and motion perception.

Prediction, Suppression of Visual Response, and Modulation of Visual Perception: Insights From Visual Evoked Potentials and Representational Momentum

When a visual object changes its position along with certain sequential regularities, the visual system rapidly and automatically forms a prediction regarding the future position of the object based on the regularities. Such prediction can drastically alter visual perception. A phenomenon called representational momentum (RM: a predictive displacement of the perceived final position of a visual object along its recent regular pattern) has provided extensive evidence for the predictive modulation of visual perception. The purpose of the present study was to identify neural effects that could explain individual differences in the strength of the predictive modulation of visual perception as measured by RM. For this purpose, in two experiments with a conventional RM paradigm where a bar was discretely presented in a regular rotation manner (with a step of 18° in Experiment 1 and a step of 20° in Experiment 2), visual evoked potentials (VEPs) in response to the regularly rotated bar were measured, and correlations between the magnitudes of RM and VEPs were examined. The results showed that the magnitudes of RM and central P2 were negatively correlated, consistently in both experiments; participants who showed a smaller central P2 tended to exhibit greater RM. Together with a previous proposal that central P2 would represent delayed reactivation of lower visual areas around the striate and prestriate cortices via reentrant feedback projections from higher areas, the present results suggest that greater suppression of delayed reactivation of lower visual areas (as indicated by smaller central P2) may underlie stronger predictive modulation of visual perception (as indicated by greater RM).

Perceived Motion and Operational Momentum: How Speed, Distance, and Time Influence Two-Digit Arithmetic

Operational momentum was originally defined as a bias toward underestimating outcomes of subtraction and overestimating outcomes of addition. It was suggested that these estimation biases are due to leftward attentional shift along the mental number-line (spatially organized internal representation of number) in subtraction and rightward shift in addition. This assumes the use of “recycled” mechanisms of spatial attention, including “representational momentum” – a tendency to overestimate future position of a moving object, which compensates for the moving object’s shift during preparation of a reaction. We tested a strong version of this assumption directly, priming two-digit addition and subtraction problems with leftward and rightward motion of varied velocity, as velocity of the tracked object was found to be a factor in determining representational momentum effect size. Operands were subsequently moving across the computer screen, and the participants’ task was to validate an outcome proposed at the end of the event, which was either too low, correct, or too high. We found improved accuracy in detecting too-high outcomes of addition, as well as complex patterns of interactions involving arithmetic operation, outcome option, speed, and direction of motion, in the analysis of reaction times. These results significantly extend previous evidence for the involvement of spatial attention in mental arithmetic, showing movement of the external attention focus as a factor directing internal attention in processing numerical information. As a whole, however, the results are incompatible with expectations derived from the strong analogy between operational and representational momenta. We suggest that the full model may be more complex than simply “moving attention along the mental number-line” as a direct counterpart of attention directed at a moving object.

Serial dependence and representational momentum in single-trial perceptual decisions

The human brain has evolved to predict and anticipate environmental events from their temporal dynamics. Predictions can bias perception toward the recent past, particularly when the environment contains no foreseeable changes, but can also push perception toward future states of sensory input, like when anticipating the trajectory of moving objects. Here, we show that perceptual decisions are simultaneously influenced by both past and future states of sensory signals. Using an orientation adjustment task, we demonstrate that single-trial errors are displaced toward previous features of behaviorally relevant stimuli and, at the same time, toward future states of dynamic sensory signals. These opposing tendencies, consistent with decisional serial dependence and representational momentum, involve different types of processing: serial dependence occurs beyond objecthood whereas representational momentum requires the representation of a single object with coherent dynamics in time and space. The coexistence of these two phenomena supports the independent binding of stimuli and decisions over time.

Dynamic representation of physical states

When a log burns, it transforms from a block of wood into a pile of ash. Such state-changes are among the most dramatic ways objects change, going beyond mere changes of position or orientation. How does the mind represent changes of state? A foundational result in visual cognition is that memory extrapolates the positions of moving objects—a distortion called "representational momentum." Here, four experiments (N=300 adults) exploited this phenomenon to investigate mental representations in "state-space." Participants who viewed objects undergoing state- changes—e.g., ice melting, logs burning, or grapes shriveling—remembered them as more changed (e.g., more melted, burned, or shriveled) than they actually were. This pattern extended to several types of state-changes, went beyond their low-level properties, and even adhered to their plausible trajectories in state-space. Thus, mental representations of a dynamic world actively incorporate change, in surprisingly broad ways: Whether in position or state, memory extrapolates how objects change.

Tactile temporal offset cues reduce visual representational momentum

The perception of dynamic objects is sometimes biased. For example, localizing a moving object after it has disappeared results in a perceptual shift in the direction of motion, a bias known as representational momentum. We investigated whether the temporal characteristics of an irrelevant, spatially uninformative vibrotactile stimulus bias the perceived location of a visual target. In two visuotactile experiments, participants judged the final location of a dynamic, visual target. Simultaneously, a continuous (starting with the onset of the visual target, Experiments 1 and 2) or brief (33-ms stimulation, Experiment 2) vibrotactile stimulus (at the palm of participant’s hands) was presented, and the offset disparity between the visual target and tactile stimulation was systematically varied. The results indicate a cross-modal influence of tactile stimulation on the perceived final location of the visual target. Closer inspection of the nature of this cross-modal influence, observed here for the first time, reveals that the vibrotactile stimulus was likely just taken as a temporal cue regarding the offset of the visual target, but no strong interaction and combined processing of the two stimuli occurred. The present results are related to similar cross-modal temporal illusions and current accounts of multisensory perception, integration, and cross-modal facilitation.