Toward a subjective synchronous communication in multimodal human-machine interaction: Intention of movement alternates simultaneous perception in auditory-tactile temporal order judgment

Abstract Visual distractors interfere with tactile temporal order judgment (TOJ) at moderately short stimulus onset asynchronies (SOAs) in typically developing participants. Presentation of a rubber hand in a forward direction to the participant’s hand enhances this effect, while that in an inverted direction weakens the effect. Individuals with autism spectrum disorder (ASD) have atypical multisensory processing; however, effects of interferences on atypical multisensory processing in ASD remain unclear. In this study, we examined the effects of visual interference on tactile TOJ in individuals with ASD. Two successive tactile stimuli were delivered to the index and ring fingers of a participant’s right hand in an opaque box. A rubber hand was placed on the box in a forward or inverted direction. Concurrently, visual stimuli provided by light-emitting diodes on the fingers of the rubber hand were delivered in a congruent or incongruent order. Participants were required to judge the temporal order of the tactile stimuli regardless of visual distractors. In the absence of a visual stimulus, participants with ASD tended to judge the simultaneous stimuli as the ring finger being stimulated first during tactile TOJ compared with typically developing (TD) controls, and congruent visual stimuli eliminated the bias. When incongruent visual stimuli were delivered, judgment was notably reversed in participants with ASD, regardless of the direction of the rubber hand. The findings demonstrate that there are considerable effects of visual interferences on tactile TOJ in individuals with ASD.

Download Full-text

Effects of handedness on tactile temporal order judgment

Neuropsychologia ◽

10.1016/j.neuropsychologia.2004.05.009 ◽

2004 ◽

Vol 42 (14) ◽

pp. 1887-1895 ◽

Cited By ~ 44

Author(s):

Makoto Wada ◽

Shinya Yamamoto ◽

Shigeru Kitazawa

Keyword(s):

Temporal Order ◽

Temporal Order Judgment ◽

Tactile Temporal Order Judgment

Download Full-text

Bayesian calibration of simultaneity in tactile temporal order judgment

Nature Neuroscience ◽

10.1038/nn1712 ◽

2006 ◽

Vol 9 (7) ◽

pp. 875-877 ◽

Cited By ~ 71

Author(s):

Makoto Miyazaki ◽

Shinya Yamamoto ◽

Sunao Uchida ◽

Shigeru Kitazawa

Keyword(s):

Temporal Order ◽

Temporal Order Judgment ◽

Bayesian Calibration ◽

Tactile Temporal Order Judgment

Download Full-text

Visual presentation of hand image modulates visuo–tactile temporal order judgment

Experimental Brain Research ◽

10.1007/s00221-013-3535-z ◽

2013 ◽

Vol 228 (1) ◽

pp. 43-50 ◽

Cited By ~ 12

Author(s):

Masakazu Ide ◽

Souta Hidaka

Keyword(s):

Temporal Order ◽

Temporal Order Judgment ◽

Visual Presentation ◽

Tactile Temporal Order Judgment ◽

Hand Image

Download Full-text

The effect of vision on tactile TOJ during arm crossing

Seeing and Perceiving ◽

10.1163/187847612x646578 ◽

2012 ◽

Vol 25 (0) ◽

pp. 35

Author(s):

Makoto Wada ◽

Kenji Kansaku

Keyword(s):

Significant Role ◽

Temporal Order ◽

Temporal Order Judgment ◽

Psychophysical Experiment ◽

Eyes Closed ◽

Tactile Stimuli ◽

Eyes Open ◽

The Subject ◽

Opening And Closing ◽

Tactile Temporal Order Judgment

When people cross their arms, subjective rank ordering of successive unseen tactile stimuli delivered to both arms is affected (often being reversed) (Shore et al., 2002; Yamamoto and Kitazawa, 2001). It is also known that vision plays a significant role in modulating perceived limb position (Graziano et al., 2000). In this study, we examined the effect of vision; i.e., eyes opening and closing on tactile temporal order judgment (TOJ) with their arms crossed or uncrossed. In a psychophysical experiment, participants (, 13 males, 27.3 ± 1.8 y.o.) were required to judge temporal order of two tactile stimuli that were delivered to their both ring fingers with four conditions: uncrossed arms with eyes closed, crossed arms with eyes closed, uncrossed arms with eyes open and crossed arms with eyes open. To evaluate judgment probabilities of the participants, degree of reversals of their judgment was calculated as the sum of differences between correct response rates of the arms crossed condition and those of the arms uncrossed condition. In arms uncrossed conditions, judgment probabilities of the participants were not significantly different between eyes closed and open conditions. In contrast, reversal of the judgment with eyes closed was significantly larger than that with eyes open in arms crossed conditions (). The results suggest that vision play a significant role in tactile order judgment when the subject arms crossed.

Download Full-text

Response type and sex differences in a tactile temporal order judgment task with tools

Seeing and Perceiving ◽

10.1163/187847612x647531 ◽

2012 ◽

Vol 25 (0) ◽

pp. 120

Author(s):

Abigail Novick ◽

Nicola Fiddes ◽

Eleanor Huber ◽

Tucker Smith ◽

Jared Medina

Keyword(s):

Temporal Order ◽

Temporal Order Judgment ◽

Body Part ◽

Judgment Task ◽

The Other ◽

Spatial Mapping ◽

Response Type ◽

Males And Females ◽

Tool Position ◽

Tactile Temporal Order Judgment

We presented participants with a temporal order judgment (TOJ) task with vibratory stimuli presented to the ends of held tools. We manipulated whether the hands and tools were uncrossed or crossed, predicting that participants would respond more accurately if the responding body part and tool tip were in the same hemispace (see Yamamoto and Kitazawa, 2001). Participants were split into two groups (24 subjects in each group). One group responded manually with the stimulated tools, the other group responded with foot pedals. Contrasting previous findings, we found no significant effect of manipulating tool position when the hands were uncrossed, regardless of response type. Effects of response type were also observed, as participants were significantly more accurate when responding with the stimulated tools compared to responding with foot pedals. Interactions were also found between response type and sex. Compared to males, females made a substantially greater number of confusion errors when responding with feet, but not when responding with tools. Additionally, compared to males, females made substantially more confusion errors with the arms crossed, reflecting previously reported results in tactile TOJ on the hands (Cadieux et al., 2010). These results suggest potential differences in spatial mapping and tactile processing in males and females.

Download Full-text

Effects of Voluntary Movements on Audio-Tactile Temporal Order Judgment

IEICE Transactions on Information and Systems ◽

10.1587/transinf.e97.d.1567 ◽

2014 ◽

Vol E97.D (6) ◽

pp. 1567-1573 ◽

Cited By ~ 4

Author(s):

Atsuhiro NISHI ◽

Masanori YOKOYAMA ◽

Ken-ichiro OGAWA ◽

Taiki OGATA ◽

Takayuki NOZAWA ◽

...

Keyword(s):

Temporal Order ◽

Temporal Order Judgment ◽

Voluntary Movements ◽

Tactile Temporal Order Judgment

Download Full-text

What Underlies a Greater Reversal in Tactile Temporal Order Judgment when the Hands Are Crossed? A Structural MRI Study

Cerebral Cortex Communications ◽

10.1093/texcom/tgab025 ◽

2021 ◽

Author(s):

Ali Moharramipour ◽

Shigeru Kitazawa

Keyword(s):

Temporal Order ◽

Spatial Information ◽

Temporal Order Judgment ◽

Superior Temporal Gyrus ◽

Structural Mri ◽

Middle Temporal Gyrus ◽

Tactile Stimuli ◽

The Right ◽

Mri Study ◽

Tactile Temporal Order Judgment

Abstract Our subjective temporal order of two successive tactile stimuli delivered one to each hand is often inverted when our hands are crossed. However, there is great variability among different individuals. We addressed the question of why some show almost complete reversal, but others show little reversal. To this end, we obtained structural MRI data from 42 participants who also participated in the tactile temporal order judgment (TOJ) task. We extracted the cortical thickness and the convoluted surface area as cortical characteristics in 68 regions. We found that the participants with a thinner, larger, and more convoluted cerebral cortex in ten regions, including the right pars-orbitalis, right and left postcentral gyri, left precuneus, left superior parietal lobule, right middle temporal gyrus, left superior temporal gyrus, right cuneus, left supramarginal gyrus, and right rostral middle frontal gyrus showed a smaller degree of judgment reversal. In light of major theoretical accounts, we suggest that cortical elaboration in the aforementioned regions improve the crossed-hand TOJ performance through better integration of the tactile stimuli with the correct spatial representations in the left parietal regions, better representation of spatial information in the postcentral gyrus, or improvement of top-down inhibitory control by the right pars-orbitalis.

Download Full-text