scholarly journals Independent Multisensory Integration and Crossmodal Attention Processing: Evidence from Audiovisual Gender Congruency Tasks

2020 ◽  
Author(s):  
Guochun Yang ◽  
Di Fu ◽  
Li Zhenghan ◽  
Haiyan Wu ◽  
Honghui Xu ◽  
...  

Multisensory integration and crossmodal attention are two of the basic mechanisms in processing multisensory inputs, and they are usually mixed. Whether these two processes are dependent or independent remains controversial. To examine the relationship between multisensory integration and crossmodal attention, we adopted modified multilevel audiovisual gender judgment paradigms and evaluated the congruency effects in reaction time (RT) and the inverse effectiveness (IE) effects. If they were dependent, the occurrence of one effect would be accompanied with that of the other. Using both morphed faces and voices, we first performed a speeded classification task, in which participants were either asked to attend to faces (experiment 1a) or attend to voices (experiment 1b); then, we performed an unspeeded rating task with faces as the targets (experiment 2). We observed both a congruency effect in RT and an IE effect in experiment 1a, a congruency effect in RT alone in experiment 1b, and an IE effect alone in experiment 2. These results indicate that the two processes are independent of each other.

Author(s):  
Yuichi Suzuki

Abstract A subtest of the LLAMA test battery (LLAMA_D) has been proposed as a potential test of implicit learning aptitude. To improve its construct validity, in the present study, the original LLAMA_D (a) instructions for incidental learning were modified, and (b) confidence ratings of test responses and (c) reaction time (RT) measurements were added. This revised LLAMA_D was administered along with the other LLAMA subtests (LLAMA-B, -E, and -F). Unconscious knowledge that may (not) result from the exposure was assessed through the relationship between the accuracy/RT and confidence ratings. The results suggest that LLAMA_D accuracy largely reflects conscious retrieval of previously heard sound sequences. However, an index derived from the LLAMA_D RT measure (coefficient of variance) was associated with an aspect of oral fluency, which is presumably dependent on proceduralization. Several recommendations are proposed to redesign and extend LLAMA_D as a potential aptitude test for proceduralization.


2016 ◽  
Vol 60 (4) ◽  
pp. 530-561
Author(s):  
Charlotte R. Vaughn ◽  
Ann R. Bradlow

While indexical information is implicated in many levels of language processing, little is known about the internal structure of the system of indexical dimensions, particularly in bilinguals. A series of three experiments using the speeded classification paradigm investigated the relationship between various indexical and non-linguistic dimensions of speech in processing. Namely, we compared the relationship between a lesser-studied indexical dimension relevant to bilinguals, which language is being spoken (in these experiments, either Mandarin Chinese or English), with: talker identity (Experiment 1), talker gender (Experiment 2), and amplitude of speech (Experiment 3). Results demonstrate that language-being-spoken is integrated in processing with each of the other dimensions tested, and that these processing dependencies seem to be independent of listeners’ bilingual status or experience with the languages tested. Moreover, the data reveal processing interference asymmetries, suggesting a processing hierarchy for indexical, non-linguistic speech features.


2015 ◽  
Vol 3 (1) ◽  
pp. 1-19 ◽  
Author(s):  
Qingyang Yan

The current study used a hand-drawn map task, a dialect difference rating task, and a dialect classification task to explore the relationship between participants’ ideologies about dialect differences and their classification of authentic talkers from six regional varieties in Enshi Prefecture, China. The talkers frequently mistaken for each other in the dialect classification task were those who came from counties that were perceived to have similar dialects in the hand-drawn map task and the dialect difference rating task. Participants showed a positive response bias for the Enshi dialect in classifying talkers, corresponding to the dialect difference ratings that Enshi was rated as least different. Thus participants’ classification of real talkers was largely consistent with their ideologies about differences among “imagined” dialects. Participants’ ideologies about dialect differences were shaped by their home county, and their classification performance was affected by their home county and the talker’s social background.


1991 ◽  
Vol 73 (1) ◽  
pp. 327-334 ◽  
Author(s):  
Shoko Kawabe-Himeno

The present study was designed to investigate the effect of speed and accuracy of force exertion on the relationship between force output and fractionated reaction time. Subjects exerted their force (10% or 40% of maximum isometric contraction) on “accurate” and “fast” tasks as rapidly as possible at the light signal. On the “fast” task, premotor time for the 40% target was lengthened in comparison with that for the 10% target, and motor time was shortened with an increase of force output. On the “accurate” task, on the other hand, premotor time was independent of magnitude of force, and no relation between motor time and force output was found. These findings show that the relationship between force output and fractionated reaction time may be affected by the effort to exert force accurately.


1979 ◽  
Vol 31 (1) ◽  
pp. 95-102 ◽  
Author(s):  
M. W. van der Molen ◽  
P. J. G. Keuss

The effect of signal intensity upon reaction time (RT) was studied in three auditory RT tasks in which the signal was a tone of high or low frequency. Experiment I showed the well-known negative gradient with intensity of simple RT when the subject was instructed to ignore the frequency and give the same response to both tones. But when the subject had to discriminate the frequency in a choice RT task, the RT/intensity relationship appeared to be U-shaped. Experiment II showed that when the subject was required to make a response to one signal but withhold it for the other, a task which requires discrimination of the frequency of the tone but removes the necessity to choose between overt responses, no increase in RT at high intensities was obtained. The results indicate that it is the response choice stage rather than the stimulus encoding stage which is retarded at higher energy levels. Experiment I also demonstrated that visual and auditory leading signals have similar facilitating effects without affecting the RT/intensity relationships.


2012 ◽  
Vol 25 (0) ◽  
pp. 164
Author(s):  
Tim Paris ◽  
Jeesun Kim ◽  
Christopher Davis

The processing of multisensory information depends on the learned association between sensory cues. In the case of speech there is a well-learned association between the movements of the lips and the subsequent sound. That is, particular lip and mouth movements reliably lead to a specific sound. EEG and MEG studies that have investigated the differences between this ‘congruent’ AV association and other ‘incongruent’ associations have commonly reported ERP differences from 350 ms after sound onset. Using a 256 active electrode EEG system, we tested whether this ‘congruency effect’ would be reduced in the context where most of the trials had an altered audiovisual association (auditory speech paired with mismatched visual lip movements). Participants were presented stimuli over 2 sessions: in one session only 15% were incongruent trials; in the other session, 85% were incongruent trials. We found a congruency effect, showing differences in ERP between congruent and incongruent speech between 350 and 500 ms. Importantly, this effect was reduced within the context of mostly incongruent trials. This reduction in the congruency effect indicates that the way in which AV speech is processed depends on the context it is viewed in. Furthermore, this result suggests that exposure to novel sensory relationships leads to updated expectations regarding the relationship between auditory and visual speech cues.


2003 ◽  
Vol 97 (1) ◽  
pp. 57-67 ◽  
Author(s):  
Rick Bell ◽  
Armand V. Cardello ◽  
Howard G. Schutz

Little is known about the relationship between perceptions of comfort and cognitive performance. In the present study, 40 subjects (20 men and 20 women) participated in a computerized cognitive task of visual vigilance. The computer task was completed under three conditions of clothing and tactile comfort: one condition was that of extreme discomfort, effected by the wearing of wool clothing material on the arms and neck in addition to each subject's normal clothing, including a short sleeve shirt; a second condition was that of minimal discomfort, effected by the wearing of cotton clothing material on the arms and neck, in addition to each subject's normal clothing, including a short sleeve shirt; and a third condition was a control, wherein no experimental material was added to each subject's normal clothing, including a short sleeve shirt. Comfort was assessed prior to, during, and after testing. Reaction time and accuracy of 400 trials of a visual vigilance task were assessed under each of these three conditions. Analysis indicated a significant difference in perceived comfort between the wool and each of the other conditions. In addition, both reaction time and accuracy declined in the wool condition. This study is among the first to identify a direct significant relationship between perceptions of clothing comfort and cognitive performance.


1986 ◽  
Vol 30 (7) ◽  
pp. 729-733 ◽  
Author(s):  
Dean G. Jensen

These experiments explored whether groups of facial features are perceived holistically or independently of one another. This was tested with the speeded classification task on inner (the eyebrows, eyes, nose, and lips) and outer (hair and chin) groups of features. When the inner features were separated, either by grouping the eyebrows or the lips as an outer feature, classifications by the inner group were affected by changes in the outer group although classifications by the outer group were unaffected by changes in the inner group. These results indicate that the outer features are perceived independently of the inner features and that the eyebrows, eyes, nose, and lips are perceived holistically. This implies that for facial reproduction, a change of an inner feature should be followed by the reconsideration of the other inner features in the presence of the changed feature.


Perception ◽  
1993 ◽  
Vol 22 (11) ◽  
pp. 1343-1364 ◽  
Author(s):  
Philip T Quinlan ◽  
Glyn W Humphreys

Three experiments on the perception of simple four-sided two-dimensional shapes are reported. In the first experiment subjects were given a paper-and-pencil test in which they had to consider each of a set of shapes in turn. They were instructed to draw in what they considered to be the most salient axis of each of the shapes ie a line that they felt most naturally went with the shape. The results showed a significant tendency to draw an axis of symmetry if one was present. However, when presented with instances of a shape that was elongated but possessed no symmetries they failed to consistently draw any particular axis. A further, speeded classification, task revealed that for this shape explicit axis information appeared not to influence performance. In contrast, such information clearly affected performance with a shape that did possess a salient axis of symmetry and elongation. Indeed this axis was shown to be integral with the contour of the shape when a final classification experiment was carried out. The axis of elongation of the other shape acted as a characteristic which was separable from the contour. The results are discussed in relation to accounts of shape perception which assume that a necessary stage in the perception of shape is the derivation of an axis-based structural description.


Author(s):  
Clarice Maria de Lucena Martins ◽  
Paulo Felipe Ribeiro Bandeira ◽  
Natália Batista Albuquerque Goulart Lemos ◽  
Thaynã Alves Bezerra ◽  
Cain Craig Truman Clark ◽  
...  

The present study aimed to analyze the dynamic and nonlinear association between screen time, executive function (EF), and fundamental motor skills (FMS) in preschoolers, considering sex and body mass index (BMI) from a network perspective. Forty-two preschoolers (24 boys, 3.91 ± 0.77 years old) provided screen time, EF, FMS, and BMI data. EF was measured using the Go/No Go task, and accuracy of Go (sustain attention), reaction time of Go, and accuracy of No Go (inhibitory control) were considered. Relationships between screen time, EF, FMS, sex, and BMI were explored using a network analysis. The emerged network highlights that screen time is intensely associated with the other variables in the network, while the accuracy of Go has the greater connectivity with other nodes in the network (2.27), being the most sensitive to potential intervention changes. Moreover, sex (1.74), screen time (0.93), and accuracy of Go (0.71) showed the greatest closeness. This study showed that in the emerged network, independent of sex, screen exposure affects the accuracy on Go task, and these components affect the variables in the network, as motor abilities and tasks involved in inhibitory control.


Sign in / Sign up

Export Citation Format

Share Document