The Role of Visual and Auditory Communication in the Performance of a Joint Team Task

Author(s):  
Adam F. Werner ◽  
Jamie C. Gorman

Objective This study examines visual, auditory, and the combination of both (bimodal) coupling modes in the performance of a two-person perceptual-motor task, in which one person provides the perceptual inputs and the other the motor inputs. Background Parking a plane or landing a helicopter on a mountain top requires one person to provide motor inputs while another person provides perceptual inputs. Perceptual inputs are communicated either visually, auditorily, or through both cues. Methods One participant drove a remote-controlled car around an obstacle and through a target, while another participant provided auditory, visual, or bimodal cues for steering and acceleration. Difficulty was manipulated using target size. Performance (trial time, path variability), cue rate, and spatial ability were measured. Results Visual coupling outperformed auditory coupling. Bimodal performance was best in the most difficult task condition but also high in the easiest condition. Cue rate predicted performance in all coupling modes. Drivers with lower spatial ability required a faster auditory cue rate, whereas drivers with higher ability performed best with a lower rate. Conclusion Visual cues result in better performance when only one coupling mode is available. As predicted by multiple resource theory, when both cues are available, performance depends more on auditory cueing. In particular, drivers must be able to transform auditory cues into spatial actions. Application Spotters should be trained to provide an appropriate cue rate to match the spatial ability of the driver or pilot. Auditory cues can enhance visual communication when the interpersonal task is visual with spatial outputs.

Author(s):  
Nada Zwayyid Almutairi ◽  
Eman Salah Ibrahim Rizk

This study explores interactive e-book cues and Information Processing Levels (IPL)’s effectiveness on Learning Retention (LR) and External Cognitive Load (ECL). 117 middle school pupils (MSP) were divided into six experimental groups based on their IPL and cues during the second term of the academic year 2019–2020. Visual Cues (VC)/Audiovisual Cues (VAC) and Auditory Cues (AC)/Audiovisual Cues (VAC) statistically varied in the Ie-book in LR test and ECL scale, same for the average scores when testing the LR in Science for MSP due to the difference between IPL for the DL. There is a statistically significant effect of cue types' interaction in Ie-book with IPL in ECL scale for MSP, at its highest peak in the case of the AVC with DL, followed by the interaction resulting from the VC with DL then AC with SL. Also, cues interaction in Ie-book with IPL immensely affect the LR test for MEP, which is at its highest peak in the case of the AVC with DL. The interactions between (DL–SL) and (AC–VC) seem to equally influence the ELC.


Author(s):  
Joan Borràs-Comes ◽  
Pilar Prieto

AbstractOne of the unresolved questions in audiovisual prosody is the relative contribution of acoustic and visual cues to the expression of prosodic meaning. Though the majority of studies on audiovisual prosody have found a complementary mode of processing whereby sight provides relatively weak and redundant information in comparison with strong auditory cues, other work has found that sight provides information more efficiently than hearing. In Catalan, a pitch range contrast in a rising-falling nuclear configuration conveys a difference between a contrastive focus statement and an echo question. The main goal of this study is to investigate the relative contribution of visual cues in conveying this distinction. Twenty native speakers of Central Catalan participated in two identification tasks in which they had to decide between a focus statement and a question interpretation. Experiment 1 used a pitch range auditory continuum combined with two congruent and incongruent videotapes showing the facial gestures that are characteristic of the two pragmatic meanings. Experiment 2 used the same auditory continuum in combination with another continuum for facial gestures produced using a digital image-morphing technique. The responses and reaction times obtained in both experiments revealed a consistent reliance on visual cues in the listener's decisions, but also a consistent effect of the auditory stimulus. We argue that although facial gestures are the most influential elements that Catalan listeners rely on to decide between contrastive focus and echo question interpretations, bimodal integration with the acoustic cues is necessary for perceptual processing to be accurate and fast. Finally, we discuss the implications of these results for models of audiovisual processing.


1997 ◽  
Vol 14 (1) ◽  
pp. 2-10 ◽  
Author(s):  
D.J. Livesey ◽  
M. Kangas

ABSTRACTThe relationship between vividness of visual movement imagery and performance on tests of kinaesthetic sensitivity was examined in high school students by comparing performance on three tests of kinaesthesis by high and low imagery students, selected using the Vividness of Movement Imagery Questionnaire. High imagers performed significantly better than low imagers when relying on kinaesthetic information. Level of movement imagery predicted performance on a motor task (a manual placement task) when the task was performed in the absence of visual cues (blindfolded). These results reflect the reliance on visual information when performing motor tasks and indicate that, in the absence of visual cues, such information is created from kinaesthetic input via visual imagery. This has important implications for our understanding of the development of kinaesthesis and motor control and may contribute to the development of remedial programmes for children with poor motor ability.


Author(s):  
Shihab Shamma ◽  
Prachi Patel ◽  
Shoutik Mukherjee ◽  
Guilhem Marion ◽  
Bahar Khalighinejad ◽  
...  

Abstract Action and Perception are closely linked in many behaviors necessitating a close coordination between sensory and motor neural processes so as to achieve a well-integrated smoothly evolving task performance. To investigate the detailed nature of these sensorimotor interactions, and their role in learning and executing the skilled motor task of speaking, we analyzed ECoG recordings of responses in the high-γ band (70 Hz-150 Hz) in human subjects while they listened to, spoke, or silently articulated speech. We found elaborate spectrotemporally-modulated neural activity projecting in both forward (motor-to-sensory) and inverse directions between the higher-auditory and motor cortical regions engaged during speaking. Furthermore, mathematical simulations demonstrate a key role for the forward projection in learning to control the vocal tract, beyond its commonly-postulated predictive role during execution. These results therefore offer a broader view of the functional role of the ubiquitous forward projection as an important ingredient in learning, rather than just control, of skilled sensorimotor tasks.


1976 ◽  
Vol 28 (2) ◽  
pp. 193-202 ◽  
Author(s):  
Philip Merikle

Report of single letters from centrally-fixated, seven-letter, target rows was probed by either auditory or visual cues. The target rows were presented for 100 ms, and the report cues were single digits which indicated the spatial location of a letter. In three separate experiments, report was always better with the auditory cues. The advantage for the auditory cues was maintained both when target rows were masked by a patterned stimulus and when the auditory cues were presented 500 ms later than comparable visual cues. The results indicate that visual cues produce modality-specific interference which operates at a level of processing beyond iconic representation.


2011 ◽  
Vol 2011 ◽  
pp. 1-5 ◽  
Author(s):  
Atsushi Hirao

In avian mating systems, male domestic fowls are polygamous and mate with a number of selected members of the opposite sex. The factors that influence mating preference are considered to be visual cues. However, several studies have indicated that chemosensory cues also affect socio-sexual behavior, including mate choice and individual recognition. The female uropygial gland appears to provide odor for mate choice, as uropygial gland secretions are specific to individual body odor. Chicken olfactory bulbs possess efferent projections to the nucleus taeniae that are involved in copulatory behavior. From various reports, it appears that the uropygial gland has the potential to act as the source of social odor cues that dictate mate choice. In this review, evidence for the possible role of the uropygial gland on mate choice in domestic chickens is presented. However, it remains unclear whether a relationship exists between the uropygial gland and major histocompatibility complex-dependent mate choice.


2016 ◽  
Vol 115 (6) ◽  
pp. 2803-2813 ◽  
Author(s):  
Miles Wischnewski ◽  
Greg M. Kowalski ◽  
Farrah Rink ◽  
Samir R. Belagaje ◽  
Marc W. Haut ◽  
...  

The role of primary motor cortex (M1) in the control of hand movements is still unclear. Functional magnetic resonance imaging (fMRI) studies of unimanual performance reported a relationship between level of precision of a motor task and additional ipsilateral M1 (iM1) activation. In the present study, we determined whether the demand on accuracy of a movement influences the magnitude of the inhibitory effect between primary motor cortices (IHI). We used transcranial magnetic stimulation (TMS) to measure active IHI (aIHI) of the iM1 on the contralateral M1 (cM1) in the premovement period of a left-hand motor task. Ten healthy participants manipulated a joystick to point to targets of two different sizes. For aIHI, the conditioning stimulus (CS) was applied to iM1, and the test stimulus (TS) to cM1, with an interstimulus interval of 10 ms. The amount of the inhibitory effect of the CS on the motor-evoked potential (MEP) of the subsequent TS was expressed as percentage of the mean MEP amplitude evoked by the single TS. Across different time points of aIHI measurements in the premovement period, there was a significant effect for target size on aIHI. Preparing to point to small targets was associated with weaker aIHI compared with pointing to large targets. The present findings suggest that, during the premovement period, aIHI from iM1 on cM1 is modulated by the demand on accuracy of the motor task. This is consistent with task fMRI findings showing bilateral M1 activation during high-precision movements but only unilateral M1 activity during low-precision movements.


Sign in / Sign up

Export Citation Format

Share Document