scholarly journals Weighted Integration of Duration Information Across Visual and Auditory Modality Is Influenced by Modality-Specific Attention

2021 ◽  
Vol 15 ◽  
Author(s):  
Hiroshi Yoshimatsu ◽  
Yuko Yotsumoto
Keyword(s):  
Hierarchical Modeling ◽  
Sensory Modality ◽  
Weighted Average ◽  
Auditory Stimuli ◽  
Auditory Modality ◽  
Neural Basis ◽  
Sensory Modalities ◽  
Duration Information ◽  
Auditory Dominance ◽  
Perceived Duration

We constantly integrate multiple types of information from different sensory modalities. Generally, such integration is influenced by the modality that we attend to. However, for duration perception, it has been shown that when duration information from visual and auditory modalities is integrated, the perceived duration of the visual stimulus leaned toward the duration of the auditory stimulus, irrespective of which modality was attended. In these studies, auditory dominance was assessed using visual and auditory stimuli with different durations whose timing of onset and offset would affect perception. In the present study, we aimed to investigate the effect of attention on duration integration using visual and auditory stimuli of the same duration. Since the duration of a visual flicker and auditory flutter tends to be perceived as longer than and shorter than its physical duration, respectively, we used the 10 Hz visual flicker and auditory flutter with the same onset and offset timings but different perceived durations. The participants were asked to attend either visual, auditory, or both modalities. Contrary to the attention-independent auditory dominance reported in previous studies, we found that the perceived duration of the simultaneous flicker and flutter presentation depended on which modality the participants attended. To further investigate the process of duration integration of the two modalities, we applied Bayesian hierarchical modeling, which enabled us to define a flexible model in which the multisensory duration is represented by the weighted average of each sensory modality. In addition, to examine whether auditory dominance results from the higher reliability of auditory stimuli, we applied another models to consider the stimulus reliability. These behavioral and modeling results suggest the following: (1) the perceived duration of visual and auditory stimuli is influenced by which modality the participants attended to when we control for the confounding effect of onset–offset timing of stimuli, and (2) the increase of the weight by attention affects the duration integration, even when the effect of stimulus reliability is controlled. Our models can be extended to investigate the neural basis and effects of other sensory modalities in duration integration.

Comparing Primary Voice-Hearers with and without Hallucinations in Other Sensory Modalities

2021 ◽  
pp. 214-220
Author(s):  
Wei Lin Toh ◽  
Neil Thomas ◽  
Susan L. Rossell
Keyword(s):  
Functional Impairment ◽  
Auditory Hallucination ◽  
Sensory Modality ◽  
Clinical Information ◽  
Auditory Hallucinations ◽  
Auditory Modality ◽  
Positive Symptoms ◽  
Psychotic Experiences ◽  
Sensory Modalities ◽  
Preliminary Study

There has been burgeoning interest in studying hallucinations in psychosis occurring across multiple sensory modalities. The current study aimed to characterize the auditory hallucination and delusion profiles in patients with auditory hallucinations only versus those with multisensory hallucinations. Participants with psychosis were partitioned into groups with voices only (AVH; <i>n</i> = 50) versus voices plus hallucinations in at least one other sensory modality (AVH+; <i>n</i> = 50), based on their responses on the Scale for the Assessment of Positive Symptoms (SAPS). Basic demographic and clinical information was collected, and the Questionnaire for Psychotic Experiences (QPE) was used to assess psychosis phenomenology. Relative to the AVH group, greater compliance to perceived commands, auditory illusions, and sensed presences was significantly elevated in the AVH+ group. The latter group also had greater levels of delusion-related distress and functional impairment and was more likely to endorse delusions of reference and misidentification. This preliminary study uncovered important phenomenological differences in those with multisensory hallucinations. Future hallucination research extending beyond the auditory modality is needed.

Can You See What I Hear?

2020 ◽  
Vol 67 (3) ◽  
pp. 186-193
Author(s):  
Anna Conci ◽  
Merim Bilalić ◽  
Robert Gaschler
Keyword(s):  
Video Sequence ◽  
Inattentional Blindness ◽  
Auditory Stimuli ◽  
Visual Modality ◽  
Auditory Modality ◽  
Drastic Reduction ◽  
Counting Task ◽  
Spoken Text ◽  
Sensory Modalities

Abstract. Previous research on inattentional blindness (IB) has focused almost entirely on the visual modality. This study extends the paradigm by pairing visual with auditory stimuli. New visual and auditory stimuli were created to investigate the phenomenon of inattention in visual, auditory, and paired modality. The goal of the study was to assess to what extent the pairing of visual and auditory modality fosters the detection of change. Participants watched a video sequence and counted predetermined words in a spoken text. IB and inattentional deafness occurred in about 40% of participants when attention was engaged by this difficult (auditory) counting task. Most importantly, participants detected the changes considerably more often (88%) when the change occurred in both modalities rather than just one. One possible reason for the drastic reduction of IB or deafness in a multimodal context is that discrepancy between expected and encountered course of events proportionally increases across sensory modalities.

scholarly journals Cognitive entrainment to isochronous rhythms is independent of both sensory modality and top-down attention

2019 ◽  
Vol 40 (2) ◽  
pp. 62-84
Author(s):  
Diana Cutanda ◽  
Daniel Sanabria ◽  
Ángel Correa
Keyword(s):  
Working Memory ◽  
Secondary Task ◽  
Cognitive Process ◽  
Sensory Modality ◽  
Reaction Times ◽  
Auditory Stimuli ◽  
Visual Modality ◽  
Auditory Modality ◽  
Top Down ◽  
Back Task

AbstractThe anisochrony of a stimulus sequence was manipulated parametrically to investigate whether rhythmic entrainment is stronger in the auditory modality than in the visual modality (Experiment 1), and whether it relies on top-down attention (Experiment 2). In Experiment 1, participants had to respond as quickly as possible to a target presented after a sequence of either visual or auditory stimuli. The anisochrony of this sequence was manipulated parametrically, rather than in an all or none fashion; that is, it could range from smaller to larger deviations of the isochrony (0, 10, 20, 50, 100, 150 and 200 ms). We compared rhythmic entrainment patterns for auditory and visual modalities. Results showed a peak of entrainment for both isochrony and deviations of isochrony up to 50 ms (i.e., participants were equally fast both after the isochronous sequences and after 10, 20 and 50 ms deviations), suggesting that anisochronous sequences can also produce entrainment. Beyond this entrainment window, the reaction times became progressively slower. Surprisingly, no differences were found between the entrainment patterns for auditory and visual rhythms. In Experiment 2, we used a dual-task methodology by adding a working memory n-back task to the procedure of Experiment 1. Results did not show interference of the secondary task in either auditory or visual modalities, with participants showing the same entrainment pattern as in Experiment 1. These results suggest that rhythmic entrainment constitutes a cognitive process that occurs by default (automatically), regardless of the modality in which the stimuli are presented, and independent of top-down attention, to generate behavioural benefits.

Reaction Time and Brain Waves in Omitted Stimulus Tasks

2010 ◽  
Vol 24 (1) ◽  
pp. 1-6 ◽  
Author(s):  
Oscar H. Hernández ◽  
Muriel Vogel-Sprott
Keyword(s):  
Reaction Time ◽  
Cognitive Processes ◽  
Young Male ◽  
Event Related Potential ◽  
Auditory Stimuli ◽  
Motor Action ◽  
Cognitive Component ◽  
Sensory Modalities ◽  
Two Measures ◽  
Somatosensory Stimuli

A missing stimulus task requires an immediate response to the omission of a regular recurrent stimulus. The task evokes a subclass of event-related potential known as omitted stimulus potential (OSP), which reflects some cognitive processes such as expectancy. The behavioral response to a missing stimulus is referred to as omitted stimulus reaction time (RT). This total RT measure is known to include cognitive and motor components. The cognitive component (premotor RT) is measured by the time from the missing stimulus until the onset of motor action. The motor RT component is measured by the time from the onset of muscle action until the completion of the response. Previous research showed that RT is faster to auditory than to visual stimuli, and that the premotor of RT to a missing auditory stimulus is correlated with the duration of an OSP. Although this observation suggests that similar cognitive processes might underlie these two measures, no research has tested this possibility. If similar cognitive processes are involved in the premotor RT and OSP duration, these two measures should be correlated in visual and somatosensory modalities, and the premotor RT to missing auditory stimuli should be fastest. This hypothesis was tested in 17 young male volunteers who performed a missing stimulus task, who were presented with trains of auditory, visual, and somatosensory stimuli and the OSP and RT measures were recorded. The results showed that premotor RT and OSP duration were consistently related, and that both measures were shorter with respect to auditory stimuli than to visual or somatosensory stimuli. This provides the first evidence that the premotor RT is related to an attribute of the OSP in all three sensory modalities.

scholarly journals The fruitless gene affects female receptivity and species isolation

2020 ◽  
Vol 287 (1923) ◽  
pp. 20192765 ◽  
Author(s):  
Tabashir Chowdhury ◽  
Ryan M. Calhoun ◽  
Katrina Bruch ◽  
Amanda J. Moehring
Keyword(s):  
Mate Choice ◽  
Critical Role ◽  
Sensory Modality ◽  
Female Mate Choice ◽  
Neural Basis ◽  
Female Receptivity ◽  
Female Mate ◽  
Multiple Transcripts ◽  
Female Behaviour ◽  
Substrate Vibrations

Female mate rejection acts as a major selective force within species, and can serve as a reproductive barrier between species. In spite of its critical role in fitness and reproduction, surprisingly little is known about the genetic or neural basis of variation in female mate choice. Here, we identify fruitless as a gene affecting female receptivity within Drosophila melanogaster , as well as female Drosophila simulans rejection of male D. melanogaster . Of the multiple transcripts this gene produces, by far the most widely studied is the sex-specifically spliced transcript involved in the sex determination pathway. However, we find that female rejection behaviour is affected by a non-sex-specifically spliced fruitless transcript. This is the first implication of fruitless in female behaviour, and the first behavioural role identified for a fruitless non-sex-specifically spliced transcript. We found that this locus does not influence preferences via a single sensory modality, examining courtship song, antennal pheromone perception, or perception of substrate vibrations, and we conclude that fruitless influences mate choice via the integration of multiple signals or through another sensory modality.

Neuroscience of synesthesia and cross-modal associations

2014 ◽  
Vol 25 (6) ◽  
Author(s):  
Marcel Neckar ◽  
Petr Bob
Keyword(s):  
Current Knowledge ◽  
Sensory Modality ◽  
Subjective Experiences ◽  
Neural Basis ◽  
Behavioral Aspects ◽  
Stimulation Of

AbstractSynesthesia is a condition in which stimulation of one sensory modality causes unusual experiences in a different, unstimulated modality. Recent findings suggest that research on synesthesia offers a unique opportunity to study the neural basis of subjective experiences in healthy and pathological brains. This review summarizes and reflects current knowledge concerning synesthesia in its various aspects, including its cognitive, neural, and behavioral aspects. In this context, recent data suggest new connections between specific conditions related to synesthesic mechanisms and association processes linked to construction of synesthetic cross-modal metaphors that may play a role in psychopathological thinking and imagination.

Who is in the Room? Notification for Intrusions While in Virtual Reality

2020 ◽  
Vol 64 (1) ◽  
pp. 521-525
Author(s):  
Aaron Crowson ◽  
Zachary H. Pugh ◽  
Michael Wilkinson ◽  
Christopher B. Mayhorn
Keyword(s):  
Virtual Reality ◽  
Visual Field ◽  
Physical World ◽  
Visual Modality ◽  
Auditory Modality ◽  
Oculus Rift ◽  
Head Mounted Display ◽  
Sensory Modalities ◽  
Orientation Type

The development of head-mounted display virtual reality systems (e.g., Oculus Rift, HTC Vive) has resulted in an increasing need to represent the physical world while immersed in the virtual. Current research has focused on representing static objects in the physical room, but there has been little research into notifying VR users of changes in the environment. This study investigates how different sensory modalities affect noticeability and comprehension of notifications designed to alert head-mounted display users when a person enters his/her area of use. In addition, this study investigates how the use of an orientation type notification aids in perception of alerts that manifest outside a virtual reality users’ visual field. Results of a survey indicated that participants perceived the auditory modality as more effective regardless of notification type. An experiment corroborated these findings for the person notifications; however, the visual modality was in practice more effective for orientation notifications.

A Reexamination of Some Nonverbal Perceptual Abilities of Language-Impaired and Normal Children as a Function of Age and Sensory Modality

1981 ◽  
Vol 24 (3) ◽  
pp. 351-357 ◽  
Author(s):  
Paula Tallal ◽  
Rachel Stark ◽  
Clayton Kallman ◽  
David Mellits
Keyword(s):  
Sensory Modality ◽  
Important Variable ◽  
Control Group ◽  
Visual Modality ◽  
Auditory Modality ◽  
Normal Children ◽  
Language Impaired ◽  
Perceptual Performance ◽  
In Series ◽  
Perceptual Abilities

A battery of nonverbal perceptual and memory tests were given to 35 language-impaired (LI) and 38 control subjects. Three modalities of tests were given: auditory, visual, and cross-modal (auditory and visual). The purpose was to reexamine some nonverbal perceptual and memory abilities of LI children as a function of age and modality of stimulation. Results failed to replicate previous findings of a temporal processing deficit that is specific to the auditory modality in LI children. The LI group made significantly more errors than did controls regardless of modality of stimulation when 2-item sequences were presented rapidly, or when more than two stimuli were presented in series. However, further analyses resolved this apparent conflict between the present and earlier studies by demonstrating that age is an important variable underlying modality specificity of perceptual performance in LI children. Whereas younger LI children were equally impaired when responding to stimuli presented rapidly to the auditory and visual modality, older LI subjects made nearly twice as many errors responding to rapidly presented auditory rather than visual stimuli. This developmental difference did not occur for the control group.

scholarly journals Synaesthesia in Autism

2016 ◽  
Vol 14 (3) ◽  
pp. 21-31 ◽  
Author(s):  
O.B. Bogdashina
Keyword(s):  
Autism Spectrum Disorders ◽  
Sensory Modality ◽  
Children With Autism ◽  
Autism Spectrum ◽  
Sensory Modalities ◽  
Spectrum Disorders ◽  
Stimulation Of

Synaesthesia — a phenomenon of perception, when stimulation of one sensory modality triggers a perception in one or more other sensory modalities. Synaesthesia is not uniform and can manifest itself in different ways. As the sensations and their interpretation vary in different periods of time, it makes it hard to study this phenom¬enon. The article presents the classification of different forms of synaesthesia, including sensory and cognitive; and bimodal and multimodal synaesthesia. Some synaesthetes have several forms and variants of synaesthesia, while others – just one form of it. Although synaesthesia is not specific to autism spectrum disorders, it is quite common among autistic individuals. The article deals with the most common forms of synaesthesia in autism, advantages and problems of synesthetic perception in children with autism spectrum disorders, and provides some advice to parents how to recognise synaesthesia in children with autism.

scholarly journals Perceptual Content, Not Physiological Signals, Determines Perceived Duration When Viewing Dynamic, Natural Scenes

2019 ◽  
Vol 5 (1) ◽  
Author(s):  
Marta Suárez-Pinilla ◽  
Kyriacos Nikiforou ◽  
Zafeirios Fountas ◽  
Anil K. Seth ◽  
Warrick Roseboom
Keyword(s):  
Time Perception ◽  
Physiological Signals ◽  
Perceptual Content ◽  
Natural Scenes ◽  
Neural Basis ◽  
Recent Proposal ◽  
Physiological Factors ◽  
Physiological Processes ◽  
Scene Content ◽  
Perceived Duration

The neural basis of time perception remains unknown. A prominent account is the pacemaker-accumulator model, wherein regular ticks of some physiological or neural pacemaker are read out as time. Putative candidates for the pacemaker have been suggested in physiological processes (heartbeat), or dopaminergic mid-brain neurons, whose activity has been associated with spontaneous blinking. However, such proposals have difficulty accounting for observations that time perception varies systematically with perceptual content. We examined physiological influences on human duration estimates for naturalistic videos between 1–64 seconds using cardiac and eye recordings. Duration estimates were biased by the amount of change in scene content. Contrary to previous claims, heart rate, and blinking were not related to duration estimates. Our results support a recent proposal that tracking change in perceptual classification networks provides a basis for human time perception, and suggest that previous assertions of the importance of physiological factors should be tempered.

Sign in / Sign up

Export Citation Format

Share Document