scholarly journals Multisensory Integration as per Technological Advances: A Review

2021 ◽  
Vol 15 ◽  
Author(s):  
Patricia Cornelio ◽  
Carlos Velasco ◽  
Marianna Obrist

Multisensory integration research has allowed us to better understand how humans integrate sensory information to produce a unitary experience of the external world. However, this field is often challenged by the limited ability to deliver and control sensory stimuli, especially when going beyond audio–visual events and outside laboratory settings. In this review, we examine the scope and challenges of new technology in the study of multisensory integration in a world that is increasingly characterized as a fusion of physical and digital/virtual events. We discuss multisensory integration research through the lens of novel multisensory technologies and, thus, bring research in human–computer interaction, experimental psychology, and neuroscience closer together. Today, for instance, displays have become volumetric so that visual content is no longer limited to 2D screens, new haptic devices enable tactile stimulation without physical contact, olfactory interfaces provide users with smells precisely synchronized with events in virtual environments, and novel gustatory interfaces enable taste perception through levitating stimuli. These technological advances offer new ways to control and deliver sensory stimulation for multisensory integration research beyond traditional laboratory settings and open up new experimentations in naturally occurring events in everyday life experiences. Our review then summarizes these multisensory technologies and discusses initial insights to introduce a bridge between the disciplines in order to advance the study of multisensory integration.

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Emily T. Wood ◽  
Kaitlin K. Cummings ◽  
Jiwon Jung ◽  
Genevieve Patterson ◽  
Nana Okada ◽  
...  

AbstractSensory over-responsivity (SOR), extreme sensitivity to or avoidance of sensory stimuli (e.g., scratchy fabrics, loud sounds), is a highly prevalent and impairing feature of neurodevelopmental disorders such as autism spectrum disorders (ASD), anxiety, and ADHD. Previous studies have found overactive brain responses and reduced modulation of thalamocortical connectivity in response to mildly aversive sensory stimulation in ASD. These findings suggest altered thalamic sensory gating which could be associated with an excitatory/inhibitory neurochemical imbalance, but such thalamic neurochemistry has never been examined in relation to SOR. Here we utilized magnetic resonance spectroscopy and resting-state functional magnetic resonance imaging to examine the relationship between thalamic and somatosensory cortex inhibitory (gamma-aminobutyric acid, GABA) and excitatory (glutamate) neurochemicals with the intrinsic functional connectivity of those regions in 35 ASD and 35 typically developing pediatric subjects. Although there were no diagnostic group differences in neurochemical concentrations in either region, within the ASD group, SOR severity correlated negatively with thalamic GABA (r = −0.48, p < 0.05) and positively with somatosensory glutamate (r = 0.68, p < 0.01). Further, in the ASD group, thalamic GABA concentration predicted altered connectivity with regions previously implicated in SOR. These variations in GABA and associated network connectivity in the ASD group highlight the potential role of GABA as a mechanism underlying individual differences in SOR, a major source of phenotypic heterogeneity in ASD. In ASD, abnormalities of the thalamic neurochemical balance could interfere with the thalamic role in integrating, relaying, and inhibiting attention to sensory information. These results have implications for future research and GABA-modulating pharmacologic interventions.


2012 ◽  
Vol 20 (1) ◽  
pp. 135-167 ◽  
Author(s):  
Irene Ronga ◽  
Carla Bazzanella ◽  
Ferdinando Rossi ◽  
Giandomenico Iannetti

Recent studies on cortical processing of sensory information highlight the importance of multisensory integration, and define precise rules governing reciprocal influences between inputs of different sensory modalities. We propose that psychophysical interactions between different types of sensory stimuli and linguistic synaesthesia share common origins and mechanisms. To test this hypothesis, we compare neurophysiological findings with corpus-based analyses relating to linguistic synaesthesia. Namely, we present Williams’ hypothesis and its recent developments about the hierarchy of synaesthetic pairings, and examine critical aspects of this theory concerning universality, directionality, sensory categories, and usage of corpora. These theoretical issues are verified against linguistic data derived from corpus-based analyses of Italian synaesthetic pairings related to auditory and tactile modalities. Our findings reveal a strong parallel between linguistic synaesthesia and neurophysiological interactions between different sensory stimuli, suggesting that linguistic synaesthesia is affected by tendencies similar to the rules underlying the perceptual association of distinct sensory modalities.


2020 ◽  
Vol 40 (01) ◽  
pp. 116-129
Author(s):  
A.M. Bronstein ◽  
J.F. Golding ◽  
M.A. Gresty

AbstractEnvironmental circumstances that result in ambiguity or conflict with the patterns of sensory stimulation may adversely affect the vestibular system. The effect of this conflict in sensory information may be dizziness, a sense of imbalance, nausea, and motion sickness sometimes even to seemingly minor daily head movement activities. In some, it is not only exposure to motion but also the observation of objects in motion around them such as in supermarket aisles or other places with visual commotion; this can lead to dizziness, nausea, or a feeling of motion sickness that is referred to as visual vertigo. All people with normal vestibular function can be made to experience motion sickness, although individual susceptibility varies widely and is at least partially heritable. Motorists learn to interpret sensory stimuli in the context of the car stabilized by its suspension and guided by steering. A type of motorist's disorientation occurs in some individuals who develop a heightened awareness of perceptions of motion in the automobile that makes them feel as though they may be rolling over on corners and as though they are veering on open highways or in streaming traffic. This article discusses the putative mechanisms, consequences and approach to managing patients with visual vertigo, motion sickness, and motorist's disorientation syndrome in the context of chronic dizziness and motion sensitivity.


The control of movement is essential for animals traversing complex environments and operating across a range of speeds and gaits. We consider how animals process sensory information and initiate motor responses, primarily focusing on simple motor responses that involve local reflex pathways of feedback and control, rather than the more complex, longer-term responses that require the broader integration of higher centers within the nervous system. We explore how local circuits facilitate decentralized coordination of locomotor rhythm and examine the fundamentals of sensory receptors located in the muscles, tendons, joints, and at the animal’s body surface. These sensors monitor the animal’s physical environment and the action of its muscles. The sensory information is then carried back to the animal’s nervous system by afferent neurons, providing feedback that is integrated at the level of the spinal cord of vertebrates and sensory-motor ganglia of invertebrates.


2017 ◽  
Vol 20 (9) ◽  
pp. 3304-3322 ◽  
Author(s):  
Holger Pötzsch

This article reconceptualizes the archive in the context of digital media ecologies. Drawing upon archival theory and critical approaches to the political economy of the Internet, I account for new dynamics and implications afforded by digital archives. Operating at both a user-controlled explicit and a state- and corporate-owned implicit level, the digital archive at once facilitates empowerment and enables unprecedented forms of management and control. Connecting the politics and economy of digital media with issues of identity formation and curation on social networking sites, I coin the terms iArchive and predictive retention to highlight how recent technological advances both provide new means for self-expression, mobilization and resistance and afford an almost ubiquitous tracking, profiling and, indeed, moulding of emergent subjectivities.


1997 ◽  
Vol 92 (2) ◽  
pp. 167-174 ◽  
Author(s):  
Gervais Tougas ◽  
Markad Kamath ◽  
Geena Watteel ◽  
Debbie Fitzpatrick ◽  
Ernest L. Fallen ◽  
...  

1. The heart and the oesophagus have similar sensory pathways, and sensations originating from the oesophagus are often difficult to differentiate from those of cardiac origin. We hypothesized that oesophageal sensory stimuli could alter neurocardiac function through autonomic reflexes elicited by these oesophageal stimuli. In the present study, we examined the neurocardiac response to oesophageal stimulation and the effects of electrical and mechanical oesophageal stimulation on the power spectrum of beat-to-beat heart rate variability in male volunteers. 2. In 14 healthy volunteers, beat-to-beat heart rate variability was compared at rest and during oesophageal stimulation, using either electrical (200 μs, 16 mA, 0.2 Hz) or mechanical (0.5 s, 14 ml, 0.2 Hz) stimuli. The power spectrum of beat-to-beat heart rate variability was obtained and its low- and high-frequency components were determined. 3. Distal oesophageal stimulation decreased heart rate slightly (both electrical and mechanical) (P < 0.005), and markedly altered heart rate variability (P < 0.001). Both electrical and mechanical oesophageal stimulation increased the absolute and normalized area of the high-frequency band within the power spectrum (P < 0.001), while simultaneously decreasing the low-frequency power (P < 0.005). 4. In humans, oesophageal stimulation, whether electrical or mechanical, appears to amplify respiratory-driven cardiac vagoafferent modulation while decreasing sympathetic modulation. The technique provides access to vagoafferent fibres and thus may yield useful information on the autonomic effects of visceral or oesophageal sensory stimulation.


1981 ◽  
Vol 9 ◽  
Author(s):  
M. Barmatz

ABSTRACTIn the near future, a large segment of the scientific community will have an opportunity to perform materials processing experiments on the Space Shuttle in the reduced gravity environment of space. Many of these experiments will require containerless processing techniques that provide manipulation and control of weightless (molten) materials without physical contact with container walls or other holding devices. A variety of containerless processing technologies are now being developed for space and ground-based materials processing facilities. The utilization of air jets or high intensity acoustic, electromagnetic or electrostatic fields can produce forces that support and manipulate materials. Most of the present containerless research is directed toward the development of high temperature systems capable of melting and resolidifying materials. This paper will review the materials processing capabilities and level of developmental progress of each technique. An introduction to available NASA test facilities will also be given.


2021 ◽  
Vol 118 (52) ◽  
pp. e2112212118
Author(s):  
Jiseok Lee ◽  
Joanna Urban-Ciecko ◽  
Eunsol Park ◽  
Mo Zhu ◽  
Stephanie E. Myal ◽  
...  

Immediate-early gene (IEG) expression has been used to identify small neural ensembles linked to a particular experience, based on the principle that a selective subset of activated neurons will encode specific memories or behavioral responses. The majority of these studies have focused on “engrams” in higher-order brain areas where more abstract or convergent sensory information is represented, such as the hippocampus, prefrontal cortex, or amygdala. In primary sensory cortex, IEG expression can label neurons that are responsive to specific sensory stimuli, but experience-dependent shaping of neural ensembles marked by IEG expression has not been demonstrated. Here, we use a fosGFP transgenic mouse to longitudinally monitor in vivo expression of the activity-dependent gene c-fos in superficial layers (L2/3) of primary somatosensory cortex (S1) during a whisker-dependent learning task. We find that sensory association training does not detectably alter fosGFP expression in L2/3 neurons. Although training broadly enhances thalamocortical synaptic strength in pyramidal neurons, we find that synapses onto fosGFP+ neurons are not selectively increased by training; rather, synaptic strengthening is concentrated in fosGFP− neurons. Taken together, these data indicate that expression of the IEG reporter fosGFP does not facilitate identification of a learning-specific engram in L2/3 in barrel cortex during whisker-dependent sensory association learning.


1998 ◽  
Vol 80 (2) ◽  
pp. 1006-1010 ◽  
Author(s):  
Mark T. Wallace ◽  
M. Alex Meredith ◽  
Barry E. Stein

Wallace, Mark T., M. Alex Meredith, and Barry E. Stein. Multisensory integration in the superior colliculus of the alert cat. J. Neurophysiol. 80: 1006–1010, 1998. The modality convergence patterns, sensory response properties, and principles governing multisensory integration in the superior colliculus (SC) of the alert cat were found to have fundamental similarities to those in anesthetized animals. Of particular interest was the observation that, in a manner indistinguishable from the anesthetized animal, combinations of two different sensory stimuli significantly enhanced the responses of SC neurons above those evoked by either unimodal stimulus. These observations are consistent with the speculation that there is a functional link among multisensory integration in individual SC neurons and cross-modality attentive and orientation behaviors.


Author(s):  
Chenggang Yuan ◽  
Min Pan ◽  
Andrew Plummer

Digital hydraulics is a new technology providing an alternative to conventional proportional or servovalve-controlled systems in the area of fluid power. Research is driven by the need for highly energy efficient hydraulic machines but is relatively immature compared to other energy-saving technologies. Digital hydraulic applications, such as digital pumps, digital valves and actuators, switched inertance hydraulic converters (SIHCs) and digital hydraulic power management systems, all promise high energy efficiency. This review introduces the development of SIHCs and evaluates the device configurations, performance and control strategies that are found in current SIHC research, particularly focusing on the work being undertaken in last 15 years. The designs for highspeed switching valves are evaluated, and their advantages and limitations are discussed. This article concludes with some suggestions for the future development of SIHCs.


Sign in / Sign up

Export Citation Format

Share Document