sensory substitution
Recently Published Documents


TOTAL DOCUMENTS

450
(FIVE YEARS 108)

H-INDEX

36
(FIVE YEARS 4)

Author(s):  
Lijun Chen ◽  
Yanggang Feng ◽  
Baojun Chen ◽  
Qining Wang ◽  
Kunlin Wei

Abstract Background For people with lower-limb amputations, wearing a prosthetic limb helps restore their motor abilities for daily activities. However, the prosthesis's potential benefits are hindered by limited somatosensory feedback from the affected limb and its prosthesis. Previous studies have examined various sensory substitution systems to alleviate this problem; the prominent approach is to convert foot–ground interaction to tactile stimulations. However, positive outcomes for improving their postural stability are still rare. We hypothesized that the sensory substiution system based on surrogated tactile stimulus is capable of improving the standing stability among people with lower-limb amputations. Methods We designed a wearable device consisting of four pressure sensors and two vibrators and tested it among people with unilateral transtibial amputations (n = 7) and non-disabled participants (n = 8). The real-time measurements of foot pressure were fused into a single representation of foot–ground interaction force, which was encoded by varying vibration intensity of the two vibrators attached to the participants’ forearm. The vibration intensity followed a logarithmic function of the force representation, in keeping with principles of tactile psychophysics. The participants were tested with a classical postural stability task in which visual disturbances perturbed their quiet standing. Results With a brief familiarization of the system, the participants exhibited better postural stability against visual disturbances when switching on sensory substitution than without. The body sway was substantially reduced, as shown in head movements and excursions of the center of pressure. The improvement was present for both groups of participants and was particularly pronounced in more challenging conditions with larger visual disturbances. Conclusions Substituting otherwise missing foot pressure feedback with vibrotactile signals can improve postural stability for people with lower-limb amputations. The design of the mapping between the foot–ground interaction force and the tactile signals is essential for the user to utilize the surrogated tactile signals for postural control, especially for situations that their postural control is challenged.


Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7351
Author(s):  
Dominik Osiński ◽  
Marta Łukowska ◽  
Dag Roar Hjelme ◽  
Michał Wierzchoń

The successful development of a system realizing color sonification would enable auditory representation of the visual environment. The primary beneficiary of such a system would be people that cannot directly access visual information—the visually impaired community. Despite the plethora of sensory substitution devices, developing systems that provide intuitive color sonification remains a challenge. This paper presents design considerations, development, and the usability audit of a sensory substitution device that converts spatial color information into soundscapes. The implemented wearable system uses a dedicated color space and continuously generates natural, spatialized sounds based on the information acquired from a camera. We developed two head-mounted prototype devices and two graphical user interface (GUI) versions. The first GUI is dedicated to researchers, and the second has been designed to be easily accessible for visually impaired persons. Finally, we ran fundamental usability tests to evaluate the new spatial color sonification algorithm and to compare the two prototypes. Furthermore, we propose recommendations for the development of the next iteration of the system.


2021 ◽  
Author(s):  
Yasser Abdelrahman ◽  
Michael Bennington ◽  
Jessica Huberts ◽  
Samira Sebt ◽  
Nipun Talwar ◽  
...  

2021 ◽  
Author(s):  
Patrick S Malone ◽  
Silvio P Eberhardt ◽  
Edward T Auer ◽  
Richard Klein ◽  
Lynne E Bernstein ◽  
...  

The goal of sensory substitution is to convey the information transduced by one sensory system through a novel sensory modality. One example is vibrotactile (VT) speech, for which acoustic speech is transformed into vibrotactile patterns. Despite an almost century-long history of studying vibrotactile speech, there has been no study of the neural bases of VT speech learning. We here trained hearing adult participants to recognize VT speech syllables. Using fMRI, we showed that both somatosensory (left post-central gyrus) and auditory (right temporal lobe) regions acquire selectivity for VT speech stimuli following training. The right planum temporale in particular was selective for both VT and auditory speech. EEG source-estimated activity revealed temporal dynamics consistent with direct, low-latency engagement of right temporal lobe following activation of the left post-central gyrus. Our results suggest that VT speech learning achieves integration with the auditory speech system by piggybacking onto corresponding auditory speech representations.


2021 ◽  
pp. 599-603
Author(s):  
Federica Barontini ◽  
Gemma Carolina Bettelani ◽  
Barbara Leporini ◽  
Giuseppe Averta ◽  
Matteo Bianchi

Sensors ◽  
2021 ◽  
Vol 21 (19) ◽  
pp. 6575
Author(s):  
Byron Remache-Vinueza ◽  
Andrés Trujillo-León ◽  
Mireya Zapata ◽  
Fabián Sarmiento-Ortiz ◽  
Fernando Vidal-Verdú

Tactile rendering has been implemented in digital musical instruments (DMIs) to offer the musician haptic feedback that enhances his/her music playing experience. Recently, this implementation has expanded to the development of sensory substitution systems known as haptic music players (HMPs) to give the opportunity of experiencing music through touch to the hearing impaired. These devices may also be conceived as vibrotactile music players to enrich music listening activities. In this review, technology and methods to render musical information by means of vibrotactile stimuli are systematically studied. The methodology used to find out relevant literature is first outlined, and a preliminary classification of musical haptics is proposed. A comparison between different technologies and methods for vibrotactile rendering is performed to later organize the information according to the type of HMP. Limitations and advantages are highlighted to find out opportunities for future research. Likewise, methods for music audio-tactile rendering (ATR) are analyzed and, finally, strategies to compose for the sense of touch are summarized. This review is intended for researchers in the fields of haptics, assistive technologies, music, psychology, and human–computer interaction as well as artists that may make use of it as a reference to develop upcoming research on HMPs and ATR.


Author(s):  
Mariacarla Memeo ◽  
Marco Jacono ◽  
Giulio Sandini ◽  
Luca Brayda

Abstract Background In this work, we present a novel sensory substitution system that enables to learn three dimensional digital information via touch when vision is unavailable. The system is based on a mouse-shaped device, designed to jointly perceive, with one finger only, local tactile height and inclination cues of arbitrary scalar fields. The device hosts a tactile actuator with three degrees of freedom: elevation, roll and pitch. The actuator approximates the tactile interaction with a plane tangential to the contact point between the finger and the field. Spatial information can therefore be mentally constructed by integrating local and global tactile cues: the actuator provides local cues, whereas proprioception associated with the mouse motion provides the global cues. Methods The efficacy of the system is measured by a virtual/real object-matching task. Twenty-four gender and age-matched participants (one blind and one blindfolded sighted group) matched a tactile dictionary of virtual objects with their 3D-printed solid version. The exploration of the virtual objects happened in three conditions, i.e., with isolated or combined height and inclination cues. We investigated the performance and the mental cost of approximating virtual objects in these tactile conditions. Results In both groups, elevation and inclination cues were sufficient to recognize the tactile dictionary, but their combination worked at best. The presence of elevation decreased a subjective estimate of mental effort. Interestingly, only visually impaired participants were aware of their performance and were able to predict it. Conclusions The proposed technology could facilitate the learning of science, engineering and mathematics in absence of vision, being also an industrial low-cost solution to make graphical user interfaces accessible for people with vision loss.


Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6275
Author(s):  
Santiago Real ◽  
Alvaro Araujo

Herein, we describe the Virtually Enhanced Senses (VES) system, a novel and highly configurable wireless sensor-actuator network conceived as a development and test-bench platform of navigation systems adapted for blind and visually impaired people. It allows to immerse its users into “walkable” purely virtual or mixed environments with simulated sensors and validate navigation system designs prior to prototype development. The haptic, acoustic, and proprioceptive feedback supports state-of-art sensory substitution devices (SSD). In this regard, three SSD were integrated in VES as examples, including the well-known “The vOICe”. Additionally, the data throughput, latency and packet loss of the wireless communication can be controlled to observe its impact in the provided spatial knowledge and resulting mobility and orientation performance. Finally, the system has been validated by testing a combination of two previous visual-acoustic and visual-haptic sensory substitution schemas with 23 normal-sighted subjects. The recorded data includes the output of a “gaze-tracking” utility adapted for SSD.


Sign in / Sign up

Export Citation Format

Share Document