An Overview of Fractal Processing of Noise-Like Auditory Signals

In this study, we designed a four-dimensional (4D) audiovisual entertainment system called Sense. This system comprises a scene recognition system and hardware modules that provide haptic sensations for users when they watch movies and animations at home. In the scene recognition system, we used Google Cloud Vision to detect common scene elements in a video, such as fire, explosions, wind, and rain, and further determine whether the scene depicts hot weather, rain, or snow. Additionally, for animated videos, we applied deep learning with a single shot multibox detector to detect whether the animated video contained scenes of fire-related objects. The hardware module was designed to provide six types of haptic sensations set as line-symmetry to provide a better user experience. After the system considers the results of object detection via the scene recognition system, the system generates corresponding haptic sensations. The system integrates deep learning, auditory signals, and haptic sensations to provide an enhanced viewing experience.

Download Full-text

Why Early Tactile Speech Aids May Have Failed: No Perceptual Integration of Tactile and Auditory Signals

Frontiers in Psychology ◽

10.3389/fpsyg.2018.00767 ◽

2018 ◽

Vol 9 ◽

Cited By ~ 1

Author(s):

Aurora Rizza ◽

Alexander V. Terekhov ◽

Guglielmo Montone ◽

Marta Olivetti-Belardinelli ◽

J. Kevin O’Regan

Keyword(s):

Perceptual Integration ◽

Auditory Signals

Download Full-text

Incidental Serial Reaction Time: Normal and Schizophrenic Response to the Onset and Cessation of Auditory Signals

The Journal of Psychology ◽

10.1080/00223980.1976.9915826 ◽

1976 ◽

Vol 93 (2) ◽

pp. 299-311

Author(s):

H. E. King

Keyword(s):

Reaction Time ◽

Serial Reaction Time ◽

Serial Reaction ◽

Auditory Signals

Download Full-text

Coal gangue recognition using multichannel auditory spectrogram of hydraulic support sound in convolutional neural network

Measurement Science and Technology ◽

10.1088/1361-6501/ac3709 ◽

2021 ◽

Author(s):

xu chen ◽

Shibo Wang ◽

Houguang Liu ◽

Jianhua Yang ◽

Songyong Liu ◽

...

Keyword(s):

Neural Network ◽

Convolutional Neural Network ◽

Spectral Characteristics ◽

Coal Gangue ◽

Hydraulic Support ◽

Practical Applications ◽

Network Training ◽

Auditory Recognition ◽

Auditory Signals ◽

Fully Connected

Abstract Many data-driven coal gangue recognition (CGR) methods based on the vibration or sound of collapsed coal and gangue have been proposed to achieve automatic CGR, which is important for realizing intelligent top-coal caving. However, the strong background noise and complex environment in underground coal mines render this task challenging in practical applications. Inspired by the fact that workers distinguish coal and gangue from underground noise by listening to the hydraulic support sound, we propose an auditory model based CGR method that simulates human auditory recognition by combining an auditory spectrogram with a convolutional neural network (CNN). First, we adjust the characteristic frequency (CF) distribution of the auditory peripheral model (APM) based on the spectral characteristics of collapsed sound signals from coal and gangue and then process the sound signals using the adjusted APM to obtain inferior colliculus auditory signals with multiple CFs. Subsequently, the auditory signals of all CFs are converted into gray images separately and then concatenated into a multichannel auditory spectrum along the channel dimension. Finally, we input the multichannel auditory spectrum as a feature map to the two-dimensional CNN, whose convolutional layers are used to automatically extract features, and the fully connected layer and softmax layer are used to flatten features and predict the recognition result, respectively. The CNN is optimized for the CGR based on a comparison study of four typical types of CNN structures with different network training hyperparameters. The experimental results show that this method affords an accurate CGR with a recognition accuracy of 99.5%. Moreover, this method offers excellent noise immunity compared with typically used CGR methods under various noisy conditions.

Download Full-text