Body pose prediction based on motion sensor data and Recurrent Neural Network

Author(s):  
Marcin Wozniak ◽  
Michal Wieczorek ◽  
Jakub Silka ◽  
Dawid Polap
2019 ◽  
Vol 42 ◽  
pp. 100991 ◽  
Author(s):  
Seongwoon Jeong ◽  
Max Ferguson ◽  
Rui Hou ◽  
Jerome P. Lynch ◽  
Hoon Sohn ◽  
...  

2019 ◽  
Vol 14 (4) ◽  
pp. 497-504
Author(s):  
Bo Qiao ◽  
Kui Fang ◽  
Yiming Chen ◽  
Xinghui Zhu ◽  
Xiping He

2019 ◽  
Vol 15 (9) ◽  
pp. 155014771987245 ◽  
Author(s):  
Zuojin Li ◽  
Qing Yang ◽  
Shengfu Chen ◽  
Wei Zhou ◽  
Liukui Chen ◽  
...  

The study of the robust fatigue feature learning method for the driver’s operational behavior is of great significance for improving the performance of the real-time detection system for driver’s fatigue state. Aiming at how to extract more abstract and deep features in the driver’s direction operation data in the robust feature learning, this article constructs a fuzzy recurrent neural network model, which includes input layer, fuzzy layer, hidden layer, and output layer. The steering-wheel direction sensing time series sends the time series to the input layer through a fixed time window. After the fuzzification process, it is sent to the hidden layer to share the weight of the hidden layer, realize the memorization of the fatigue feature, and improve the feature depth capability of the steering wheel angle time sequence. The experimental results show that the proposed model achieves an average recognition rate of 87.30% in the fatigue sample database of real vehicle conditions, which indicates that the model has strong robustness to different subjects under real driving conditions. The model proposed in this article has important theoretical and engineering significance for studying the prediction of fatigue driving under real driving conditions.


Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1086
Author(s):  
Raoul Hoffmann ◽  
Hanna Brodowski ◽  
Axel Steinhage ◽  
Marcin Grzegorzek

Gait patterns are a result of the complex kinematics that enable human two-legged locomotion, and they can reveal a lot about a person’s state and health. Analysing them is useful for researchers to get new insights into the course of diseases, and for physicians to track the progress after healing from injuries. When a person walks and is interfered with in any way, the resulting disturbance can show up and be found in the gait patterns. This paper describes an experimental setup for capturing gait patterns with a capacitive sensor floor, which can detect the time and position of foot contacts on the floor. With this setup, a dataset was recorded where 42 participants walked over a sensor floor in different modes, inter alia, normal pace, closed eyes, and dual-task. A recurrent neural network based on Long Short-Term Memory units was trained and evaluated for the classification task of recognising the walking mode solely from the floor sensor data. Furthermore, participants were asked to do the Unilateral Heel-Rise Test, and their gait was recorded before and after doing the test. Another neural network instance was trained to predict the number of repetitions participants were able to do on the test. As the results of the classification tasks turned out to be promising, the combination of this sensor floor and the recurrent neural network architecture seems like a good system for further investigation leading to applications in health and care.


Author(s):  
Tianshi Wang ◽  
Shuochao Yao ◽  
Shengzhong Liu ◽  
Jinyang Li ◽  
Dongxin Liu ◽  
...  

In this paper, we present a novel deep neural network architecture that reconstructs the high-frequency audio of selected spoken human words from low-sampling-rate signals of (ego-)motion sensors, such as accelerometer and gyroscope data, recorded on everyday mobile devices. As the sampling rate of such motion sensors is much lower than the Nyquist rate of ordinary human voice (around 6kHz+), these motion sensor recordings suffer from a significant frequency aliasing effect. In order to recover the original high-frequency audio signal, our neural network introduces a novel layer, called the alias unfolding layer, specialized in expanding the bandwidth of an aliased signal by reversing the frequency folding process in the time-frequency domain. While perfect unfolding is known to be unrealizable, we leverage the sparsity of the original signal to arrive at a sufficiently accurate statistical approximation. Comprehensive experiments show that our neural network significantly outperforms the state of the art in audio reconstruction from motion sensor data, effectively reconstructing a pre-trained set of spoken keywords from low-frequency motion sensor signals (with a sampling rate of 100-400 Hz). The approach demonstrates the potential risk of information leakage from motion sensors in smart mobile devices.


Sign in / Sign up

Export Citation Format

Share Document