Assessment of Foot Trajectory for Human Gait Phase Detection Using Wireless Ultrasonic Sensor Network

Author(s):  
Yongbin Qi ◽  
Cheong Boon Soh ◽  
Erry Gunawan ◽  
Kay-Soon Low ◽  
Rijil Thomas
Author(s):  
Tao Zhen ◽  
Lei Yan ◽  
Jian-lei Kong

Human-gait-phase-recognition is an important technology in the field of exoskeleton robot control and medical rehabilitation. Inertial sensors with accelerometers and gyroscopes are easy to wear, inexpensive and have great potential for analyzing gait dynamics. However, current deep-learning methods extract spatial and temporal features in isolation—while ignoring the inherent correlation in high-dimensional spaces—which limits the accuracy of a single model. This paper proposes an effective hybrid deep-learning framework based on the fusion of multiple spatiotemporal networks (FMS-Net), which is used to detect asynchronous phases from IMU signals. More specifically, it first uses a gait-information acquisition system to collect IMU sensor data fixed on the lower leg. Through data preprocessing, the framework constructs a spatial feature extractor with CNN module and a temporal feature extractor, combined with LSTM module. Finally, a skip-connection structure and the two-layer fully connected layer fusion module are used to achieve the final gait recognition. Experimental results show that this method has better identification accuracy than other comparative methods with the macro-F1 reaching 96.7%.


Sensor Review ◽  
2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Sachin Negi ◽  
Shiru Sharma ◽  
Neeraj Sharma

Purpose The purpose of this paper is to present gait analysis for five different terrains: level ground, ramp ascent, ramp descent, stair ascent and stair descent. Design/methodology/approach Gait analysis has been carried out using a combination of the following sensors: force-sensitive resistor (FSR) sensors fabricated in foot insole to sense foot pressure, a gyroscopic sensor to detect the angular velocity of the shank and MyoWare electromyographic muscle sensors to detect muscle’s activities. All these sensors were integrated around the Arduino nano controller board for signal acquisition and conditioning purposes. In the present scheme, the muscle activities were obtained from the tibialis anterior and medial gastrocnemius muscles using electromyography (EMG) electrodes, and the acquired EMG signals were correlated with the simultaneously attained signals from the FSR and gyroscope sensors. The nRF24L01+ transceivers were used to transfer the acquired data wirelessly to the computer for further analysis. For the acquisition of sensor data, a Python-based graphical user interface has been designed to analyze and display the processed data. In the present paper, the authors got motivated to design and develop a reliable real-time gait phase detection technique that can be used later in designing a control scheme for the powered ankle-foot prosthesis. Findings The effectiveness of the gait phase detection was obtained in an open environment. Both off-line and real-time gait events and gait phase detections were accomplished for the FSR and gyroscopic sensors. Both sensors showed their usefulness for detecting the gait events in real-time, i.e. within 10 ms. The heuristic rules and a zero-crossing based-algorithm for the shank angular rate correctly identified all the gait events for the locomotion in all five terrains. Practical implications This study leads to an understanding of human gait analysis for different types of terrains. A real-time standalone system has been designed and realized, which may find application in the design and development of ankle-foot prosthesis having real-time control feature for the above five terrains. Originality/value The noise-free data from three sensors were collected in the same time frame from both legs using a wireless sensor network between two transmitters and a single receiver. Unlike the data collection using a treadmill in a laboratory environment, this setup is useful for gait analysis in an open environment for different terrains.


Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-14 ◽  
Author(s):  
Lei Yan ◽  
Tao Zhen ◽  
Jian-Lei Kong ◽  
Lian-Ming Wang ◽  
Xiao-Lei Zhou

Human gait phase recognition is a significant technology for rehabilitation training robot, human disease diagnosis, artificial prosthesis, and so on. The efficient design of the recognition method for gait information is the key issue in the current gait phase division and eigenvalues extraction research. In this paper, a novel voting-weighted integrated neural network (VWI-DNN) is proposed to detect different gait phases from multidimensional acceleration signals. More specifically, it first employs a gait information acquisition system to collect different IMU sensors data fixed on the human lower limb. Then, with dimensionality reduction and four-phase division preprocessing, key features are selected and merged as unified vectors to learn common and domain knowledge in time domain. Next, multiple refined DNNs are transferred to design a multistream integrated neural network, which utilizes the mixture-granularity information to exploit high-dimensional feature representative. Finally, a voting-weighted function is developed to fuse different submodels as a unified representation for distinguishing small discrepancy among different gait phases. The end-to-end implementation of the VWI-DNN model is fine-tuned by the loss optimization of gradient back-propagation. Experimental results demonstrate the outperforming performance of the proposed method with higher classification accuracy compared with the other methods, of which classification accuracy and macro-F1 is up to 99.5%. More discussions are provided to indicate the potential applications in combination with other works.


Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Tao Zhen ◽  
Jian-lei Kong ◽  
Lei Yan

Human gait phase detection is a significance technology for robotics exoskeletons control and exercise rehabilitation therapy. Inertial Measurement Units (IMUs) with accelerometer and gyroscope are convenient and inexpensive to collect gait data, which are often used to analyze gait dynamics for personal daily applications. However, current deep-learning methods that extract spatial and the isolated temporal features can easily ignore the correlation that may exist in the high-dimensional space, which limits the recognition effect of a single model. In this study, an effective hybrid deep-learning framework based on Gaussian probability fusion of multiple spatiotemporal networks (GFM-Net) is proposed to detect different gait phases from multisource IMU signals. Furthermore, it first employs the gait information acquisition system to collect IMU data fixed on lower limb. With the data preprocessing, the framework constructs a spatial feature extractor with AutoEncoder and CNN modules and a multistream temporal feature extractor with three collateral modules combining RNN, LSTM, and GRU modules. Finally, the novel Gaussian probability fusion module optimized by the Expectation-Maximum (EM) algorithm is developed to integrate the different feature maps output by the three submodels and continues to realize gait recognition. The framework proposed in this paper implements the inner loop that also contains the EM algorithm in the outer loop and optimizes the reverse gradient in the entire network. Experiments show that this method has better performance in gait classification with accuracy reaching more than 96.7%.


Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 789
Author(s):  
David Kreuzer ◽  
Michael Munz

With an ageing society comes the increased prevalence of gait disorders. The restriction of mobility leads to a considerable reduction in the quality of life, because associated falls increase morbidity and mortality. Consideration of gait analysis data often alters surgical recommendations. For that reason, the early and systematic diagnostic treatment of gait disorders can spare a lot of suffering. As modern gait analysis systems are, in most cases, still very costly, many patients are not privileged enough to have access to comparable therapies. Low-cost systems such as inertial measurement units (IMUs) still pose major challenges, but offer possibilities for automatic real-time motion analysis. In this paper, we present a new approach to reliably detect human gait phases, using IMUs and machine learning methods. This approach should form the foundation of a new medical device to be used for gait analysis. A model is presented combining deep 2D-convolutional and LSTM networks to perform a classification task; it predicts the current gait phase with an accuracy of over 92% on an unseen subject, differentiating between five different phases. In the course of the paper, different approaches to optimize the performance of the model are presented and evaluated.


Sign in / Sign up

Export Citation Format

Share Document