scholarly journals Design of Mirror Therapy System Base on Multi-Channel Surface-Electromyography Signal Pattern Recognition and Mobile Augmented Reality

Electronics ◽  
2020 ◽  
Vol 9 (12) ◽  
pp. 2142
Author(s):  
Lizheng Liu ◽  
Jianjun Cui ◽  
Jian Niu ◽  
Na Duan ◽  
Xianjia Yu ◽  
...  

Numerous studies have proven that the mirror therapy can make rehabilitation more effective on hemiparesis following a stroke. Using surface electromyography (SEMG) to predict gesture presents one of the important subjects in related research areas, including rehabilitation medicine, sports medicine, prosthetic control, and so on. However, current signal analysis methods still fail to achieve accurate recognition of multimode motion in a very reliable way due to the weak physiological signal and low noise-ratio. In this paper, a mirror therapy system based on multi-channel SEMG signal pattern recognition and mobile augmented reality is studied. Besides, wavelet transform method is designed to mitigate the noise. The spectrogram obtained by analyzing electromyography signals is proposed to be used as an image. Two approaches, including Convolutional Neural Network (CNN) and grid-optimized Support Vector Machine (SVM), are designed to classify the SEMG of different gestures. The mobile augmented reality provides a virtual hand movement in the real environment to perform mirror therapy process. The experimental results show that the overall accuracy of SVM is 93.07%, and that of CNN is up to 97.8%.

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Xiaoyun Liu ◽  
Xugang Xi ◽  
Xian Hua ◽  
Hujiao Wang ◽  
Wei Zhang

The feature extraction of surface electromyography (sEMG) signals has been an important aspect of myoelectric prosthesis control. To improve the practicability of myoelectric prosthetic hands, we proposed a feature extraction method for sEMG signals that uses wavelet weighted permutation entropy (WWPE). First, wavelet transform was used to decompose and preprocess sEMG signals collected from the relevant muscles of the upper limbs to obtain the wavelet sub-bands in each frequency segment. Then, the weighted permutation entropies (WPEs) of the wavelet sub-bands were extracted to construct WWPE feature set. Lastly, the WWPE feature set was used as input to a support vector machine (SVM) classifier and a backpropagation neural network (BPNN) classifier to recognize seven hand movements. Experimental results show that the proposed method exhibits remarkable recognition accuracy that is superior to those of single sub-band feature set and commonly used time-domain feature set. The maximum recognition accuracy rate is 100% for hand movements, and the average recognition accuracy rates of SVM and BPNN are 100% and 98%, respectively.


2013 ◽  
Vol 448-453 ◽  
pp. 3561-3565
Author(s):  
Zhuo Jun Xu ◽  
Yan Tao Tian ◽  
Zhi Ming Yang ◽  
Yang Li

Finger joint angle pattern recognition is significant for the development of an intelligent bionic hand. It makes the intelligent prosthesis understand the users intension more accurately and complete movements better. Surface electromyography signals have been widely used in intelligent bionics prosthesis research and rehabilitation medicine due to its advantages like high efficiency, convenient collection and non-invasive access. An improved grid-search method using a support vector machine has been proposed for the finger joint angle pattern recognition issue in surface electromyography signals. Pattern recognition for surface electromyography signals of index finger movement and metacarpophalangeal joint angle has been performed. Better classification performance was achieved through screening of feature vector combined with an improved grid-search support vector machine classification algorithm.


2021 ◽  
Vol 38 (3) ◽  
pp. 689-697
Author(s):  
Chao Zhang ◽  
Ji Zou ◽  
Zhongjing Ma

The development of science and technology has promoted the extensive application of surface electromyography (sEMG) collection technique in real-time exercise testing, assistive judgment of rehabilitation therapy, and assessment of intelligent artificial limb application. However, there is a severe lacking of studies on pattern recognition based on effective signal, and evaluation of limb rehabilitation status. To make up for the gap, this paper explores the identification and analysis of limb rehabilitation signal based on wavelet transform. Specifically, the authors detailed the basic flow of sEMG signal generation in motor unit during limb rehabilitation exercise, and proposed a limb EMG pattern recognition method. Then, support vector machine (SVM) was selected to recognize the pattern of the EMG signal extracted from the limb rehabilitation exercise of patients, and to judge the rehabilitation status. Finally, wavelet thresholding was combined with total variation denoising (TVD) to effectively remove the noise from EMG signal. The proposed method was proved effective through experiments.


2021 ◽  
Author(s):  
Haiqiang Duan ◽  
Chenyun Dai ◽  
Wei Chen

Abstract Background: The transmission of human body movements to other devices through wearable smart bracelets have attracted more and more attentions in the field of human-machine interface (HMI) applications. However, due to the limitation of the collection range of wearable bracelets, it is necessary to study the relationship between the superposition of wrist and finger motion and their cooperative motion to simplify the collection system of the device.Methods: The multi-channel high-density surface electromyogram (HD-sEMG) signal has high spatial resolution and can improve the accuracy of multi-channel fitting. In this study, we quantified the HD-sEMG forearm spatial activation features of 256 channels of hand movement, and performed a linear fitting of the quantified features of fingers and wrist movements to verify the linear superposition relationship between fingers and wrist cooperative movements and their independent movements. The most important thing is to classify and predict the results of the fitting and the actual measured fingers and wrist cooperative actions by four commonly used classifiers: Linear Discriminant Analysis (LDA) ,K-Nearest Neighbor (KNN) ,Support Vector Machine (SVM) and Random Forest (RF), and evaluate the performance of the four classifiers in gesture fitting in detail according to the classification results.Results: In a total of 12 kinds of synthetic gesture actions, in the three cases where the number of fitting channels was selected as 8, 32 and 64, four classifiers of LDA, SVM, RF and KNN are used for classification prediction. When the number of fitting channels was 8, the prediction accuracy of LDA classifier was 99.70%, the classification accuracy of KNN was 99.40%, the classification accuracy of SVM was 99.20%, and the classification accuracy of RF was 93.75%. When the number of fitting channels was 32, the accuracy of LDA was 98.51%, the classification accuracy of KNN was 97.92%, the accuracy of SVM is 96.73%, and the accuracy of RF was 86.61%. When the number of fitting channels is 64, the accuracy of LDA is 95.83%, the classification accuracy of KNN is 91.67%, the accuracy of SVM is 86.90%, and the accuracy of RF is 83.30%.Conclusion: It can be seen from the results that when the number of fitting channels is 8, the classification accuracy of the three classifiers of LDA, KNN and SVM is basically the same, but the time-consuming of SVM is very small. When the amount of data is large, the priority should be selected SVM as the classifier. When the number of fitting channels increases, the classification accuracy of the LDA classifier will be higher than the other three classifiers, so the LDA classifier should be more appropriate. The classification accuracy of the RF classifier in this type of problem has always been far lower than the other three classifiers, so it is not recommended to use the RF classifier as a classifier for gesture stacking related work.


2020 ◽  
Vol 42 (13) ◽  
pp. 2492-2498
Author(s):  
Chenyang Gu ◽  
Chunhua Ren ◽  
Meilin Zhou

Surface electromyography (sEMG) signals mainly contain power line interference (PLI), white Gaussian noise (WGN), and baseline wandering (BW) noise. These noises lead to the problems of poor feature extraction performance and low recognition rate. In this paper, we propose a novel sEMG signal processing method named filtering and self-enhancement algorithm with classical wavelet (FSECW) algorithm, which denoises interference noises of raw signals and improve the pedestrian motion pattern recognition rate. The proposed FSECW algorithm contains two core parts: in the first part, the original signal is reconstructed after four-layer wavelet decomposition. This part decreases the BW noise and enhances the active segment; in the other part, band-pass filtering and lifting wavelet transformation are used to reduce noises inside and outside the sEMG signal band. Then two signals from the above parts are multiplied. Thus, the enhanced filtered signal of the active segment is obtained. After feature extraction, the algorithm uses classical machine learning algorithm for motion pattern recognition. Experimental results show that the proposed FSECW algorithm does not need to set different thresholds for different data sets with the same motion pattern. Moreover, it has better adaptability to conversions of different motion patterns.


2021 ◽  
Vol 15 ◽  
Author(s):  
Wei Li ◽  
Ping Shi ◽  
Hongliu Yu

Amputation of the upper limb brings heavy burden to amputees, reduces their quality of life, and limits their performance in activities of daily life. The realization of natural control for prosthetic hands is crucial to improving the quality of life of amputees. Surface electromyography (sEMG) signal is one of the most widely used biological signals for the prediction of upper limb motor intention, which is an essential element of the control systems of prosthetic hands. The conversion of sEMG signals into effective control signals often requires a lot of computational power and complex process. Existing commercial prosthetic hands can only provide natural control for very few active degrees of freedom. Deep learning (DL) has performed surprisingly well in the development of intelligent systems in recent years. The significant improvement of hardware equipment and the continuous emergence of large data sets of sEMG have also boosted the DL research in sEMG signal processing. DL can effectively improve the accuracy of sEMG pattern recognition and reduce the influence of interference factors. This paper analyzes the applicability and efficiency of DL in sEMG-based gesture recognition and reviews the key techniques of DL-based sEMG pattern recognition for the prosthetic hand, including signal acquisition, signal preprocessing, feature extraction, classification of patterns, post-processing, and performance evaluation. Finally, the current challenges and future prospects in clinical application of these techniques are outlined and discussed.


2021 ◽  
Vol 7 ◽  
pp. e448
Author(s):  
Yongfei Feng ◽  
Mingwei Zhong ◽  
Xusheng Wang ◽  
Hao Lu ◽  
Hongbo Wang ◽  
...  

The portable and inexpensive hand rehabilitation robot has become a practical rehabilitation device for patients with hand dysfunction. A pneumatic rehabilitation glove with an active trigger control system is proposed, which is based on surface electromyography (sEMG) signals. It can trigger the hand movement based on the patient’s hand movement trend, which may improve the enthusiasm and efficiency of patient training. Firstly, analysis of sEMG sensor installation position on human’s arm and signal acquisition process were carried out. Then, according to the statistical law, three optimal eigenvalues of sEMG signals were selected as the follow-up neural network classification input. Using the back propagation (BP) neural network, the classifier of hand movement is established. Moreover, the mapping relationship between hand sEMG signals and hand actions is built by training and testing. Different patients choose the same optimal eigenvalues, and the calculation formula of eigenvalues’ amplitude is unique. Due to the differences among individuals, the weights and thresholds of each node in the BP neural network model corresponding to different patients are not the same. Therefore, the BP neural network model library is established, and the corresponding network is called for operation when different patients are trained. Finally, based on sEMG signal trigger, the pneumatic glove training control algorithm was proposed. The combination of the trigger signal waveform and the motion signal waveform indicates that the pneumatic rehabilitation glove is triggered to drive the patient’s hand movement. Preliminary tests have confirmed that the accuracy rate of trend recognition for hand movement is about 90%. In the future, clinical trials of patients will be conducted to prove the effectiveness of this system.


2021 ◽  
Vol 271 ◽  
pp. 01030
Author(s):  
Zihan Yin

Hands are important parts of a human body. It is not only the main tool for people to engage in productive labor, but also an important communication tool. When the hand moves, the human body produces a kind of signal named surface electromyography (sEMG), which is a kind of electrophysiological signal that accompanies muscle activity. It contains a lot of information about human movement consciousness. The bionic limb is driven by multi-degree-freedom control, which is got by converting the recognition result and this can meet the urgent need of people with disabilities for autonomous operation. A profound study of hand action pattern technology based on sEMG signals can achieve the ability of the bionic limb to distinguish the hand action fast and accurately. From the perspective of the pattern recognition of the bionic limb, this paper discussed the human hand action pattern recognition technology of sEMG. By analyzing and summarizing the current development of human hand movement recognition, the author proposed a bionic limb schema based on artificial neural network and the improved DT-SVM hand action recognition system. According to the research results, it is necessary to expand the type and total amount of hand movements and gesture recognition, in order to adapt to the objective requirements of the diversity of hand action patterns in the application of the bionic limb.


Sign in / Sign up

Export Citation Format

Share Document