scholarly journals Hidden Markov Model-Based Video Recognition for Sports

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Zhiyuan Wang ◽  
Chongyuan Bi ◽  
Songhui You ◽  
Junjie Yao

In this paper, we conduct an in-depth study and analysis of sports video recognition by improved hidden Markov model. The feature module is a complex gesture recognition module based on hidden Markov model gesture features, which applies the hidden Markov model features to gesture recognition and performs the recognition of complex gestures made by combining simple gestures based on simple gesture recognition. The combination of the two modules forms the overall technology of this paper, which can be applied to many scenarios, including some special scenarios with high-security levels that require real-time feedback and some public indoor scenarios, which can achieve different prevention and services for different age groups. With the increase of the depth of the feature extraction network, the experimental effect is enhanced; however, the two-dimensional convolutional neural network loses temporal information when extracting features, so the three-dimensional convolutional network is used in this paper to extract features from the video in time and space. Multiple binary classifications of the extracted features are performed to achieve the goal of multilabel classification. A multistream residual neural network is used to extract features from video data of three modalities, and the extracted feature vectors are fed into the attention mechanism network, then, the more critical information for video recognition is selected from a large amount of spatiotemporal information, further learning the temporal dependencies existing between consecutive video frames, and finally fusing the multistream network outputs to obtain the final prediction category. By training and optimizing the model in an end-to-end manner, recognition accuracies of 92.7% and 64.4% are achieved on the dataset, respectively.

2003 ◽  
Vol 15 (01) ◽  
pp. 17-26 ◽  
Author(s):  
MU-CHUN SU ◽  
YU-XIANG ZHAO ◽  
EUGENE LAI

Gesture recognition is needed for a variety of applications. One particular application of gesture-based systems is to implement a speaking aid for the deaf. Among several factors constituting a hand gesture, the arm movement pattern is one of the most challenging features to recognize. In this paper, we propose a neural-network-based approach to recognition of spatio-temporal patterns of nonlinear 3D arm movements. Compared to Hidden-Markov-Model-based methods, the most appealing property of the proposed method is its simplicity. The effectiveness of this method is evaluated by a database consisted of 10 persons.


2021 ◽  
Vol 11 (7) ◽  
pp. 3138
Author(s):  
Mingchi Zhang ◽  
Xuemin Chen ◽  
Wei Li

In this paper, a deep neural network hidden Markov model (DNN-HMM) is proposed to detect pipeline leakage location. A long pipeline is divided into several sections and the leakage occurs in different section that is defined as different state of hidden Markov model (HMM). The hybrid HMM, i.e., DNN-HMM, consists of a deep neural network (DNN) with multiple layers to exploit the non-linear data. The DNN is initialized by using a deep belief network (DBN). The DBN is a pre-trained model built by stacking top-down restricted Boltzmann machines (RBM) that compute the emission probabilities for the HMM instead of Gaussian mixture model (GMM). Two comparative studies based on different numbers of states using Gaussian mixture model-hidden Markov model (GMM-HMM) and DNN-HMM are performed. The accuracy of the testing performance between detected state sequence and actual state sequence is measured by micro F1 score. The micro F1 score approaches 0.94 for GMM-HMM method and it is close to 0.95 for DNN-HMM method when the pipeline is divided into three sections. In the experiment that divides the pipeline as five sections, the micro F1 score for GMM-HMM is 0.69, while it approaches 0.96 with DNN-HMM method. The results demonstrate that the DNN-HMM can learn a better model of non-linear data and achieve better performance compared to GMM-HMM method.


2014 ◽  
Author(s):  
Jing Jin ◽  
Yuanqing Wang ◽  
Liujing Xu ◽  
Liqun Cao ◽  
Lei Han ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document