Human motion retrieval based on deep learning and dynamic time warping

Author(s):  
Qinkun Xiao ◽  
Chaoqin Chu
2014 ◽  
Vol 687-691 ◽  
pp. 847-851
Author(s):  
Ming Zeng ◽  
Zai Xin Yang ◽  
Hong Lin Ren ◽  
Qing Hao Meng

Evaluating motion similarity between trainer and trainee is a key part in computer-assisted sports teaching system. Our similarity evaluation algorithm mainly contains four steps. Firstly, the multichannel 3D human motion data are captured using the Kinect, a depth sensor of Microsoft. Next, in order to greatly reduce the amount of data analysis, the piecewise extremum method (PEM) is applied to achieve this goal. Then, considering that doing the same motions the rhythms of different people are not synchronized, the Dynamic Time Warping algorithm (DTW) is selected to solve the problem of analyzing one channel unequal length motion sequences. Finally, the similarity between the two sets of multichannel human motion sequences can be evaluated using the combined method of the information entropy and DTW. The experimental results indicate that compared with other traditional methods, the proposed method not only accurately measures similarity degree of different motions, but also requires less computational time and memory storage capacity.


2020 ◽  
Author(s):  
Ebrahim Eslami ◽  
Yunsoo Choi ◽  
Yannic Lops ◽  
Alqamah Sayeed ◽  
Ahmed Khan Salman

Abstract. As the deep learning algorithm has become a popular data analytic technique, atmospheric scientists should have a balanced perception of its strengths and limitations so that they can provide a powerful analysis of complex data with well-established procedures. Despite the enormous success of the algorithm in numerous applications, certain issues related to its applications in air quality forecasting (AQF) require further analysis and discussion. This study addresses significant limitations of an advanced deep learning algorithm, the convolutional neural network (CNN), in two common applications: (i) a real-time AQF model, and (ii) a post-processing tool in a dynamical AQF model, the Community Multi-scale Air Quality Model (CMAQ). In both cases, the CNN model shows promising accuracy for ozone prediction 24 hours in advance in both the United States and South Korea (with an overall index of agreement exceeding 0.8). For the first case, we use the wavelet transform to determine the reasons behind the poor performance of CNN during the nighttime, cold months, and high ozone episodes. We find that when fine wavelet modes (hourly and daily) are relatively weak or when coarse wavelet modes (weekly) are strong, the CNN model produces less accurate forecasts. For the second case, we use the dynamic time warping (DTW) distance analysis to compare post-processed results with their CMAQ counterparts (as a base model). For CMAQ results that show a consistent DTW distance from the observation, the post-processing approach properly addresses the modeling bias with predicted IOAs exceeding 0.85. When the DTW distance of CMAQ-vs-observation is irregular, the post-processing approach is unlikely to perform satisfactorily. Awareness of the limitations in CNN models will enable scientists to develop more accurate regional or local air quality forecasting systems by identifying the affecting factors in high concentration episodes.


2020 ◽  
Vol 13 (12) ◽  
pp. 6237-6251
Author(s):  
Ebrahim Eslami ◽  
Yunsoo Choi ◽  
Yannic Lops ◽  
Alqamah Sayeed ◽  
Ahmed Khan Salman

Abstract. As the deep learning algorithm has become a popular data analysis technique, atmospheric scientists should have a balanced perception of its strengths and limitations so that they can provide a powerful analysis of complex data with well-established procedures. Despite the enormous success of the algorithm in numerous applications, certain issues related to its applications in air quality forecasting (AQF) require further analysis and discussion. This study addresses significant limitations of an advanced deep learning algorithm, the convolutional neural network (CNN), in two common applications: (i) a real-time AQF model and (ii) a post-processing tool in a dynamical AQF model, the Community Multi-scale Air Quality Model (CMAQ). In both cases, the CNN model shows promising accuracy for ozone prediction 24 h in advance in both the United States of America and South Korea (with an overall index of agreement exceeding 0.8). For the first case, we use the wavelet transform to determine the reasons behind the poor performance of CNN during the nighttime, cold months, and high-ozone episodes. We find that when fine wavelet modes (hourly and daily) are relatively weak or when coarse wavelet modes (weekly) are strong, the CNN model produces less accurate forecasts. For the second case, we use the dynamic time warping (DTW) distance analysis to compare post-processed results with their CMAQ counterparts (as a base model). For CMAQ results that show a consistent DTW distance from the observation, the post-processing approach properly addresses the modeling bias with predicted indexes of agreement exceeding 0.85. When the DTW distance of CMAQ versus observation is irregular, the post-processing approach is unlikely to perform satisfactorily. Awareness of the limitations in CNN models will enable scientists to develop more accurate regional or local air quality forecasting systems by identifying the affecting factors in high-concentration episodes.


Sign in / Sign up

Export Citation Format

Share Document