Human Gesture Detection Based on 3D Blobs and Skeleton Model

Author(s):  
Sungil Kang ◽  
Juhee Oh ◽  
Hyunki Hong
Keyword(s):  
Author(s):  
Yinong Zhang ◽  
Shanshan Guan ◽  
Cheng Xu ◽  
Hongzhe Liu

In the era of intelligent education, human behavior recognition based on computer vision is an important branch of pattern recognition. Human behavior recognition is a basic technology in the fields of intelligent monitoring and human-computer interaction in education. The dynamic changes of human skeleton provide important information for the recognition of educational behavior. Traditional methods usually use manual information to label or traverse rules only, resulting in limited representation capabilities and poor generalization performance of the model. In this paper, a kind of dynamic skeleton model with residual is adopted—a spatio-temporal graph convolutional network based on residual connections, which not only overcomes the limitations of previous methods, but also can learn the spatio-temporal model from the skeleton data. In the big bone NTU-RGB + D dataset, the network model not only improved the representation ability of human behavior characteristics, but also improved the generalization ability, and achieved better recognition effect than the existing model. In addition, this paper also compares the results of behavior recognition on subsets of different joint points, and finds that spatial structure division have better effects.


Author(s):  
Chin-Yun Fan ◽  
Meng-Hsuan Lin ◽  
Te-Feng Su ◽  
Shang-Hong Lai ◽  
Chih-Hsiang Yu

2011 ◽  
Vol 403-408 ◽  
pp. 2593-2597
Author(s):  
Hong Bao ◽  
Zhi Min Liu

In the analysis of human motion, movement was divided into regular motion (such as walking and running) and random motion (such as falling down).Human skeleton model is used in this paper to do the video-based analysis. Key joints on human body were chosen to be traced instead of tracking the entire human body. Shape features like mass center trajectory were used to describe the movement, and to classify human motion. desired results achieved.


Author(s):  
Andrew J. Majda ◽  
Samuel N. Stechmann ◽  
Shengqian Chen ◽  
H. Reed Ogrosky ◽  
Sulian Thual
Keyword(s):  

2008 ◽  
Author(s):  
Matthias Weber ◽  
Thomas Alexander ◽  
Heni Ben Amor

Author(s):  
Sergey Romensky ◽  
Sergey Rotkov

This work is devoted to various stages of the formation of a three-dimensional wireframe model when solving the problem of converting paper drawings into drawing-design documentation. The stages of obtaining geometric-graphic information by an application program and forming a three-dimensional skeleton model are considered in detail. The study of the temporal characteristics of the developed algorithm is also given.


10.2196/17289 ◽  
2020 ◽  
Vol 7 (2) ◽  
pp. e17289
Author(s):  
Reza Haghighi Osgouei ◽  
David Soulsby ◽  
Fernando Bello

Background Performing physiotherapy exercises in front of a physiotherapist yields qualitative assessment notes and immediate feedback. However, practicing the exercises at home lacks feedback on how well patients are performing the prescribed tasks. The absence of proper feedback might result in patients performing the exercises incorrectly, which could worsen their condition. We present an approach to generate performance scores to enable tracking the progress by both the patient at home and the physiotherapist in the clinic. Objective This study aims to propose the use of 2 machine learning algorithms, dynamic time warping (DTW) and hidden Markov model (HMM), to quantitatively assess the patient’s performance with respect to a reference. Methods Movement data were recorded using a motion sensor (Kinect V2), capable of detecting 25 joints in the human skeleton model, and were compared with those of a reference. A total of 16 participants were recruited to perform 4 different exercises: shoulder abduction, hip abduction, lunge, and sit-to-stand exercises. Their performance was compared with that of a physiotherapist as a reference. Results Both algorithms showed a similar trend in assessing participant performance. However, their sensitivity levels were different. Although DTW was more sensitive to small changes, HMM captured a general view of the performance, being less sensitive to the details. Conclusions The chosen algorithms demonstrated their capacity to objectively assess the performance of physical therapy. HMM may be more suitable in the early stages of a physiotherapy program to capture and report general performance, whereas DTW could be used later to focus on the details. The scores enable the patient to monitor their daily performance. They can also be reported back to the physiotherapist to track and assess patient progress, provide feedback, and adjust the exercise program if needed.


Sign in / Sign up

Export Citation Format

Share Document