2D Multi-Person Pose Estimation Combined with Face Detection

2021 ◽  
Author(s):  
Qiming Li ◽  
Lu Xu ◽  
Xiaoyan Yang
Keyword(s):  
Face Detection ◽  
Pose Estimation ◽  
Human Motion ◽  
Two Dimensional ◽  
Estimation Model ◽  
Motion Recognition ◽  
Human Motion Recognition ◽  
The Mean ◽  
Human Pose ◽  
Validation Set

Pose estimation is the basis and key of human motion recognition. In the two-dimensional human pose estimation based on image, in order to reduce the adverse effects of mutual occlusion among multiple people and improve the accuracy of motion recognition, a structurally symmetrical two-dimensional multi-person pose estimation model combined with face detection is proposed in this paper. First, transfer learning is used to initialize each sub-branch network model. Then, MTCNN is used for face detection to predict the number of people in the image. According to the number of people, the image is input into the improved two-branch OpenPose network. What is more, the double judgment algorithm is proposed to correct the false detection of MTCNN. The experimental results show that compared with TensorPose, which is the latest improved method based on OpenPose, the Average Precision (AP) (Intersection over Union [Formula: see text]) on the validation set is 8.8 higher. Furthermore, compared with OpenPose, the mean AP ([Formula: see text]) is 1.7 higher on the validation set and is 1.3 higher on the Test-dev test set.

scholarly journals Human Motion Tracking Algorithm Based on Image Segmentation Algorithm and Kinect Depth Information

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Zuo Wu
Keyword(s):  
Image Segmentation ◽  
Human Body ◽  
Motion Tracking ◽  
Human Motion ◽  
Depth Information ◽  
Two Dimensional ◽  
Motion Recognition ◽  
Otsu Method ◽  
Recognition Function ◽  
Human Motion Recognition

Human motion recognition has an important application value in scenarios such as intelligent monitoring and advanced human-computer interaction, and it is an important research direction in the field of computer vision. Traditional human motion recognition algorithms based on two-dimensional cameras are susceptible to changes in light intensity and texture. The advent of depth sensors, especially the Kinect series with good performance and low price released by Microsoft, enables extensive research based on depth information. However, to a large extent, the depth information has not overcome these problems based on two-dimensional images. This article introduces the research background and significance of human motion recognition technology based on depth information, introduces in detail the research methods of human motion recognition algorithms based on depth information at home and abroad, and analyzes their advantages and disadvantages. The public dataset is introduced. Then, based on the depth information, a method of human motion recognition is proposed and optimized. A moving human body image segmentation method based on an improved two-dimensional Otsu method is proposed to solve the problem of inaccurate and slow segmentation of moving human body images using the two-dimensional Otsu method. In the process of constructing the threshold recognition function, this algorithm not only uses the cohesion of the pixels within the class but also considers the maximum variance between the target class and the background class. Then, the quantum particle swarm algorithm is used to find the optimal threshold solution of the threshold recognition function. Finally, the optimal solution is used to achieve accurate and fast image segmentation, which increases the accuracy of human body motion tracking by more than 30%.

scholarly journals Application of human motion recognition technology in extreme learning machine

2021 ◽  
Vol 18 (1) ◽  
pp. 172988142098321
Author(s):  
Anzhu Miao ◽  
Feiping Liu
Keyword(s):  
Extreme Learning Machine ◽  
Research Work ◽  
Human Motion ◽  
Feature Descriptor ◽  
Background Variable ◽  
Motion Recognition ◽  
Network Training ◽  
Other Information ◽  
Human Motion Recognition ◽  
Learning Machine

Human motion recognition is a branch of computer vision research and is widely used in fields like interactive entertainment. Most research work focuses on human motion recognition methods based on traditional video streams. Traditional RGB video contains rich colors, edges, and other information, but due to complex background, variable illumination, occlusion, viewing angle changes, and other factors, the accuracy of motion recognition algorithms is not high. For the problems, this article puts forward human motion recognition based on extreme learning machine (ELM). ELM uses the randomly calculated implicit network layer parameters for network training, which greatly reduces the time spent on network training and reduces computational complexity. In this article, the interframe difference method is used to detect the motion region, and then, the HOG3D feature descriptor is used for feature extraction. Finally, ELM is used for classification and recognition. The results imply that the method proposed here has achieved good results in human motion recognition.

scholarly journals The Potential of Computer Vision-Based Marker-Less Human Motion Analysis for Rehabilitation

2021 ◽  
Vol 10 ◽  
pp. 117957272110223
Author(s):  
Thomas Hellsten ◽  
Jonny Karlsson ◽  
Muhammed Shamsuzzaman ◽  
Göran Pulkkis
Keyword(s):  
Computer Vision ◽  
Motion Analysis ◽  
Pose Estimation ◽  
Joint Angle ◽  
Human Motion ◽  
Human Pose Estimation ◽  
Human Motion Analysis ◽  
Single View ◽  
Recent Computer ◽  
Human Pose

Background: Several factors, including the aging population and the recent corona pandemic, have increased the need for cost effective, easy-to-use and reliable telerehabilitation services. Computer vision-based marker-less human pose estimation is a promising variant of telerehabilitation and is currently an intensive research topic. It has attracted significant interest for detailed motion analysis, as it does not need arrangement of external fiducials while capturing motion data from images. This is promising for rehabilitation applications, as they enable analysis and supervision of clients’ exercises and reduce clients’ need for visiting physiotherapists in person. However, development of a marker-less motion analysis system with precise accuracy for joint identification, joint angle measurements and advanced motion analysis is an open challenge. Objectives: The main objective of this paper is to provide a critical overview of recent computer vision-based marker-less human pose estimation systems and their applicability for rehabilitation application. An overview of some existing marker-less rehabilitation applications is also provided. Methods: This paper presents a critical review of recent computer vision-based marker-less human pose estimation systems with focus on their provided joint localization accuracy in comparison to physiotherapy requirements and ease of use. The accuracy, in terms of the capability to measure the knee angle, is analysed using simulation. Results: Current pose estimation systems use 2D, 3D, multiple and single view-based techniques. The most promising techniques from a physiotherapy point of view are 3D marker-less pose estimation based on a single view as these can perform advanced motion analysis of the human body while only requiring a single camera and a computing device. Preliminary simulations reveal that some proposed systems already provide a sufficient accuracy for 2D joint angle estimations. Conclusions: Even though test results of different applications for some proposed techniques are promising, more rigour testing is required for validating their accuracy before they can be widely adopted in advanced rehabilitation applications.

A Projection-based Human Motion Recognition Algorithm based on Depth Sensors

2021 ◽  
pp. 1-1
Author(s):  
Mu-Chun Su ◽  
Pang-Ti Tai ◽  
Jieh-Haur Chen ◽  
Yi-Zeng Hsieh ◽  
Shu-Fang Lee ◽  
...  
Keyword(s):  
Recognition Algorithm ◽  
Human Motion ◽  
Motion Recognition ◽  
Depth Sensors ◽  
Human Motion Recognition
Sign in / Sign up

Export Citation Format

Share Document