A Lightweight Keypoint Matching Framework for Morphometric Landmark Detection

Geometric morphometrics has become an important approach in insect morphology studies because it capitalizes on advanced quantitative methods to analyze shape. Shape could be digitized as a set of landmarks from specimen images. However, the existing tools mostly require manual landmark digitization, and previous works on automatic landmark detection methods do not focus on implementation for end-users. Motivated by that, we propose a novel approach for automatic landmark detection, based on visual features of landmarks and keypoint matching techniques. While still archiving comparable accuracy to that of the state-of-the-art method, our framework requires less initial annotated data to build prediction model and runs faster. It is lightweight also in terms of implementation, in which a four-step workflow is provided with user-friendly graphical interfaces to produce correct landmark coordinates both by model prediction and manual correction. The utility iMorph is freely available at https://github.com/ha-usth/WingLanmarkPredictor, currently supporting Windows, MacOS, and Linux.

Syntactic model-based human body 3D reconstruction and event classification via association based features mining and deep learning

The study of human posture analysis and gait event detection from various types of inputs is a key contribution to the human life log. With the help of this research and technologies humans can save costs in terms of time and utility resources. In this paper we present a robust approach to human posture analysis and gait event detection from complex video-based data. For this, initially posture information, landmark information are extracted, and human 2D skeleton mesh are extracted, using this information set we reconstruct the human 2D to 3D model. Contextual features, namely, degrees of freedom over detected body parts, joint angle information, periodic and non-periodic motion, and human motion direction flow, are extracted. For features mining, we applied the rule-based features mining technique and, for gait event detection and classification, the deep learning-based CNN technique is applied over the mpii-video pose, the COCO, and the pose track datasets. For the mpii-video pose dataset, we achieved a human landmark detection mean accuracy of 87.09% and a gait event recognition mean accuracy of 90.90%. For the COCO dataset, we achieved a human landmark detection mean accuracy of 87.36% and a gait event recognition mean accuracy of 89.09%. For the pose track dataset, we achieved a human landmark detection mean accuracy of 87.72% and a gait event recognition mean accuracy of 88.18%. The proposed system performance shows a significant improvement compared to existing state-of-the-art frameworks.