A Review on Vision-Based Hand Gesture Recognition and Applications

2015 ◽  
pp. 256-281 ◽  
Author(s):  
Ananya Choudhury ◽  
Anjan Kumar Talukdar ◽  
Kandarpa Kumar Sarma
Keyword(s):  
Gesture Recognition ◽  
Recognition System ◽  
Research Area ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Dynamic Background ◽  
Lighting Condition ◽  
Recognition Systems

In the present scenario, vision based hand gesture recognition has become a highly emerging research area for the purpose of human computer interaction. Such recognition systems are deployed to serve as a replacement for the commonly used human-machine interactive devices such as keyboard, mouse, joystick etc. in real world situations. The major challenges faced by a vision based hand gesture recognition system include recognition in complex background, in dynamic background, in presence of multiple gestures in the background, under variable lighting condition, under different viewpoints etc. In the context of sign language recognition, which is a highly demanding application of hand gesture recognition system, coarticulation detection is a challenging task. The main objective of this chapter is to provide a general overview of vision based hand gesture recognition system as well as to bring into light some of the research works that have been done in this field.

scholarly journals Sign Language Recognition System for Disabled People

2019 ◽  
Vol 9 (1S) ◽  
pp. 48-52
Keyword(s):  
Real Time ◽  
Sign Language ◽  
Gesture Recognition ◽  
Recognition System ◽  
Hand Gesture Recognition ◽  
Support Vector ◽  
Hand Gesture ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Real Time System

The aim is to present a real time system for hand gesture recognition on the basis of detection of some meaningful shape based feature like orientation, center of mass, status of fingers in term of raised or folded fingers of hand and their respective location in image. Hand gesture Recognition System has various real time applications in natural, innovative, user friendly way of how to interact with the computer which has more facilities that are familiar to us. Gesture recognition has a wide area of application including Human machine interaction, sign language, game technology robotics etc are some of the areas where Gesture recognition can be applied. More specifically hand gesture is used as a signal or input means given to the computer especially by disabled person. Being an interesting part of the human and computer interaction hand gesture recognition is needed for real life application, but complex of structures presents in human hand has a lot of challenges for being tracked and extracted. Making use of computer vision algorithms and gesture recognition techniques will result in developing low-cost interface devices using hand gestures for interacting with objects in virtual environment. SVM (support vector machine) and efficient feature extraction technique is presented for hand gesture recognition. This method deals with the dynamic aspects of hand gesture recognition system.

scholarly journals Pose Invariant Hand Gesture Recognition using Two Stream Transfer Learning Architecture

2019 ◽  
Vol 9 (1) ◽  
pp. 1771-1777
Keyword(s):  
Machine Learning ◽  
Transfer Learning ◽  
Gesture Recognition ◽  
Classification Accuracy ◽  
Decision Fusion ◽  
Hand Gesture Recognition ◽  
Machine Learning Techniques ◽  
Hand Gesture ◽  
Language Recognition ◽  
Sign Language Recognition

The hand gesture detection problem is one of the most prominent problems in machine learning and computer vision applications. Many machine learning techniques have been employed to solve the hand gesture recognition. These techniques find applications in sign language recognition, virtual reality, human machine interaction, autonomous vehicles, driver assistive systems etc. In this paper, the goal is to design a system to correctly identify hand gestures from a dataset of hundreds of hand gesture images. In order to incorporate this, decision fusion based system using the transfer learning architectures is proposed to achieve the said task. Two pretrained models namely ‘MobileNet’ and ‘Inception V3’ are used for this purpose. To find the region of interest (ROI) in the image, YOLO (You Only Look Once) architecture is used which also decides the type of model. Edge map images and the spatial images are trained using two separate versions of the MobileNet based transfer learning architecture and then the final probabilities are combined to decide upon the hand sign of the image. The simulation results using classification accuracy indicate the superiority of the approach of this paper against the already researched approaches using different quantitative techniques such as classification accuracy.

scholarly journals A Frame Detection Method for Real-Time Hand Gesture Recognition Systems Using CW-Radar

Sensors ◽  
2020 ◽  
Vol 20 (8) ◽  
pp. 2321 ◽  
Author(s):  
Myoungseok Yu ◽  
Narae Kim ◽  
Yunho Jung ◽  
Seongjoo Lee
Keyword(s):  
Real Time ◽  
Conventional Method ◽  
Gesture Recognition ◽  
Detection Method ◽  
Recognition System ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Recognition Probability ◽  
Recognition Systems ◽  
Cw Radar

In this paper, a method to detect frames was described that can be used as hand gesture data when configuring a real-time hand gesture recognition system using continuous wave (CW) radar. Detecting valid frames raises accuracy which recognizes gestures. Therefore, it is essential to detect valid frames in the real-time hand gesture recognition system using CW radar. The conventional research on hand gesture recognition systems has not been conducted on detecting valid frames. We took the R-wave on electrocardiogram (ECG) detection as the conventional method. The detection probability of the conventional method was 85.04%. It has a low accuracy to use the hand gesture recognition system. The proposal consists of 2-stages to improve accuracy. We measured the performance of the detection method of hand gestures provided by the detection probability and the recognition probability. By comparing the performance of each detection method, we proposed an optimal detection method. The proposal detects valid frames with an accuracy of 96.88%, 11.84% higher than the accuracy of the conventional method. Also, the recognition probability of the proposal method was 94.21%, which was 3.71% lower than the ideal method.

scholarly journals Hand Gesture Recognition Using PCA, KNN and SVM

2019 ◽  
pp. 547-550
Author(s):  
Julakanti Likhitha Reddy ◽  
Bhavya Mallela ◽  
Lakshmi Lavanya Bannaravuri ◽  
Kotha Mohan Krishna
Keyword(s):  
Gesture Recognition ◽  
Skin Color ◽  
Template Matching ◽  
Hand Gesture Recognition ◽  
Support Vector ◽  
Hand Gesture ◽  
Color Model ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Skin Color Model

To interact with world using expressions or body movements is comparatively effective than just speaking. Gesture recognition can be a better way to convey meaningful information. Communication through gestures has been widely used by humans to express their thoughts and feelings. Gestures can be performed with any body part like head, face, hands and arms but most predominantly hand is use to perform gestures, Hand Gesture Recognition have been widely accepted for numerous applications such as human computer interactions, robotics, sign language recognition, etc. This paper focuses on bare hand gesture recognition system by proposing a scheme using a database-driven hand gesture recognition based upon skin color model approach and thresholding approach along with an effective template matching with can be effectively used for human robotics applications and similar other applications .Initially, hand region is segmented by applying skin color model in YCbCr color space. Y represents the luminance and Cb and Cr represents chrominance. In the next stage Otsu thresholding is applied to separate foreground and background. Finally, template based matching technique is developed using Principal Component Analysis (PCA), k-nearest neighbour (KNN) and Support Vector Machine (SVM) for recognition. KNN is used for statistical estimation and pattern recognition. SVM can be used for classification or regression problems.

scholarly journals A Deep Learning-Based End-to-End Composite System for Hand Detection and Gesture Recognition

Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5282 ◽  
Author(s):  
Adam Ahmed Qaid MOHAMMED ◽  
Jiancheng Lv ◽  
MD. Sajjatul Islam
Keyword(s):  
Deep Learning ◽  
Gesture Recognition ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Hand Detection ◽  
Cluttered Environments ◽  
Classical Dance ◽  
Action Analysis

Recent research on hand detection and gesture recognition has attracted increasing interest due to its broad range of potential applications, such as human-computer interaction, sign language recognition, hand action analysis, driver hand behavior monitoring, and virtual reality. In recent years, several approaches have been proposed with the aim of developing a robust algorithm which functions in complex and cluttered environments. Although several researchers have addressed this challenging problem, a robust system is still elusive. Therefore, we propose a deep learning-based architecture to jointly detect and classify hand gestures. In the proposed architecture, the whole image is passed through a one-stage dense object detector to extract hand regions, which, in turn, pass through a lightweight convolutional neural network (CNN) for hand gesture recognition. To evaluate our approach, we conducted extensive experiments on four publicly available datasets for hand detection, including the Oxford, 5-signers, EgoHands, and Indian classical dance (ICD) datasets, along with two hand gesture datasets with different gesture vocabularies for hand gesture recognition, namely, the LaRED and TinyHands datasets. Here, experimental results demonstrate that the proposed architecture is efficient and robust. In addition, it outperforms other approaches in both the hand detection and gesture classification tasks.

scholarly journals A User-Specific Hand Gesture Recognition Model Based on Feed-Forward Neural Networks, EMGs, and Correction of Sensor Orientation

2020 ◽  
Vol 10 (23) ◽  
pp. 8604
Author(s):  
Marco E. Benalcázar ◽  
Ángel Leonardo Valdivieso Caraguay ◽  
Lorena Isabel Barona López
Keyword(s):  
Gesture Recognition ◽  
Recognition System ◽  
Maximum Energy ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Feed Forward Neural Network ◽  
Feed Forward ◽  
Performance Reduction ◽  
Recognition Systems ◽  
The Right

Hand gesture recognition systems have several applications including medicine and engineering. A gesture recognition system should identify the class, time, and duration of a gesture executed by a user. Gesture recognition systems based on electromyographies (EMGs) produce good results when the EMG sensor is placed on the same orientation for training and testing. However, when the orientation of the sensor changes between training and testing, which is very common in practice, the classification and recognition accuracies degrade significantly. In this work, we propose a system for recognizing, in real time, five gestures of the right hand. These gestures are the same ones recognized by the proprietary system of the Myo armband. The proposed system is based on the use of a shallow artificial feed-forward neural network. This network takes as input the covariances between the channels of an EMG and the result of a bag of five functions applied to each channel of an EMG. To correct the rotation of the EMG sensor, we also present an algorithm based on finding the channel of maximum energy given a set of synchronization EMGs, which for this work correspond to the gesture waveout. The classification and recognition accuracies obtained here show that the recognition system, together with the algorithm for correcting the orientation, allows a user to wear the EMG sensor in different orientations for training and testing, without a significant performance reduction. Finally, to reproduce the results obtained in this paper, we have made the code and the dataset used here publicly available.

scholarly journals A COLORED FINGER TIP-BASED TRACKING METHOD FOR CONTINUOUS HAND GESTURE RECOGNITION

2014 ◽  
pp. 236-240
Author(s):  
DHARANI MAZUMDAR ◽  
ANJAN KUMAR TALUKDAR ◽  
Kandarpa Kumar Sarma
Keyword(s):  
Gesture Recognition ◽  
Low Cost ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Body Parts ◽  
Dynamic Background ◽  
Lighting Condition ◽  
Background Removal ◽  
Hand Segmentation ◽  
Finger Tip

Hand gesture recognition system can be used for human-computer interaction (HCI). Proper hand segmentation from the background and other body parts of the video is the primary requirement for the design of a hand-gesture based application. These video frames can be captured from a low cost webcam (camera) for use in a vision based gesture recognition technique. This paper discusses about the continuous hand gesture recognition. The aim of this paper is to report a robust and efficient hand segmentation algorithm where a new method, wearing glove on the hand is utilized. After that a new idea called “Finger-Pen”, is developed by segmenting only one finger from the hand for proper tracking. In this technique only a finger tip is segmented in spite of the full hand part. Hence this technique allows the hand (excepting the segmented finger tip) to move freely during the tracking time also. Problems such as skin colour detection, complexity from large numbers of people in front of the camera, complex background removal and variable lighting condition are found to be efficiently handled by the system. Noise present in the segmented image due to dynamic background can be removed with the help of this adaptive technique which is found to be effective for the application conceived.

scholarly journals STUDY OF HAND GESTURE RECOGNITION AND CLASSIFICATION

2017 ◽  
Vol 10 (13) ◽  
pp. 25
Author(s):  
Srinivas K ◽  
Manoj Kumar Rajagopal
Keyword(s):  
Sign Language ◽  
Gesture Recognition ◽  
Hand Movement ◽  
Hand Gesture Recognition ◽  
Hand Movements ◽  
Support Vector ◽  
Hand Gesture ◽  
Language Recognition ◽  
Sign Language Recognition ◽  
Hand Gestures

To recognize different hand gestures and achieve efficient classification to understand static and dynamic hand movements used for communications.Static and dynamic hand movements are first captured using gesture recognition devices including Kinect device, hand movement sensors, connecting electrodes, and accelerometers. These gestures are processed using hand gesture recognition algorithms such as multivariate fuzzy decision tree, hidden Markov models (HMM), dynamic time warping framework, latent regression forest, support vector machine, and surface electromyogram. Hand movements made by both single and double hands are captured by gesture capture devices with proper illumination conditions. These captured gestures are processed for occlusions and fingers close interactions for identification of right gesture and to classify the gesture and ignore the intermittent gestures. Real-time hand gestures recognition needs robust algorithms like HMM to detect only the intended gesture. Classified gestures are then compared for the effectiveness with training and tested standard datasets like sign language alphabets and KTH datasets. Hand gesture recognition plays a very important role in some of the applications such as sign language recognition, robotics, television control, rehabilitation, and music orchestration.

VISION-BASED APPLICATION-ADAPTIVE HAND GESTURE RECOGNITION SYSTEM

2013 ◽  
Vol 09 (01) ◽  
pp. 1350007 ◽  
Author(s):  
SIDDHARTH S. RAUTARAY ◽  
ANUPAM AGRAWAL
Keyword(s):  
Gesture Recognition ◽  
Positive Impact ◽  
Recognition Rate ◽  
Recognition System ◽  
Hand Gesture Recognition ◽  
Hand Gesture ◽  
Natural Form ◽  
Gesture Control ◽  
Recognition Systems ◽  
Accuracy Stress

With the increasing role of computing devices, facilitating natural human computer interaction (HCI) will have a positive impact on their usage and acceptance as a whole. For long time, research on HCI has been restricted to techniques based on the use of keyboard, mouse, etc. Recently, this paradigm has changed. Techniques such as vision, sound, speech recognition allow for much richer form of interaction between the user and machine. The emphasis is to provide a natural form of interface for interaction. Gestures are one of the natural forms of interaction between humans. As gesture commands are found to be natural for humans, the development of gesture control systems for controlling devices have become a popular research topic in recent years. Researchers have proposed different gesture recognition systems which act as an interface for controlling the applications. One of the drawbacks of present gesture recognition systems is application dependence which makes it difficult to transfer one gesture control interface into different applications. This paper focuses on designing a vision-based hand gesture recognition system which is adaptive to different applications thus making the gesture recognition systems to be application adaptive. The designed system comprises different processing steps like detection, segmentation, tracking, recognition, etc. For making the system as application-adaptive, different quantitative and qualitative parameters have been taken into consideration. The quantitative parameters include gesture recognition rate, features extracted and root mean square error of the system while the qualitative parameters include intuitiveness, accuracy, stress/comfort, computational efficiency, user's tolerance, and real-time performance related to the proposed system. These parameters have a vital impact on the performance of the proposed application adaptive hand gesture recognition system.

Sign in / Sign up

Export Citation Format

Share Document