Recognition of Hand Gesture Image Using Deep Convolutional Neural Network

Author(s):  
K. Martin Sagayam ◽  
A. Diana Andrushia ◽  
Ahona Ghosh ◽  
Omer Deperlioglu ◽  
Ahmed A. Elngar

In recent technology, there is tremendous growth in computer applications that highlight human–computer interaction (HCI), such as augmented reality (AR), and Internet of Things (IoT). As a consequence, hand gesture recognition was highlighted as a very up-to-date research area in computer vision. The body language is a vital method to communicate between people, as well as emphasis on voice messages, or as a complete message on its own. Thus, automatic hand gestures recognition systems can be used to increase human–computer interaction. Therefore, many approaches for hand gesture recognition systems have been designed. However, most of these methods include hybrid processes such as image pre-processing, segmentation, and classification. This paper describes how to create hand gesture model easily and quickly with a well-tuned deep convolutional neural network. Experiments were performed using the Cambridge Hand Gesture data set for illustration of success and efficiency of the convolutional neural network. The accuracy was achieved as 96.66%, where sensitivity and specificity were found to be 85% and 98.12%, respectively, according to the average values obtained at the end of 20 times of operation. These results were compared with the existing works using the same dataset and it was found to have higher values than the hybrid methods.

2020 ◽  
Vol 10 (2) ◽  
pp. 722 ◽  
Author(s):  
Dinh-Son Tran ◽  
Ngoc-Huynh Ho ◽  
Hyung-Jeong Yang ◽  
Eu-Tteum Baek ◽  
Soo-Hyung Kim ◽  
...  

Using hand gestures is a natural method of interaction between humans and computers. We use gestures to express meaning and thoughts in our everyday conversations. Gesture-based interfaces are used in many applications in a variety of fields, such as smartphones, televisions (TVs), video gaming, and so on. With advancements in technology, hand gesture recognition is becoming an increasingly promising and attractive technique in human–computer interaction. In this paper, we propose a novel method for fingertip detection and hand gesture recognition in real-time using an RGB-D camera and a 3D convolution neural network (3DCNN). This system can accurately and robustly extract fingertip locations and recognize gestures in real-time. We demonstrate the accurateness and robustness of the interface by evaluating hand gesture recognition across a variety of gestures. In addition, we develop a tool to manipulate computer programs to show the possibility of using hand gesture recognition. The experimental results showed that our system has a high level of accuracy of hand gesture recognition. This is thus considered to be a good approach to a gesture-based interface for human–computer interaction by hand in the future.


2015 ◽  
Vol 96 (1) ◽  
pp. 19-29
Author(s):  
P. Rodrigo Díaz-Monterrosas ◽  
Rubén Posada-Gómez ◽  
Albino Martínez-Sibaja

Sign in / Sign up

Export Citation Format

Share Document