Hand Gesture Detection and Recognition Using Spectrogram and Image Processing Technique with a Single Pair of Ultrasonic Transducers

This paper presents an effective signal processing scheme of hand gesture recognition with a superior accuracy rate of judging identical and dissimilar hand gestures. This scheme is implemented with the air sonar possessing a pair of cost-effective ultrasonic emitter and receiver along with signal processing circuitry. Through the circuitry, the Doppler signals of hand gestures are obtained and processed with the developed algorithm for recognition. Four different hand gestures of push motion, wrist motion from flexion to extension, pinch out, and hand rotation are investigated. To judge the starting time of hand gesture occurrence, the technique based on continuous short-period analysis is proposed. It could identify the starting time of the hand gesture with small-scale motion and avoid faulty judgment while no hand in front of the sonar. Fusing the short-time Fourier transform spectrogram of hand gesture to the image processing techniques of corner feature detection, feature descriptors, and Hamming-distance matching are the first-time, to our knowledge, employed to recognize hand gestures. The results show that the number of matching points is an effective parameter for classifying hand gestures. Based on the experimental data, the proposed scheme could achieve an accuracy rate of 99.8% for the hand gesture recognition.

Download Full-text

Electromyogram-based hand gesture recognition robust to various arm postures

International Journal of Distributed Sensor Networks ◽

10.1177/1550147718790751 ◽

2018 ◽

Vol 14 (7) ◽

pp. 155014771879075 ◽

Cited By ~ 1

Author(s):

Kiwon Rhee ◽

Hyun-Chool Shin

Keyword(s):

Gesture Recognition ◽

Recognition Accuracy ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Hand Gestures ◽

Practical Applications ◽

Electrode Positioning ◽

Recognition Technique

In the recognition of electromyogram-based hand gestures, the recognition accuracy may be degraded during the actual stage of practical applications for various reasons such as electrode positioning bias and different subjects. Besides these, the change in electromyogram signals due to different arm postures even for identical hand gestures is also an important issue. We propose an electromyogram-based hand gesture recognition technique robust to diverse arm postures. The proposed method uses both the signals of the accelerometer and electromyogram simultaneously to recognize correct hand gestures even for various arm postures. For the recognition of hand gestures, the electromyogram signals are statistically modeled considering the arm postures. In the experiments, we compared the cases that took into account the arm postures with the cases that disregarded the arm postures for the recognition of hand gestures. In the cases in which varied arm postures were disregarded, the recognition accuracy for correct hand gestures was 54.1%, whereas the cases using the method proposed in this study showed an 85.7% average recognition accuracy for hand gestures, an improvement of more than 31.6%. In this study, accelerometer and electromyogram signals were used simultaneously, which compensated the effect of different arm postures on the electromyogram signals and therefore improved the recognition accuracy of hand gestures.

Download Full-text

Hand Gesture Recognition Based on Single-Shot Multibox Detector Deep Learning

Mobile Information Systems ◽

10.1155/2019/3410348 ◽

2019 ◽

Vol 2019 ◽

pp. 1-7 ◽

Cited By ~ 2

Author(s):

Peng Liu ◽

Xiangxiang Li ◽

Haiting Cui ◽

Shanshan Li ◽

Yafei Yuan

Keyword(s):

Deep Learning ◽

Gesture Recognition ◽

Learning Algorithm ◽

Recognition System ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Single Shot ◽

Complex Scene ◽

Hand Gestures ◽

Benchmark Database

Hand gesture recognition is an intuitive and effective way for humans to interact with a computer due to its high processing speed and recognition accuracy. This paper proposes a novel approach to identify hand gestures in complex scenes by the Single-Shot Multibox Detector (SSD) deep learning algorithm with 19 layers of a neural network. A benchmark database with gestures is used, and general hand gestures in the complex scene are chosen as the processing objects. A real-time hand gesture recognition system based on the SSD algorithm is constructed and tested. The experimental results show that the algorithm quickly identifies humans’ hands and accurately distinguishes different types of gestures. Furthermore, the maximum accuracy is 99.2%, which is significantly important for human-computer interaction application.

Download Full-text

Hand Gesture Recognition using Image Processing and Feature Extraction Techniques

Procedia Computer Science ◽

10.1016/j.procs.2020.06.022 ◽

2020 ◽

Vol 173 ◽

pp. 181-190

Author(s):

Ashish Sharma ◽

Anmol Mittal ◽

Savitoj Singh ◽

Vasudev Awatramani

Keyword(s):

Image Processing ◽

Feature Extraction ◽

Gesture Recognition ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Extraction Techniques

Download Full-text

Computer Vision Based Hand Gesture Recognition For Speech Disabled Persons

Journal of the Institute of Engineering ◽

10.3126/jie.v11i1.14693 ◽

2016 ◽

Vol 11 (1) ◽

pp. 30-35

Author(s):

Manoj Acharya ◽

Dibakar Raj Pant

Keyword(s):

Neural Network ◽

Computer Vision ◽

Sign Language ◽

Gesture Recognition ◽

Disabled Persons ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Dependency Analysis ◽

Hand Gestures

This paper proposes a method to recognize static hand gestures in an image or video where a person is performing Nepali Sign Language (NSL) and translate it to words and sentences. The classification is carried out using Neural Network where contour of the hand is used as the feature. The work is verified successfully for NSL recognition using signer dependency analysis. Journal of the Institute of Engineering, 2015, 11(1): 30-35

Download Full-text

HAND GESTURE RECOGNITION FOR INDONESIAN SIGN LANGUAGE INTERPRETER SYSTEM WITH MYO ARMBAND USING SUPPORT VECTOR MACHINE

KLIK - KUMPULAN JURNAL ILMU KOMPUTER ◽

10.20527/klik.v7i2.320 ◽

2020 ◽

Vol 7 (2) ◽

pp. 164

Author(s):

Aditiya Anwar ◽

Achmad Basuki ◽

Riyanto Sigit

Keyword(s):

Support Vector Machine ◽

Sign Language ◽

Gesture Recognition ◽

Hand Gesture Recognition ◽

Support Vector ◽

Hand Gesture ◽

Deaf People ◽

Hand Gestures ◽

Moment Invariant ◽

Myo Armband

Hand gestures are the communication ways for the deaf people and the other. Each hand gesture has a different meaning. In order to better communicate, we need an automatic translator who can recognize hand movements as a word or sentence in communicating with deaf people. This paper proposes a system to recognize hand gestures based on Indonesian Sign Language Standard. This system uses Myo Armband as hand gesture sensors. Myo Armband has 21 sensors to express the hand gesture data. Recognition process uses a Support Vector Machine (SVM) to classify the hand gesture based on the dataset of Indonesian Sign Language Standard. SVM yields the accuracy of 86.59% to recognize hand gestures as sign language.Keywords: Hand Gesture Recognition, Feature Extraction, Indonesian Sign Language, Myo Armband, Moment Invariant

Download Full-text

Hand Gesture Robot Car using ADXL 335

International Journal of Recent Technology and Engineering - 2 ◽

10.35940/ijrte.d7798.118419 ◽

2019 ◽

Vol 8 (4) ◽

pp. 1027-1029

Keyword(s):

Gesture Recognition ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Hand Gestures ◽

Rf Receiver ◽

Transmission Problems ◽

Transmission Phase

In today’s world gesture recognition technologies are much newer. Hand gesture recognition is well known done using glove based technique. In our project the vehicle that can be controlled by hand gestures. The gesture controlled robot car is now we controlled by our hand sign and not in our older days controlled using buttons. The controller just they need to wear some small transmission sensor in his hand which acts as accelerometer and at end it receives signals using RF receiver sensor in the car. We refer this idea in some previous projects and we implement some extra features in our project. We uses different sensor to implement better. In previous cases there are some transmission problems but in this we alter the transmission phase and we also fixed extra antenna to transmit extra range of signals. The microcontrollers controls the movement of the robot in the same direction as our hand moves.

Download Full-text

Shape-Based Features for Optimized Hand Gesture Recognition

International Journal of Artificial Intelligence and Machine Learning ◽

10.4018/ijaiml.2021010103 ◽

2021 ◽

Vol 11 (1) ◽

pp. 23-38

Author(s):

Priyanka R. ◽

Prahanya Sriram ◽

Jayasree L. N. ◽

Angelin Gladston

Keyword(s):

Gesture Recognition ◽

Center Of Mass ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Hand Gestures ◽

Web Browser ◽

Real Time System ◽

Hand Size ◽

Fast Pace ◽

Natural Way

Gesture recognition is the most intuitive form of human-computer interface. Hand gestures provide a natural way for humans to interact with computers to perform a variety of different applications. However, factors such as complexity of hand gesture structures, differences in hand size, hand posture, and environmental illumination can influence the performance of hand gesture recognition algorithms. Considering the above factors, this paper aims to present a real time system for hand gesture recognition on the basis of detection of some meaningful shape-based features like orientation, center of mass, status of fingers, thumb in terms of raised or folded fingers of hand and their respective location in image. The internet is growing at a very fast pace. The use of web browser is also growing. Everyone has at least two or three most frequently visited website. Thus, in this paper, effectiveness of the gesture recognition and its ability to control the browser via the recognized hand gestures are experimented and the results are analyzed.

Download Full-text

putEMG—A Surface Electromyography Hand Gesture Recognition Dataset

Sensors ◽

10.3390/s19163548 ◽

2019 ◽

Vol 19 (16) ◽

pp. 3548 ◽

Cited By ~ 7

Author(s):

Piotr Kaczmarek ◽

Tomasz Mańkowski ◽

Jakub Tomczyński

Keyword(s):

Gesture Recognition ◽

Motion Tracking ◽

Recognition Performance ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Svm Classifier ◽

Classification Methods ◽

Hand Gestures ◽

Semg Signal ◽

Feature Sets

In this paper, we present a putEMG dataset intended for the evaluation of hand gesture recognition methods based on sEMG signal. The dataset was acquired for 44 able-bodied subjects and include 8 gestures (3 full hand gestures, 4 pinches and idle). It consists of uninterrupted recordings of 24 sEMG channels from the subject’s forearm, RGB video stream and depth camera images used for hand motion tracking. Moreover, exemplary processing scripts are also published. The putEMG dataset is available under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0). The dataset was validated regarding sEMG amplitudes and gesture recognition performance. The classification was performed using state-of-the-art classifiers and feature sets. An accuracy of 90% was achieved for SVM classifier utilising RMS feature and for LDA classifier using Hudgin’s and Du’s feature sets. Analysis of performance for particular gestures showed that LDA/Du combination has significantly higher accuracy for full hand gestures, while SVM/RMS performs better for pinch gestures. The presented dataset can be used as a benchmark for various classification methods, the evaluation of electrode localisation concepts, or the development of classification methods invariant to user-specific features or electrode displacement.

Download Full-text