Authorized Traffic Controller Hand Gesture Recognition for Situation-Aware Autonomous Driving

An authorized traffic controller (ATC) has the highest priority for direct road traffic. In some irregular situations, the ATC supersedes other traffic control. Human drivers indigenously understand such situations and tend to follow the ATC; however, an autonomous vehicle (AV) can become confused in such circumstances. Therefore, autonomous driving (AD) crucially requires a human-level understanding of situation-aware traffic gesture recognition. In AVs, vision-based recognition is particularly desirable because of its suitability; however, such recognition systems have various bottlenecks, such as failing to recognize other humans on the road, identifying a variety of ATCs, and gloves in the hands of ATCs. We propose a situation-aware traffic control hand-gesture recognition system, which includes ATC detection and gesture recognition. Three-dimensional (3D) hand model-based gesture recognition is used to mitigate the problem associated with gloves. Our database contains separate training and test videos of approximately 60 min length, captured at a frame rate of 24 frames per second. It has 35,291 different frames that belong to traffic control hand gestures. Our approach correctly recognized traffic control hand gestures; therefore, the proposed system can be considered as an extension of the operational domain of the AV.

Download Full-text

Electromyogram-based hand gesture recognition robust to various arm postures

International Journal of Distributed Sensor Networks ◽

10.1177/1550147718790751 ◽

2018 ◽

Vol 14 (7) ◽

pp. 155014771879075 ◽

Cited By ~ 1

Author(s):

Kiwon Rhee ◽

Hyun-Chool Shin

Keyword(s):

Gesture Recognition ◽

Recognition Accuracy ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Hand Gestures ◽

Practical Applications ◽

Electrode Positioning ◽

Recognition Technique

In the recognition of electromyogram-based hand gestures, the recognition accuracy may be degraded during the actual stage of practical applications for various reasons such as electrode positioning bias and different subjects. Besides these, the change in electromyogram signals due to different arm postures even for identical hand gestures is also an important issue. We propose an electromyogram-based hand gesture recognition technique robust to diverse arm postures. The proposed method uses both the signals of the accelerometer and electromyogram simultaneously to recognize correct hand gestures even for various arm postures. For the recognition of hand gestures, the electromyogram signals are statistically modeled considering the arm postures. In the experiments, we compared the cases that took into account the arm postures with the cases that disregarded the arm postures for the recognition of hand gestures. In the cases in which varied arm postures were disregarded, the recognition accuracy for correct hand gestures was 54.1%, whereas the cases using the method proposed in this study showed an 85.7% average recognition accuracy for hand gestures, an improvement of more than 31.6%. In this study, accelerometer and electromyogram signals were used simultaneously, which compensated the effect of different arm postures on the electromyogram signals and therefore improved the recognition accuracy of hand gestures.

Download Full-text

Hand Gesture Recognition Based on Single-Shot Multibox Detector Deep Learning

Mobile Information Systems ◽

10.1155/2019/3410348 ◽

2019 ◽

Vol 2019 ◽

pp. 1-7 ◽

Cited By ~ 2

Author(s):

Peng Liu ◽

Xiangxiang Li ◽

Haiting Cui ◽

Shanshan Li ◽

Yafei Yuan

Keyword(s):

Deep Learning ◽

Gesture Recognition ◽

Learning Algorithm ◽

Recognition System ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Single Shot ◽

Complex Scene ◽

Hand Gestures ◽

Benchmark Database

Hand gesture recognition is an intuitive and effective way for humans to interact with a computer due to its high processing speed and recognition accuracy. This paper proposes a novel approach to identify hand gestures in complex scenes by the Single-Shot Multibox Detector (SSD) deep learning algorithm with 19 layers of a neural network. A benchmark database with gestures is used, and general hand gestures in the complex scene are chosen as the processing objects. A real-time hand gesture recognition system based on the SSD algorithm is constructed and tested. The experimental results show that the algorithm quickly identifies humans’ hands and accurately distinguishes different types of gestures. Furthermore, the maximum accuracy is 99.2%, which is significantly important for human-computer interaction application.

Download Full-text

Computer Vision Based Hand Gesture Recognition For Speech Disabled Persons

Journal of the Institute of Engineering ◽

10.3126/jie.v11i1.14693 ◽

2016 ◽

Vol 11 (1) ◽

pp. 30-35

Author(s):

Manoj Acharya ◽

Dibakar Raj Pant

Keyword(s):

Neural Network ◽

Computer Vision ◽

Sign Language ◽

Gesture Recognition ◽

Disabled Persons ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Dependency Analysis ◽

Hand Gestures

This paper proposes a method to recognize static hand gestures in an image or video where a person is performing Nepali Sign Language (NSL) and translate it to words and sentences. The classification is carried out using Neural Network where contour of the hand is used as the feature. The work is verified successfully for NSL recognition using signer dependency analysis. Journal of the Institute of Engineering, 2015, 11(1): 30-35

Download Full-text

HAND GESTURE RECOGNITION FOR INDONESIAN SIGN LANGUAGE INTERPRETER SYSTEM WITH MYO ARMBAND USING SUPPORT VECTOR MACHINE

KLIK - KUMPULAN JURNAL ILMU KOMPUTER ◽

10.20527/klik.v7i2.320 ◽

2020 ◽

Vol 7 (2) ◽

pp. 164

Author(s):

Aditiya Anwar ◽

Achmad Basuki ◽

Riyanto Sigit

Keyword(s):

Support Vector Machine ◽

Sign Language ◽

Gesture Recognition ◽

Hand Gesture Recognition ◽

Support Vector ◽

Hand Gesture ◽

Deaf People ◽

Hand Gestures ◽

Moment Invariant ◽

Myo Armband

Hand gestures are the communication ways for the deaf people and the other. Each hand gesture has a different meaning. In order to better communicate, we need an automatic translator who can recognize hand movements as a word or sentence in communicating with deaf people. This paper proposes a system to recognize hand gestures based on Indonesian Sign Language Standard. This system uses Myo Armband as hand gesture sensors. Myo Armband has 21 sensors to express the hand gesture data. Recognition process uses a Support Vector Machine (SVM) to classify the hand gesture based on the dataset of Indonesian Sign Language Standard. SVM yields the accuracy of 86.59% to recognize hand gestures as sign language.Keywords: Hand Gesture Recognition, Feature Extraction, Indonesian Sign Language, Myo Armband, Moment Invariant

Download Full-text

Hand Gesture Robot Car using ADXL 335

International Journal of Recent Technology and Engineering - 2 ◽

10.35940/ijrte.d7798.118419 ◽

2019 ◽

Vol 8 (4) ◽

pp. 1027-1029

Keyword(s):

Gesture Recognition ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Hand Gestures ◽

Rf Receiver ◽

Transmission Problems ◽

Transmission Phase

In today’s world gesture recognition technologies are much newer. Hand gesture recognition is well known done using glove based technique. In our project the vehicle that can be controlled by hand gestures. The gesture controlled robot car is now we controlled by our hand sign and not in our older days controlled using buttons. The controller just they need to wear some small transmission sensor in his hand which acts as accelerometer and at end it receives signals using RF receiver sensor in the car. We refer this idea in some previous projects and we implement some extra features in our project. We uses different sensor to implement better. In previous cases there are some transmission problems but in this we alter the transmission phase and we also fixed extra antenna to transmit extra range of signals. The microcontrollers controls the movement of the robot in the same direction as our hand moves.

Download Full-text

Shape-Based Features for Optimized Hand Gesture Recognition

International Journal of Artificial Intelligence and Machine Learning ◽

10.4018/ijaiml.2021010103 ◽

2021 ◽

Vol 11 (1) ◽

pp. 23-38

Author(s):

Priyanka R. ◽

Prahanya Sriram ◽

Jayasree L. N. ◽

Angelin Gladston

Keyword(s):

Gesture Recognition ◽

Center Of Mass ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Hand Gestures ◽

Web Browser ◽

Real Time System ◽

Hand Size ◽

Fast Pace ◽

Natural Way

Gesture recognition is the most intuitive form of human-computer interface. Hand gestures provide a natural way for humans to interact with computers to perform a variety of different applications. However, factors such as complexity of hand gesture structures, differences in hand size, hand posture, and environmental illumination can influence the performance of hand gesture recognition algorithms. Considering the above factors, this paper aims to present a real time system for hand gesture recognition on the basis of detection of some meaningful shape-based features like orientation, center of mass, status of fingers, thumb in terms of raised or folded fingers of hand and their respective location in image. The internet is growing at a very fast pace. The use of web browser is also growing. Everyone has at least two or three most frequently visited website. Thus, in this paper, effectiveness of the gesture recognition and its ability to control the browser via the recognized hand gestures are experimented and the results are analyzed.

Download Full-text

putEMG—A Surface Electromyography Hand Gesture Recognition Dataset

Sensors ◽

10.3390/s19163548 ◽

2019 ◽

Vol 19 (16) ◽

pp. 3548 ◽

Cited By ~ 7

Author(s):

Piotr Kaczmarek ◽

Tomasz Mańkowski ◽

Jakub Tomczyński

Keyword(s):

Gesture Recognition ◽

Motion Tracking ◽

Recognition Performance ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Svm Classifier ◽

Classification Methods ◽

Hand Gestures ◽

Semg Signal ◽

Feature Sets

In this paper, we present a putEMG dataset intended for the evaluation of hand gesture recognition methods based on sEMG signal. The dataset was acquired for 44 able-bodied subjects and include 8 gestures (3 full hand gestures, 4 pinches and idle). It consists of uninterrupted recordings of 24 sEMG channels from the subject’s forearm, RGB video stream and depth camera images used for hand motion tracking. Moreover, exemplary processing scripts are also published. The putEMG dataset is available under a Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0). The dataset was validated regarding sEMG amplitudes and gesture recognition performance. The classification was performed using state-of-the-art classifiers and feature sets. An accuracy of 90% was achieved for SVM classifier utilising RMS feature and for LDA classifier using Hudgin’s and Du’s feature sets. Analysis of performance for particular gestures showed that LDA/Du combination has significantly higher accuracy for full hand gestures, while SVM/RMS performs better for pinch gestures. The presented dataset can be used as a benchmark for various classification methods, the evaluation of electrode localisation concepts, or the development of classification methods invariant to user-specific features or electrode displacement.

Download Full-text

Development of Real-Time Hand Gesture Recognition for Tabletop Holographic Display Interaction Using Azure Kinect

Sensors ◽

10.3390/s20164566 ◽

2020 ◽

Vol 20 (16) ◽

pp. 4566

Author(s):

Chanhwi Lee ◽

Jaehan Kim ◽

Seoungbae Cho ◽

Jinwoong Kim ◽

Jisang Yoo ◽

...

Keyword(s):

Real Time ◽

Gesture Recognition ◽

Hand Gesture Recognition ◽

Depth Image ◽

Hand Gesture ◽

Leap Motion ◽

Hand Gestures ◽

Actual Object ◽

Holographic Display ◽

Continuous Rotation

The use of human gesturing to interact with devices such as computers or smartphones has presented several problems. This form of interaction relies on gesture interaction technology such as Leap Motion from Leap Motion, Inc, which enables humans to use hand gestures to interact with a computer. The technology has excellent hand detection performance, and even allows simple games to be played using gestures. Another example is the contactless use of a smartphone to take a photograph by simply folding and opening the palm. Research on interaction with other devices via hand gestures is in progress. Similarly, studies on the creation of a hologram display from objects that actually exist are also underway. We propose a hand gesture recognition system that can control the Tabletop holographic display based on an actual object. The depth image obtained using the latest Time-of-Flight based depth camera Azure Kinect is used to obtain information about the hand and hand joints by using the deep-learning model CrossInfoNet. Using this information, we developed a real time system that defines and recognizes gestures indicating left, right, up, and down basic rotation, and zoom in, zoom out, and continuous rotation to the left and right.

Download Full-text

Dynamic Hand Gesture Recognition Based on a Leap Motion Controller and Two-Layer Bidirectional Recurrent Neural Network

Sensors ◽

10.3390/s20072106 ◽

2020 ◽

Vol 20 (7) ◽

pp. 2106 ◽

Cited By ~ 2

Author(s):

Linchu Yang ◽

Ji’an Chen ◽

Weihang Zhu

Keyword(s):

Neural Network ◽

Gesture Recognition ◽

Recurrent Neural Network ◽

Hand Gesture Recognition ◽

Hand Gesture ◽

Leap Motion ◽

Motion Controller ◽

Hand Gestures ◽

Leap Motion Controller ◽

Dynamic Hand Gesture Recognition

Dynamic hand gesture recognition is one of the most significant tools for human–computer interaction. In order to improve the accuracy of the dynamic hand gesture recognition, in this paper, a two-layer Bidirectional Recurrent Neural Network for the recognition of dynamic hand gestures from a Leap Motion Controller (LMC) is proposed. In addition, based on LMC, an efficient way to capture the dynamic hand gestures is identified. Dynamic hand gestures are represented by sets of feature vectors from the LMC. The proposed system has been tested on the American Sign Language (ASL) datasets with 360 samples and 480 samples, and the Handicraft-Gesture dataset, respectively. On the ASL dataset with 360 samples, the system achieves accuracies of 100% and 96.3% on the training and testing sets. On the ASL dataset with 480 samples, the system achieves accuracies of 100% and 95.2%. On the Handicraft-Gesture dataset, the system achieves accuracies of 100% and 96.7%. In addition, 5-fold, 10-fold, and Leave-One-Out cross-validation are performed on these datasets. The accuracies are 93.33%, 94.1%, and 98.33% (360 samples), 93.75%, 93.5%, and 98.13% (480 samples), and 88.66%, 90%, and 92% on ASL and Handicraft-Gesture datasets, respectively. The developed system demonstrates similar or better performance compared to other approaches in the literature.

Download Full-text

Hand Gesture Recognition Using an IR-UWB Radar with an Inception Module-Based Classifier

Sensors ◽

10.3390/s20020564 ◽

2020 ◽

Vol 20 (2) ◽

pp. 564 ◽

Cited By ~ 4

Author(s):

Shahzad Ahmed ◽

Sung Ho Cho

Keyword(s):

Gesture Recognition ◽

Human Subjects ◽

Three Dimensional ◽

Hand Gesture Recognition ◽

Ultra Wideband ◽

Hand Gesture ◽

Natural Mode ◽

Hand Gestures ◽

Daily Lives ◽

Deep Learning Network

The emerging integration of technology in daily lives has increased the need for more convenient methods for human–computer interaction (HCI). Given that the existing HCI approaches exhibit various limitations, hand gesture recognition-based HCI may serve as a more natural mode of man–machine interaction in many situations. Inspired by an inception module-based deep-learning network (GoogLeNet), this paper presents a novel hand gesture recognition technique for impulse-radio ultra-wideband (IR-UWB) radars which demonstrates a higher gesture recognition accuracy. First, methodology to demonstrate radar signals as three-dimensional image patterns is presented and then, the inception module-based variant of GoogLeNet is used to analyze the pattern within the images for the recognition of different hand gestures. The proposed framework is exploited for eight different hand gestures with a promising classification accuracy of 95%. To verify the robustness of the proposed algorithm, multiple human subjects were involved in data acquisition.

Download Full-text