A real-time American Sign Language word recognition system based on neural networks and a probabilistic model

Abstract: Sign language is one of the oldest and most natural form of language for communication, but since most people do not know sign language and interpreters are very difficult to come by we have come up with a real time method using neural networks for fingerspelling based American sign language. In our method, the hand is first passed through a filter and after the filter is applied the hand is passed through a classifier which predicts the class of the hand gestures.

Download Full-text

A Real-Time American Sign Language Recognition System using Convolutional Neural Network for Real Datasets

TEM Journal ◽

10.18421/tem93-14 ◽

2020 ◽

pp. 937-943

Author(s):

Rasha Amer Kadhim ◽

Muntadher Khamees

Keyword(s):

Neural Network ◽

Convolutional Neural Network ◽

American Sign Language ◽

Real Time ◽

Sign Language ◽

Recognition System ◽

High Accuracy ◽

American Sign ◽

Language Recognition ◽

Sign Language Recognition

In this paper, a real-time ASL recognition system was built with a ConvNet algorithm using real colouring images from a PC camera. The model is the first ASL recognition model to categorize a total of 26 letters, including (J & Z), with two new classes for space and delete, which was explored with new datasets. It was built to contain a wide diversity of attributes like different lightings, skin tones, backgrounds, and a wide variety of situations. The experimental results achieved a high accuracy of about 98.53% for the training and 98.84% for the validation. As well, the system displayed a high accuracy for all the datasets when new test data, which had not been used in the training, were introduced.

Download Full-text

A REAL – TIME SYSTEM FOR RECOGNITION OF AMERICAN SIGN LANGUAGE BY USING DEEP LEARINING

International journal of multidisciplinary advanced scientific research and innovation ◽

10.53633/ijmasri.2021.1.10.011 ◽

2021 ◽

Vol 1 (10) ◽

pp. 316-322

Author(s):

Mohit Panwar ◽

Rohit Pandey ◽

Rohan Singla ◽

Kavita Saxena

Keyword(s):

American Sign Language ◽

Real Time ◽

Sign Language ◽

Gesture Recognition ◽

Recognition System ◽

American Sign ◽

Language Recognition ◽

Sign Language Recognition ◽

Real Time System ◽

Static Gesture Recognition

Every day we see many people, who are facing illness like deaf, dumb etc. There are not as many technologies which help them to interact with each other. They face difficulty in interacting with others. Sign language is used by deaf and hard hearing people to exchange information between their own community and with other people. Computer recognition of sign language deals from sign gesture acquisition and continues till text/speech generation. Sign gestures can be classified as static and dynamic. However static gesture recognition is simpler than dynamic gesture recognition but both recognition systems are important to the human community. The ASL American sign language recognition steps are described in this survey. There are not as many technologies which help them to interact with each other. They face difficulty in interacting with others. Image classification and machine learning can be used to help computers recognize sign language, which could then be interpreted by other people. Earlier we have Glove-based method in which the person has to wear a hardware glove, while the hand movements are getting captured. It seems a bit uncomfortable for practical use. Here we use visual based method. Convolutional neural networks and mobile ssd model have been employed in this paper to recognize sign language gestures. Preprocessing was performed on the images, which then served as the cleaned input. Tensor flow is used for training of images. A system will be developed which serves as a tool for sign language detection. Tensor flow is used for training of images. Keywords: ASL recognition system, convolutional neural network (CNNs), classification, real time, tensor flow

Download Full-text