scholarly journals Deep learning based facial expressions recognition system for assisting visually impaired persons

2020 ◽  
Vol 9 (3) ◽  
pp. 1208-1219
Author(s):  
Hendra Kusuma ◽  
Muhammad Attamimi ◽  
Hasby Fahrudin

In general, a good interaction including communication can be achieved when verbal and non-verbal information such as body movements, gestures, facial expressions, can be processed in two directions between the speaker and listener. Especially the facial expression is one of the indicators of the inner state of the speaker and/or the listener during the communication. Therefore, recognizing the facial expressions is necessary and becomes the important ability in communication. Such ability will be a challenge for the visually impaired persons. This fact motivated us to develop a facial recognition system. Our system is based on deep learning algorithm. We implemented the proposed system on a wearable device which enables the visually impaired persons to recognize facial expressions during the communication. We have conducted several experiments involving the visually impaired persons to validate our proposed system and the promising results were achieved.

2021 ◽  
Vol 23 (6) ◽  
pp. 1318-1331
Author(s):  
Yuxiu Guo ◽  
Yubin Liu ◽  
Weiying Ding ◽  
Yufen Feng

2021 ◽  
Vol 2062 (1) ◽  
pp. 012018
Author(s):  
C Selvi ◽  
Y Anvitha ◽  
C H Asritha ◽  
P B Sayannah

Abstract To develop a Deep Learning algorithm that detects the Kathakali face expression (or Navarasas) from a given image of a person who performs Kathakali. One of India’s major classical dance forms is Kathakali. It is a “story play” genre of art, but one distinguished by the traditional male-actor-dancers costumes, face masks and makeup they wear. In the Southern region of India, Kathakali is a Hindu performance art in Malayalam speaking. Most of the plays are epic scenes of Mahabharata and Ramayana. A lot of foreigners visiting India are inspired by this art form and have been curious about the culture. It is still used for entertainment as a part of tourism and temple rituals. An understanding of facial expressions are essential so as to enjoy the play. The scope of the paper is to identify the facial expressions of Kathakali to have a better understanding of the art play. In this paper, Machine Learning and Image Processing techniques are used to decode the expressions. Kathakali face expressions are nine types namely-Adbhutam (wonder), Hasyam (comic), Sringaram(love), Bheebatsam(repulsion), Bhayanakam(fear), Roudram(anger), Veeram(pride), Karunam(sympathy) and Shantham (peace). These Expressions are mapped to real world human emotions for better classification through face detection and extraction to achieve the same. Similarly a lot of research in terms of Preprocessing and Classification is done to achieve the maximum accuracy. Using CNN algorithm 90% of the accuracy was achieved. In order to conserve the pixel distribution and as no preprocessing was used for better object recognition and analysis Fuzzy algorithm is taken into consideration. Using this preprocessing technique 93% accuracy was achieved.


2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Edeh Michael Onyema ◽  
Piyush Kumar Shukla ◽  
Surjeet Dalal ◽  
Mayuri Neeraj Mathur ◽  
Mohammed Zakariah ◽  
...  

The use of machine learning algorithms for facial expression recognition and patient monitoring is a growing area of research interest. In this study, we present a technique for facial expression recognition based on deep learning algorithm: convolutional neural network (ConvNet). Data were collected from the FER2013 dataset that contains samples of seven universal facial expressions for training. The results show that the presented technique improves facial expression recognition accuracy without encoding several layers of CNN that lead to a computationally costly model. This study proffers solutions to the issues of high computational cost due to the implementation of facial expression recognition by providing a model close to the accuracy of the state-of-the-art model. The study concludes that deep l\earning-enabled facial expression recognition techniques enhance accuracy, better facial recognition, and interpretation of facial expressions and features that promote efficiency and prediction in the health sector.


Sign in / Sign up

Export Citation Format

Share Document