Facial emotion recognition using convolutional neural network

Author(s):  
Arjun Singh ◽  
Arun Pratap Srivastav ◽  
Pushpa Choudhary ◽  
Sandeep Raj
2021 ◽  
Author(s):  
Naveen Kumari ◽  
Rekha Bhatia

Abstract Facial emotion recognition extracts the human emotions from the images and videos. As such, it requires an algorithm to understand and model the relationships between faces and facial expressions, and to recognize human emotions. Recently, deep learning models are extensively utilized enhance the facial emotion recognition rate. However, the deep learning models suffer from the overfitting issue. Moreover, deep learning models perform poorly for images which have poor visibility and noise. Therefore, in this paper, a novel deep learning based facial emotion recognition tool is proposed. Initially, a joint trilateral filter is applied to the obtained dataset to remove the noise. Thereafter, contrast-limited adaptive histogram equalization (CLAHE) is applied to the filtered images to improve the visibility of images. Finally, a deep convolutional neural network is trained. Nadam optimizer is also utilized to optimize the cost function of deep convolutional neural networks. Experiments are achieved by using the benchmark dataset and competitive human emotion recognition models. Comparative analysis demonstrates that the proposed facial emotion recognition model performs considerably better compared to the competitive models.


2021 ◽  
Vol 6 (1) ◽  
pp. 1-5
Author(s):  
Steven Lawrence ◽  
Taif Anjum ◽  
Amir Shabani

Facial emotion recognition (FER) is a critical component for affective computing in social companion robotics. Current FER datasets are not sufficiently age-diversified as they are predominantly adults excluding seniors above fifty years of age which is the target group in long-term care facilities. Data collection from this age group is more challenging due to their privacy concerns and also restrictions under pandemic situations such as COVID-19. We address this issue by using age augmentation which could act as a regularizer and reduce the overfitting of the classifier as well. Our comprehensive experiments show that improving a typical Deep Convolutional Neural Network (CNN) architecture with facial age augmentation improves both the accuracy and standard deviation of the classifier when predicting emotions of diverse age groups including seniors. The proposed framework is a promising step towards improving a participant’s experience and interactions with social companion robots with affective computing.


2019 ◽  
Vol 8 (4) ◽  
pp. 4351-4354

This paper presents the idea related to automated live facial emotion recognition through image processing and artificial intelligence (AI) techniques. It is a challenging task for a computer vision to recognize as same as humans through AI. Face detection plays a vital role in emotion recognition. Emotions are classified as happy, sad, disgust, angry, neutral, fear, and surprise. Other aspects such as speech, eye contact, frequency of the voice, and heartbeat are considered. Nowadays face recognition is more efficient and used for many real-time applications due to security purposes. We detect emotion by scanning (static) images or with the (dynamic) recording. Features extracting can be done like eyes, nose, and mouth for face detection. The convolutional neural network (CNN) algorithm follows steps as max-pooling (maximum feature extraction) and flattening.


Recognition of face emotion has been a challenging task for many years. This work uses machine learning algorithms for both, a real-time image or a stored database image in the area of facial emotion recognition system. So it is very clear that, deep learning technology becomes important for Human-computer interaction (HCI) applications. The proposed system has two parts, real-time based facial emotion recognition system and also the image based facial emotion recognition system. A Convolutional Neural Network (CNN) model is used to train and test different facial emotion images in this research work. This work was executed successfully using Python 3.7.6 platform. The input Face image of a person was taken using the webcam video stream or from the standard database available for research. The five different facial emotions considered in this work are happy, surprise, angry, sad and neutral. The best recognition accuracy with the proposed system for the webcam video stream is found to be 91.2%, whereas for the input database images is found to be 90.08%.


Sign in / Sign up

Export Citation Format

Share Document