Human Emotion Recognition using Convolutional Neural Network in Real Time

Author(s):  
Rohit Pathar ◽  
Abhishek Adivarekar ◽  
Arti Mishra ◽  
Anushree Deshmukh

Recognition of face emotion has been a challenging task for many years. This work uses machine learning algorithms for both, a real-time image or a stored database image in the area of facial emotion recognition system. So it is very clear that, deep learning technology becomes important for Human-computer interaction (HCI) applications. The proposed system has two parts, real-time based facial emotion recognition system and also the image based facial emotion recognition system. A Convolutional Neural Network (CNN) model is used to train and test different facial emotion images in this research work. This work was executed successfully using Python 3.7.6 platform. The input Face image of a person was taken using the webcam video stream or from the standard database available for research. The five different facial emotions considered in this work are happy, surprise, angry, sad and neutral. The best recognition accuracy with the proposed system for the webcam video stream is found to be 91.2%, whereas for the input database images is found to be 90.08%.


2019 ◽  
Vol 8 (4) ◽  
pp. 12940-12944

Human life is a complex social structure. It is not possible for the humans to navigate without reading the other persons. They do it by identifying the faces. The state of response can be decided based on the mood of the opposite person. Whereas a person’s mood can be figured out by observing his emotion (Facial Gesture). The aim of the project is to construct a “Facial emotion Recognition” model using DCNN (Deep convolutional neural network) in real time. The model is constructed using DCNN as it is proven that DCNN work with greater accuracy than CNN (convolutional neural network). The facial expression of humans is very dynamic in nature it changes in split seconds whether it may be Happy, Sad, Angry, Fear, Surprise, Disgust and Neutral etc. This project is to predict the emotion of the person in real time. Our brains have neural networks which are responsible for all kinds of thinking (decision making, understanding). This model tries to develop these decisions making and classification skills by training the machine. It can classify and predict the multiple faces and different emotions at the very same time. In order to obtain higher accuracy, we take the models which are trained over thousands of datasets.


Currently a the very beginning's of the unsolved difficulty in pc imaginative and prescient is perceiving or understanding different people' feelings and sentiments. Albeit ongoing strategies accomplish close to human exactness in controlled conditions, the acknowledgment of emotions inside the wild remains a hard difficulty. On this paper we proposed MAM Pooling (mean of common and maximum) strategy with CNN to perceive human feelings. We center round programmed distinguishing evidence of six emotions constantly: Happiness, Anger, unhappiness, surprise, fear, and Disgust. Convolutional Neural network (CNN) is a certainly propelled trainable layout that may study invariant highlights for numerous programs. Whilst all is said in carried out, CNNs include of rotating convolutional layers, non-linearity layers and highlight pooling layers. In this artwork, a Novel include pooling approach, named as MAM pooling is proposed to regularize CNNs, which replaces the deterministic pooling obligations with a stochastic system thru taking the ordinary of max pooling and regular pooling strategies. The benefit of the proposed MAM pooling technique lies in its firstrate capability to address the over fitting problem skilled with the resource of CNN age.


Sign in / Sign up

Export Citation Format

Share Document