scholarly journals Development of a Robust Multi-Scale Featured Local Binary Pattern for Improved Facial Expression Recognition

Sensors ◽  
2020 ◽  
Vol 20 (18) ◽  
pp. 5391
Author(s):  
Suraiya Yasmin ◽  
Refat Khan Pathan ◽  
Munmun Biswas ◽  
Mayeen Uddin Khandaker ◽  
Mohammad Rashed Iqbal Faruque
Keyword(s):  
Facial Expression ◽  
Facial Expression Recognition ◽  
Local Binary Pattern ◽  
Support Vector ◽  
Expression Recognition ◽  
Feature Extraction Method ◽  
Multi Scale ◽  
Essential Components ◽  
The Face ◽  
Facial Images

Compelling facial expression recognition (FER) processes have been utilized in very successful fields like computer vision, robotics, artificial intelligence, and dynamic texture recognition. However, the FER’s critical problem with traditional local binary pattern (LBP) is the loss of neighboring pixels related to different scales that can affect the texture of facial images. To overcome such limitations, this study describes a new extended LBP method to extract feature vectors from images, detecting each image from facial expressions. The proposed method is based on the bitwise AND operation of two rotational kernels applied on LBP(8,1) and LBP(8,2) and utilizes two accessible datasets. Firstly, the facial parts are detected and the essential components of a face are observed, such as eyes, nose, and lips. The portion of the face is then cropped to reduce the dimensions and an unsharp masking kernel is applied to sharpen the image. The filtered images then go through the feature extraction method and wait for the classification process. Four machine learning classifiers were used to verify the proposed method. This study shows that the proposed multi-scale featured local binary pattern (MSFLBP), together with Support Vector Machine (SVM), outperformed the recent LBP-based state-of-the-art approaches resulting in an accuracy of 99.12% for the Extended Cohn–Kanade (CK+) dataset and 89.08% for the Karolinska Directed Emotional Faces (KDEF) dataset.

Computer Intelligent Nursing Care of Critically III Patients Based on Improved Patient Facial Expression Recognition Method

2014 ◽  
Vol 543-547 ◽  
pp. 2350-2353
Author(s):  
Xiao Yan Wan
Keyword(s):  
Facial Expression ◽  
Critically Ill ◽  
Nursing Care ◽  
Facial Expression Recognition ◽  
Recognition Rate ◽  
Support Vector ◽  
Appearance Model ◽  
Expression Recognition ◽  
Recognition Method ◽  
The Face

In order to extract the expression features of critically ill patients, and realize the computer intelligent nursing, an improved facial expression recognition method is proposed based on the of active appearance model, the support vector machine (SVM) for facial expression recognition is taken in research, and the face recognition model structure active appearance model is designed, and the attribute reduction algorithm of rough set affine transformation theory is introduced, and the invalid and redundant feature points are removed. The critically ill patient expressions are classified and recognized based on the support vector machine (SVM). The face image attitudes are adjusted, and the self-adaptive performance of facial expression recognition for the critical patient attitudes is improved. New method overcomes the effect of patient attitude to the recognition rate to a certain extent. The highest average recognition rate can be increased about 7%. The intelligent monitoring and nursing care of critically ill patients are realized with the computer vision effect. The nursing quality is enhanced, and it ensures the timely treatment of rescue.

Combining 2D Gabor and Local Binary Pattern for Facial Expression Recognition Using Extreme Learning Machine

2019 ◽  
Vol 23 (3) ◽  
pp. 444-455 ◽  
Author(s):  
Zhen-Tao Liu ◽  
Si-Han Li ◽  
Wei-Hua Cao ◽  
Dan-Yun Li ◽  
Man Hao ◽  
...  
Keyword(s):  
Facial Expression ◽  
Extreme Learning Machine ◽  
Facial Expression Recognition ◽  
Local Binary Pattern ◽  
Human Robot Interaction ◽  
Support Vector ◽  
Expression Recognition ◽  
Robot Interaction ◽  
Interaction Detection ◽  
Learning Machine

The efficiency of facial expression recognition (FER) is important for human-robot interaction. Detection of the facial region, extraction of discriminative facial expression features, and identification of categories of facial expressions are all related to the recognition accuracy and time-efficiency. An FER framework is proposed, in which 2D Gabor and local binary pattern (LBP) are combined to extract discriminative features of salient facial expression patches, and extreme learning machine (ELM) is adopted to identify facial expression categories. The combination of 2D Gabor and LBP can not only describe multiscale and multidirectional textural features, but also capture small local details. The FER of ELM and support vector machine (SVM) is performed using the Japanese female facial expression database and extended Cohn-Kanade database, respectively, in which both ELM and SVM achieve an accuracy of more than 85%, and the computational efficiency of ELM is higher than that of SVM. The proposed framework has been used in the multimodal emotional communication based humans-robots interaction system, in which FER within 2 seconds enables real-time human-robot interaction.

scholarly journals Facial expression recognition using three-stage support vector machines

2019 ◽  
Vol 2 (1) ◽  
Author(s):  
Issam Dagher ◽  
Elio Dahdah ◽  
Morshed Al Shakik
Keyword(s):  
Facial Expression ◽  
Facial Expression Recognition ◽  
Support Vector ◽  
Expression Recognition ◽  
Second Stage ◽  
Vector Machines ◽  
Third Stage ◽  
The Face ◽  
Leave One Out ◽  
Gradient Feature

AbstractHerein, a three-stage support vector machine (SVM) for facial expression recognition is proposed. The first stage comprises 21 SVMs, which are all the binary combinations of seven expressions. If one expression is dominant, then the first stage will suffice; if two are dominant, then the second stage is used; and, if three are dominant, the third stage is used. These multilevel stages help reduce the possibility of experiencing an error as much as possible. Different image preprocessing stages are used to ensure that the features attained from the face detected have a meaningful and proper contribution to the classification stage. Facial expressions are created as a result of muscle movements on the face. These subtle movements are detected by the histogram-oriented gradient feature, because it is sensitive to the shapes of objects. The features attained are then used to train the three-stage SVM. Two different validation methods were used: the leave-one-out and K-fold tests. Experimental results on three databases (Japanese Female Facial Expression, Extended Cohn-Kanade Dataset, and Radboud Faces Database) show that the proposed system is competitive and has better performance compared with other works.

Subject Independent Facial Expression Recognition from 3D Face Models using Deformation Modeling

2011 ◽  
pp. 574-595
Author(s):  
Ruchir Srivastava ◽  
Shuicheng Yan ◽  
Terence Sim ◽  
Surendra Ranganath
Keyword(s):  
Facial Expression ◽  
Facial Expression Recognition ◽  
Test Subject ◽  
Future Research ◽  
Support Vector ◽  
Expression Recognition ◽  
Neutral Face ◽  
The Face ◽  
Future Research Directions ◽  
3D Information

Most of the works on Facial Expression Recognition (FER) have worked on 2D images or videos. However, researchers are now increasingly utilizing 3D information for FER. As a contribution, this chapter zooms in on 3D based approaches while introducing FER. Prominent works are reviewed briefly, and some of the issues involved in 3D FER are discussed along with the future research directions. In most of the FER approaches, there is a need for having a neutral (expressionless) face of the subject which might not always be practical. This chapter also presents a novel technique of feature extraction which does not require any neutral face of the test subject. A proposition has been verified experimentally that motion of a set of landmark points on the face, in exhibiting a particular facial expression, is similar in different persons. The presented approach shows promising results using Support Vector Machine (SVM) as the classifier.

scholarly journals A Facial Expression Recognition Model Based on Texture and Shape Features

2020 ◽  
Vol 37 (4) ◽  
pp. 627-632
Author(s):  
Aihua Li ◽  
Lei An ◽  
Zihui Che
Keyword(s):  
Feature Extraction ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Texture Features ◽  
Support Vector ◽  
Svm Classifier ◽  
Expression Recognition ◽  
Shape Features ◽  
The Face ◽  
Facial Expression Classification

With the development of computer vision, facial expression recognition has become a research hotspot. To further improve the accuracy of facial expression recognition, this paper probes deep into image segmentation, feature extraction, and facial expression classification. Firstly, the convolution neural network (CNN) was adopted to accurately separate the salient regions from the face image. Next, the Gaussian Markov random field (GMRF) model was improved to enhance the ability of texture features to represent image information, and a novel feature extraction algorithm called specific angle abundance entropy (SAAE) was designed to improve the representation ability of shape features. After that, the texture features were combined with shape features, and trained and classified by the support vector machine (SVM) classifier. Finally, the proposed method was compared with common methods of facial expression recognition on a standard facial expression database. The results show that our method can greatly improve the accuracy of facial expression recognition.

A Hierarchical Facial Feature Extraction Method for Expression Recognition

2012 ◽  
Vol 452-453 ◽  
pp. 802-806
Author(s):  
Jin Lin Han ◽  
Hong Zhang
Keyword(s):  
Feature Extraction ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Extraction Method ◽  
Facial Feature ◽  
Support Vector ◽  
Expression Recognition ◽  
Feature Extraction Method ◽  
Facial Identity ◽  
Facial Feature Extraction

With the development of computer visual technology, facial expression recognition plays an important role in the friendly and harmonious human-computer interaction field.Against the inadequacy of the original feature extraction method based on singular value decomposition, this paper proposed a hierarchical facial feature extraction method according to the needs of facial expression recognition, which combines the way of hierarchy and block to enhance the detail information of the image. Then utilize a combination of support vector machine to classify. The results of the two experiments show that the method is effective for the facial identity and expression recognition.

scholarly journals Facial Expression Recognition with LBP and ORB Features

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Ben Niu ◽  
Zhenxing Gao ◽  
Bingbing Guo
Keyword(s):  
Facial Expression ◽  
Facial Expression Recognition ◽  
Real Life ◽  
Local Binary Patterns ◽  
Detection Algorithm ◽  
Support Vector ◽  
Expression Recognition ◽  
Region Division ◽  
The Face ◽  
Combined Features

Emotion plays an important role in communication. For human–computer interaction, facial expression recognition has become an indispensable part. Recently, deep neural networks (DNNs) are widely used in this field and they overcome the limitations of conventional approaches. However, application of DNNs is very limited due to excessive hardware specifications requirement. Considering low hardware specifications used in real-life conditions, to gain better results without DNNs, in this paper, we propose an algorithm with the combination of the oriented FAST and rotated BRIEF (ORB) features and Local Binary Patterns (LBP) features extracted from facial expression. First of all, every image is passed through face detection algorithm to extract more effective features. Second, in order to increase computational speed, the ORB and LBP features are extracted from the face region; specifically, region division is innovatively employed in the traditional ORB to avoid the concentration of the features. The features are invariant to scale and grayscale as well as rotation changes. Finally, the combined features are classified by Support Vector Machine (SVM). The proposed method is evaluated on several challenging databases such as Cohn-Kanade database (CK+), Japanese Female Facial Expressions database (JAFFE), and MMI database; experimental results of seven emotion state (neutral, joy, sadness, surprise, anger, fear, and disgust) show that the proposed framework is effective and accurate.

FACIAL EXPRESSION RECOGNITION BASED ON LOCAL BINARY PATTERN FEATURES AND SUPPORT VECTOR MACHINE

2014 ◽  
Vol 28 (06) ◽  
pp. 1456012 ◽  
Author(s):  
NHAN THI CAO ◽  
AN HOA TON-THAT ◽  
HYUNG IL CHOI
Keyword(s):  
Support Vector Machine ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Communication Systems ◽  
Local Binary Pattern ◽  
Recognition Rate ◽  
Support Vector ◽  
Expression Recognition ◽  
Face Images ◽  
Intelligent Communication

Facial expression recognition has been researched much in recent years because of their applications in intelligent communication systems. Many methods have been developed based on extracting Local Binary Pattern (LBP) features associating different classifying techniques in order to get more and more better effects of facial expression recognition. In this work, we propose a novel method for recognizing facial expressions based on Local Binary Pattern features and Support Vector Machine with two effective improvements. First is the preprocessing step and second is the method of dividing face images into nonoverlap square regions for extracting LBP features. The method was experimented on three typical kinds of database: small (213 images), medium (2040 images) and large (5130 images). Experimental results show the effectiveness of our method for obtaining remarkably better recognition rate in comparison with other methods.

scholarly journals Iranian kinect face database (IKFDB): a color-depth based face database collected by kinect v.2 sensor

2021 ◽  
Vol 3 (1) ◽  
Author(s):  
Seyed Muhammad Hossein Mousavi ◽  
S. Younes Mirinezhad
Keyword(s):  
Neural Network ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Depth Image ◽  
Sensor Technology ◽  
Support Vector ◽  
Expression Recognition ◽  
Face Database ◽  
Depth Data ◽  
Color Depth

AbstractThis study presents a new color-depth based face database gathered from different genders and age ranges from Iranian subjects. Using suitable databases, it is possible to validate and assess available methods in different research fields. This database has application in different fields such as face recognition, age estimation and Facial Expression Recognition and Facial Micro Expressions Recognition. Image databases based on their size and resolution are mostly large. Color images usually consist of three channels namely Red, Green and Blue. But in the last decade, another aspect of image type has emerged, named “depth image”. Depth images are used in calculating range and distance between objects and the sensor. Depending on the depth sensor technology, it is possible to acquire range data differently. Kinect sensor version 2 is capable of acquiring color and depth data simultaneously. Facial expression recognition is an important field in image processing, which has multiple uses from animation to psychology. Currently, there is a few numbers of color-depth (RGB-D) facial micro expressions recognition databases existing. With adding depth data to color data, the accuracy of final recognition will be increased. Due to the shortage of color-depth based facial expression databases and some weakness in available ones, a new and almost perfect RGB-D face database is presented in this paper, covering Middle-Eastern face type. In the validation section, the database will be compared with some famous benchmark face databases. For evaluation, Histogram Oriented Gradients features are extracted, and classification algorithms such as Support Vector Machine, Multi-Layer Neural Network and a deep learning method, called Convolutional Neural Network or are employed. The results are so promising.

Sign in / Sign up

Export Citation Format

Share Document