A Hybrid Approach for Facial Expression Recognition Using Extended Local Binary Patterns and Principal Component Analysis

2021 ◽  
pp. 517-544
Author(s):  
Gopal Krishan Prajapat ◽  
Rakesh Kumar
Keyword(s):  
Principal Component Analysis ◽  
Feature Extraction ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Local Binary Pattern ◽  
Recognition Rate ◽  
Principal Component ◽  
Local Binary Patterns ◽  
Component Analysis ◽  
Expression Recognition

Facial feature extraction and recognition plays a prominent role in human non-verbal interaction and it is one of the crucial factors among pose, speech, facial expression, behaviour and actions which are used in conveying information about the intentions and emotions of a human being. In this article an extended local binary pattern is used for the feature extraction process and a principal component analysis (PCA) is used for dimensionality reduction. The projections of the sample and model images are calculated and compared by Euclidean distance method. The combination of extended local binary pattern and PCA (ELBP+PCA) improves the accuracy of the recognition rate and also diminishes the evaluation complexity. The evaluation of proposed facial expression recognition approach will focus on the performance of the recognition rate. A series of tests are performed for the validation of algorithms and to compare the accuracy of the methods on the JAFFE, Extended Cohn-Kanade images database.

A Hybrid Approach for Facial Expression Recognition Using Extended Local Binary Patterns and Principal Component Analysis

2019 ◽  
Vol 8 (2) ◽  
pp. 1-25
Author(s):  
Gopal Krishan Prajapat ◽  
Rakesh Kumar
Keyword(s):  
Principal Component Analysis ◽  
Feature Extraction ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Local Binary Pattern ◽  
Recognition Rate ◽  
Principal Component ◽  
Component Analysis ◽  
Expression Recognition ◽  
Distance Method

Facial feature extraction and recognition plays a prominent role in human non-verbal interaction and it is one of the crucial factors among pose, speech, facial expression, behaviour and actions which are used in conveying information about the intentions and emotions of a human being. In this article an extended local binary pattern is used for the feature extraction process and a principal component analysis (PCA) is used for dimensionality reduction. The projections of the sample and model images are calculated and compared by Euclidean distance method. The combination of extended local binary pattern and PCA (ELBP+PCA) improves the accuracy of the recognition rate and also diminishes the evaluation complexity. The evaluation of proposed facial expression recognition approach will focus on the performance of the recognition rate. A series of tests are performed for the validation of algorithms and to compare the accuracy of the methods on the JAFFE, Extended Cohn-Kanade images database.

scholarly journals PROSES EKSTRAKSI DAN KLASIFIKASI CITRA EMOSI MENGGUNAKAN METODE PCA DAN CNN

JOUTICA ◽  
2021 ◽  
Vol 6 (2) ◽  
pp. 484
Author(s):  
Resty Wulanningrum ◽  
Anggi Nur Fadzila ◽  
Danar Putra Pamungkas
Keyword(s):  
Neural Network ◽  
Principal Component Analysis ◽  
Facial Expression ◽  
Convolutional Neural Network ◽  
Facial Expression Recognition ◽  
Principal Component ◽  
Component Analysis ◽  
Expression Recognition

Manusia secara alami menggunakan ekspresi wajah untuk berkomunikasi dan menunjukan emosi mereka dalam berinteraksi sosial. Ekspresi wajah termasuk kedalam komunikasi non-verbal yang dapat menyampaikan keadaan emosi seseorang kepada orang yang telah mengamatinya. Penelitian ini menggunakan metode Principal Component Analysis (PCA) untuk proses ekstraksi ciri pada citra ekspresi dan metode Convolutional Neural Network (CNN) sebagai prosesi klasifikasi emosi, dengan menggunakan data Facial Expression Recognition-2013 (FER-2013) dilakukan proses training dan testing untuk menghasilkan nilai akurasi dan pengenalan emosi wajah. Hasil pengujian akhir mendapatkan nilai akurasi pada metode PCA sebesar 59,375% dan nilai akurasi pada pengujian metode CNN sebesar 59,386%.

2D Principal Component Analysis for Face and Facial-Expression Recognition

2011 ◽  
Vol 13 (3) ◽  
pp. 9-13 ◽  
Author(s):  
Luiz Oliveira ◽  
Marcelo Mansano ◽  
Alessandro Koerich ◽  
Alceu de Souza Britto
Keyword(s):  
Principal Component Analysis ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Principal Component ◽  
Component Analysis ◽  
Expression Recognition

scholarly journals Facial Expression Recognition Using Computer Vision: A Systematic Review

2019 ◽  
Vol 9 (21) ◽  
pp. 4678 ◽  
Author(s):  
Daniel Canedo ◽  
António J. R. Neves
Keyword(s):  
Systematic Review ◽  
Computer Vision ◽  
Facial Expression ◽  
Emotion Recognition ◽  
Facial Expression Recognition ◽  
Principal Component ◽  
Local Binary Patterns ◽  
Future Research ◽  
Expression Recognition ◽  
Contemporary World

Emotion recognition has attracted major attention in numerous fields because of its relevant applications in the contemporary world: marketing, psychology, surveillance, and entertainment are some examples. It is possible to recognize an emotion through several ways; however, this paper focuses on facial expressions, presenting a systematic review on the matter. In addition, 112 papers published in ACM, IEEE, BASE and Springer between January 2006 and April 2019 regarding this topic were extensively reviewed. Their most used methods and algorithms will be firstly introduced and summarized for a better understanding, such as face detection, smoothing, Principal Component Analysis (PCA), Local Binary Patterns (LBP), Optical Flow (OF), Gabor filters, among others. This review identified a clear difficulty in translating the high facial expression recognition (FER) accuracy in controlled environments to uncontrolled and pose-variant environments. The future efforts in the FER field should be put into multimodal systems that are robust enough to face the adversities of real world scenarios. A thorough analysis on the research done on FER in Computer Vision based on the selected papers is presented. This review aims to not only become a reference for future research on emotion recognition, but also to provide an overview of the work done in this topic for potential readers.

Robust Facial Expression Recognition with Low-Rank Sparse Error Dictionary Based Probabilistic Collaborative Representation Classification

2017 ◽  
Vol 26 (04) ◽  
pp. 1750017 ◽  
Author(s):  
Zhe Sun ◽  
Zheng-Ping Hu ◽  
Meng Wang ◽  
Fan Bai ◽  
Bo Sun
Keyword(s):  
Feature Extraction ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Random Noise ◽  
Local Binary Patterns ◽  
Extraction Methods ◽  
Low Rank ◽  
Collaborative Representation ◽  
Expression Recognition ◽  
Maximum Probability

The performance of facial expression recognition (FER) would be degraded due to some factors such as individual differences, Gaussian random noise and so on. Prior feature extraction methods like Local Binary Patterns (LBP) and Gabor filters require explicit expression components, which are always unavailable and difficult to obtain. To make the facial expression recognition (FER) more robust, we propose a novel FER approach based on low-rank sparse error dictionary (LRSE) to remit the side-effect caused by the problems above. Then the query samples can be represented and classified by a probabilistic collaborative representation based classifier (ProCRC), which exploits the maximum likelihood that the query sample belonging to the collaborative subspace of all classes can be better computed. The final classification is performed by seeking which class has the maximum probability. The proposed approach which exploits ProCRC associated with the LRSE features (LRSE ProCRC) for robust FER reaches higher average accuracies on the different databases (i.e., 79.39% on KDEF database, 89.54% on CAS-PEAL database, 84.45% on CK+ database etc.). In addition, our method also leads to state-of-the-art classification results from the aspect of feature extraction methods, training samples, Gaussian noise variances and classification based methods on benchmark databases.

scholarly journals On Facial Expression Recognition Benchmarks

2021 ◽  
Vol 2021 ◽  
pp. 1-20
Author(s):  
Ebenezer Owusu ◽  
Jacqueline Asor Kumi ◽  
Justice Kwame Appati
Keyword(s):  
Feature Extraction ◽  
Feature Selection ◽  
Facial Expression ◽  
Facial Expressions ◽  
Facial Expression Recognition ◽  
Principal Component ◽  
Research Area ◽  
Expression Recognition ◽  
Important Form ◽  
Fold Cross Validation

Facial expression is an important form of nonverbal communication, as it is noted that 55% of what humans communicate is expressed in facial expressions. There are several applications of facial expressions in diverse fields including medicine, security, gaming, and even business enterprises. Thus, currently, automatic facial expression recognition is a hotbed research area that attracts lots of grants and therefore the need to understand the trends very well. This study, as a result, aims to review selected published works in the domain of study and conduct valuable analysis to determine the most common and useful algorithms employed in the study. We selected published works from 2010 to 2021 and extracted, analyzed, and summarized the findings based on the most used techniques in feature extraction, feature selection, validation, databases, and classification. The result of the study indicates strongly that local binary pattern (LBP), principal component analysis (PCA), saturated vector machine (SVM), CK+, and 10-fold cross-validation are the most widely used feature extraction, feature selection, classifier, database, and validation method used, respectively. Therefore, in line with our findings, this study provides recommendations for research specifically for new researchers with little or no background as to which methods they can employ and strive to improve.

Sign in / Sign up

Export Citation Format

Share Document