scholarly journals A Novel Approach on Motion Estimation for Micro-Expression Recognition Using Phase Only Correlation with All Block Search (POC-ABS)

2020 ◽  
Vol 13 (6) ◽  
pp. 546-559
Author(s):  
Ulla Rosiani ◽  
◽  
Priska Choirina ◽  
Niyalatul Muna ◽  
Eko Mulyanto ◽  
...  
Keyword(s):  
Motion Vector ◽  
Block Matching ◽  
Expression Recognition ◽  
Motion Feature ◽  
Novel Approach ◽  
The Face ◽  
Casme Ii ◽  
The Right ◽  
Performance Results ◽  
Micro Expression

Micro-expression is an expression when a person tries to held or hidden, but the leak of this emotion still occurs in one or two areas of the face or maybe a short expression that across in the whole-face. Not more than 500ms, micro-expressions can be difficult to recognize and detect where the leakage area is located. This study presents a new method to recognize and detect the subtle motion on the facial components area using Phase Only Correlation algorithm with All Block Search (POC-ABS) to estimate the motion of all block areas. This block matching method is proposed by comparing each block in the two frames to determine whether there is movement or not. If the two blocks are identical, then the motion vector value is not displayed, whereas if the blocks are non-identical, the motion vector value of the POC is displayed. The motion vector, which is as a motion feature, estimates whether or not there are movements in the same block. In order to further confirm the reliability of the proposed method, two different classifiers were used for the micro-expression recognition of the CASME II dataset. The highest performance results are for SVM at 94.3 percent and for KNN at 95.6 percent. Finally, this algorithm detects leaks of motion based on the ratio of the motion vectors. The left and right eyebrows are dominant when expressing disgust, sadness, and surprise. Meanwhile, the movements of the right eye and left eye were the most dominant when the happiness expression.

scholarly journals Spatiotemporal Convolutional Neural Network with Convolutional Block Attention Module for Micro-Expression Recognition

Information ◽  
2020 ◽  
Vol 11 (8) ◽  
pp. 380
Author(s):  
Boyu Chen ◽  
Zhihao Zhang ◽  
Nian Liu ◽  
Yang Tan ◽  
Xinyu Liu ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Three Dimensional ◽  
Expression Recognition ◽  
Learning Framework ◽  
The Face ◽  
3D Cnn ◽  
Visual Attention Mechanism ◽  
Casme Ii ◽  
Micro Expression

A micro-expression is defined as an uncontrollable muscular movement shown on the face of humans when one is trying to conceal or repress his true emotions. Many researchers have applied the deep learning framework to micro-expression recognition in recent years. However, few have introduced the human visual attention mechanism to micro-expression recognition. In this study, we propose a three-dimensional (3D) spatiotemporal convolutional neural network with the convolutional block attention module (CBAM) for micro-expression recognition. First image sequences were input to a medium-sized convolutional neural network (CNN) to extract visual features. Afterwards, it learned to allocate the feature weights in an adaptive manner with the help of a convolutional block attention module. The method was testified in spontaneous micro-expression databases (Chinese Academy of Sciences Micro-expression II (CASME II), Spontaneous Micro-expression Database (SMIC)). The experimental results show that the 3D CNN with convolutional block attention module outperformed other algorithms in micro-expression recognition.

The influence of operational excellence on the culture and agility of organizations: evidence from industry

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
André M. Carvalho ◽  
Paulo Sampaio ◽  
Eric Rebentisch ◽  
João Álvaro Carvalho ◽  
Pedro Saraiva
Keyword(s):  
Organizational Behavior ◽  
Organizational Dynamics ◽  
Organizational Agility ◽  
Content Type ◽  
Business Environments ◽  
Cultural Paradigm ◽  
Novel Approach ◽  
The Face ◽  
The Right ◽  
Operational Excellence

PurposeThis article offers a novel approach that brings together management, engineering and organizational behavior. It focuses on the understanding of organizational dynamics in an era of technological change, upholding the importance of organizational agility and of the cultural paradigm in the management of organizations.Design/methodology/approachIn this work, the authors present the conclusions from a set of studies carried out in organizations operating in technical and technological industries. The authors assessed the capabilities of these organizations in terms of operational excellence maturity and its impact on the organizational culture and organizational agility.FindingsResults show the importance of operational excellence either in developing or expanding organizational agility capabilities while reinforcing the cruciality of an excellence-oriented culture to sustain these efforts over time.Originality/valueIncreasingly unstable business environments have led to a growing interest in how to develop and maintain operational excellence in the face of continued and disruptive change. However, this interest has, so far, been advanced with little empirical evidence to support the corresponding predictions. This work offers the first practical evidence that continued focus and optimization of operations, with the right cultural alignment, helps organizations survive and thrive in increasingly volatile, uncertain, complex and ambiguous environments.

scholarly journals An Improved Micro-Expression Recognition Method Based on Necessary Morphological Patches

Symmetry ◽  
2019 ◽  
Vol 11 (4) ◽  
pp. 497 ◽  
Author(s):  
Yue Zhao ◽  
Jiancheng Xu
Keyword(s):  
Optical Flow ◽  
Support Vector ◽  
Svm Classifier ◽  
Expression Recognition ◽  
Optical Flow Method ◽  
Psychological Analysis ◽  
Emotional Representation ◽  
Discriminant Ability ◽  
Casme Ii ◽  
Micro Expression

Micro-expression is a spontaneous emotional representation that is not controlled by logic. A micro-expression is both transitory (short duration) and subtle (small intensity), so it is difficult to detect in people. Micro-expression detection is widely used in the fields of psychological analysis, criminal justice and human-computer interaction. Additionally, like traditional facial expressions, micro-expressions also have local muscle movement. Psychologists have shown micro-expressions have necessary morphological patches (NMPs), which are triggered by emotion. Furthermore, the objective of this paper is to sort and filter these NMPs and extract features from NMPs to train classifiers to recognize micro-expressions. Firstly, we use the optical flow method to compare the on-set frame and the apex frame of the micro-expression sequences. By doing this, we could find facial active patches. Secondly, to find the NMPs of micro-expressions, this study calculates the local binary pattern from three orthogonal planes (LBP-TOP) operators and cascades them with optical flow histograms to form the fusion features of the active patches. Finally, a random forest feature selection (RFFS) algorithm is used to identify the NMPs and to characterize them via support vector machine (SVM) classifier. We evaluated the proposed method on two popular publicly available databases: CASME II and SMIC. Results show that NMPs are statistically determined and contribute to significant discriminant ability instead of holistic utilization of all facial regions.

scholarly journals Objective Classes for Micro-Facial Expression Recognition

2018 ◽  
Vol 4 (10) ◽  
pp. 119 ◽  
Author(s):  
Adrian Davison ◽  
Walied Merghani ◽  
Moi Yap
Keyword(s):  
Facial Expressions ◽  
Local Binary Patterns ◽  
Expression Recognition ◽  
Coding System ◽  
Histogram Of Oriented Gradient ◽  
Action Units ◽  
Self Reports ◽  
Casme Ii ◽  
Academy Of Sciences ◽  
Micro Expression

Micro-expressions are brief spontaneous facial expressions that appear on a face when a person conceals an emotion, making them different to normal facial expressions in subtlety and duration. Currently, emotion classes within the CASME II dataset (Chinese Academy of Sciences Micro-expression II) are based on Action Units and self-reports, creating conflicts during machine learning training. We will show that classifying expressions using Action Units, instead of predicted emotion, removes the potential bias of human reporting. The proposed classes are tested using LBP-TOP (Local Binary Patterns from Three Orthogonal Planes), HOOF (Histograms of Oriented Optical Flow) and HOG 3D (3D Histogram of Oriented Gradient) feature descriptors. The experiments are evaluated on two benchmark FACS (Facial Action Coding System) coded datasets: CASME II and SAMM (A Spontaneous Micro-Facial Movement). The best result achieves 86.35% accuracy when classifying the proposed 5 classes on CASME II using HOG 3D, outperforming the result of the state-of-the-art 5-class emotional-based classification in CASME II. Results indicate that classification based on Action Units provides an objective method to improve micro-expression recognition.

scholarly journals Multi-scale joint feature network for micro-expression recognition

2021 ◽  
Author(s):  
Xinyu Li ◽  
Guangshun Wei ◽  
Jie Wang ◽  
Yuanfeng Zhou
Keyword(s):  
Optical Flow ◽  
Expression Recognition ◽  
Facial Motion ◽  
Multi Scale ◽  
Flow Image ◽  
Wide Range ◽  
Recognition Ability ◽  
Benchmark Datasets ◽  
Casme Ii ◽  
Micro Expression

AbstractMicro-expression recognition is a substantive cross-study of psychology and computer science, and it has a wide range of applications (e.g., psychological and clinical diagnosis, emotional analysis, criminal investigation, etc.). However, the subtle and diverse changes in facial muscles make it difficult for existing methods to extract effective features, which limits the improvement of micro-expression recognition accuracy. Therefore, we propose a multi-scale joint feature network based on optical flow images for micro-expression recognition. First, we generate an optical flow image that reflects subtle facial motion information. The optical flow image is then fed into the multi-scale joint network for feature extraction and classification. The proposed joint feature module (JFM) integrates features from different layers, which is beneficial for the capture of micro-expression features with different amplitudes. To improve the recognition ability of the model, we also adopt a strategy for fusing the feature prediction results of the three JFMs with the backbone network. Our experimental results show that our method is superior to state-of-the-art methods on three benchmark datasets (SMIC, CASME II, and SAMM) and a combined dataset (3DB).

scholarly journals Necessary Morphological Patches Extraction for Automatic Micro-Expression Recognition

2018 ◽  
Vol 8 (10) ◽  
pp. 1811 ◽  
Author(s):  
Yue Zhao ◽  
Jiancheng Xu
Keyword(s):  
Computer Vision ◽  
Expression Recognition ◽  
Emotional States ◽  
Coding System ◽  
Entropy Weight ◽  
Facial Muscles ◽  
Rational Thought ◽  
Entropy Weight Method ◽  
Casme Ii ◽  
Micro Expression

Micro expressions are usually subtle and brief facial expressions that humans use to hide their true emotional states. In recent years, micro-expression recognition has attracted wide attention in the fields of psychology, mass media, and computer vision. The shortest micro expression lasts only 1/25 s. Furthermore, different from macro-expressions, micro-expressions have considerable low intensity and inadequate contraction of the facial muscles. Based on these characteristics, automatic micro-expression detection and recognition are great challenges in the field of computer vision. In this paper, we propose a novel automatic facial expression recognition framework based on necessary morphological patches (NMPs) to better detect and identify micro expressions. Micro expression is a subconscious facial muscle response. It is not controlled by the rational thought of the brain. Therefore, it calls on a few facial muscles and has local properties. NMPs are the facial regions that must be involved when a micro expression occurs. NMPs were screened based on weighting the facial active patches instead of the holistic utilization of the entire facial area. Firstly, we manually define the active facial patches according to the facial landmark coordinates and the facial action coding system (FACS). Secondly, we use a LBP-TOP descriptor to extract features in these patches and the Entropy-Weight method to select NMP. Finally, we obtain the weighted LBP-TOP features of these NMP. We test on two recent publicly available datasets: CASME II and SMIC database that provided sufficient samples. Compared with many recent state-of-the-art approaches, our method achieves more promising recognition results.

scholarly journals A Convolutional Neural Network for Compound Micro-Expression Recognition

Sensors ◽  
2019 ◽  
Vol 19 (24) ◽  
pp. 5553
Author(s):  
Yue Zhao ◽  
Jiancheng Xu
Keyword(s):  
Optical Flow ◽  
Mental States ◽  
Expression Recognition ◽  
Human Beings ◽  
Synthetic Compound ◽  
Flow Maps ◽  
Flow Information ◽  
Casme Ii ◽  
High Level ◽  
Micro Expression

Human beings are particularly inclined to express real emotions through micro-expressions with subtle amplitude and short duration. Though people regularly recognize many distinct emotions, for the most part, research studies have been limited to six basic categories: happiness, surprise, sadness, anger, fear, and disgust. Like normal expressions (i.e., macro-expressions), most current research into micro-expression recognition focuses on these six basic emotions. This paper describes an important group of micro-expressions, which we call compound emotion categories. Compound micro-expressions are constructed by combining two basic micro-expressions but reflect more complex mental states and more abundant human facial emotions. In this study, we firstly synthesized a Compound Micro-expression Database (CMED) based on existing spontaneous micro-expression datasets. These subtle feature of micro-expression makes it difficult to observe its motion track and characteristics. Consequently, there are many challenges and limitations to synthetic compound micro-expression images. The proposed method firstly implemented Eulerian Video Magnification (EVM) method to enhance facial motion features of basic micro-expressions for generating compound images. The consistent and differential facial muscle articulations (typically referred to as action units) associated with each emotion category have been labeled to become the foundation of generating compound micro-expression. Secondly, we extracted the apex frames of CMED by 3D Fast Fourier Transform (3D-FFT). Moreover, the proposed method calculated the optical flow information between the onset frame and apex frame to produce an optical flow feature map. Finally, we designed a shallow network to extract high-level features of these optical flow maps. In this study, we synthesized four existing databases of spontaneous micro-expressions (CASME I, CASME II, CAS(ME)2, SAMM) to generate the CMED and test the validity of our network. Therefore, the deep network framework designed in this study can well recognize the emotional information of basic micro-expressions and compound micro-expressions.

Motion correction in PET/CT

2005 ◽  
Vol 44 (S 01) ◽  
pp. S46-S50 ◽  
Author(s):  
M. Dawood ◽  
N. Lang ◽  
F. Büther ◽  
M. Schäfers ◽  
O. Schober ◽  
...  
Keyword(s):  
Optical Flow ◽  
Motion Correction ◽  
Motion Vector ◽  
Emission Tomography ◽  
Cardiac Pet ◽  
Novel Approach ◽  
Positron Emission ◽  
Pet Ct ◽  
Flow Algorithm ◽  
Motion Vector Field

Summary:Motion in PET/CT leads to artifacts in the reconstructed PET images due to the different acquisition times of positron emission tomography and computed tomography. The effect of motion on cardiac PET/CT images is evaluated in this study and a novel approach for motion correction based on optical flow methods is outlined. The Lukas-Kanade optical flow algorithm is used to calculate the motion vector field on both simulated phantom data as well as measured human PET data. The motion of the myocardium is corrected by non-linear registration techniques and results are compared to uncorrected images.

scholarly journals Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network

Sensors ◽  
2021 ◽  
Vol 21 (9) ◽  
pp. 3046
Author(s):  
Shervin Minaee ◽  
Mehdi Minaei ◽  
Amirali Abdolrashidi
Keyword(s):  
Deep Learning ◽  
Facial Expression ◽  
Facial Expression Recognition ◽  
Expression Recognition ◽  
Visualization Technique ◽  
Convolutional Network ◽  
The Past ◽  
Multiple Datasets ◽  
The Face ◽  
Traditional Approaches

Facial expression recognition has been an active area of research over the past few decades, and it is still challenging due to the high intra-class variation. Traditional approaches for this problem rely on hand-crafted features such as SIFT, HOG, and LBP, followed by a classifier trained on a database of images or videos. Most of these works perform reasonably well on datasets of images captured in a controlled condition but fail to perform as well on more challenging datasets with more image variation and partial faces. In recent years, several works proposed an end-to-end framework for facial expression recognition using deep learning models. Despite the better performance of these works, there are still much room for improvement. In this work, we propose a deep learning approach based on attentional convolutional network that is able to focus on important parts of the face and achieves significant improvement over previous models on multiple datasets, including FER-2013, CK+, FERG, and JAFFE. We also use a visualization technique that is able to find important facial regions to detect different emotions based on the classifier’s output. Through experimental results, we show that different emotions are sensitive to different parts of the face.

Sign in / Sign up

Export Citation Format

Share Document