System of automatic analysis of methods for recognizing the emotional state of a person

2021 ◽  
Author(s):  
A.I. Vlasov ◽  
I.T. Larionov ◽  
A.N. Orekhov ◽  
L.V. Tetik
Keyword(s):  
Neural Networks ◽  
Emotional State ◽  
Hopfield Neural Network ◽  
Remote Work ◽  
Automated Recognition ◽  
Active Systems ◽  
Social Sphere ◽  
Self Employment ◽  
The Face ◽  
Complex Features

The introduction of methods and means of digital transformation of industry and the social sphere poses new challenges. One of these tasks is the management of active systems, in which simple registration and identification of the initiators of actions is not enough, but a deeper assessment of their state, including psychophysical and emotional, is required. The article is devoted to the analysis of methods and means of recognizing the emotional state of a person. Approaches to automated recognition of a person's emotional state based on primary, secondary and more complex features are analyzed. The main focus is on a comprehensive approach to recognition of a person's emotional state based on the analysis of visual and audio channels using neural networks and computer psyche algorithms. The target of the article is a formalization of methods and development of means to recognize a person's emotional state according to complex audiovisual criteria. Analyzed software for recognizing the emotional state of a person: FaceReaderNoldus, EmoDetect, FaceSecurity, Microsoft Oxford Project Emotion Recognition, eMotion Software, MMER_FEASy. Methods used to recognize the emotional state of a person by his face have been investigated, such as: the method of basic components, the Viola-Jones method, template comparison, the Hopfield neural network, the method based on the localization of key points on the face and the method based on texture information. Separately analyzed methods of recognizing the emotional state of a person from his speech. invention proposes a solution for multilevel recognition of emotional state of a person based on using algorithms of neural networks and computer psyche. Software for recognizing the emotional state of a person was analyzed: the developed approach can be used for various digital applications, ranging from the analysis of the psychophysiological and emotional state of a person - an operator (pilot, driver, etc.), to multimedia mobile applications for analyzing the emotional state of an interlocutor. The trend for remote work and self-employment opens up such areas of application of these applications as consulting psychologists, interviewing online, optimizing the human resources of companies and organizations. Prospects for using the latest versions of emotional analyzers are shown.

Methods for Monitoring the Psychophysiological State of a Human Operator via Emotions Reflected in Facial Expressions and Analysis of Blinking Characteristics using Deep Convolutional Neural Networks

2021 ◽  
pp. 120-134
Author(s):  
O.N. Korsun ◽  
V.N. Yurko
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Physiological State ◽  
Human Operator ◽  
Deep Convolutional Neural Networks ◽  
Automated Recognition ◽  
The Neural Network ◽  
Psychophysiological State ◽  
The Face ◽  
Flight Parameters

We analysed two approaches to estimating the state of a human operator according to video imaging of the face. These approaches, both using deep convolutional neural networks, are as follows: 1) automated emotion recognition; 2) analysis of blinking characteristics. The study involved assessing changes in the functional state of a human operator performing a manual landing in a flight simulator. During this process, flight parameters were recorded, and the operator’s face was filmed. Then we used our custom software to perform automated recognition of emotions (blinking), synchronising the emotions (blinking) recognised to the flight parameters recorded. As a result, we detected persistent patterns linking the operator fatigue level to the number of emotions recognised by the neural network. The type of emotion depends on unique psychological characteristics of the operator. Our experiments allow for easily tracing these links when analysing the emotions of "Sadness", "Fear" and "Anger". The study revealed a correlation between blinking properties and piloting accuracy. A higher piloting accuracy meant more blinks recorded, which may be explained by a stable psycho-physiological state leading to confident piloting

scholarly journals Features of Providing Psychological Assistance to Relatives of Patients in an Infectious Hospital when Working with COVID-19

2020 ◽  
Vol 100 (6) ◽  
pp. 4-13
Author(s):  
A.D. Aizenshtein ◽  
D.D. Volovik ◽  
R.A. Abdurakhmanov ◽  
I.A. Kirova ◽  
A.A. Korneeva ◽  
...  
Keyword(s):  
Emotional State ◽  
Psychological Support ◽  
Remote Work ◽  
Course Of Illness ◽  
Face To Face ◽  
Psychological Service ◽  
Lack Of Information ◽  
The Face ◽  
Psychological Assistance ◽  
Severity Of The Disease

The article summarizes the experience of the psychological service of the “FSMN” of the FMBA of Russia with relatives of patients during the conversion of the center to an infectious hospital for the treatment of a new coronavirus infection. The restriction of communication between family members and a sick relative (visiting specialized medical institutions working with Covid‑19 is prohibited), aswell as with treating doctors working in the “red” zone, necessitated the organization of not only informational, but also psychological support for relatives of patients with Covid‑19. The lack of information in relatives of patients is accompanied by various psychological and behavioral reactions (increased levels of anxiety, fear, aggressive behavior, etc.), and this has determined the key tasks of psychological work with relatives: informing, providing emotional support, and stabilizing the emotional state. Face-to-face and remote work formats were developed to provide psychological support for patients ‘ relatives. Based on our experience, we can say that the emotional state of relatives largely depended on the severity of the disease in their relatives who were being treated. With a mild course of illness, relatives, as a rule, were more in demand for a remote format of psychological assistance, the main purpose of which was to inform. The face-to-face format of work with a psychologist was more popular and showed greater effectiveness for those relatives whose relatives were in a more serious condition, were transferred to the intensive care unit, as well as for relatives of the deceased.

FACE RECOGNITION USING FUZZY INFERENCE SYSTEM

2009 ◽  
Vol 8 (3) ◽  
pp. 887-897
Author(s):  
Vishal Paika ◽  
Er. Pankaj Bhambri
Keyword(s):  
Neural Networks ◽  
Fuzzy Inference ◽  
Facial Features ◽  
Facial Appearance ◽  
Feature Points ◽  
Inference System ◽  
Detection Techniques ◽  
The Face ◽  
Hair Style ◽  
Facial Images

The face is the feature which distinguishes a person. Facial appearance is vital for human recognition. It has certain features like forehead, skin, eyes, ears, nose, cheeks, mouth, lip, teeth etc which helps us, humans, to recognize a particular face from millions of faces even after a large span of time and despite large changes in their appearance due to ageing, expression, viewing conditions and distractions such as disfigurement of face, scars, beard or hair style. A face is not merely a set of facial features but is rather but is rather something meaningful in its form.In this paper, depending on the various facial features, a system is designed to recognize them. To reveal the outline of the face, eyes, ears, nose, teeth etc different edge detection techniques have been used. These features are extracted in the term of distance between important feature points. The feature set obtained is then normalized and are feed to artificial neural networks so as to train them for reorganization of facial images.

scholarly journals Convolutional Neural Networks for Semantic Segmentation as a Tool for Multiclass Face Analysis in Thermal Infrared

2021 ◽  
Vol 40 (1) ◽  
Author(s):  
David Müller ◽  
Andreas Ehlen ◽  
Bernd Valeske
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Semantic Segmentation ◽  
Thermal Infrared ◽  
Relative Temperature ◽  
Face Analysis ◽  
Image Translation ◽  
The Face ◽  
Live Image ◽  
Quantitative Thermography

AbstractConvolutional neural networks were used for multiclass segmentation in thermal infrared face analysis. The principle is based on existing image-to-image translation approaches, where each pixel in an image is assigned to a class label. We show that established networks architectures can be trained for the task of multiclass face analysis in thermal infrared. Created class annotations consisted of pixel-accurate locations of different face classes. Subsequently, the trained network can segment an acquired unknown infrared face image into the defined classes. Furthermore, face classification in live image acquisition is shown, in order to be able to display the relative temperature in real-time from the learned areas. This allows a pixel-accurate temperature face analysis e.g. for infection detection like Covid-19. At the same time our approach offers the advantage of concentrating on the relevant areas of the face. Areas of the face irrelevant for the relative temperature calculation or accessories such as glasses, masks and jewelry are not considered. A custom database was created to train the network. The results were quantitatively evaluated with the intersection over union (IoU) metric. The methodology shown can be transferred to similar problems for more quantitative thermography tasks like in materials characterization or quality control in production.

scholarly journals Convolutional Neural Networks and Geometric Moments to Identify the Bilateral Symmetric Midplane in Facial Skeletons from CT Scans

Biology ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 182
Author(s):  
Rodrigo Dalvit Carvalho da Silva ◽  
Thomas Richard Jenkyn ◽  
Victor Alexander Carranza
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Surgical Planning ◽  
Good Accuracy ◽  
Bilateral Symmetry ◽  
Ct Scans ◽  
Facial Skeleton ◽  
Intact Side ◽  
Geometric Moments ◽  
The Face

In reconstructive craniofacial surgery, the bilateral symmetry of the midplane of the facial skeleton plays an important role in surgical planning. Surgeons can take advantage of the intact side of the face as a template for the malformed side by accurately locating the midplane to assist in the preparation of the surgical procedure. However, despite its importance, the location of the midline is still a subjective procedure. The aim of this study was to present a 3D technique using a convolutional neural network and geometric moments to automatically calculate the craniofacial midline symmetry of the facial skeleton from CT scans. To perform this task, a total of 195 skull images were assessed to validate the proposed technique. In the symmetry planes, the technique was found to be reliable and provided good accuracy. However, further investigations to improve the results of asymmetric images may be carried out.

scholarly journals Nonlinear Dynamics and Chaos in Fractional-Order Hopfield Neural Networks with Delay

2013 ◽  
Vol 2013 ◽  
pp. 1-9 ◽  
Author(s):  
Xia Huang ◽  
Zhen Wang ◽  
Yuxia Li
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Fractional Order ◽  
Hopfield Neural Network ◽  
Hopfield Neural Networks ◽  
Phase Portraits ◽  
Chaotic Attractors ◽  
Chaotic Motions ◽  
Dynamical Behaviors ◽  
Nonlinear Dynamics And Chaos

A fractional-order two-neuron Hopfield neural network with delay is proposed based on the classic well-known Hopfield neural networks, and further, the complex dynamical behaviors of such a network are investigated. A great variety of interesting dynamical phenomena, including single-periodic, multiple-periodic, and chaotic motions, are found to exist. The existence of chaotic attractors is verified by the bifurcation diagram and phase portraits as well.

scholarly journals An Optimal Model of Financial Distress Prediction: A Comparative Study between Neural Networks and Logistic Regression

Risks ◽  
2021 ◽  
Vol 9 (11) ◽  
pp. 200
Author(s):  
Youssef Zizi ◽  
Amine Jamali-Alaoui ◽  
Badreddine El Goumi ◽  
Mohamed Oudgou ◽  
Abdeslam El Moudden
Keyword(s):  
Neural Networks ◽  
Logistic Regression ◽  
Financial Distress ◽  
Prediction Models ◽  
Type I ◽  
Return On Assets ◽  
Logistic Regression Models ◽  
The Face ◽  
One Year ◽  
Type Ii Errors

In the face of rising defaults and limited studies on the prediction of financial distress in Morocco, this article aims to determine the most relevant predictors of financial distress and identify its optimal prediction models in a normal Moroccan economic context over two years. To achieve these objectives, logistic regression and neural networks are used based on financial ratios selected by lasso and stepwise techniques. Our empirical results highlight the significant role of predictors, namely interest to sales and return on assets in predicting financial distress. The results show that logistic regression models obtained by stepwise selection outperform the other models with an overall accuracy of 93.33% two years before financial distress and 95.00% one year prior to financial distress. Results also show that our models classify distressed SMEs better than healthy SMEs with type I errors lower than type II errors.

scholarly journals TRANSFORMATION OF LABOR RELATIONS BASED ON GIG-ECONOMY IN CONDITIONS OF DIGITALIZATION OF ECONOMIC SYSTEMS

2021 ◽  
Vol 9 (1) ◽  
pp. 96-106
Author(s):  
YUliya Polozhyentsyeva ◽  
A. Stepanova
Keyword(s):  
Service Sector ◽  
Business Processes ◽  
Labor Relations ◽  
Remote Work ◽  
Gig Economy ◽  
Spare Time ◽  
Entrepreneurial Organization ◽  
Flexible Schedule ◽  
The Face ◽  
Expert Assessments

The decline in the growth rate of the country's economy leads to an increase in the interest of various sectors of society in the search for effective ways of organizing work in the face of increasing universal digitalization. In the post-pandemic world, the able-bodied population needs new ways of earning money, the opportunity to work in their spare time, the presence of a flexible schedule, as employers are increasingly striving to optimize the costs of business processes, including personnel. Therefore, domestic employers are waiting for the development and growth of the institution of freelance, which requires an active restructuring of labor relations. The application of the gig economy as a new socio-economic model of entrepreneurial organization has influenced the emergence of modern forms of labor organization, such as outsourcing, subcontracting, freelance, remote work, outstaffing, which represent the possibility of partial employment. Such forms of labor relations are mainly in demand in the service sector and IT organizations. The aim of the study is to study the directions of transformation of forms of organization of labor activity in domestic and foreign business in conditions of transition to gig-economy. The study analyzed the development prospects of gig-economy as one of the directions of digital transformation of the economy. Also, on the basis of a synthesis of expert assessments and surveys of the population, features and prospects for the development of freelance in Russia were formed. Based on the study, the following main results were obtained: the main trends in the development of the gig economy were identified; analyzed the theoretical and practical aspects of the development of gig-economy as one of the developing areas of the digital economy; statistical assessment of the studied direction is given; the problems of organization of freelance in conditions of gig-economy are covered.

scholarly journals Strategi Filosofis Masyarakat Jepang Dalam Mengatasi Dilema Budaya Kerja Di Masa Pandemi Covid-19

KIRYOKU ◽  
2021 ◽  
Vol 5 (1) ◽  
pp. 159-164
Author(s):  
Iriyanto Widisuseno
Keyword(s):  
Japanese Society ◽  
Economic Recession ◽  
Developed Countries ◽  
Work Culture ◽  
Remote Work ◽  
Japanese People ◽  
Social Phenomena ◽  
The People ◽  
The Face ◽  
Normative Rule

For the Japanese people, the remote work policy which aims to break the chain of the spread of the Corona-19 Virus is a cultural dilemma, because it clashes with the work culture of the people who have a strong work ethic. But in fact, Japan's economic recession rate is not as bad as other developed countries, such as America, China, and Korea. The death rate from Covid-19 is very low. Currently, Japan has started to return to the normal national economy. The mystery behind it all in Japan is the factor of superior immunity or cultural superiority. The assumption is, if because of the cultural superiority factor, what are the basic values that underlie the formation of behavior and culture of Japanese society. This philosophical qualitative study aims to examine philosophical strategies: what are the basic values that underlie the way Japanese people think and behave in the face of the Covid-19 pandemic, how to properly solve problems (epistemology), and what normative rules are used to give direction to achieve goals (axiology). Through philosophical descriptive methods, this research can reveal the philosophical values (ontological, epistemological, axiological) behind social phenomena in Japanese society. The results of the study show that Japanese people hold firmly to the value of discipline as an ontological footing, the samurai is used as a way to solve problems, the value of harmony as a normative rule that gives direction to the achievement of goals. The benefits of this research provide enlightenment for the community about understanding the basic problems in society that are often neglected, while many people only focus on the surface of the problem that causes failure to understand.

scholarly journals Peculiarities of Employment Relations in Ukraine for the Period of Established Quarantine (Covid-19)

2020 ◽  
Vol 24 (1) ◽  
pp. 151-156
Author(s):  
T. Pisоchenkо ◽  
◽  
S. Agafonova ◽  
Keyword(s):  
Labor Relations ◽  
Working Hours ◽  
Remote Work ◽  
The People ◽  
Labor Legislation ◽  
Unpaid Leave ◽  
The Face ◽  
Part Time ◽  
The Right ◽  
Restrictive Measures

Annotation. Introduction. The author investigates in his article the main drawbacks of the Ukrainian legislative base that may cause difficulties for employers and employees during the COVID-19 pandemic. While reading this article you will find several solutions on how to limit salary expenses of you company or firm, lead in remote or part-time working schedule on the enterprise and grant employees unpaid leave. The article also deals with the procedure of the paper work that should be done while processing sick leaves of the people who suffered from the COVID-19 disease or contacted with the COVID-19 patients. Purpоse. The purpose of this article is to identify the shortcomings of labor legislation during quarantine and restrictive measures related to the spread of coronavirus disease (COVID-19). Consider and analyze new approaches in building labor relations between employees and employers in the face of rising unemployment and the introduction of telework. Results. The pandemic covered 210 countries and territories. Studies have shown that tens of millions of people have lost their jobs. According to various social survey centers, every third company surveyed optimized the payroll, sent employees to remote work with a reduction in wages, reduced staff and transferred some workers to contracts. Today it is possible to exercise the right to receive partial unemployment benefits for insured workers who have lost part of their wages due to forced downtime or reduction of working hours due to quarantine. Cоnclusiоns. Today, much responsibility lies with the subjects of labor relations, much depends on the employees and employers, on their responsibility and charity. State aid to those categories that were more vulnerable during the crisis remains important. Financial assistance can take the form of grants and grace periods on outstanding loans – in order to support and overcome the profitability crisis. Keywоrds: labor relations; pandemic; wages; COVID-19.

Sign in / Sign up

Export Citation Format

Share Document