scholarly journals Ensemble Learning of Hybrid Acoustic Features for Speech Emotion Recognition

Algorithms ◽  
2020 ◽  
Vol 13 (3) ◽  
pp. 70 ◽  
Author(s):  
Kudakwashe Zvarevashe ◽  
Oludayo Olugbara
Keyword(s):  
Emotion Recognition ◽  
Ensemble Learning ◽  
Automatic Recognition ◽  
Speech Emotion Recognition ◽  
Spectral Features ◽  
Intelligent Robot ◽  
Acoustic Features ◽  
Random Decision Forest ◽  
Facial Images ◽  
Decision Forest

Automatic recognition of emotion is important for facilitating seamless interactivity between a human being and intelligent robot towards the full realization of a smart society. The methods of signal processing and machine learning are widely applied to recognize human emotions based on features extracted from facial images, video files or speech signals. However, these features were not able to recognize the fear emotion with the same level of precision as other emotions. The authors propose the agglutination of prosodic and spectral features from a group of carefully selected features to realize hybrid acoustic features for improving the task of emotion recognition. Experiments were performed to test the effectiveness of the proposed features extracted from speech files of two public databases and used to train five popular ensemble learning algorithms. Results show that random decision forest ensemble learning of the proposed hybrid acoustic features is highly effective for speech emotion recognition.

scholarly journals Speech Emotion Recognition System

2021 ◽  
pp. 156-159
Author(s):  
Sourabh Suke ◽  
Ganesh Regulwar ◽  
Nikesh Aote ◽  
Pratik Chaudhari ◽  
Rajat Ghatode ◽  
...  
Keyword(s):  
Emotion Recognition ◽  
Automobile Industry ◽  
Emotional State ◽  
Recognition System ◽  
Classification Model ◽  
General Idea ◽  
Speech Emotion Recognition ◽  
Support Vector ◽  
Emotional Speech ◽  
Acoustic Features

This project describes "VoiEmo- A Speech Emotion Recognizer", a system for recognizing the emotional state of an individual from his/her speech. For example, one's speech becomes loud and fast, with a higher and wider range in pitch, when in a state of fear, anger, or joy whereas human voice is generally slow and low pitched in sadness and tiredness. We have particularly developed a classification model speech emotion detection based on Convolutional neural networks (CNNs), Support Vector Machine (SVM), Multilayer Perceptron (MLP) Classification which make predictions considering the acoustic features of speech signal such as Mel Frequency Cepstral Coefficient (MFCC). Our models have been trained to recognize seven common emotions (neutral, calm, happy, sad, angry, fearful, disgust, surprise). For training and testing the model, we have used relevant data from the Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS) dataset and the Toronto Emotional Speech Set (TESS) Dataset. The system is advantageous as it can provide a general idea about the emotional state of the individual based on the acoustic features of the speech irrespective of the language the speaker speaks in, moreover, it also saves time and effort. Speech emotion recognition systems have their applications in various fields like in call centers and BPOs, criminal investigation, psychiatric therapy, the automobile industry, etc.

Novel acoustic features for speech emotion recognition

2009 ◽  
Vol 52 (7) ◽  
pp. 1838-1848 ◽  
Author(s):  
Yong-Wan Roh ◽  
Dong-Ju Kim ◽  
Woo-Seok Lee ◽  
Kwang-Seok Hong
Keyword(s):  
Emotion Recognition ◽  
Speech Emotion Recognition ◽  
Acoustic Features

Emotion Recognition from Speech Signals Using Elicited Data and Fuzzy KDA

2013 ◽  
Vol 385-386 ◽  
pp. 1385-1388
Author(s):  
Yong Qiang Bao ◽  
Li Zhao ◽  
Cheng Wei Hang
Keyword(s):  
Discriminant Analysis ◽  
Emotion Recognition ◽  
Real World ◽  
Recognition Rate ◽  
Experimental Results ◽  
Speech Emotion Recognition ◽  
Acoustic Features ◽  
Reliable System ◽  
Kernel Discriminant Analysis ◽  
Real World Applications

In this paper we introduced the application of Fuzzy KDA in speech emotion recognition using elicited data. The emotional data induced in a psychology experiment. The acted data is not suitable for developing real world applications and by using more naturalistic data we may build more reliable system. The emotional feature set is then constructed for modeling and recognition. A total of 372 low level acoustic features are used and kernel discriminant analysis is used for emotion recognition. The experimental results show a promising recognition rate.

scholarly journals Cross corpus multi-lingual speech emotion recognition using ensemble learning

2021 ◽  
Author(s):  
Wisha Zehra ◽  
Abdul Rehman Javed ◽  
Zunera Jalil ◽  
Habib Ullah Khan ◽  
Thippa Reddy Gadekallu
Keyword(s):  
Emotion Recognition ◽  
Ensemble Learning ◽  
Emotional Response ◽  
Machine Learning Algorithms ◽  
Majority Voting ◽  
Service Robots ◽  
Speech Emotion Recognition ◽  
Learning Approach ◽  
German Data ◽  
And Training

AbstractReceiving an accurate emotional response from robots has been a challenging task for researchers for the past few years. With the advancements in technology, robots like service robots interact with users of different cultural and lingual backgrounds. The traditional approach towards speech emotion recognition cannot be utilized to enable the robot and give an efficient and emotional response. The conventional approach towards speech emotion recognition uses the same corpus for both training and testing of classifiers to detect accurate emotions, but this approach cannot be generalized for multi-lingual environments, which is a requirement for robots used by people all across the globe. In this paper, a series of experiments are conducted to highlight an ensemble learning effect using a majority voting technique for cross-corpus, multi-lingual speech emotion recognition system. A comparison of the performance of an ensemble learning approach against traditional machine learning algorithms is performed. This study tests a classifier’s performance trained on one corpus with data from another corpus to evaluate its efficiency for multi-lingual emotion detection. According to experimental analysis, different classifiers give the highest accuracy for different corpora. Using an ensemble learning approach gives the benefit of combining all classifiers’ effect instead of choosing one classifier and compromising certain language corpus’s accuracy. Experiments show an increased accuracy of 13% for Urdu corpus, 8% for German corpus, 11% for Italian corpus, and 5% for English corpus from with-in corpus testing. For cross-corpus experiments, an improvement of 2% when training on Urdu data and testing on German data and 15% when training on Urdu data and testing on Italian data is achieved. An increase of 7% in accuracy is obtained when testing on Urdu data and training on German data, 3% when testing on Urdu data and training on Italian data, and 5% when testing on Urdu data and training on English data. Experiments prove that the ensemble learning approach gives promising results against other state-of-the-art techniques.

scholarly journals Survey of Deep Representation Learning for Speech Emotion Recognition

2021 ◽  
Author(s):  
Siddique Latif ◽  
Rajib Rana ◽  
Sara Khalifa ◽  
Raja Jurdak ◽  
Junaid Qadir ◽  
...  
Keyword(s):  
Emotion Recognition ◽  
General Setting ◽  
Representation Learning ◽  
Data Driven ◽  
Speech Emotion Recognition ◽  
Feature Engineering ◽  
Acoustic Features ◽  
Learning Techniques ◽  
Comprehensive Survey ◽  
Hierarchical Representations

<div>Traditionally, speech emotion recognition (SER) research has relied on manually handcrafted acoustic features using feature engineering. However, the design of handcrafted features for complex SER tasks requires significant manual effort, which impedes generalisability and slows the pace of innovation. This has motivated the adoption of representation learning techniques that can automatically learn an intermediate representation of the input signal without any manual feature engineering. Representation learning has led to improved SER performance and enabled rapid innovation. Its effectiveness has further increased with advances in deep learning (DL), which has facilitated deep representation learning where hierarchical representations are automatically learned in a data-driven manner. This paper presents the first comprehensive survey on the important topic of deep representation learning for SER. We highlight various techniques, related challenges and identify important future areas of research. Our survey bridges the gap in the literature since existing surveys either focus on SER with hand-engineered features or representation learning in the general setting without focusing on SER.</div>

Sign in / Sign up

Export Citation Format

Share Document