scholarly journals Multi-Scale Frequency Bands Ensemble Learning for EEG-Based Emotion Recognition

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1262
Author(s):  
Fangyao Shen ◽  
Yong Peng ◽  
Wanzeng Kong ◽  
Guojun Dai
Keyword(s):  
Emotion Recognition ◽  
Ensemble Learning ◽  
Global Scale ◽  
Learning Method ◽  
Eeg Signals ◽  
Data Set ◽  
Frequency Bands ◽  
Multi Scale ◽  
Adaptive Weight ◽  
Weight Learning

Emotion recognition has a wide range of potential applications in the real world. Among the emotion recognition data sources, electroencephalography (EEG) signals can record the neural activities across the human brain, providing us a reliable way to recognize the emotional states. Most of existing EEG-based emotion recognition studies directly concatenated features extracted from all EEG frequency bands for emotion classification. This way assumes that all frequency bands share the same importance by default; however, it cannot always obtain the optimal performance. In this paper, we present a novel multi-scale frequency bands ensemble learning (MSFBEL) method to perform emotion recognition from EEG signals. Concretely, we first re-organize all frequency bands into several local scales and one global scale. Then we train a base classifier on each scale. Finally we fuse the results of all scales by designing an adaptive weight learning method which automatically assigns larger weights to more important scales to further improve the performance. The proposed method is validated on two public data sets. For the “SEED IV” data set, MSFBEL achieves average accuracies of 82.75%, 87.87%, and 78.27% on the three sessions under the within-session experimental paradigm. For the “DEAP” data set, it obtains average accuracy of 74.22% for four-category classification under 5-fold cross validation. The experimental results demonstrate that the scale of frequency bands influences the emotion recognition rate, while the global scale that directly concatenating all frequency bands cannot always guarantee to obtain the best emotion recognition performance. Different scales provide complementary information to each other, and the proposed adaptive weight learning method can effectively fuse them to further enhance the performance.

scholarly journals Emotion Recognition of EEG Signals Based on the Ensemble Learning Method: AdaBoost

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Yu Chen ◽  
Rui Chang ◽  
Jifeng Guo
Keyword(s):  
Emotion Recognition ◽  
Ensemble Learning ◽  
Binary Classification ◽  
Feature Selection Method ◽  
Learning Method ◽  
Eeg Signals ◽  
Data Set ◽  
Linear Discriminant ◽  
Time Frequency ◽  
Nonlinear Features

In recent years, with the continuous development of artificial intelligence and brain-computer interface technology, emotion recognition based on physiological signals, especially, electroencephalogram (EEG) signals, has become a popular research topic and attracted wide attention. However, how to extract effective features from EEG signals and accurately recognize them by classifiers have also become an increasingly important task. Therefore, in this paper, we propose an emotion recognition method of EEG signals based on the ensemble learning method, AdaBoost. First, we consider the time domain, time-frequency domain, and nonlinear features related to emotion, extract them from the preprocessed EEG signals, and fuse the features into an eigenvector matrix. Then, the linear discriminant analysis feature selection method is used to reduce the dimensionality of the features. Next, we use the optimized feature sets and train a classifier based on the ensemble learning method, AdaBoost, for binary classification. Finally, the proposed method has been tested in the DEAP data set on four emotional dimensions: valence, arousal, dominance, and liking. The proposed method is proved to be effective in emotion recognition, and the best average accuracy rate can reach up to 88.70% on the dominance dimension. Compared with other existing methods, the performance of the proposed method is significantly improved.

scholarly journals EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels

Sensors ◽  
2021 ◽  
Vol 21 (15) ◽  
pp. 5092
Author(s):  
Tran-Dac-Thinh Phan ◽  
Soo-Hyung Kim ◽  
Hyung-Jeong Yang ◽  
Guee-Sang Lee
Keyword(s):  
Emotion Recognition ◽  
Binary Classification ◽  
Eeg Signals ◽  
Frequency Bands ◽  
Multi Scale ◽  
Eeg Data ◽  
Crucial Information ◽  
The Time Domain ◽  
Electroencephalogram Eeg ◽  
Selection Of

Besides facial or gesture-based emotion recognition, Electroencephalogram (EEG) data have been drawing attention thanks to their capability in countering the effect of deceptive external expressions of humans, like faces or speeches. Emotion recognition based on EEG signals heavily relies on the features and their delineation, which requires the selection of feature categories converted from the raw signals and types of expressions that could display the intrinsic properties of an individual signal or a group of them. Moreover, the correlation or interaction among channels and frequency bands also contain crucial information for emotional state prediction, and it is commonly disregarded in conventional approaches. Therefore, in our method, the correlation between 32 channels and frequency bands were put into use to enhance the emotion prediction performance. The extracted features chosen from the time domain were arranged into feature-homogeneous matrices, with their positions following the corresponding electrodes placed on the scalp. Based on this 3D representation of EEG signals, the model must have the ability to learn the local and global patterns that describe the short and long-range relations of EEG channels, along with the embedded features. To deal with this problem, we proposed the 2D CNN with different kernel-size of convolutional layers assembled into a convolution block, combining features that were distributed in small and large regions. Ten-fold cross validation was conducted on the DEAP dataset to prove the effectiveness of our approach. We achieved the average accuracies of 98.27% and 98.36% for arousal and valence binary classification, respectively.

Emotion Recognition Using EEG Signals: Accuracy Comparison Between Methods and Frequency Bands

2021 ◽  
Author(s):  
Hamed Nazemi ◽  
Alireza Taheri ◽  
Ali Meghdari ◽  
Mehrdad Boroushaki ◽  
Ali Ghazizadeh
Keyword(s):  
Emotion Recognition ◽  
Eeg Signals ◽  
Frequency Bands ◽  
Accuracy Comparison

scholarly journals EEG-Based Multi-Modal Emotion Recognition using Bag of Deep Features: An Optimal Feature Selection Approach

Sensors ◽  
2019 ◽  
Vol 19 (23) ◽  
pp. 5218 ◽  
Author(s):  
Muhammad Adeel Asghar ◽  
Muhammad Jamil Khan ◽  
Fawad ◽  
Yasar Amin ◽  
Muhammad Rizwan ◽  
...  
Keyword(s):  
Emotion Recognition ◽  
Single Channel ◽  
Support Vector ◽  
Data Sets ◽  
Learning Technology ◽  
Emotional States ◽  
Eeg Signal ◽  
K Nearest Neighbor ◽  
Eeg Signals ◽  
Data Set

Much attention has been paid to the recognition of human emotions with the help of electroencephalogram (EEG) signals based on machine learning technology. Recognizing emotions is a challenging task due to the non-linear property of the EEG signal. This paper presents an advanced signal processing method using the deep neural network (DNN) for emotion recognition based on EEG signals. The spectral and temporal components of the raw EEG signal are first retained in the 2D Spectrogram before the extraction of features. The pre-trained AlexNet model is used to extract the raw features from the 2D Spectrogram for each channel. To reduce the feature dimensionality, spatial, and temporal based, bag of deep features (BoDF) model is proposed. A series of vocabularies consisting of 10 cluster centers of each class is calculated using the k-means cluster algorithm. Lastly, the emotion of each subject is represented using the histogram of the vocabulary set collected from the raw-feature of a single channel. Features extracted from the proposed BoDF model have considerably smaller dimensions. The proposed model achieves better classification accuracy compared to the recently reported work when validated on SJTU SEED and DEAP data sets. For optimal classification performance, we use a support vector machine (SVM) and k-nearest neighbor (k-NN) to classify the extracted features for the different emotional states of the two data sets. The BoDF model achieves 93.8% accuracy in the SEED data set and 77.4% accuracy in the DEAP data set, which is more accurate compared to other state-of-the-art methods of human emotion recognition.

scholarly journals Two-Level Domain Adaptation Neural Network for EEG-Based Emotion Recognition

2021 ◽  
Vol 14 ◽  
Author(s):  
Guangcheng Bao ◽  
Ning Zhuang ◽  
Li Tong ◽  
Bin Yan ◽  
Jun Shu ◽  
...  
Keyword(s):  
Neural Network ◽  
Emotion Recognition ◽  
Domain Adaptation ◽  
The Self ◽  
Eeg Signals ◽  
Transfer Experiment ◽  
Data Set ◽  
The Cross ◽  
Seed Data ◽  
Domain Transfer

Emotion recognition plays an important part in human-computer interaction (HCI). Currently, the main challenge in electroencephalogram (EEG)-based emotion recognition is the non-stationarity of EEG signals, which causes performance of the trained model decreasing over time. In this paper, we propose a two-level domain adaptation neural network (TDANN) to construct a transfer model for EEG-based emotion recognition. Specifically, deep features from the topological graph, which preserve topological information from EEG signals, are extracted using a deep neural network. These features are then passed through TDANN for two-level domain confusion. The first level uses the maximum mean discrepancy (MMD) to reduce the distribution discrepancy of deep features between source domain and target domain, and the second uses the domain adversarial neural network (DANN) to force the deep features closer to their corresponding class centers. We evaluated the domain-transfer performance of the model on both our self-built data set and the public data set SEED. In the cross-day transfer experiment, the ability to accurately discriminate joy from other emotions was high: sadness (84%), anger (87.04%), and fear (85.32%) on the self-built data set. The accuracy reached 74.93% on the SEED data set. In the cross-subject transfer experiment, the ability to accurately discriminate joy from other emotions was equally high: sadness (83.79%), anger (84.13%), and fear (81.72%) on the self-built data set. The average accuracy reached 87.9% on the SEED data set, which was higher than WGAN-DA. The experimental results demonstrate that the proposed TDANN can effectively handle the domain transfer problem in EEG-based emotion recognition.

scholarly journals Evaluation of Wigner-Ville Distribution Features to Estimate Steady-State Visual Evoked Potentials' Stimulation Frequency

2021 ◽  
pp. 133-136
Author(s):  
Murside Degirmenci ◽  
Ebru Sayilgan ◽  
Yalcin Isler
Keyword(s):  
Machine Learning ◽  
Steady State ◽  
Evoked Potentials ◽  
Ensemble Learning ◽  
Visual Evoked Potentials ◽  
Support Vector ◽  
Eeg Signals ◽  
Data Set ◽  
Time Frequency ◽  
Visual Evoked

Brain Computer Interface (BCI) is a system that enables people to communicate with the outside world and control various electronic devices by interpreting only brain activity (motor movement imagination, emotional state, any focused visual or auditory stimulus, etc.). The visual stimulation based recording is one of the most popular methods among various electroencephalography (EEG) recording methods. Steady-state visual-evoked potentials (SSVEPs) where visual objects are blinking at a fixed frequency play an important role due to their high signal-to-noise ratio and higher information transfer rate in BCI applications. However, the design of multiple (more than 3) commands systems in SSVEPs based BCI systems is limited. The different approaches are recommended to overcome these problems. In this study, an approach based on machine learning is proposed to determine stimulating frequency in SSVEP signals. The data set (AVI SSVEP Dataset) is obtained through open access from the internet for simulations. The dataset includes EEG signals that was recorded when subjects looked at a flickering frequency at seven different frequencies (6-6.5-7-7.5-8.2-9.3-10Hz). In the machine learning-based approach Wigner-Ville Distribution (WVD) is used and features are extracted using Time-Frequency (TF) representations of EEG signals. These features are classified by Decision Tree, Linear Discriminant Analysis (LDA), k-Nearest Neighbor (k-NN), Support Vector Machine (SVM), Naive Bayes, Ensemble Learning classifiers. Simulation results demonstrate that the proposed approach achieved promising accuracy rates for 7 command SSVEP systems. As a consequence, the maximum accuracy is achieved in the Ensemble Learning classifier with 47.60%.

scholarly journals An overlapping sliding window and combined features based emotion recognition system for EEG signals

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Shruti Garg ◽  
Rahul Kumar Patro ◽  
Soumyajit Behera ◽  
Neha Prerna Tigga ◽  
Ranjita Pandey
Keyword(s):  
Neural Network ◽  
Emotion Recognition ◽  
Sliding Window ◽  
Variable Length ◽  
Convolution Neural Network ◽  
Two Dimensional ◽  
Eeg Signals ◽  
Data Set ◽  
Content Type ◽  
Combined Features

PurposeThe purpose of this study is to propose an alternative efficient 3D emotion recognition model for variable-length electroencephalogram (EEG) data.Design/methodology/approachClassical AMIGOS data set which comprises of multimodal records of varying lengths on mood, personality and other physiological aspects on emotional response is used for empirical assessment of the proposed overlapping sliding window (OSW) modelling framework. Two features are extracted using Fourier and Wavelet transforms: normalised band power (NBP) and normalised wavelet energy (NWE), respectively. The arousal, valence and dominance (AVD) emotions are predicted using one-dimension (1D) and two-dimensional (2D) convolution neural network (CNN) for both single and combined features.FindingsThe two-dimensional convolution neural network (2D CNN) outcomes on EEG signals of AMIGOS data set are observed to yield the highest accuracy, that is 96.63%, 95.87% and 96.30% for AVD, respectively, which is evidenced to be at least 6% higher as compared to the other available competitive approaches.Originality/valueThe present work is focussed on the less explored, complex AMIGOS (2018) data set which is imbalanced and of variable length. EEG emotion recognition-based work is widely available on simpler data sets. The following are the challenges of the AMIGOS data set addressed in the present work: handling of tensor form data; proposing an efficient method for generating sufficient equal-length samples corresponding to imbalanced and variable-length data.; selecting a suitable machine learning/deep learning model; improving the accuracy of the applied model.

scholarly journals The challenges of emotion recognition methods based on electroencephalogram signals: a literature review

2022 ◽  
Vol 12 (2) ◽  
pp. 1508
Author(s):  
I Made Agus Wirawan ◽  
Retantyo Wardoyo ◽  
Danang Lelono
Keyword(s):  
Emotion Recognition ◽  
Eeg Signals ◽  
Data Set ◽  
Eeg Data ◽  
Network Method ◽  
Reduction Methods ◽  
Research Questions ◽  
Participant Characteristics ◽  
Diverse Data ◽  
Electroencephalogram Eeg

Electroencephalogram (EEG) signals in recognizing emotions have several advantages. Still, the success of this study, however, is strongly influenced by: i) the distribution of the data used, ii) consider of differences in participant characteristics, and iii) consider the characteristics of the EEG signals. In response to these issues, this study will examine three important points that affect the success of emotion recognition packaged in several research questions: i) What factors need to be considered to generate and distribute EEG data?, ii) How can EEG signals be generated with consideration of differences in participant characteristics?, and iii) How do EEG signals with characteristics exist among its features for emotion recognition? The results, therefore, indicate some important challenges to be studied further in EEG signals-based emotion recognition research. These include i) determine robust methods for imbalanced EEG signals data, ii) determine the appropriate smoothing method to eliminate disturbances on the baseline signals, iii) determine the best baseline reduction methods to reduce the differences in the characteristics of the participants on the EEG signals, iv) determine the robust architecture of the capsule network method to overcome the loss of knowledge information and apply it in more diverse data set.

Sign in / Sign up

Export Citation Format

Share Document