scholarly journals EEG data augmentation for emotion recognition with a multiple generator conditional Wasserstein GAN

2021 ◽  
Author(s):  
Aiming Zhang ◽  
Lei Su ◽  
Yin Zhang ◽  
Yunfa Fu ◽  
Liping Wu ◽  
...  
Keyword(s):  
Emotion Recognition ◽  
Data Augmentation ◽  
Real Data ◽  
Training Data ◽  
Quality Data ◽  
Emotion Classification ◽  
High Quality ◽  
Proposed Model ◽  
Eeg Data ◽  
Substantial Progress

AbstractEEG-based emotion recognition has attracted substantial attention from researchers due to its extensive application prospects, and substantial progress has been made in feature extraction and classification modelling from EEG data. However, insufficient high-quality training data are available for building EEG-based emotion recognition models via machine learning or deep learning methods. The artificial generation of high-quality data is an effective approach for overcoming this problem. In this paper, a multi-generator conditional Wasserstein GAN method is proposed for the generation of high-quality artificial that covers a more comprehensive distribution of real data through the use of various generators. Experimental results demonstrate that the artificial data that are generated by the proposed model can effectively improve the performance of emotion classification models that are based on EEG.

scholarly journals Dialog State Tracking with Reinforced Data Augmentation

2020 ◽  
Vol 34 (05) ◽  
pp. 9474-9481
Author(s):  
Yichun Yin ◽  
Lifeng Shang ◽  
Xin Jiang ◽  
Xiao Chen ◽  
Qun Liu
Keyword(s):  
Data Augmentation ◽  
State Of The Art ◽  
The State ◽  
Training Data ◽  
Quality Data ◽  
Specific Context ◽  
High Quality ◽  
High Quality Data ◽  
Fine Grained ◽  
State Tracking

Neural dialog state trackers are generally limited due to the lack of quantity and diversity of annotated training data. In this paper, we address this difficulty by proposing a reinforcement learning (RL) based framework for data augmentation that can generate high-quality data to improve the neural state tracker. Specifically, we introduce a novel contextual bandit generator to learn fine-grained augmentation policies that can generate new effective instances by choosing suitable replacements for specific context. Moreover, by alternately learning between the generator and the state tracker, we can keep refining the generative policies to generate more high-quality training data for neural state tracker. Experimental results on the WoZ and MultiWoZ (restaurant) datasets demonstrate that the proposed framework significantly improves the performance over the state-of-the-art models, especially with limited training data.

scholarly journals Data Augmentation for Audio–Visual Emotion Recognition with an Efficient Multimodal Conditional GAN

2022 ◽  
Vol 12 (1) ◽  
pp. 527
Author(s):  
Fei Ma ◽  
Yang Li ◽  
Shiguang Ni ◽  
Shaolun Huang ◽  
Lin Zhang
Keyword(s):  
Deep Learning ◽  
Emotion Recognition ◽  
Data Augmentation ◽  
Class Imbalance ◽  
Real Data ◽  
Training Data ◽  
Visual Modality ◽  
Emotional States ◽  
Generative Adversarial Network ◽  
Multimodal Data

Audio–visual emotion recognition is the research of identifying human emotional states by combining the audio modality and the visual modality simultaneously, which plays an important role in intelligent human–machine interactions. With the help of deep learning, previous works have made great progress for audio–visual emotion recognition. However, these deep learning methods often require a large amount of data for training. In reality, data acquisition is difficult and expensive, especially for the multimodal data with different modalities. As a result, the training data may be in the low-data regime, which cannot be effectively used for deep learning. In addition, class imbalance may occur in the emotional data, which can further degrade the performance of audio–visual emotion recognition. To address these problems, we propose an efficient data augmentation framework by designing a multimodal conditional generative adversarial network (GAN) for audio–visual emotion recognition. Specifically, we design generators and discriminators for audio and visual modalities. The category information is used as their shared input to make sure our GAN can generate fake data of different categories. In addition, the high dependence between the audio modality and the visual modality in the generated multimodal data is modeled based on Hirschfeld–Gebelein–Re´nyi (HGR) maximal correlation. In this way, we relate different modalities in the generated data to approximate the real data. Then, the generated data are used to augment our data manifold. We further apply our approach to deal with the problem of class imbalance. To the best of our knowledge, this is the first work to propose a data augmentation strategy with a multimodal conditional GAN for audio–visual emotion recognition. We conduct a series of experiments on three public multimodal datasets, including eNTERFACE’05, RAVDESS, and CMEW. The results indicate that our multimodal conditional GAN has high effectiveness for data augmentation of audio–visual emotion recognition.

Semi-Supervised Aspect-Based Sentiment Analysis for Case-Related Microblog Reviews Using Case Knowledge Graph Embedding

2021 ◽  
pp. 2050012
Author(s):  
Peilian Zhao ◽  
Cunli Mao ◽  
Zhengtao Yu
Keyword(s):  
Sentiment Analysis ◽  
Domain Knowledge ◽  
Opinion Mining ◽  
Data Augmentation ◽  
Training Data ◽  
Knowledge Graph ◽  
Fine Grained ◽  
Learning Framework ◽  
Proposed Model ◽  
Real World Applications

Aspect-Based Sentiment Analysis (ABSA), a fine-grained task of opinion mining, which aims to extract sentiment of specific target from text, is an important task in many real-world applications, especially in the legal field. Therefore, in this paper, we study the problem of limitation of labeled training data required and ignorance of in-domain knowledge representation for End-to-End Aspect-Based Sentiment Analysis (E2E-ABSA) in legal field. We proposed a new method under deep learning framework, named Semi-ETEKGs, which applied E2E framework using knowledge graph (KG) embedding in legal field after data augmentation (DA). Specifically, we pre-trained the BERT embedding and in-domain KG embedding for unlabeled data and labeled data with case elements after DA, and then we put two embeddings into the E2E framework to classify the polarity of target-entity. Finally, we built a case-related dataset based on a popular benchmark for ABSA to prove the efficiency of Semi-ETEKGs, and experiments on case-related dataset from microblog comments show that our proposed model outperforms the other compared methods significantly.

scholarly journals Using diffusion MRI data acquired with ultra-high gradients to improve tractography in routine-quality data

2021 ◽  
Author(s):  
Chiara Maffei ◽  
Christine Lee ◽  
Michael Planich ◽  
Manisha Ramprasad ◽  
Nivedita Ravi ◽  
...  
Keyword(s):  
Diffusion Mri ◽  
Region Of Interest ◽  
Training Data ◽  
Quality Data ◽  
High Quality ◽  
Scanning Time ◽  
Human Connectome Project ◽  
High Gradients ◽  
Comprehensive Comparison

The development of scanners with ultra-high gradients, spearheaded by the Human Connectome Project, has led to dramatic improvements in the spatial, angular, and diffusion resolution that is feasible for in vivo diffusion MRI acquisitions. The improved quality of the data can be exploited to achieve higher accuracy in the inference of both microstructural and macrostructural anatomy. However, such high-quality data can only be acquired on a handful of Connectom MRI scanners worldwide, while remaining prohibitive in clinical settings because of the constraints imposed by hardware and scanning time. In this study, we first update the classical protocols for tractography-based, manual annotation of major white-matter pathways, to adapt them to the much greater volume and variability of the streamlines that can be produced from today's state-of-the-art diffusion MRI data. We then use these protocols to annotate 42 major pathways manually in data from a Connectom scanner. Finally, we show that, when we use these manually annotated pathways as training data for global probabilistic tractography with anatomical neighborhood priors, we can perform highly accurate, automated reconstruction of the same pathways in much lower-quality, more widely available diffusion MRI data. The outcomes of this work include both a new, comprehensive atlas of WM pathways from Connectom data, and an updated version of our tractography toolbox, TRActs Constrained by UnderLying Anatomy (TRACULA), which is trained on data from this atlas. Both the atlas and TRACULA are distributed publicly as part of FreeSurfer. We present the first comprehensive comparison of TRACULA to the more conventional, multi-region-of-interest approach to automated tractography, and the first demonstration of training TRACULA on high-quality, Connectom data to benefit studies that use more modest acquisition protocols.

scholarly journals Improving the Quality of Positive Datasets for the Establishment of Machine Learning Models for pre-microRNA Detection

2017 ◽  
Vol 14 (2) ◽  
Author(s):  
Müşerref Duygu Saçar Demirci ◽  
Jens Allmer
Keyword(s):  
Machine Learning ◽  
Training Data ◽  
Quality Data ◽  
Virus Infections ◽  
High Quality ◽  
Disease States ◽  
Positive Data ◽  
Mirna Detection ◽  
Post Transcriptional Regulation

AbstractMicroRNAs (miRNAs) are involved in the post-transcriptional regulation of protein abundance and thus have a great impact on the resulting phenotype. It is, therefore, no wonder that they have been implicated in many diseases ranging from virus infections to cancer. This impact on the phenotype leads to a great interest in establishing the miRNAs of an organism. Experimental methods are complicated which led to the development of computational methods for pre-miRNA detection. Such methods generally employ machine learning to establish models for the discrimination between miRNAs and other sequences. Positive training data for model establishment, for the most part, stems from miRBase, the miRNA registry. The quality of the entries in miRBase has been questioned, though. This unknown quality led to the development of filtering strategies in attempts to produce high quality positive datasets which can lead to a scarcity of positive data. To analyze the quality of filtered data we developed a machine learning model and found it is well able to establish data quality based on intrinsic measures. Additionally, we analyzed which features describing pre-miRNAs could discriminate between low and high quality data. Both models are applicable to data from miRBase and can be used for establishing high quality positive data. This will facilitate the development of better miRNA detection tools which will make the prediction of miRNAs in disease states more accurate. Finally, we applied both models to all miRBase data and provide the list of high quality hairpins.

scholarly journals 3dinfogan: 3d Models’ Reconstruction In Infogans

2021 ◽  
Vol 10 (02) ◽  
pp. 95-109
Author(s):  
Du Chunqi ◽  
Shinobu Hasegawa
Keyword(s):  
Computer Vision ◽  
Deep Learning ◽  
Latent Variables ◽  
Data Augmentation ◽  
Synthetic Data ◽  
Real Data ◽  
3D Models ◽  
High Quality ◽  
Shape Constraint ◽  
Real Objects

In computer vision and computer graphics, 3D reconstruction is the process of capturing real objects’ shapes and appearances. 3D models always can be constructed by active methods which use high-quality scanner equipment, or passive methods that learn from the dataset. However, both of these two methods only aimed to construct the 3D models, without showing what element affects the generation of 3D models. Therefore, the goal of this research is to apply deep learning to automatically generating 3D models, and finding the latent variables which affect the reconstructing process. The existing research GANs can be trained in little data with two networks called Generator and Discriminator, respectively. Generator can produce synthetic data, and Discriminator can discriminate between the generator’s output and real data. The existing research shows that InFoGAN can maximize the mutual information between latent variables and observation. In our approach, we will generate the 3D models based on InFoGAN and design two constraints, shape-constraint and parameters-constraint, respectively. Shape-constraint utilizes the data augmentation method to limit the synthetic data generated in the models’ profiles. At the same time, we also try to employ parameters-constraint to find the 3D models’ relationship corresponding to the latent variables. Furthermore, our approach will be a challenge in the architecture of generating 3D models built on InFoGAN. Finally, in the process of generation, we might discover the contribution of the latent variables influencing the 3D models to the whole network.

scholarly journals Data Augmentation of Automotive LIDAR Point Clouds under Adverse Weather Situations

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4503
Author(s):  
Jose Roberto Vargas Rivero ◽  
Thiemo Gerbich ◽  
Boris Buschardt ◽  
Jia Chen
Keyword(s):  
Autonomous Vehicles ◽  
Data Augmentation ◽  
Synthetic Data ◽  
Real Data ◽  
Weather Conditions ◽  
Point Clouds ◽  
Training Data ◽  
Driver Assistance Systems ◽  
Solid Objects ◽  
Adverse Weather

In contrast to previous works on data augmentation using LIDAR (Light Detection and Ranging), which mostly consider point clouds under good weather conditions, this paper uses point clouds which are affected by spray. Spray water can be a cause of phantom braking and understanding how to handle the extra detections caused by it is an important step in the development of ADAS (Advanced Driver Assistance Systems)/AV (Autonomous Vehicles) functions. The extra detections caused by spray cannot be safely removed without considering cases in which real solid objects may be present in the same region in which the detections caused by spray take place. As collecting real examples would be extremely difficult, the use of synthetic data is proposed. Real scenes are reconstructed virtually with an added extra object in the spray region, in a way that the detections caused by this obstacle match the characteristics a real object in the same position would have regarding intensity, echo number and occlusion. The detections generated by the obstacle are then used to augment the real data, obtaining, after occlusion effects are added, a good approximation of the desired training data. This data is used to train a classifier achieving an average F-Score of 92. The performance of the classifier is analyzed in detail based on the characteristics of the synthetic object: size, position, reflection, duration. The proposed method can be easily expanded to different kinds of obstacles and classifier types.

scholarly journals Crowdsourcing Image Analysis for Plant Phenomics to Generate Ground Truth Data for Machine Learning

2018 ◽  
Author(s):  
Naihui Zhou ◽  
Zachary D Siegel ◽  
Scott Zarecor ◽  
Nigel Lee ◽  
Darwin A Campbell ◽  
...  
Keyword(s):  
Machine Learning ◽  
Image Analysis ◽  
Best Practices ◽  
Ground Truth ◽  
Training Data ◽  
Quality Data ◽  
High Quality ◽  
Ground Truth Data ◽  
Plant Phenomics

AbstractThe accuracy of machine learning tasks critically depends on high quality ground truth data. Therefore, in many cases, producing good ground truth data typically involves trained professionals; however, this can be costly in time, effort, and money. Here we explore the use of crowdsourcing to generate a large number of training data of good quality. We explore an image analysis task involving the segmentation of corn tassels from images taken in a field setting. We investigate the accuracy, speed and other quality metrics when this task is performed by students for academic credit, Amazon MTurk workers, and Master Amazon MTurk workers. We conclude that the Amazon MTurk and Master Mturk workers perform significantly better than the for-credit students, but with no significant difference between the two MTurk worker types. Furthermore, the quality of the segmentation produced by Amazon MTurk workers rivals that of an expert worker. We provide best practices to assess the quality of ground truth data, and to compare data quality produced by different sources. We conclude that properly managed crowdsourcing can be used to establish large volumes of viable ground truth data at a low cost and high quality, especially in the context of high throughput plant phenotyping. We also provide several metrics for assessing the quality of the generated datasets.Author SummaryFood security is a growing global concern. Farmers, plant breeders, and geneticists are hastening to address the challenges presented to agriculture by climate change, dwindling arable land, and population growth. Scientists in the field of plant phenomics are using satellite and drone images to understand how crops respond to a changing environment and to combine genetics and environmental measures to maximize crop growth efficiency. However, the terabytes of image data require new computational methods to extract useful information. Machine learning algorithms are effective in recognizing select parts of images, butthey require high quality data curated by people to train them, a process that can be laborious and costly. We examined how well crowdsourcing works in providing training data for plant phenomics, specifically, segmenting a corn tassel – the male flower of the corn plant – from the often-cluttered images of a cornfield. We provided images to students, and to Amazon MTurkers, the latter being an on-demand workforce brokered by Amazon.com and paid on a task-by-task basis. We report on best practices in crowdsourcing image labeling for phenomics, and compare the different groups on measures such as fatigue and accuracy over time. We find that crowdsourcing is a good way of generating quality labeled data, rivaling that of experts.

scholarly journals The Design of CNN Architectures for Optimal Six Basic Emotion Classification Using Multiple Physiological Signals

Sensors ◽  
2020 ◽  
Vol 20 (3) ◽  
pp. 866 ◽  
Author(s):  
SeungJun Oh ◽  
Jun-Young Lee ◽  
Dong Keun Kim
Keyword(s):  
Emotion Recognition ◽  
Identification Accuracy ◽  
Physiological Signals ◽  
Dominant Factor ◽  
Basic Emotion ◽  
Emotion Classification ◽  
Physiological Signal ◽  
Proposed Model ◽  
Respiration Sensor ◽  
Signal Combination

This study aimed to design an optimal emotion recognition method using multiple physiological signal parameters acquired by bio-signal sensors for improving the accuracy of classifying individual emotional responses. Multiple physiological signals such as respiration (RSP) and heart rate variability (HRV) were acquired in an experiment from 53 participants when six basic emotion states were induced. Two RSP parameters were acquired from a chest-band respiration sensor, and five HRV parameters were acquired from a finger-clip blood volume pulse (BVP) sensor. A newly designed deep-learning model based on a convolutional neural network (CNN) was adopted for detecting the identification accuracy of individual emotions. Additionally, the signal combination of the acquired parameters was proposed to obtain high classification accuracy. Furthermore, a dominant factor influencing the accuracy was found by comparing the relativeness of the parameters, providing a basis for supporting the results of emotion classification. The users of this proposed model will soon be able to improve the emotion recognition model further based on CNN using multimodal physiological signals and their sensors.

Sign in / Sign up

Export Citation Format

Share Document