scholarly journals Identification of Epileptic EEG Signals Through TSK Transfer Learning Fuzzy System

2021 ◽  
Vol 15 ◽  
Author(s):  
Zhaoliang Zheng ◽  
Xuan Dong ◽  
Jian Yao ◽  
Leyuan Zhou ◽  
Yang Ding ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Fuzzy System ◽  
Marginal Distribution ◽  
Data Distribution ◽  
Eeg Signals ◽  
Training Set ◽  
Proposed Model ◽  
Class Information ◽  
Intelligent Recognition ◽  
Distribution Distance

We propose a new model to identify epilepsy EEG signals. Some existing intelligent recognition technologies require that the training set and test set have the same distribution when recognizing EEG signals, some only consider reducing the marginal distribution distance of the data while ignoring the intra-class information of data, and some lack of interpretability. To address these deficiencies, we construct a TSK transfer learning fuzzy system (TSK-TL) based on the easy-to-interpret TSK fuzzy system the transfer learning method. The proposed model is interpretable. By using the information contained in the source domain and target domains more effectively, the requirements for data distribution are further relaxed. It realizes the identification of epilepsy EEG signals in data drift scene. The experimental results show that compared with the existing algorithms, TSK-TL has better performance in EEG recognition of epilepsy.

Seizure Classification From EEG Signals Using Transfer Learning, Semi-Supervised Learning and TSK Fuzzy System

2017 ◽  
Vol 25 (12) ◽  
pp. 2270-2284 ◽  
Author(s):  
Yizhang Jiang ◽  
Dongrui Wu ◽  
Zhaohong Deng ◽  
Pengjiang Qian ◽  
Jun Wang ◽  
...  
Keyword(s):  
Supervised Learning ◽  
Transfer Learning ◽  
Fuzzy System ◽  
Eeg Signals ◽  
Seizure Classification

Intelligent recognition of semantic relationships based on antonymy

2020 ◽  
Vol 16 (3) ◽  
pp. 263-290
Author(s):  
Hui Guan ◽  
Chengzhen Jia ◽  
Hongji Yang
Keyword(s):  
Semantic Similarity ◽  
New Approach ◽  
Word Similarity ◽  
Semantic Relationships ◽  
Proposed Model ◽  
Path Distance ◽  
The Hierarchical Structure ◽  
Thinking Process ◽  
Similarity Measuring ◽  
Intelligent Recognition

Since computing semantic similarity tends to simulate the thinking process of humans, semantic dissimilarity must play a part in this process. In this paper, we present a new approach for semantic similarity measuring by taking consideration of dissimilarity into the process of computation. Specifically, the proposed measures explore the potential antonymy in the hierarchical structure of WordNet to represent the dissimilarity between concepts and then combine the dissimilarity with the results of existing methods to achieve semantic similarity results. The relation between parameters and the correlation value is discussed in detail. The proposed model is then applied to different text granularity levels to validate the correctness on similarity measurement. Experimental results show that the proposed approach not only achieves high correlation value against human ratings but also has effective improvement to existing path-distance based methods on the word similarity level, in the meanwhile effectively correct existing sentence similarity method in some cases in Microsoft Research Paraphrase Corpus and SemEval-2014 date set.

scholarly journals UAV Image Multi-Labeling with Data-Efficient Transformers

2021 ◽  
Vol 11 (9) ◽  
pp. 3974
Author(s):  
Laila Bashmal ◽  
Yakoub Bazi ◽  
Mohamad Mahmoud Al Rahhal ◽  
Haikel Alhichri ◽  
Naif Al Ajlan
Keyword(s):  
Data Augmentation ◽  
Feature Representation ◽  
Aerial Image ◽  
Remote Sensing Images ◽  
Training Set ◽  
Proposed Model ◽  
Class Labels ◽  
Using Data ◽  
Uav Image

In this paper, we present an approach for the multi-label classification of remote sensing images based on data-efficient transformers. During the training phase, we generated a second view for each image from the training set using data augmentation. Then, both the image and its augmented version were reshaped into a sequence of flattened patches and then fed to the transformer encoder. The latter extracts a compact feature representation from each image with the help of a self-attention mechanism, which can handle the global dependencies between different regions of the high-resolution aerial image. On the top of the encoder, we mounted two classifiers, a token and a distiller classifier. During training, we minimized a global loss consisting of two terms, each corresponding to one of the two classifiers. In the test phase, we considered the average of the two classifiers as the final class labels. Experiments on two datasets acquired over the cities of Trento and Civezzano with a ground resolution of two-centimeter demonstrated the effectiveness of the proposed model.

scholarly journals Application of a modified Inception-v3 model in the dynasty-based classification of ancient murals

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Jianfang Cao ◽  
Minmin Yan ◽  
Yiming Jia ◽  
Xiaodong Tian ◽  
Zibang Zhang
Keyword(s):  
Transfer Learning ◽  
Adaptive Learning ◽  
Deep Level ◽  
Image Resolution ◽  
Learning Rate ◽  
Stochastic Gradient Descent ◽  
Natural Image ◽  
Historical Period ◽  
Proposed Model

AbstractIt is difficult to identify the historical period in which some ancient murals were created because of damage due to artificial and/or natural factors; similarities in content, style, and color among murals; low image resolution; and other reasons. This study proposed a transfer learning-fused Inception-v3 model for dynasty-based classification. First, the model adopted Inception-v3 with frozen fully connected and softmax layers for pretraining over ImageNet. Second, the model fused Inception-v3 with transfer learning for parameter readjustment over small datasets. Third, the corresponding bottleneck files of the mural images were generated, and the deep-level features of the images were extracted. Fourth, the cross-entropy loss function was employed to calculate the loss value at each step of the training, and an algorithm for the adaptive learning rate on the stochastic gradient descent was applied to unify the learning rate. Finally, the updated softmax classifier was utilized for the dynasty-based classification of the images. On the constructed small datasets, the accuracy rate, recall rate, and F1 value of the proposed model were 88.4%, 88.36%, and 88.32%, respectively, which exhibited noticeable increases compared with those of typical deep learning models and modified convolutional neural networks. Comparisons of the classification outcomes for the mural dataset with those for other painting datasets and natural image datasets showed that the proposed model achieved stable classification outcomes with a powerful generalization capacity. The training time of the proposed model was only 0.7 s, and overfitting seldom occurred.

Relationship between Selic rate and Basel III parameters - A statistics approach and a fuzzy forecasting model

2021 ◽  
pp. 1-14
Author(s):  
Thiago Henrique Barbosa de Carvalho Tavares ◽  
Bruno Pérez Ferreira ◽  
Eduardo Mazoni Andrade Marçal Mendes
Keyword(s):  
Cross Correlation ◽  
Data Distribution ◽  
Forecasting Model ◽  
Basel Iii ◽  
Output Data ◽  
Basel Accords ◽  
Proposed Model ◽  
The Relationship ◽  
The Universe ◽  
Universe Of Discourse

In this work the relationship between the Selic rate and some bank parameters defined by the so-called Basel Accords is studied. The cross-correlation between the Selic rate and the parameters is used to explain how these parameters affect the Selic rate and vice-versa so as to define the predictability of the Selic rate using (some of) these parameters as inputs. A model is then proposed for predicting the Selic rate based on some specific parameters using fuzzy logic ideas, which dealt with a partitioning of the universe of discourse using clusters related to the output data distribution. The proposed model is compared to four other known models in the literature and showed to have better performance in average compared to all other models.

scholarly journals Optimizing the Performance of Breast Cancer Classification by Employing the Same Domain Transfer Learning from Hybrid Deep Convolutional Neural Network Model

Electronics ◽  
2020 ◽  
Vol 9 (3) ◽  
pp. 445 ◽  
Author(s):  
Laith Alzubaidi ◽  
Omran Al-Shamma ◽  
Mohammed A. Fadhel ◽  
Laith Farhan ◽  
Jinglan Zhang ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Deep Learning ◽  
Transfer Learning ◽  
Cancer Diagnosis ◽  
Classification Accuracy ◽  
Cancer Classification ◽  
Learning Models ◽  
Proposed Model ◽  
Domain Transfer ◽  
Domain Transfer Learning

Breast cancer is a significant factor in female mortality. An early cancer diagnosis leads to a reduction in the breast cancer death rate. With the help of a computer-aided diagnosis system, the efficiency increased, and the cost was reduced for the cancer diagnosis. Traditional breast cancer classification techniques are based on handcrafted features techniques, and their performance relies upon the chosen features. They also are very sensitive to different sizes and complex shapes. However, histopathological breast cancer images are very complex in shape. Currently, deep learning models have become an alternative solution for diagnosis, and have overcome the drawbacks of classical classification techniques. Although deep learning has performed well in various tasks of computer vision and pattern recognition, it still has some challenges. One of the main challenges is the lack of training data. To address this challenge and optimize the performance, we have utilized a transfer learning technique which is where the deep learning models train on a task, and then fine-tune the models for another task. We have employed transfer learning in two ways: Training our proposed model first on the same domain dataset, then on the target dataset, and training our model on a different domain dataset, then on the target dataset. We have empirically proven that the same domain transfer learning optimized the performance. Our hybrid model of parallel convolutional layers and residual links is utilized to classify hematoxylin–eosin-stained breast biopsy images into four classes: invasive carcinoma, in-situ carcinoma, benign tumor and normal tissue. To reduce the effect of overfitting, we have augmented the images with different image processing techniques. The proposed model achieved state-of-the-art performance, and it outperformed the latest methods by achieving a patch-wise classification accuracy of 90.5%, and an image-wise classification accuracy of 97.4% on the validation set. Moreover, we have achieved an image-wise classification accuracy of 96.1% on the test set of the microscopy ICIAR-2018 dataset.

scholarly journals An Automatic Epilepsy Detection Method Based on Improved Inductive Transfer Learning

2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Yufeng Yao ◽  
Zhiming Cui
Keyword(s):  
Transfer Learning ◽  
Real Life ◽  
Eeg Signal ◽  
Signal Recognition ◽  
Least Squares Regression ◽  
Eeg Signals ◽  
Strong Basis ◽  
Inductive Transfer ◽  
Inductive Transfer Learning ◽  
The Impact

Epilepsy is a chronic disease caused by sudden abnormal discharge of brain neurons, causing transient brain dysfunction. The seizures of epilepsy have the characteristics of being sudden and repetitive, which has seriously endangered patients’ health, cognition, etc. In the current condition, EEG plays a vital role in the diagnosis, judgment, and qualitative location of epilepsy among the clinical diagnosis of various epileptic seizures and is an indispensable means of detection. The study of the EEG signals of patients with epilepsy can provide a strong basis and useful information for in-depth understanding of its pathogenesis. Although, intelligent classification technologies based on machine learning have been widely used to the classification of epilepsy EEG signals and show the effectiveness. In fact, it is difficult to ensure that there is always enough EEG data available for training the model in real life, which will affect the performance of the algorithms. In view of this, to reduce the impact of insufficient data on the detection performance of the algorithms, a novel discriminate least squares regression- (DLSR-) based inductive transfer learning method was introduced which is on the basis of DLSR and the inductive transfer learning. And, it is applied to promote the adaptability and accuracy of the epilepsy EEG signal recognition. The proposed method inherits the advantages of DLSR; it can be more suitable for classification scenarios by expanding the interval between different classes. Meanwhile, it can simultaneously use the data of the target domain and the knowledge of the source domain, which is helpful for getting better performance. The results show that the improved method has more advantages in EEG signal recognition comparing to several other representative methods.

scholarly journals Ambulatory and Laboratory Stress Detection Based on Raw Electrocardiogram Signals Using a Convolutional Neural Network

Sensors ◽  
2019 ◽  
Vol 19 (20) ◽  
pp. 4408 ◽  
Author(s):  
Hyun-Myung Cho ◽  
Heesu Park ◽  
Suh-Yeon Dong ◽  
Inchan Youn
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Mental Arithmetic ◽  
Small Data ◽  
Data Sets ◽  
Learning Method ◽  
Data Set ◽  
Electrocardiogram Signals ◽  
Proposed Model ◽  
Small Data Set

The goals of this study are the suggestion of a better classification method for detecting stressed states based on raw electrocardiogram (ECG) data and a method for training a deep neural network (DNN) with a smaller data set. We suggest an end-to-end architecture to detect stress using raw ECGs. The architecture consists of successive stages that contain convolutional layers. In this study, two kinds of data sets are used to train and validate the model: A driving data set and a mental arithmetic data set, which smaller than the driving data set. We apply a transfer learning method to train a model with a small data set. The proposed model shows better performance, based on receiver operating curves, than conventional methods. Compared with other DNN methods using raw ECGs, the proposed model improves the accuracy from 87.39% to 90.19%. The transfer learning method improves accuracy by 12.01% and 10.06% when 10 s and 60 s of ECG signals, respectively, are used in the model. In conclusion, our model outperforms previous models using raw ECGs from a small data set and, so, we believe that our model can significantly contribute to mobile healthcare for stress management in daily life.

scholarly journals FAOD-Net: A Fast AOD-Net for Dehazing Single Image

2020 ◽  
Vol 2020 ◽  
pp. 1-11 ◽  
Author(s):  
Wen Qian ◽  
Chao Zhou ◽  
Dengyin Zhang
Keyword(s):  
Quality Evaluation ◽  
Deep Neural Networks ◽  
Reference Image ◽  
Context Information ◽  
Global Information ◽  
Single Image ◽  
Training Set ◽  
Test Set ◽  
Full Reference ◽  
Proposed Model

In this paper, we present an extremely computation-efficient model called FAOD-Net for dehazing single image. FAOD-Net is based on a streamlined architecture that uses depthwise separable convolutions to build lightweight deep neural networks. Moreover, the pyramid pooling module is added in FAOD-Net to aggregate the context information of different regions of the image, thereby improving the ability of the network model to obtain the global information of the foggy image. To get the best FAOD-Net, we use the RESIDE training set to train our proposed model. In addition, we have carried out extensive experiments on the RESIDE test set. We use full-reference and no-reference image quality evaluation indicators to measure the effect of dehazing. Experimental results show that the proposed algorithm has satisfactory results in terms of defogging quality and speed.

Sign in / Sign up

Export Citation Format

Share Document