Performance Optimisation of Deep Learning Models using Majority Voting Algorithm for Brain Tumour Classification

2021 ◽  
pp. 104564
Author(s):  
Gopal S. Tandel ◽  
Ashish Tiwari ◽  
O.G. Kakde
Keyword(s):  
Deep Learning ◽  
Brain Tumour ◽  
Majority Voting ◽  
Learning Models ◽  
Tumour Classification

scholarly journals A Novel Intelligent System for Detection of Type 2 Diabetes with Modified Loss Function and Regularization

2021 ◽  
Vol 33 (2) ◽  
pp. 93-114
Author(s):  
Mallika G.C. ◽  
Abeer Alsadoon ◽  
Duong Thu Hang Pham ◽  
Salma Hameedi Abdullah ◽  
Ha Thi Mai ◽  
...  
Keyword(s):  
Machine Learning ◽  
Type 2 Diabetes ◽  
Deep Learning ◽  
Intelligent System ◽  
Model Solution ◽  
Majority Voting ◽  
Ensemble Model ◽  
Pima Indians ◽  
Learning Models

Type 2 Diabetes (T2DM) makes up about 90% of diabetes cases, as well as tough restriction on continuous monitoring and detecting become one of key aspects in T2DM. This research aims to develop an ensemble of several machine learning and deep learning models for early detection of T2DM with high accuracy. With high diversity of models, the ensemble will provide more excessive performance than single models. Methodology: The proposed system is modified enhanced ensemble of machine learning models for T2DM prediction. It is composed of Logistic Regression, Random Forest, SVM and Deep Neural Network models to generate a modified ensemble model. Results: The output of each model in the modified ensemble is used to figure out the final output of the system. The datasets being used for these models include Practice Fusion HER, Pima Indians diabetic's data, UCI AIM94 Dataset and CA Diabetes Prevalence 2014. In comparison to the previous solutions, the proposed ensemble model solution exposes the effectiveness of accuracy, sensitivity, and specificity. It provides an accuracy of 87.5% from 83.51% in average, sensitivity of 35.8% from 29.59% as well as specificity of 98.9% from 96.27%. The processing time of the proposed model solution with 96.6ms is faster than the state-of-the-art with 97.5ms. Conclusion: The proposed modified enhanced system in this work improves the overall prediction capability of T2DM using an ensemble of several machine learning and deep learning models. A majority voting scheme utilizes the output from several models to make the final accurate prediction. Regularization function in this work is modified in order to include the regularization of all the models in ensemble, that helps prevent the overfitting and encourages the generalization capacity of the proposed system.

Classification of electrocardiogram signal using an ensemble of deep learning models

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Saroj Kumar Pandey ◽  
Rekh Ram Janghel
Keyword(s):  
Deep Learning ◽  
Majority Voting ◽  
Classification Model ◽  
World Health ◽  
Product Rule ◽  
Learning Models ◽  
Data Set ◽  
Raw Data ◽  
Content Type ◽  
Heartbeat Classification

PurposeAccording to the World Health Organization, arrhythmia is one of the primary causes of deaths across the globe. In order to reduce mortality rate, cardiovascular disease should be properly identified and the proper treatment for the same should be immediately provided to the patients. The objective of this paper was to implement a better heartbeat classification model which will work better than the other implemented heartbeat classification methods.Design/methodology/approachIn this paper, the ensemble of two deep learning models is proposed to classify the MIT-BIH arrhythmia database into four different classes according to ANSI-AAMI standards. First, a convolutional neural network (CNN) model is used to classify heartbeats on a raw data set. Secondly, four features (wavelets, R-R intervals, morphological and higher-order statistics) are extracted from the data set and then applied to a long short-term memory (LSTM) model to classify the heartbeats. Finally, the ensemble of CNN and LSTM model with sum rule, product rule and majority voting has been used to identify the heartbeat classes.FindingsAmong these, the highest accuracy obtained is 98.58% using ensemble method with product rule. The results show that the ensemble of CNN and BLSTM has offered satisfactory performance compared to other techniques discussed in this study.Originality/valueIn this study, we have developed a new combination of two deep learning models to enhance the performance of arrhythmia classification using segmentation of input ECG signals. The contributions of this study are as follows: First, a deep CNN model is built to classify ECG heartbeat using a raw data set. Second, four types of features (R-R interval, HOS, morphological and wavelet) were extracted from the raw data set and then applied to the bidirectional LSTM model to classify the ECG heartbeat. Third, combination rules (sum rules, product rules and majority voting rules) were tested to ensure the accumulated probabilities of the CNN and LSTM models.

scholarly journals Extracting Family History of Patients From Clinical Narratives: Exploring an End-to-End Solution With Deep Learning Models (Preprint)

2020 ◽  
Author(s):  
Xi Yang ◽  
Hansi Zhang ◽  
Xing He ◽  
Jiang Bian ◽  
Yonghui Wu
Keyword(s):  
Deep Learning ◽  
Family History ◽  
Information Extraction ◽  
Language Processing ◽  
Conditional Random Fields ◽  
Short Term Memory ◽  
Majority Voting ◽  
Learning Models ◽  
Concept Extraction ◽  
End To End

BACKGROUND Patients’ family history (FH) is a critical risk factor associated with numerous diseases. However, FH information is not well captured in the structured database but often documented in clinical narratives. Natural language processing (NLP) is the key technology to extract patients’ FH from clinical narratives. In 2019, the National NLP Clinical Challenge (n2c2) organized shared tasks to solicit NLP methods for FH information extraction. OBJECTIVE This study presents our end-to-end FH extraction system developed during the 2019 n2c2 open shared task as well as the new transformer-based models that we developed after the challenge. We seek to develop a machine learning–based solution for FH information extraction without task-specific rules created by hand. METHODS We developed deep learning–based systems for FH concept extraction and relation identification. We explored deep learning models including long short-term memory-conditional random fields and bidirectional encoder representations from transformers (BERT) as well as developed ensemble models using a majority voting strategy. To further optimize performance, we systematically compared 3 different strategies to use BERT output representations for relation identification. RESULTS Our system was among the top-ranked systems (3 out of 21) in the challenge. Our best system achieved micro-averaged F1 scores of 0.7944 and 0.6544 for concept extraction and relation identification, respectively. After challenge, we further explored new transformer-based models and improved the performances of both subtasks to 0.8249 and 0.6775, respectively. For relation identification, our system achieved a performance comparable to the best system (0.6810) reported in the challenge. CONCLUSIONS This study demonstrated the feasibility of utilizing deep learning methods to extract FH information from clinical narratives.

scholarly journals Ensemble of Deep Learning Models for Sleep Apnea Detection: An Experimental Study

Sensors ◽  
2021 ◽  
Vol 21 (16) ◽  
pp. 5425
Author(s):  
Debadyuti Mukherjee ◽  
Koustav Dhar ◽  
Friedhelm Schwenker ◽  
Ram Sarkar
Keyword(s):  
Experimental Study ◽  
Deep Learning ◽  
Sleep Apnea ◽  
Choquet Integral ◽  
The Body ◽  
Majority Voting ◽  
Detection Accuracy ◽  
Learning Models ◽  
Ensemble Techniques ◽  
Obstructive Sleep

Sleep Apnea is a breathing disorder occurring during sleep. Older people suffer most from this disease. In-time diagnosis of apnea is needed which can be observed by the application of a proper health monitoring system. In this work, we focus on Obstructive Sleep Apnea (OSA) detection from the Electrocardiogram (ECG) signals obtained through the body sensors. Our work mainly consists of an experimental study of different ensemble techniques applied on three deep learning models—two Convolutional Neural Network (CNN) based models, and a combination of CNN and Long Short-Term Memory (LSTM) models, which were previously proposed in the OSA detection domain. We have chosen four ensemble techniques—majority voting, sum rule and Choquet integral based fuzzy fusion and trainable ensemble using Multi-Layer Perceptron (MLP) for our case study. All the experiments are conducted on the benchmark PhysioNet Apnea-ECG Database. Finally, we have achieved highest OSA detection accuracy of 85.58% using the MLP based ensemble approach. Our best result is also able to surpass many of state-of-the-art methods.

scholarly journals Extracting Family History of Patients From Clinical Narratives: Exploring an End-to-End Solution With Deep Learning Models

10.2196/22982 ◽  
2020 ◽  
Vol 8 (12) ◽  
pp. e22982
Author(s):  
Xi Yang ◽  
Hansi Zhang ◽  
Xing He ◽  
Jiang Bian ◽  
Yonghui Wu
Keyword(s):  
Deep Learning ◽  
Family History ◽  
Information Extraction ◽  
Language Processing ◽  
Conditional Random Fields ◽  
Short Term Memory ◽  
Majority Voting ◽  
Learning Models ◽  
Concept Extraction ◽  
End To End

Background Patients’ family history (FH) is a critical risk factor associated with numerous diseases. However, FH information is not well captured in the structured database but often documented in clinical narratives. Natural language processing (NLP) is the key technology to extract patients’ FH from clinical narratives. In 2019, the National NLP Clinical Challenge (n2c2) organized shared tasks to solicit NLP methods for FH information extraction. Objective This study presents our end-to-end FH extraction system developed during the 2019 n2c2 open shared task as well as the new transformer-based models that we developed after the challenge. We seek to develop a machine learning–based solution for FH information extraction without task-specific rules created by hand. Methods We developed deep learning–based systems for FH concept extraction and relation identification. We explored deep learning models including long short-term memory-conditional random fields and bidirectional encoder representations from transformers (BERT) as well as developed ensemble models using a majority voting strategy. To further optimize performance, we systematically compared 3 different strategies to use BERT output representations for relation identification. Results Our system was among the top-ranked systems (3 out of 21) in the challenge. Our best system achieved micro-averaged F1 scores of 0.7944 and 0.6544 for concept extraction and relation identification, respectively. After challenge, we further explored new transformer-based models and improved the performances of both subtasks to 0.8249 and 0.6775, respectively. For relation identification, our system achieved a performance comparable to the best system (0.6810) reported in the challenge. Conclusions This study demonstrated the feasibility of utilizing deep learning methods to extract FH information from clinical narratives.

Levenshtein Augmentation Improves Performance of SMILES Based Deep-Learning Synthesis Prediction

2020 ◽  
Author(s):  
Dean Sumner ◽  
Jiazhen He ◽  
Amol Thakkar ◽  
Ola Engkvist ◽  
Esben Jannik Bjerrum
Keyword(s):  
Neural Networks ◽  
Pattern Recognition ◽  
Deep Learning ◽  
Recurrent Neural Networks ◽  
Data Augmentation ◽  
State Of The Art ◽  
Sequence Similarity ◽  
Learning Models ◽  
Underlying Network

<p>SMILES randomization, a form of data augmentation, has previously been shown to increase the performance of deep learning models compared to non-augmented baselines. Here, we propose a novel data augmentation method we call “Levenshtein augmentation” which considers local SMILES sub-sequence similarity between reactants and their respective products when creating training pairs. The performance of Levenshtein augmentation was tested using two state of the art models - transformer and sequence-to-sequence based recurrent neural networks with attention. Levenshtein augmentation demonstrated an increase performance over non-augmented, and conventionally SMILES randomization augmented data when used for training of baseline models. Furthermore, Levenshtein augmentation seemingly results in what we define as <i>attentional gain </i>– an enhancement in the pattern recognition capabilities of the underlying network to molecular motifs.</p>

Improving the Accuracy of Protein-Ligand Binding Affinity Prediction by Deep Learning Models: Benchmark and Model

2019 ◽  
Author(s):  
Mohammad Rezaei ◽  
Yanjun Li ◽  
Xiaolin Li ◽  
Chenglong Li
Keyword(s):  
Deep Learning ◽  
Drug Design ◽  
Binding Affinity ◽  
Benchmark Dataset ◽  
Rational Drug Design ◽  
Learning Models ◽  
Structure Based Drug Design ◽  
Binding Affinity Prediction ◽  
Affinity Prediction ◽  
Rational Drug

<b>Introduction:</b> The ability to discriminate among ligands binding to the same protein target in terms of their relative binding affinity lies at the heart of structure-based drug design. Any improvement in the accuracy and reliability of binding affinity prediction methods decreases the discrepancy between experimental and computational results.<br><b>Objectives:</b> The primary objectives were to find the most relevant features affecting binding affinity prediction, least use of manual feature engineering, and improving the reliability of binding affinity prediction using efficient deep learning models by tuning the model hyperparameters.<br><b>Methods:</b> The binding site of target proteins was represented as a grid box around their bound ligand. Both binary and distance-dependent occupancies were examined for how an atom affects its neighbor voxels in this grid. A combination of different features including ANOLEA, ligand elements, and Arpeggio atom types were used to represent the input. An efficient convolutional neural network (CNN) architecture, DeepAtom, was developed, trained and tested on the PDBbind v2016 dataset. Additionally an extended benchmark dataset was compiled to train and evaluate the models.<br><b>Results: </b>The best DeepAtom model showed an improved accuracy in the binding affinity prediction on PDBbind core subset (Pearson’s R=0.83) and is better than the recent state-of-the-art models in this field. In addition when the DeepAtom model was trained on our proposed benchmark dataset, it yields higher correlation compared to the baseline which confirms the value of our model.<br><b>Conclusions:</b> The promising results for the predicted binding affinities is expected to pave the way for embedding deep learning models in virtual screening and rational drug design fields.

Sign in / Sign up

Export Citation Format

Share Document