Oversampling Based on k-NN and GAN for Effective Classification of Class Imbalance Dataset

2020 ◽  
Vol 46 (4) ◽  
pp. 365-371
Author(s):  
Jisu Park ◽  
Gilseung Ahn ◽  
Sun Hur
Keyword(s):  
Class Imbalance ◽  
Imbalance Dataset

scholarly journals Deep learning framework for handling concept drift and class imbalanced complex decision-making on streaming data

2021 ◽  
Author(s):  
S. Priya ◽  
R. Annie Uthra
Keyword(s):  
Decision Making ◽  
Deep Learning ◽  
Concept Drift ◽  
Class Imbalance ◽  
Streaming Data ◽  
Superior Performance ◽  
Data Streaming ◽  
Minority Class ◽  
Concept Drift Detection

AbstractIn present times, data science become popular to support and improve decision-making process. Due to the accessibility of a wide application perspective of data streaming, class imbalance and concept drifting become crucial learning problems. The advent of deep learning (DL) models finds useful for the classification of concept drift in data streaming applications. This paper presents an effective class imbalance with concept drift detection (CIDD) using Adadelta optimizer-based deep neural networks (ADODNN), named CIDD-ADODNN model for the classification of highly imbalanced streaming data. The presented model involves four processes namely preprocessing, class imbalance handling, concept drift detection, and classification. The proposed model uses adaptive synthetic (ADASYN) technique for handling class imbalance data, which utilizes a weighted distribution for diverse minority class examples based on the level of difficulty in learning. Next, a drift detection technique called adaptive sliding window (ADWIN) is employed to detect the existence of the concept drift. Besides, ADODNN model is utilized for the classification processes. For increasing the classifier performance of the DNN model, ADO-based hyperparameter tuning process takes place to determine the optimal parameters of the DNN model. The performance of the presented model is evaluated using three streaming datasets namely intrusion detection (NSL KDDCup) dataset, Spam dataset, and Chess dataset. A detailed comparative results analysis takes place and the simulation results verified the superior performance of the presented model by obtaining a maximum accuracy of 0.9592, 0.9320, and 0.7646 on the applied KDDCup, Spam, and Chess dataset, respectively.

scholarly journals LICIC: Less Important Components for Imbalanced Multiclass Classification

Information ◽  
2018 ◽  
Vol 9 (12) ◽  
pp. 317 ◽  
Author(s):  
Vincenzo Dentamaro ◽  
Donato Impedovo ◽  
Giuseppe Pirlo
Keyword(s):  
Gene Expression ◽  
Class Imbalance ◽  
Imbalanced Data ◽  
Multiclass Classification ◽  
Cancer Diagnostics ◽  
Mass Spectrometry Data ◽  
High Dimensional ◽  
Or Gene ◽  
High Dimensional Datasets

Multiclass classification in cancer diagnostics, using DNA or Gene Expression Signatures, but also classification of bacteria species fingerprints in MALDI-TOF mass spectrometry data, is challenging because of imbalanced data and the high number of dimensions with respect to the number of instances. In this study, a new oversampling technique called LICIC will be presented as a valuable instrument in countering both class imbalance, and the famous “curse of dimensionality” problem. The method enables preservation of non-linearities within the dataset, while creating new instances without adding noise. The method will be compared with other oversampling methods, such as Random Oversampling, SMOTE, Borderline-SMOTE, and ADASYN. F1 scores show the validity of this new technique when used with imbalanced, multiclass, and high-dimensional datasets.

scholarly journals Classification of Imbalanced Malaria Disease Using Naïve Bayesian Algorithm

2018 ◽  
Vol 7 (2.7) ◽  
pp. 786 ◽  
Author(s):  
T Sajana ◽  
M R.Narasingarao
Keyword(s):  
Comparative Study ◽  
Class Imbalance ◽  
Machine Learning Algorithms ◽  
Bayesian Algorithm ◽  
Naive Bayesian ◽  
Class Distribution ◽  
Naïve Bayesian ◽  
R Programming ◽  
The Impact

Malaria disease is one whose presence is rampant in semi urban and non-urban areas especially resource poor developing countries. It is quite evident from the datasets like malaria, dengue, etc., where there is always a possibility of having more negative patients (non-occurrence of the disease) compared to patients suffering from disease (positive cases). Developing a model based decision support system with such unbalanced datasets is a cause of concern and it is indeed necessary to have a model predicting the disease quite accurately. Classification of imbalanced malaria disease data become a crucial task in medical application domain because most of the conventional machine learning algorithms are showing very poor performance to classify whether a patient is affected by malaria disease or not. In imbalanced data, majority (unaffected) class samples are dominates the minority (affected) class samples leading to class imbalance. To overcome the nature of class imbalance problem, balancing the data samples is the best solution which produces the better accuracy in classification of minority samples. The aim of this research is to propose a comparative study on classifying the imbalanced malaria disease data using Naive Bayesian classifier in different environments like weka and using an R-language. We present here, clinical descriptive study on 165 patients of different age group people collected at medical wards of Narasaraopet from 2014-17. Synthetic Minority Oversampling Technique (SMOTE) technique has been used to balance the class distribution and then we performed a comparative study on the dataset using Naïve Bayesian algorithm in various platforms. Out of balanced class distribution data, 70% data was given to train the Naive Bayesian algorithm and the rest of the data was used for testing the model for both weka and R programming environments. Experimental results have indicated that, classification of malaria disease data in weka environment has highest accuracy of 88.5% than the Naive Bayesian algorithm accuracy of 87.5% using R programming language. The impact of vector borne disease is very high in medical applications. Prediction of disease like malaria is an hour of the need and this is possible only with a suitable model for a given dataset. Hence, we have developed a model with Naive Bayesian algorithm is used for current research.    

scholarly journals A Dynamic Ensemble Framework for Mining Textual Streams with Class Imbalance

2014 ◽  
Vol 2014 ◽  
pp. 1-11 ◽  
Author(s):  
Ge Song ◽  
Yunming Ye
Keyword(s):  
Large Scale ◽  
State Of The Art ◽  
Concept Drift ◽  
Real Life ◽  
Class Imbalance ◽  
High Dimensional ◽  
Adaptive Selection ◽  
Stream Classification ◽  
Rare Class

Textual stream classification has become a realistic and challenging issue since large-scale, high-dimensional, and non-stationary streams with class imbalance have been widely used in various real-life applications. According to the characters of textual streams, it is technically difficult to deal with the classification of textual stream, especially in imbalanced environment. In this paper, we propose a new ensemble framework, clustering forest, for learning from the textual imbalanced stream with concept drift (CFIM). The CFIM is based on ensemble learning by integrating a set of clustering trees (CTs). An adaptive selection method, which flexibly chooses the useful CTs by the property of the stream, is presented in CFIM. In particular, to deal with the problem of class imbalance, we collect and reuse both rare-class instances and misclassified instances from the historical chunks. Compared to most existing approaches, it is worth pointing out that our approach assumes that both majority class and rareclass may suffer from concept drift. Thus the distribution of resampled instances is similar to the current concept. The effectiveness of CFIM is examined in five real-world textual streams under an imbalanced nonstationary environment. Experimental results demonstrate that CFIM achieves better performance than four state-of-the-art ensemble models.

scholarly journals K-means-SMOTE for handling class imbalance in the classification of diabetes with C4.5, SVM, and naive Bayes

2020 ◽  
Vol 8 (2) ◽  
pp. 89-93 ◽  
Author(s):  
Hairani Hairani ◽  
Khurniawan Eko Saputro ◽  
Sofiansyah Fadli
Keyword(s):  
Naive Bayes ◽  
Class Imbalance ◽  
Naïve Bayes ◽  
Data Sampling ◽  
Minority Class ◽  
Class A ◽  
Positive Class ◽  
Negative Class ◽  
Imbalanced Class

The occurrence of imbalanced class in a dataset causes the classification results to tend to the class with the largest amount of data (majority class). A sampling method is needed to balance the minority class (positive class) so that the class distribution becomes balanced and leading to better classification results. This study was conducted to overcome imbalanced class problems on the Indian Pima diabetes illness dataset using k-means-SMOTE. The dataset has 268 instances of the positive class (minority class) and 500 instances of the negative class (majority class). The classification was done by comparing C4.5, SVM, and naïve Bayes while implementing k-means-SMOTE in data sampling. Using k-means-SMOTE, the SVM classification method has the highest accuracy and sensitivity of 82 % and 77 % respectively, while the naive Bayes method produces the highest specificity of 89 %.

scholarly journals Drug discrimination of Near Infrared spectroscopy based on the scaled convex hull classifier

2014 ◽  
Vol 07 (04) ◽  
pp. 1450020
Author(s):  
Zhenbing Liu ◽  
Shujie Jiang ◽  
Huihua Yang
Keyword(s):  
Infrared Spectroscopy ◽  
Convex Hull ◽  
Near Infrared Spectroscopy ◽  
Near Infrared ◽  
Class Imbalance ◽  
Discrimination Performance ◽  
Computational Method ◽  
Pharmaceutical Drugs ◽  
Class Imbalance Problem

Near Infrared spectroscopy (NIRS) has been widely used in the discrimination (classification) of pharmaceutical drugs. In real applications, however, the class imbalance of the drug samples, i.e., the number of one drug sample may be much larger than the number of the other drugs, deceases drastically the discrimination performance of the classification models. To address this class imbalance problem, a new computational method — the scaled convex hull (SCH)-based maximum margin classifier is proposed in this paper. By a suitable selection of the reduction factor of the SCHs generated by the two classes of drug samples, respectively, the maximal margin classifier between SCHs can be constructed which can obtain good classification performance. With an optimization of the parameters involved in the modeling by Cuckoo Search, a satisfied model is achieved for the classification of the drug. The experiments on spectra samples produced by a pharmaceutical company show that the proposed method is more effective and robust than the existing ones.

CLASSIFICATION OF IMBALANCED DATA: A REVIEW

2009 ◽  
Vol 23 (04) ◽  
pp. 687-719 ◽  
Author(s):  
YANMIN SUN ◽  
ANDREW K. C. WONG ◽  
MOHAMED S. KAMEL
Keyword(s):  
Learning Algorithms ◽  
Class Imbalance ◽  
Imbalanced Data ◽  
Class Imbalance Problem ◽  
Class Distribution ◽  
Imbalance Problem ◽  
Misclassification Costs ◽  
Imbalanced Class Distribution ◽  
Classifier Learning

Classification of data with imbalanced class distribution has encountered a significant drawback of the performance attainable by most standard classifier learning algorithms which assume a relatively balanced class distribution and equal misclassification costs. This paper provides a review of the classification of imbalanced data regarding: the application domains; the nature of the problem; the learning difficulties with standard classifier learning algorithms; the learning objectives and evaluation measures; the reported research solutions; and the class imbalance problem in the presence of multiple classes.

Sign in / Sign up

Export Citation Format

Share Document