Imbalanced Data Classification Based on Clustering

2013 ◽  
Vol 443 ◽  
pp. 741-745
Author(s):  
Hu Li ◽  
Peng Zou ◽  
Wei Hong Han ◽  
Rong Ze Xia
Keyword(s):  
Real World ◽  
Imbalanced Data ◽  
Data Classification ◽  
Comprehensive Analysis ◽  
Classification Method ◽  
Classification Methods ◽  
Real World Data ◽  
Minority Class ◽  
Imbalanced Data Classification ◽  
Traditional Classification

Many real world data is imbalanced, i.e. one category contains significantly more samples than other categories. Traditional classification methods take different categories equally and are often ineffective. Based on the comprehensive analysis of existing researches, we propose a new imbalanced data classification method based on clustering. The method clusters both majority class and minority class at first. Then, clustered minority class will be over-sampled by SMOTE while clustered majority class be under-sampled randomly. Through clustering, the proposed method can avoid the loss of useful information while resampling. Experiments on several UCI datasets show that the proposed method can effectively improve the classification results on imbalanced data.

scholarly journals Oversampling for Imbalanced Data via Optimal Transport

2019 ◽  
Vol 33 ◽  
pp. 5605-5612 ◽  
Author(s):  
Yuguang Yan ◽  
Mingkui Tan ◽  
Yanwu Xu ◽  
Jiezhang Cao ◽  
Michael Ng ◽  
...  
Keyword(s):  
Real World ◽  
Optimal Transport ◽  
Imbalanced Data ◽  
Data Sets ◽  
Similar Distribution ◽  
Real World Data ◽  
Geometric Information ◽  
Minority Class ◽  
Real World Applications ◽  
Multiple Metrics

The issue of data imbalance occurs in many real-world applications especially in medical diagnosis, where normal cases are usually much more than the abnormal cases. To alleviate this issue, one of the most important approaches is the oversampling method, which seeks to synthesize minority class samples to balance the numbers of different classes. However, existing methods barely consider global geometric information involved in the distribution of minority class samples, and thus may incur distribution mismatching between real and synthetic samples. In this paper, relying on optimal transport (Villani 2008), we propose an oversampling method by exploiting global geometric information of data to make synthetic samples follow a similar distribution to that of minority class samples. Moreover, we introduce a novel regularization based on synthetic samples and shift the distribution of minority class samples according to loss information. Experiments on toy and real-world data sets demonstrate the efficacy of our proposed method in terms of multiple metrics.

scholarly journals Comprehensive Assessment of Imbalanced Data Classification

2020 ◽  
Vol 9 (4) ◽  
pp. 1426-1431
Keyword(s):  
Real World ◽  
Imbalanced Data ◽  
Predictive Modelling ◽  
Classification Problem ◽  
Minority Class ◽  
Unequal Distribution ◽  
Imbalanced Classification ◽  
Imbalanced Data Classification ◽  
Improved Performance ◽  
And Performance

This is an attempt to address the various challenges opportunities and scope for formulating and designing new procedure in imbalanced classification problem which poses a challenge to a predictive modelling as many of AI ML n DL algorithms which are extensively used for classification are always designed from the perspective of with majority of focus on assuming equal number of examples for a class. It leads to poor efficiency and performance especially in minority class. As Minority class is always very crucial and sensitive to classification errors and also its utmost important in imbalanced classification. This chapter discusses addresses and gives novel as well as deep insights with unequal distribution of classes in training datasets. Largely real time and real world classifications are comprising imbalanced distribution so need specialized techniques for more challenging and sophisticated models with minimal errors and improved performance.

scholarly journals Imbalanced data classification based on hybrid resampling and twin support vector machine

2017 ◽  
Vol 14 (3) ◽  
pp. 579-595 ◽  
Author(s):  
Lu Cao ◽  
Hong Shen
Keyword(s):  
Support Vector Machine ◽  
Real Life ◽  
Imbalanced Data ◽  
Data Classification ◽  
Training Data ◽  
Twin Support Vector Machine ◽  
Support Vector ◽  
Imbalanced Datasets ◽  
Minority Class ◽  
Imbalanced Data Classification

Imbalanced datasets exist widely in real life. The identification of the minority class in imbalanced datasets tends to be the focus of classification. As a variant of enhanced support vector machine (SVM), the twin support vector machine (TWSVM) provides an effective technique for data classification. TWSVM is based on a relative balance in the training sample dataset and distribution to improve the classification accuracy of the whole dataset, however, it is not effective in dealing with imbalanced data classification problems. In this paper, we propose to combine a re-sampling technique, which utilizes oversampling and under-sampling to balance the training data, with TWSVM to deal with imbalanced data classification. Experimental results show that our proposed approach outperforms other state-of-art methods.

scholarly journals Increasing Minority Recall Support Vector Machine Model for Imbalanced Data Classification

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Chunye Wu ◽  
Nan Wang ◽  
Yu Wang
Keyword(s):  
Support Vector Machine ◽  
Medical Diagnosis ◽  
Imbalanced Data ◽  
Data Classification ◽  
Recall Rate ◽  
Superior Performance ◽  
Support Vector ◽  
Minority Class ◽  
Imbalanced Data Classification ◽  
New Strategy

Imbalanced data classification is gaining importance in data mining and machine learning. The minority class recall rate requires special treatment in fields such as medical diagnosis, information security, industry, and computer vision. This paper proposes a new strategy and algorithm based on a cost-sensitive support vector machine to improve the minority class recall rate to 1 because the misclassification of even a few samples can cause serious losses in some physical problems. In the proposed method, the modification employs a margin compensation to make the margin lopsided, enabling decision boundary drift. When the boundary reaches a certain position, the minority class samples will be more generalized to achieve the requirement of a recall rate of 1. In the experiments, the effects of different parameters on the performance of the algorithm were analyzed, and the optimal parameters for a recall rate of 1 were determined. The experimental results reveal that, for the imbalanced data classification problem, the traditional definite cost classification scheme and the models classified using the area under the receiver operating characteristic curve criterion rarely produce results such as a recall rate of 1. The new strategy can yield a minority recall of 1 for imbalanced data as the loss of the majority class is acceptable; moreover, it improves the g -means index. The proposed algorithm provides superior performance in minority recall compared to the conventional methods. The proposed method has important practical significance in credit card fraud, medical diagnosis, and other areas.

Sign in / Sign up

Export Citation Format

Share Document