Under-sampling by algorithm with performance guaranteed for class-imbalance problem

2014 ◽  
Author(s):  
Wattana Jindaluang ◽  
Varin Chouvatut ◽  
Sanpawat Kantabutra
Keyword(s):  
Class Imbalance ◽  
Class Imbalance Problem ◽  
Imbalance Problem ◽  
Under Sampling

An Investigation of Imbalanced Ensemble Learning Methods for Cross-Project Defect Prediction

2019 ◽  
Vol 33 (12) ◽  
pp. 1959037 ◽  
Author(s):  
Shaojian Qiu ◽  
Lu Lu ◽  
Siyu Jiang ◽  
Yang Guo
Keyword(s):  
Ensemble Learning ◽  
Class Imbalance ◽  
Training Data ◽  
Defect Prediction ◽  
Class Imbalance Problem ◽  
Learning Methods ◽  
Imbalance Problem ◽  
Intelligent Software ◽  
Under Sampling ◽  
Cross Project

Machine-learning-based software defect prediction (SDP) methods are receiving great attention from the researchers of intelligent software engineering. Most existing SDP methods are performed under a within-project setting. However, there usually is little to no within-project training data to learn an available supervised prediction model for a new SDP task. Therefore, cross-project defect prediction (CPDP), which uses labeled data of source projects to learn a defect predictor for a target project, was proposed as a practical SDP solution. In real CPDP tasks, the class imbalance problem is ubiquitous and has a great impact on performance of the CPDP models. Unlike previous studies that focus on subsampling and individual methods, this study investigated 15 imbalanced learning methods for CPDP tasks, especially for assessing the effectiveness of imbalanced ensemble learning (IEL) methods. We evaluated the 15 methods by extensive experiments on 31 open-source projects derived from five datasets. Through analyzing a total of 37504 results, we found that in most cases, the IEL method that combined under-sampling and bagging approaches will be more effective than the other investigated methods.

scholarly journals CoGBUS- Center of Gravity based under Sampling Method for Imbalanced Data Classification

2019 ◽  
Vol 8 (2) ◽  
pp. 2463-2468
Keyword(s):  
Learning Community ◽  
Sampling Method ◽  
Class Imbalance ◽  
Imbalanced Data ◽  
Center Of Gravity ◽  
Classification Algorithms ◽  
Class Imbalance Problem ◽  
Imbalance Problem ◽  
Imbalanced Data Classification ◽  
Under Sampling

Learning of class imbalanced data becomes a challenging issue in the machine learning community as all classification algorithms are designed to work for balanced datasets. Several methods are available to tackle this issue, among which the resampling techniques- undersampling and oversampling are more flexible and versatile. This paper introduces a new concept for undersampling based on Center of Gravity principle which helps to reduce the excess instances of majority class. This work is suited for binary class problems. The proposed technique –CoGBUS- overcomes the class imbalance problem and brings best results in the study. We take F-Score, GMean and ROC for the performance evaluation of the method.

Resampling Methods for Solving Class Imbalance Problem in Traffic Incident Detection

2015 ◽  
Vol 744-746 ◽  
pp. 1985-1989 ◽  
Author(s):  
Miao Hua Li ◽  
Shu Yan Chen
Keyword(s):  
Class Imbalance ◽  
Detection Performance ◽  
Incident Detection ◽  
Traffic Data ◽  
Class Imbalance Problem ◽  
Classification Rate ◽  
Resampling Methods ◽  
Traffic Incident ◽  
Imbalance Problem ◽  
Under Sampling

Traffic data is highly skewed with rare traffic incidents in the real word while most of the existing automatic incident detection (AID) algorithms suffer from limitations due to their inability to detect incidents under imbalanced traffic data condition. This paper developed feasible AID algorithms based on resampling methods to process imbalanced traffic data. In order to obtain the optimal sampling method for incident detection, we compare the detection performance of different AID algorithms based on various resampling methods. The detection performance is evaluated by the common criteria including classification rate, detection rate, false alarm rate, mean time to detection and an integrated performance index. The I-880 dataset is finally used in experiments to verify the proposed algorithms. The experimental results indicate that the proposed AID algorithm based on resampling can achieve better performance through handling imbalanced traffic data problem. Moreover, the under-sampling is competitive than over-sampling for traffic incident detection.

scholarly journals RUESVMs: An Ensemble Method to Handle the Class Imbalance Problem in Land Cover Mapping Using Google Earth Engine

2020 ◽  
Vol 12 (21) ◽  
pp. 3484 ◽  
Author(s):  
Amin Naboureh ◽  
Hamid Ebrahimy ◽  
Mohsen Azadbakht ◽  
Jinhu Bian ◽  
Meisam Amani
Keyword(s):  
Vegetation Index ◽  
Normalized Difference Vegetation Index ◽  
Geometric Mean ◽  
Class Imbalance ◽  
Google Earth ◽  
Support Vector ◽  
Class Imbalance Problem ◽  
Imbalance Problem ◽  
Percentage Points ◽  
Under Sampling

Timely and accurate Land Cover (LC) information is required for various applications, such as climate change analysis and sustainable development. Although machine learning algorithms are most likely successful in LC mapping tasks, the class imbalance problem is known as a common challenge in this regard. This problem occurs during the training phase and reduces classification accuracy for infrequent and rare LC classes. To address this issue, this study proposes a new method by integrating random under-sampling of majority classes and an ensemble of Support Vector Machines, namely Random Under-sampling Ensemble of Support Vector Machines (RUESVMs). The performance of RUESVMs for LC classification was evaluated in Google Earth Engine (GEE) over two different case studies using Sentinel-2 time-series data and five well-known spectral indices, including the Normalized Difference Vegetation Index (NDVI), Green Normalized Difference Vegetation Index (GNDVI), Soil-Adjusted Vegetation Index (SAVI), Normalized Difference Built-up Index (NDBI), and Normalized Difference Water Index (NDWI). The performance of RUESVMs was also compared with the traditional SVM and combination of SVM with three benchmark data balancing techniques namely the Random Over-Sampling (ROS), Random Under-Sampling (RUS), and Synthetic Minority Over-sampling Technique (SMOTE). It was observed that the proposed method considerably improved the accuracy of LC classification, especially for the minority classes. After adopting RUESVMs, the overall accuracy of the generated LC map increased by approximately 4.95 percentage points, and this amount for the geometric mean of producer’s accuracies was almost 3.75 percentage points, in comparison to the most accurate data balancing method (i.e., SVM-SMOTE). Regarding the geometric mean of users’ accuracies, RUESVMs also outperformed the SVM-SMOTE method with an average increase of 6.45 percentage points.

A Novel Hybrid-Based Ensemble for Class Imbalance Problem

2018 ◽  
Vol 27 (06) ◽  
pp. 1850025 ◽  
Author(s):  
Huaping Guo ◽  
Jun Zhou ◽  
Chang-an Wu ◽  
Wei She
Keyword(s):  
Class Imbalance ◽  
Imbalanced Data ◽  
Sampling Technique ◽  
Original Training ◽  
Training Set ◽  
Class Imbalance Problem ◽  
Minority Class ◽  
Imbalance Problem ◽  
Under Sampling ◽  
Feature Projection

Class-imbalance is very common in real world. However, conventional advanced methods do not work well on imbalanced data due to imbalanced class distribution. This paper proposes a simple but effective Hybrid-based Ensemble (HE) to deal with two-class imbalanced problem. HE learns a hybrid ensemble using the following two stages: (1) learning several projection matrixes from the rebalanced data obtained by under-sampling the original training set and constructing new training sets by projecting the original training set to different spaces defined by the matrixes, and (2) undersampling several subsets from each new training set and training a model on each subset. Here, feature projection aims to improve the diversity between ensemble members and under-sampling technique is to improve generalization ability of individual members on minority class. Experimental results show that, compared with other state-of-the-art methods, HE shows significantly better performance on measures of AUC, G-mean, F-measure and recall.

Sign in / Sign up

Export Citation Format

Share Document