scholarly journals Dynamic Weighted Majority for Incremental Learning of Imbalanced Data Streams with Concept Drift

2017 ◽  
Author(s):  
Yang Lu ◽  
Yiu-ming Cheung ◽  
Yuan Yan Tang
Keyword(s):  
Data Streams ◽  
Incremental Learning ◽  
High Efficiency ◽  
Concept Drift ◽  
Computational Cost ◽  
Class Imbalance ◽  
Real Data ◽  
Current Data ◽  
Class Imbalance Problem ◽  
Weighted Majority

Concept drifts occurring in data streams will jeopardize the accuracy and stability of the online learning process. If the data stream is imbalanced, it will be even more challenging to detect and cure the concept drift. In the literature, these two problems have been intensively addressed separately, but have yet to be well studied when they occur together. In this paper, we propose a chunk-based incremental learning method called Dynamic Weighted Majority for Imbalance Learning (DWMIL) to deal with the data streams with concept drift and class imbalance problem. DWMIL utilizes an ensemble framework by dynamically weighting the base classifiers according to their performance on the current data chunk. Compared with the existing methods, its merits are four-fold: (1) it can keep stable for non-drifted streams and quickly adapt to the new concept; (2) it is totally incremental, i.e. no previous data needs to be stored; (3) it keeps a limited number of classifiers to ensure high efficiency; and (4) it is simple and needs only one thresholding parameter. Experiments on both synthetic and real data sets with concept drift show that DWMIL performs better than the state-of-the-art competitors, with less computational cost.

scholarly journals VFC-SMOTE: very fast continuous synthetic minority oversampling for evolving data streams

2021 ◽  
Author(s):  
Alessio Bernardo ◽  
Emanuele Della Valle
Keyword(s):  
Data Streams ◽  
Concept Drift ◽  
Class Imbalance ◽  
Imbalanced Data ◽  
Real Data ◽  
Minority Class ◽  
Machine Learning Classification ◽  
Imbalance Learning ◽  
Class Imbalance Learning ◽  
Better Than

AbstractThe world is constantly changing, and so are the massive amount of data produced. However, only a few studies deal with online class imbalance learning that combines the challenges of class-imbalanced data streams and concept drift. In this paper, we propose the very fast continuous synthetic minority oversampling technique (VFC-SMOTE). It is a novel meta-strategy to be prepended to any streaming machine learning classification algorithm aiming at oversampling the minority class using a new version of Smote and Borderline-Smote inspired by Data Sketching. We benchmarked VFC-SMOTE pipelines on synthetic and real data streams containing different concept drifts, imbalance levels, and class distributions. We bring statistical evidence that VFC-SMOTE pipelines learn models whose minority class performances are better than state-of-the-art. Moreover, we analyze the time/memory consumption and the concept drift recovery speed.

scholarly journals Minority Resampling Based Ensemble Framework Using Enhanced Early Drift Detection Method For Imbalanced Data Streams

2021 ◽  
Author(s):  
Priya S ◽  
Annie Uthra
Keyword(s):  
Data Streams ◽  
Data Stream ◽  
Detection Method ◽  
Concept Drift ◽  
Class Imbalance ◽  
Current Data ◽  
Classification Model ◽  
Ensemble Classifiers ◽  
K Nearest Neighbor ◽  
Jaccard Similarity

Abstract As the data mining applications are increasing popularly, large volumes of data streams are generated over the period of time. The main problem in data streams is that it exhibits a high degree of class imbalance and distribution of data changes over time. In this paper, Timely Drift Detection and Minority Resampling Technique (TDDMRT) based on K-nearest neighbor and Jaccard similarity is proposed to handle the class imbalance by finding the current ratio of class labels. The Enhanced Early Drift Detection Method (EEDDM) is proposed for detecting the concept drift and the Minority Resampling Method (KNN-JS) determines whether the current data stream should be regarded as imbalance and it resamples the minority instances in the drifting data stream. The K-Nearest Neighbors technique is used to resample the minority classes and the Jaccard similarity measure is established over the resampled data to generate the synthetic data similar to the original data and it is handled by ensemble classifiers. The proposed ensemble based classification model outperforms the existing over sampling and under sampling techniques with accuracy of 98.52%.

A Survey of Class Imbalance Problem on Evolving Data Stream

2021 ◽  
pp. 23-41
Author(s):  
D. Himaja ◽  
T. Maruthi Padmaja ◽  
P. Radha Krishna
Keyword(s):  
Change Detection ◽  
Data Streams ◽  
Data Stream ◽  
Concept Drift ◽  
Class Imbalance ◽  
Detection Methods ◽  
Class Imbalance Problem ◽  
Imbalance Problem ◽  
Learning From Data ◽  
Main Emphasis

Learning from data streams with both online class imbalance and concept drift (OCI-CD) is receiving much attention in today's world. Due to this problem, the performance is affected for the current models that learn from both stationary as well as non-stationary environments. In the case of non-stationary environments, due to the imbalance, it is hard to spot the concept drift using conventional drift detection methods that aim at tracking the change detection based on the learner's performance. There is limited work on the combined problem from imbalanced evolving streams both from stationary and non-stationary environments. Here the data may be evolved with complete labels or with only limited labels. This chapter's main emphasis is to provide different methods for the purpose of resolving the issue of class imbalance in emerging streams, which involves changing and unchanging environments with supervised and availability of limited labels.

scholarly journals Handling Concept Drift in Data Stream Classification

2019 ◽  
Vol 8 (10) ◽  
pp. 548-550
Keyword(s):  
Data Streams ◽  
Data Stream ◽  
Concept Drift ◽  
Research Work ◽  
Class Imbalance ◽  
Class Imbalance Problem ◽  
Stream Classification ◽  
Data Stream Classification ◽  
Imbalance Problem ◽  
Major Factors

Data Streams are having huge volume and it can-not be stored permanently in the memory for processing. In this paper we would be mainly focusing on issues in data stream, the major factors which are affecting the accuracy of classifier like imbalance class and Concept Drift. The drift in Data Stream mining refers to the change in data. Such as Class imbalance problem notifies that the samples are in the classes are not equal. In our research work we are trying to identify the change (Drift) in data, we are trying to detect Imbalance class and noise from changed data. And According to the type of drift we are applying the algorithms and trying to make the stream more balance and noise free to improve classifier’s accuracy.

scholarly journals Mining Massive E-Health Data Streams for IoMT Enabled Healthcare Systems

Sensors ◽  
2020 ◽  
Vol 20 (7) ◽  
pp. 2131 ◽  
Author(s):  
Affan Ahmed Toor ◽  
Muhammad Usman ◽  
Farah Younas ◽  
Alvis Cheuk M. Fong ◽  
Sajid Ali Khan ◽  
...  
Keyword(s):  
Data Streams ◽  
Detection Method ◽  
Concept Drift ◽  
Class Imbalance ◽  
Health Data ◽  
Smart Devices ◽  
Detection Delay ◽  
Medical Sensors ◽  
Synthetic Datasets ◽  
Almost All

With the increasing popularity of the Internet-of-Medical-Things (IoMT) and smart devices, huge volumes of data streams have been generated. This study aims to address the concept drift, which is a major challenge in the processing of voluminous data streams. Concept drift refers to overtime change in data distribution. It may occur in the medical domain, for example the medical sensors measuring for general healthcare or rehabilitation, which may switch their roles for ICU emergency operations when required. Detecting concept drifts becomes trickier when the class distributions in data are skewed, which is often true for medical sensors e-health data. Reactive Drift Detection Method (RDDM) is an efficient method for detecting long concepts. However, RDDM has a high error rate, and it does not handle class imbalance. We propose an Enhanced Reactive Drift Detection Method (ERDDM), which systematically generates strategies to handle concept drift with class imbalance in data streams. We conducted experiments to compare ERDDM with three contemporary techniques in terms of prediction error, drift detection delay, latency, and ability to handle data imbalance. The experimentation was done in Massive Online Analysis (MOA) on 48 synthetic datasets customized to possess the capabilities of data streams. ERDDM can handle abrupt and gradual drifts and performs better than all benchmarks in almost all experiments.

scholarly journals Real-Time Route Search by Locations

2020 ◽  
Vol 34 (01) ◽  
pp. 574-581
Author(s):  
Lisi Chen ◽  
Shuo Shang ◽  
Tao Guo
Keyword(s):  
Real Time ◽  
Data Streams ◽  
High Efficiency ◽  
Route Planning ◽  
Real Data ◽  
Location Based Services ◽  
Good Time ◽  
Efficient Route ◽  
Route Search ◽  
Insight Into

With the proliferation of GPS-based data (e.g., routes and trajectories), it is of great importance to enable the functionality of real-time route search and recommendations. We define and study a novel Continuous Route-Search-by-Location (C-RSL) problem to enable real-time route search by locations for a large number of users over route data streams. Given a set of C-RSL queries where each query q contains a set of places q.O to visit and a threshold q.θ, we continuously feed each query q with routes that has similarity to q.O no less than q.θ. We also extend our proposal to support top-k C-RSL problem where each query continuously maintains k most similar routes. The C-RSL problem targets a variety of applications, including real-time route planning, ridesharing, and other location-based services that have real-time demand. To enable efficient route matching on a large number of C-RSL queries, we develop novel parallel route matching algorithms with good time complexity. Extensive experiments with real data offer insight into the performance of our algorithms, indicating that our proposal is capable of achieving high efficiency and scalability.

scholarly journals Cost-Sensitive Classification for Evolving Data Streams with Concept Drift and Class Imbalance

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Yange Sun ◽  
Meng Li ◽  
Lei Li ◽  
Han Shao ◽  
Yi Sun
Keyword(s):  
Data Streams ◽  
Data Stream ◽  
Learning Strategy ◽  
Concept Drift ◽  
Class Imbalance ◽  
Data Preprocessing ◽  
Cost Information ◽  
Detection Mechanism ◽  
Stream Classification ◽  
Data Stream Classification

Class imbalance and concept drift are two primary principles that exist concurrently in data stream classification. Although the two issues have drawn enough attention separately, the joint treatment largely remains unexplored. Moreover, the class imbalance issue is further complicated if data streams with concept drift. A novel Cost-Sensitive based Data Stream (CSDS) classification is introduced to overcome the two issues simultaneously. The CSDS considers cost information during the procedures of data preprocessing and classification. During the data preprocessing, a cost-sensitive learning strategy is introduced into the ReliefF algorithm for alleviating the class imbalance at the data level. In the classification process, a cost-sensitive weighting schema is devised to enhance the overall performance of the ensemble. Besides, a change detection mechanism is embedded in our algorithm, which guarantees that an ensemble can capture and react to drift promptly. Experimental results validate that our method can obtain better classification results under different imbalanced concept drifting data stream scenarios.

Learning from Unbalanced Stream Data in Non-Stationary Environments Using Logistic Regression Model

2016 ◽  
pp. 561-582
Author(s):  
Pallavi Digambarrao Kulkarni ◽  
Roshani Ade
Keyword(s):  
Learning Strategies ◽  
Real World ◽  
Incremental Learning ◽  
Concept Drift ◽  
Data Distribution ◽  
Class Imbalance ◽  
Learning Approaches ◽  
Stream Data ◽  
Future Data ◽  
Distribution Generation

There are several deep learning approaches that can be applied for analyzing situations in real world problems and inventing their solution in a scientific technique. Supervised data mining methods that predicts instance values, using previously obtained results from already collected data are pretty popular due to their intelligence in machine learning area. Stream data is continuous form of data which can be handled by using incremental learning approach. Stream data learning may face several challenges in real world like concept drift or class imbalance. Concept drift occurs in non-stationary environment where data distribution generation function is dynamic in nature and has no fixed formula to predict the future data distribution nature. Neural network techniques are intelligent enough to improve performance of algorithmic systems that work in such problem domains. This chapter briefly describes how MLP technique is integrated in system so that the system becomes a complete framework for handling unbalanced data with concept drift in the incremental learning strategies.

Sign in / Sign up

Export Citation Format

Share Document