Analyzing and repairing concept drift adaptation in data stream classification

2021 ◽  
Author(s):  
Ben Halstead ◽  
Yun Sing Koh ◽  
Patricia Riddle ◽  
Russel Pears ◽  
Mykola Pechenizkiy ◽  
...  
Keyword(s):  
Data Stream ◽  
Concept Drift ◽  
Stream Classification ◽  
Data Stream Classification

Heuristic ensemble for unsupervised detection of multiple types of concept drift in data stream classification

2021 ◽  
pp. 1-14
Author(s):  
Hanqing Hu ◽  
Mehmed Kantardzic
Keyword(s):  
Data Stream ◽  
Concept Drift ◽  
False Alarms ◽  
Detection Accuracy ◽  
Real World Data ◽  
Traditional Concept ◽  
Stream Classification ◽  
Data Stream Classification ◽  
Detection Algorithms ◽  
Concept Drift Detection

Real-world data stream classification often deals with multiple types of concept drift, categorized by change characteristics such as speed, distribution, and severity. When labels are unavailable, traditional concept drift detection algorithms, used in stream classification frameworks, are often focused on only one type of concept drift. To overcome the limitations of traditional detection algorithms, this study proposed a Heuristic Ensemble Framework for Drift Detection (HEFDD). HEFDD aims to detect all types of concept drift by employing an ensemble of selected concept drift detection algorithms, each capable of detecting at least one type of concept drift. Experimental results show HEFDD provides significant improvement based on the z-score test when comparing detection accuracy with state-of-the-art individual algorithms. At the same time, HEFDD is able to reduce false alarms generated by individual concept drift detection algorithms.

Data Stream Mining Using Ensemble Classifier

2017 ◽  
pp. 236-249
Author(s):  
Snehlata Sewakdas Dongre ◽  
Latesh G. Malik
Keyword(s):  
Collaborative Filtering ◽  
Data Stream ◽  
Concept Drift ◽  
Ensemble Classifier ◽  
Ensemble Classification ◽  
Data Stream Mining ◽  
Main Concern ◽  
Stream Mining ◽  
Stream Classification ◽  
Data Stream Classification

A data stream is giant amount of data which is generated uncontrollably at a rapid rate from many applications like call detail records, log records, sensors applications etc. Data stream mining has grasped the attention of so many researchers. A rising problem in Data Streams is the handling of concept drift. To be a good algorithm it should adapt the changes and handle the concept drift properly. Ensemble classification method is the group of classifiers which works in collaborative manner. Overall this chapter will cover all the aspects of the data stream classification. The mission of this chapter is to discuss various techniques which use collaborative filtering for the data stream mining. The main concern of this chapter is to make reader familiar with the data stream domain and data stream mining. Instead of single classifier the group of classifiers is used to enhance the accuracy of classification. The collaborative filtering will play important role here how the different classifiers work collaborative within the ensemble to achieve a goal.

scholarly journals Cost-Sensitive Classification for Evolving Data Streams with Concept Drift and Class Imbalance

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Yange Sun ◽  
Meng Li ◽  
Lei Li ◽  
Han Shao ◽  
Yi Sun
Keyword(s):  
Data Streams ◽  
Data Stream ◽  
Learning Strategy ◽  
Concept Drift ◽  
Class Imbalance ◽  
Data Preprocessing ◽  
Cost Information ◽  
Detection Mechanism ◽  
Stream Classification ◽  
Data Stream Classification

Class imbalance and concept drift are two primary principles that exist concurrently in data stream classification. Although the two issues have drawn enough attention separately, the joint treatment largely remains unexplored. Moreover, the class imbalance issue is further complicated if data streams with concept drift. A novel Cost-Sensitive based Data Stream (CSDS) classification is introduced to overcome the two issues simultaneously. The CSDS considers cost information during the procedures of data preprocessing and classification. During the data preprocessing, a cost-sensitive learning strategy is introduced into the ReliefF algorithm for alleviating the class imbalance at the data level. In the classification process, a cost-sensitive weighting schema is devised to enhance the overall performance of the ensemble. Besides, a change detection mechanism is embedded in our algorithm, which guarantees that an ensemble can capture and react to drift promptly. Experimental results validate that our method can obtain better classification results under different imbalanced concept drifting data stream scenarios.

scholarly journals Microcluster-Based Incremental Ensemble Learning for Noisy, Nonstationary Data Streams

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-12
Author(s):  
Sanmin Liu ◽  
Shan Xue ◽  
Fanzhen Liu ◽  
Jieren Cheng ◽  
Xiulai Li ◽  
...  
Keyword(s):  
Ensemble Learning ◽  
Data Streams ◽  
Data Stream ◽  
Concept Drift ◽  
Majority Vote ◽  
Stream Classification ◽  
Model Stability ◽  
Data Stream Classification ◽  
Nonstationary Data ◽  
Synthetic Datasets

Data stream classification becomes a promising prediction work with relevance to many practical environments. However, under the environment of concept drift and noise, the research of data stream classification faces lots of challenges. Hence, a new incremental ensemble model is presented for classifying nonstationary data streams with noise. Our approach integrates three strategies: incremental learning to monitor and adapt to concept drift; ensemble learning to improve model stability; and a microclustering procedure that distinguishes drift from noise and predicts the labels of incoming instances via majority vote. Experiments with two synthetic datasets designed to test for both gradual and abrupt drift show that our method provides more accurate classification in nonstationary data streams with noise than the two popular baselines.

scholarly journals An Ensemble Extreme Learning Machine for Data Stream Classification

Algorithms ◽  
2018 ◽  
Vol 11 (7) ◽  
pp. 107 ◽  
Author(s):  
Rui Yang ◽  
Shuliang Xu ◽  
Lin Feng
Keyword(s):  
Extreme Learning Machine ◽  
Data Stream ◽  
Learning Strategy ◽  
Concept Drift ◽  
Stream Classification ◽  
Data Stream Classification ◽  
Classification Tasks ◽  
Learning Machine ◽  
Hidden Layer ◽  
Short Time

Extreme learning machine (ELM) is a single hidden layer feedforward neural network (SLFN). Because ELM has a fast speed for classification, it is widely applied in data stream classification tasks. In this paper, a new ensemble extreme learning machine is presented. Different from traditional ELM methods, a concept drift detection method is embedded; it uses online sequence learning strategy to handle gradual concept drift and uses updating classifier to deal with abrupt concept drift, so both gradual concept drift and abrupt concept drift can be detected in this paper. The experimental results showed the new ELM algorithm not only can improve the accuracy of classification result, but also can adapt to new concept in a short time.

Sign in / Sign up

Export Citation Format

Share Document