ADAW: Age decay accuracy weighted ensemble method for drifting data stream mining

Dynamic environment data generators are very often in real-world that produce data streams. A data source of a dynamic environment generates data streams in which the underlying data distribution changes very frequently with respect to time and hence results in concept drifts. As compared to the stationary environment, learning in the dynamic environment is very difficult due to the presence of concept drifts. Learning in dynamic environment requires evolutionary and adaptive approaches to be accommodated with the learning algorithms. Ensemble methods are commonly used to build classifiers for learning in a dynamic environment. The ensemble methods of learning are generally described at three very crucial aspects, namely, the learning and testing method employed, result integration method and forgetting mechanism for old concepts. In this paper, we propose a novel approach called Age Decay Accuracy Weighted (ADAW) ensemble architecture for learning in concept drifting data streams. The ADAW method assigned weights to the component classifiers based on its accuracy and its remaining life-time in the ensemble is such a way that ensures maximum accuracy. We empirically evaluated ADAW on benchmark artificial drifting data stream generators and real datasets and compared its performance with ten well-known state-of-the-art existing methods. The experimental results show that ADAW outperforms over the existing methods.

Adaptive Machine Learning for Automated Modeling of Residential Prosumer Agents

An efficient participation of prosumers in power system management depends on the quality of information they can obtain. Prosumers actions can be performed by automated agents that are operating in time-changing environments. Therefore, it is essential for them to deal with data stream problems in order to make reliable decisions based on the most accurate information. This paper provides an in-depth investigation of data and concept drift issues in accordance with residential prosumer agents. Additionally, the adaptation techniques, forgetting mechanisms, and learning strategies employed to handle these issues are explored. Accordingly, an approach is proposed to adapt the prosumer agent models to overcome the gradual and sudden concept drift concurrently. The suggested method is based on triggered adaptation techniques and performance-based forgetting mechanism. The results obtained in this study demonstrate that the proposed approach is capable of constructing efficient prosumer agents models with regard to the concept drift problem.

Invariant Representations through Adversarial Forgetting

We propose a novel approach to achieving invariance for deep neural networks in the form of inducing amnesia to unwanted factors of data through a new adversarial forgetting mechanism. We show that the forgetting mechanism serves as an information-bottleneck, which is manipulated by the adversarial training to learn invariance to unwanted factors. Empirical results show that the proposed framework achieves state-of-the-art performance at learning invariance in both nuisance and bias settings on a diverse collection of datasets and tasks.

ASYMPTOTIC BEHAVIOUR OF THE STOCHASTIC MAKI–THOMPSON MODEL WITH A FORGETTING MECHANISM ON OPEN POPULATIONS

Rumours have become part of our daily lives, and their spread has a negative impact on a variety of human affairs. Therefore, how to control the spread of rumours is an important topic. In this paper, we extend the classic Maki–Thompson model from a deterministic framework to a stochastic framework with a forgetting mechanism, because real-world person-to-person communications are inevitably affected by random factors. By constructing suitable stochastic Lyapunov functions, we show that the asymptotic behaviour of the stochastic rumour model is governed by the basic reproductive number. If this number is less than one, then the solution of the stochastic rumour model oscillates around the rumour-free equilibrium under extra mild conditions, indicating the extinction of the rumour with a probability of one. Otherwise, the solution always fluctuates around the endemic equilibrium under certain parametric restrictions, implying that the rumour will continually persist. In addition, we discuss a possible intervention strategy that stops the spread of rumours by strengthening the intensity of white noise, which is very different from the deterministic rumour model without white noise. Also, numerical simulations are conducted to support our analytical results.