scholarly journals Online Anomaly Detection Using Statistical Leverage for Streaming Business Process Events

Author(s):  
Jonghyeon Ko ◽  
Marco Comuzzi
2019 ◽  
Vol 12 (1) ◽  
pp. 54-75 ◽  
Author(s):  
Gabriel Marques Tavares ◽  
Victor Guilherme Turrisi da Costa ◽  
Vinicius Eiji Martins ◽  
Paolo Ceravolo ◽  
Sylvio Barbon Jr.

Identifying fraudulent or anomalous business procedures is today a key challenge for organisations of any dimension. Nonetheless, the continuous nature of business activities conveys to the continuous acquisition of data in support of business process monitoring. In light of this, we propose a method for online anomaly detection in business processes. From a stream of events, our approach extract cases descriptors and applies a density-based clustering technique to detect outliers. We applied our method to a real-life dataset, and we used streaming clustering measures for evaluating performances. Exploring different combinations of parameters, we obtained promising performance metrics, showing that our method is capable of finding anomalous process instances in a vast complexity of scenarios.


2020 ◽  
Author(s):  
Bo Zhang ◽  
Hongyu Zhang ◽  
Pablo Moscato

<div>Complex software intensive systems, especially distributed systems, generate logs for troubleshooting. The logs are text messages recording system events, which can help engineers determine the system's runtime status. This paper proposes a novel approach named ADR (stands for Anomaly Detection by workflow Relations) that employs matrix nullspace to mine numerical relations from log data. The mined relations can be used for both offline and online anomaly detection and facilitate fault diagnosis. We have evaluated ADR on log data collected from two distributed systems, HDFS (Hadoop Distributed File System) and BGL (IBM Blue Gene/L supercomputers system). ADR successfully mined 87 and 669 numerical relations from the logs and used them to detect anomalies with high precision and recall. For online anomaly detection, ADR employs PSO (Particle Swarm Optimization) to find the optimal sliding windows' size and achieves fast anomaly detection.</div><div>The experimental results confirm that ADR is effective for both offline and online anomaly detection. </div>


Author(s):  
Alireza Vafaei Sadr ◽  
Bruce A. Bassett ◽  
M. Kunz

AbstractAnomaly detection is challenging, especially for large datasets in high dimensions. Here, we explore a general anomaly detection framework based on dimensionality reduction and unsupervised clustering. DRAMA is released as a general python package that implements the general framework with a wide range of built-in options. This approach identifies the primary prototypes in the data with anomalies detected by their large distances from the prototypes, either in the latent space or in the original, high-dimensional space. DRAMA is tested on a wide variety of simulated and real datasets, in up to 3000 dimensions, and is found to be robust and highly competitive with commonly used anomaly detection algorithms, especially in high dimensions. The flexibility of the DRAMA framework allows for significant optimization once some examples of anomalies are available, making it ideal for online anomaly detection, active learning, and highly unbalanced datasets. Besides, DRAMA naturally provides clustering of outliers for subsequent analysis.


Author(s):  
C. Birk Jones ◽  
Adrian Chavez ◽  
Shamina Hossain-McKenzie ◽  
Nicholas Jacobs ◽  
Adam Summers ◽  
...  

Author(s):  
Gabriel Marques Tavares ◽  
Victor G. Turrisi da Costa ◽  
Vinicius Eiji Martins ◽  
Paolo Ceravolo ◽  
Sylvio Barbon

2017 ◽  
Vol 50 (6) ◽  
pp. 430-438 ◽  
Author(s):  
Yoshinari Hori ◽  
Hiroki Yamamoto ◽  
Tomoko Suzuki ◽  
Jun Okitsu ◽  
Tomohiro Nakamura ◽  
...  

2021 ◽  
pp. 99-129
Author(s):  
Florian Skopik ◽  
Markus Wurzenberger ◽  
Max Landauer

Sign in / Sign up

Export Citation Format

Share Document