Automated real-time anomaly detection of temperature sensors through machine-learning

2020 ◽  
Vol 34 (3) ◽  
pp. 137
Author(s):  
Harry Perros ◽  
Debanjana Nayak

This research discloses how to utilize machine learning methods for anomaly detection in real-time on a computer network. While utilizing machine learning for this task is definitely not a novel idea, little literature is about the matter of doing it in real-time. Most machine learning research in PC network anomaly detection depends on the KDD '99 data set and means to demonstrate the proficiency of the algorithms introduced. The emphasis on this data set has caused a lack of scientific papers disclosing how to assemble network data, remove features, and train algorithms for use inreal-time networks. It has been contended that utilizing the KDD '99 dataset for anomaly detection is not appropriate for real-time network systems. This research proposes how the data gathering procedure will be possible utilizing a dummy network and generating synthetic network traffic by analyzing the importance of One-class SVM. As the efficiency of k-means clustering and LTSM neural networks is lower than one-class SVM, that is why this research uses the results of existing research of LSTM and k-means clustering for the comparison with reported outcomes of a similar algorithm on the KDD '99 dataset. Precisely, without engaging KDD ’99 data set by using synthetic network traffic, this research achieved the higher accuracy as compared to the previous researches.


Proceedings ◽  
2020 ◽  
Vol 54 (1) ◽  
pp. 38
Author(s):  
David Novoa-Paradela ◽  
Óscar Fontenla-Romero ◽  
Bertha Guijarro-Berdiñas

Anomaly detection is a sub-area of machine learning that deals with the development of methods to distinguish among normal and anomalous data. Due to the frequent use of anomaly-detection systems in monitoring and the lack of methods capable of learning in real time, this research presents a new method that provides such online adaptability. The method bases its operation on the properties of scaled convex hulls. It begins building a convex hull, using a minimum set of data, that is adapted and subdivided along time to accurately fit the boundary of the normal class data. The model has online learning ability and its execution can be carried out in a distributed and parallel way, all of them interesting advantages when dealing with big datasets. The method has been compared to other state-of-the-art algorithms demonstrating its effectiveness.


Sensors ◽  
2020 ◽  
Vol 20 (14) ◽  
pp. 3987 ◽  
Author(s):  
Toshitaka Yamakawa ◽  
Miho Miyajima ◽  
Koichi Fujiwara ◽  
Manabu Kano ◽  
Yoko Suzuki ◽  
...  

A warning prior to seizure onset can help improve the quality of life for epilepsy patients. The feasibility of a wearable system for predicting epileptic seizures using anomaly detection based on machine learning is evaluated. An original telemeter is developed for continuous measurement of R-R intervals derived from an electrocardiogram. A bespoke smartphone app calculates the indices of heart rate variability in real time from the R-R intervals, and the indices are monitored using multivariate statistical process control by the smartphone app. The proposed system was evaluated on seven epilepsy patients. The accuracy and reliability of the R-R interval measurement, which was examined in comparison with the reference electrocardiogram, showed sufficient performance for heart rate variability analysis. The results obtained using the proposed system were compared with those obtained using the existing video and electroencephalogram assessments; it was noted that the proposed method has a sensitivity of 85.7% in detecting heart rate variability change prior to seizures. The false positive rate of 0.62 times/h was not significantly different from the healthy controls. The prediction performance and practical advantages of portability and real-time operation are demonstrated in this study.


2021 ◽  
Vol 3 ◽  
Author(s):  
Haizhou Du ◽  
Shiwei Wang ◽  
Huan Huo

In recent years, the emergence of distributed machine learning has enabled deep learning models to ensure data security and privacy while training efficiently. Anomaly detection for network traffic in distributed machine learning scenarios is of great significance for network security. Although deep neural networks have made remarkable achievements in anomaly detection for network traffic, they mainly focus on closed sets, that is, assuming that all anomalies are known. However, in a real network environment, unknown abnormalities are fatal risks faced by the system because they have no labels and occur before the known anomalies. In this study, we design and implement XFinder, a dynamic unknown traffic anomaly detection framework in distributed machine learning. XFinder adopts an online mode to detect unknown anomalies in real-time. XFinder detects unknown anomalies by the unknowns detector, transfers the unknown anomalies to the prior knowledge base by the network updater, and adopts the online mode to report new anomalies in real-time. The experimental results show that the average accuracy of the unknown anomaly detection of our model is increased by 27% and the average F1-Score is improved by 20%. Compared with the offline mode, XFinder’s detection time is reduced by an average of approximately 33% on three datasets, and can better meet the network requirement.


2021 ◽  
Author(s):  
Mustafa Can Kara ◽  
Malina Majeran ◽  
Bret Peterson ◽  
Tom Wimberly ◽  
Greg Sinclair

Abstract Deepwater wells possess a high risk of sand escaping the reservoir into the production systems. Sand production is a common operational issue which results in potential equipment damage and hence product contamination. Excessive sand erosion causes blockage in tubulars and cavities in downhole equipment (subsea valves, chokes, bends etc.), resulting in maintenance costs for subsea equipment that adds up to millions of dollars yearly to operators. In this work, a scalable Machine Learning (ML) model readily accessing historical and real-time feed of sensor and simulation data is built to develop a predictive solution. Deployed workflow can inform Control Room Operators before significant damage occurs. An anomaly detection architecture, a common unsupervised learning framework for maintenance analytics, is deployed. Anomaly detection models include methods within the scope of dimensionality reduction. Principle Component Analysis (PCA) and Long Short-Term Memory (LSTM) Autoencoders are deployed to tackle the problem through reconstruction of the original input. During the workflow, a threshold is calculated after batch training and passed along with anomaly error scores in real-time. An alarm is triggered once the real-time anomaly score passes the threshold calculated during batch training. ML outputs are streamlined in near real-time to the database. In this study, deployed ML model performance is benchmarked against a GOM Deepwater well where sanding is known to occur often. The ML Model architecture can process data that is captured by OSI PI historian, predict anomalous sanding events in advance, and is shown to be scalable to other wells in GOM. It is noted from this study that streamlined ML architecture and outputs simplify exploratory data analysis and model deployment across Onshore and Offshore Business Units. In addition, sanding stakeholders are notified in advance and can take early mitigative action before significant damage to wellhead or downhole equipment occurs instead of reacting to a possible sanding event offshore. The novelty of the utilized ML algorithm and process is in the ability to predict sanding anomalies in advance through ML batch training, infer prediction values near real-time, and scale to other assets.


Sign in / Sign up

Export Citation Format

Share Document