scholarly journals Recent Advances in Anomaly Detection Methods applied to Aviation

2019 ◽  
Author(s):  
Luis Basora ◽  
Xavier Olive ◽  
Thomas Dubot
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Data Driven ◽  
Sensor Data ◽  
Detection Methods ◽  
Series Data ◽  
Detection Techniques ◽  
Advantages And Disadvantages ◽  
Recent Advances ◽  
Flight Operations

Anomaly detection is an active area of research with numerous methods and applications. This survey reviews the state-of-the-art of data-driven anomaly detection techniques and their application to the the aviation domain. After a brief introduction to the main traditional data-driven methods for anomaly detection, we review the recent advances in the area of neural networks, deep learning and temporal-logic based learning. We cover especially unsupervised techniques applicable to time series data because of their relevance to the aviation domain, where the lack of labeled data is the most usual case, and the nature of flight trajectories and sensor data is sequential, or temporal. The advantages and disadvantages of each method are presented in terms of computational efficiency and detection efficacy. The second part of the survey explores the application of anomaly detection techniques to aviation and their contributions to the improvement of the safety and performance of flight operations and aviation systems. As far as we know, some of the presented methods have not yet found an application in the aviation domain. We review applications ranging from the identification of significant operational events in air traffic operations to the prediction of potential aviation system failures for predictive maintenance.

scholarly journals Recent Advances in Anomaly Detection Methods Applied to Aviation

Aerospace ◽  
2019 ◽  
Vol 6 (11) ◽  
pp. 117 ◽  
Author(s):  
Luis Basora ◽  
Xavier Olive ◽  
Thomas Dubot
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Data Driven ◽  
Sensor Data ◽  
Detection Methods ◽  
Series Data ◽  
Detection Techniques ◽  
Advantages And Disadvantages ◽  
Recent Advances ◽  
Flight Operations

Anomaly detection is an active area of research with numerous methods and applications. This survey reviews the state-of-the-art of data-driven anomaly detection techniques and their application to the aviation domain. After a brief introduction to the main traditional data-driven methods for anomaly detection, we review the recent advances in the area of neural networks, deep learning and temporal-logic based learning. In particular, we cover unsupervised techniques applicable to time series data because of their relevance to the aviation domain, where the lack of labeled data is the most usual case, and the nature of flight trajectories and sensor data is sequential, or temporal. The advantages and disadvantages of each method are presented in terms of computational efficiency and detection efficacy. The second part of the survey explores the application of anomaly detection techniques to aviation and their contributions to the improvement of the safety and performance of flight operations and aviation systems. As far as we know, some of the presented methods have not yet found an application in the aviation domain. We review applications ranging from the identification of significant operational events in air traffic operations to the prediction of potential aviation system failures for predictive maintenance.

scholarly journals Indirectly Supervised Anomaly Detection of Clinically Meaningful Health Events from Smart Home Data

2021 ◽  
Vol 12 (2) ◽  
pp. 1-18
Author(s):  
Jessamyn Dahmen ◽  
Diane J. Cook
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Bayesian Optimization ◽  
Detection Methods ◽  
Series Data ◽  
Detection Techniques ◽  
Health Events ◽  
Warm Start ◽  
Health Related ◽  
Unsupervised Algorithms

Anomaly detection techniques can extract a wealth of information about unusual events. Unfortunately, these methods yield an abundance of findings that are not of interest, obscuring relevant anomalies. In this work, we improve upon traditional anomaly detection methods by introducing Isudra, an Indirectly Supervised Detector of Relevant Anomalies from time series data. Isudra employs Bayesian optimization to select time scales, features, base detector algorithms, and algorithm hyperparameters that increase true positive and decrease false positive detection. This optimization is driven by a small amount of example anomalies, driving an indirectly supervised approach to anomaly detection. Additionally, we enhance the approach by introducing a warm-start method that reduces optimization time between similar problems. We validate the feasibility of Isudra to detect clinically relevant behavior anomalies from over 2M sensor readings collected in five smart homes, reflecting 26 health events. Results indicate that indirectly supervised anomaly detection outperforms both supervised and unsupervised algorithms at detecting instances of health-related anomalies such as falls, nocturia, depression, and weakness.

scholarly journals A Hybrid Deep Learning Framework for Unsupervised Anomaly Detection in Multivariate Spatio-Temporal Data

2020 ◽  
Vol 10 (15) ◽  
pp. 5191
Author(s):  
Yıldız Karadayı ◽  
Mehmet N. Aydin ◽  
A. Selçuk Öğrenci
Keyword(s):  
Deep Learning ◽  
Anomaly Detection ◽  
Hurricane Katrina ◽  
Time Series Data ◽  
Hybrid Approach ◽  
Ground Truth ◽  
Outbreak Detection ◽  
Series Data ◽  
Detection Techniques ◽  
Spatio Temporal

Multivariate time-series data with a contextual spatial attribute have extensive use for finding anomalous patterns in a wide variety of application domains such as earth science, hurricane tracking, fraud, and disease outbreak detection. In most settings, spatial context is often expressed in terms of ZIP code or region coordinates such as latitude and longitude. However, traditional anomaly detection techniques cannot handle more than one contextual attribute in a unified way. In this paper, a new hybrid approach based on deep learning is proposed to solve the anomaly detection problem in multivariate spatio-temporal dataset. It works under the assumption that no prior knowledge about the dataset and anomalies are available. The architecture of the proposed hybrid framework is based on an autoencoder scheme, and it is more efficient in extracting features from the spatio-temporal multivariate datasets compared to the traditional spatio-temporal anomaly detection techniques. We conducted extensive experiments using buoy data of 2005 from National Data Buoy Center and Hurricane Katrina as ground truth. Experiments demonstrate that the proposed model achieves more than 10% improvement in accuracy over the methods used in the comparison where our model jointly processes the spatial and temporal dimensions of the contextual data to extract features for anomaly detection.

scholarly journals Forecast Quality of Physics-Based and Data-Driven PV Performance Models for a Small-Scale PV System

2021 ◽  
Vol 9 ◽  
Author(s):  
Moritz Stüber ◽  
Felix Scherhag ◽  
Matthieu Deru ◽  
Alassane Ndiaye ◽  
Muhammad Moiz Sakha ◽  
...  
Keyword(s):  
Smart Grids ◽  
Time Series Data ◽  
Short Term Memory ◽  
Data Driven ◽  
Series Data ◽  
Small Scale ◽  
Pv System ◽  
Advantages And Disadvantages ◽  
Forecast Quality

In the context of smart grids, the need for forecasts of the power output of small-scale photovoltaic (PV) arrays increases as control processes such as the management of flexibilities in the distribution grid gain importance. However, there is often only very little knowledge about the PV systems installed: even fundamental system parameters such as panel orientation, the number of panels and their type, or time series data of past PV system performance are usually unknown to the grid operator. In the past, only forecasting models that attempted to account for cause-and-effect chains existed; nowadays, also data-driven methods that attempt to recognize patterns in past behavior are available. Choosing between physics-based or data-driven forecast methods requires knowledge about the typical forecast quality as well as the requirements that each approach entails. In this contribution, the achieved forecast quality for a typical scenario (day-ahead, based on numerical weather predictions [NWP]) is evaluated for one physics-based as well as five different data-driven forecast methods for a year at the same site in south-western Germany. Namely, feed-forward neural networks (FFNN), long short-term memory (LSTM) networks, random forest, bagging and boosting are investigated. Additionally, the forecast quality of the weather forecast is analyzed for key quantities. All evaluated PV forecast methods showed comparable performance; based on concise descriptions of the forecast approaches, advantages and disadvantages of each are discussed. The approaches are viable even though the forecasts regularly differ significantly from the observed behavior; the residual analysis performed offers a qualitative insight into the achievable forecast quality in a typical real-world scenario.

scholarly journals Anomaly Detection of Water Level Using Deep Autoencoder

Sensors ◽  
2021 ◽  
Vol 21 (19) ◽  
pp. 6679
Author(s):  
Isack Thomas Nicholaus ◽  
Jun Ryeol Park ◽  
Kyuil Jung ◽  
Jun Seoung Lee ◽  
Dae-Ki Kang
Keyword(s):  
Anomaly Detection ◽  
Time Series Data ◽  
Detection System ◽  
Water Levels ◽  
Sensor Data ◽  
Series Data ◽  
Network Architectures ◽  
Data Points ◽  
Water Tanks ◽  
The Given

Anomaly detection is one of the crucial tasks in daily infrastructure operations as it can prevent massive damage to devices or resources, which may then lead to catastrophic outcomes. To address this challenge, we propose an automated solution to detect anomaly pattern(s) of the water levels and report the analysis and time/point(s) of abnormality. This research’s motivation is the level difficulty and time-consuming managing facilities responsible for controlling water levels due to the rare occurrence of abnormal patterns. Consequently, we employed deep autoencoder, one of the types of artificial neural network architectures, to learn different patterns from the given sequences of data points and reconstruct them. Then we use the reconstructed patterns from the deep autoencoder together with a threshold to report which patterns are abnormal from the normal ones. We used a stream of time-series data collected from sensors to train the model and then evaluate it, ready for deployment as the anomaly detection system framework. We run extensive experiments on sensor data from water tanks. Our analysis shows why we conclude vanilla deep autoencoder as the most effective solution in this scenario.

Variance error of multi-classification based anomaly detection for time series data

2020 ◽  
pp. 1-16
Author(s):  
Baoquan Wang ◽  
Tonghai Jiang ◽  
Xi Zhou ◽  
Bo Ma ◽  
Fan Zhao ◽  
...  
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Anomaly Detection ◽  
Time Series Data ◽  
Short Term Memory ◽  
Computational Cost ◽  
Reconstruction Error ◽  
Detection Methods ◽  
Series Data ◽  
Data Set

For abnormal detection of time series data, the supervised anomaly detection methods require labeled data. While the range of outlier factors used by the existing semi-supervised methods varies with data, model and time, the threshold for determining abnormality is difficult to obtain, in addition, the computational cost of the way to calculate outlier factors from other data points in the data set is also very large. These make such methods difficult to practically apply. This paper proposes a framework named LSTM-VE which uses clustering combined with visualization method to roughly label normal data, and then uses the normal data to train long short-term memory (LSTM) neural network for semi-supervised anomaly detection. The variance error (VE) of the normal data category classification probability sequence is used as outlier factor. The framework enables anomaly detection based on deep learning to be practically applied and using VE avoids the shortcomings of existing outlier factors and gains a better performance. In addition, the framework is easy to expand because the LSTM neural network can be replaced with other classification models. Experiments on the labeled and real unlabeled data sets prove that the framework is better than replicator neural networks with reconstruction error (RNN-RS) and has good scalability as well as practicability.

scholarly journals Recent Advancement in Anomaly Detection in Surveillance Videos

2019 ◽  
Vol 8 (2) ◽  
pp. 964-970
Keyword(s):  
Computer Vision ◽  
Anomaly Detection ◽  
Video Data ◽  
Detection Methods ◽  
Future Research ◽  
Detection Techniques ◽  
Advantages And Disadvantages ◽  
Recent Computer ◽  
Banking Education ◽  
To Come

Detection of Anomaly is of a notable and emergent problem into many diverse fields like information theory, deep learning, computer vision, machine learning, and statistics that have been researched within the various application from diverse domains including agriculture, health care, banking, education, and transport anomaly detection. Newly, numbers of important anomaly detection techniques along with diverseness of sort have been watched. The main aim of this paper to come up with a broad summary of the present development on detection of an anomaly, exclusively for video data with mixed types and high dimensionalities, where identifying the anomalous behaviors and event or anomalous patterns is a significant task. The paper expresses the advantages and disadvantages of the detection methods the experiments tried on the publically available benchmark dataset to assess numerous popular and classical methods and models. The objective of this analysis is to furnish an understanding of recent computer vision and machine algorithms methods and also state-of-the-art deep learnings techniques to detect anomalies for researchers. At last, the paper delivered roughly directions for future research on an anomalies detection.

Data-Driven Fault Detection in Aircraft Engines With Noisy Sensor Measurements

2011 ◽  
Vol 133 (8) ◽  
Author(s):  
Soumik Sarkar ◽  
Xin Jin ◽  
Asok Ray
Keyword(s):  
Fault Detection ◽  
Time Series Data ◽  
Data Driven ◽  
Sensor Data ◽  
Series Data ◽  
Test Bed ◽  
Symbolic Dynamic Filtering ◽  
Sensor Signals ◽  
Sensor Degradation ◽  
Dynamic Filtering

An inherent difficulty in sensor-data-driven fault detection is that the detection performance could be drastically reduced under sensor degradation (e.g., drift and noise). Complementary to traditional model-based techniques for fault detection, this paper proposes symbolic dynamic filtering by optimally partitioning the time series data of sensor observation. The objective here is to mask the effects of sensor noise level variation and magnify the system fault signatures. In this regard, the concepts of feature extraction and pattern classification are used for fault detection in aircraft gas turbine engines. The proposed methodology of data-driven fault detection is tested and validated on the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) test-bed developed by NASA for noisy (i.e., increased variance) sensor signals.

scholarly journals Aircraft Fleet Health Monitoring with Anomaly Detection Techniques

Aerospace ◽  
2021 ◽  
Vol 8 (4) ◽  
pp. 103
Author(s):  
Luis Basora ◽  
Paloma Bry ◽  
Xavier Olive ◽  
Floris Freeman
Keyword(s):  
Anomaly Detection ◽  
Health Monitoring ◽  
Health Management ◽  
Sensor Data ◽  
Detection Methods ◽  
Aviation Industry ◽  
Nominal Data ◽  
Detection Techniques ◽  
Aircraft System ◽  
Anomaly Score

Predictive maintenance has received considerable attention in the aviation industry where costs, system availability and reliability are major concerns. In spite of recent advances, effective health monitoring and prognostics for the scheduling of condition-based maintenance operations is still very challenging. The increasing availability of maintenance and operational data along with recent progress made in machine learning has boosted the development of data-driven prognostics and health management (PHM) models. In this paper, we describe the data workflow in place at an airline for the maintenance of an aircraft system and highlight the difficulties related to a proper labelling of the health status of such systems, resulting in a poor suitability of supervised learning techniques. We focus on investigating the feasibility and the potential of semi-supervised anomaly detection methods for the health monitoring of a real aircraft system. Proposed methods are evaluated on large volumes of real sensor data from a cooling unit system on a modern wide body aircraft from a major European airline. For the sake of confidentiality, data has been anonymized and only few technical and operational details about the system had been made available. We trained several deep neural network autoencoder architectures on nominal data and used the anomaly scores to calculate a health indicator. Results suggest that high anomaly scores are correlated with identified failures in the maintenance logs. Also, some situations see an increase in the anomaly score for several flights prior to the system’s failure, which paves a natural way for early fault identification.

Sign in / Sign up

Export Citation Format

Share Document