scholarly journals Explainable Deep Neural Networks for Multivariate Time Series Predictions

2019 ◽  
Author(s):  
Roy Assaf ◽  
Anika Schumann
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Network Architecture ◽  
Power Plants ◽  
Deep Neural Networks ◽  
Time Series Data ◽  
Multivariate Time Series ◽  
Average Energy ◽  
Series Data ◽  
Time Interval

We demonstrate that CNN deep neural networks can not only be used for making predictions based on multivariate time series data, but also for explaining these predictions. This is important for a number of applications where predictions are the basis for decisions and actions. Hence, confidence in the prediction result is crucial. We design a two stage convolutional neural network architecture which uses particular kernel sizes. This allows us to utilise gradient based techniques for generating saliency maps for both the time dimension and the features. These are then used for explaining which features during which time interval are responsible for a given prediction, as well as explaining during which time intervals was the joint contribution of all features most important for that prediction. We demonstrate our approach for predicting the average energy production of photovoltaic power plants and for explaining these predictions.

scholarly journals A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data

2019 ◽  
Vol 33 ◽  
pp. 1409-1416 ◽  
Author(s):  
Chuxu Zhang ◽  
Dongjin Song ◽  
Yuncong Chen ◽  
Xinyang Feng ◽  
Cristian Lumezanu ◽  
...  
Keyword(s):  
Time Series ◽  
Anomaly Detection ◽  
Power Plants ◽  
Time Series Data ◽  
Multivariate Time Series ◽  
Series Data ◽  
Feature Maps ◽  
Multi Scale ◽  
Unsupervised Anomaly Detection ◽  
Detection And Diagnosis

Nowadays, multivariate time series data are increasingly collected in various real world systems, e.g., power plants, wearable devices, etc. Anomaly detection and diagnosis in multivariate time series refer to identifying abnormal status in certain time steps and pinpointing the root causes. Building such a system, however, is challenging since it not only requires to capture the temporal dependency in each time series, but also need encode the inter-correlations between different pairs of time series. In addition, the system should be robust to noise and provide operators with different levels of anomaly scores based upon the severity of different incidents. Despite the fact that a number of unsupervised anomaly detection algorithms have been developed, few of them can jointly address these challenges. In this paper, we propose a Multi-Scale Convolutional Recurrent Encoder-Decoder (MSCRED), to perform anomaly detection and diagnosis in multivariate time series data. Specifically, MSCRED first constructs multi-scale (resolution) signature matrices to characterize multiple levels of the system statuses in different time steps. Subsequently, given the signature matrices, a convolutional encoder is employed to encode the inter-sensor (time series) correlations and an attention based Convolutional Long-Short Term Memory (ConvLSTM) network is developed to capture the temporal patterns. Finally, based upon the feature maps which encode the inter-sensor correlations and temporal information, a convolutional decoder is used to reconstruct the input signature matrices and the residual signature matrices are further utilized to detect and diagnose anomalies. Extensive empirical studies based on a synthetic dataset and a real power plant dataset demonstrate that MSCRED can outperform state-ofthe-art baseline methods.

Neural Network Techniques for Time Series Prediction: A Review

2019 ◽  
Vol 3 (3) ◽  
Author(s):  
Muhammad Faheem Mushtaq ◽  
Urooj Akram ◽  
Muhammad Aamir ◽  
Haseeb Ali ◽  
Muhammad Zulqarnain
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Time Series Data ◽  
Weather Prediction ◽  
Time Series Prediction ◽  
Series Data ◽  
Prediction Problem ◽  
Neural Network Models ◽  
Physical Time

It is important to predict a time series because many problems that are related to prediction such as health prediction problem, climate change prediction problem and weather prediction problem include a time component. To solve the time series prediction problem various techniques have been developed over many years to enhance the accuracy of forecasting. This paper presents a review of the prediction of physical time series applications using the neural network models. Neural Networks (NN) have appeared as an effective tool for forecasting of time series.  Moreover, to resolve the problems related to time series data, there is a need of network with single layer trainable weights that is Higher Order Neural Network (HONN) which can perform nonlinearity mapping of input-output. So, the developers are focusing on HONN that has been recently considered to develop the input representation spaces broadly. The HONN model has the ability of functional mapping which determined through some time series problems and it shows the more benefits as compared to conventional Artificial Neural Networks (ANN). The goal of this research is to present the reader awareness about HONN for physical time series prediction, to highlight some benefits and challenges using HONN.

A review of irregular time series data handling with gated recurrent neural networks

2021 ◽  
Vol 441 ◽  
pp. 161-178
Author(s):  
Philip B. Weerakody ◽  
Kok Wai Wong ◽  
Guanjin Wang ◽  
Wendell Ela
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Data Handling

scholarly journals Time–frequency time–space LSTM for robust classification of physiological signals

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Tuan D. Pham
Keyword(s):  
Time Series ◽  
Network Architecture ◽  
Time Series Data ◽  
Short Term Memory ◽  
Physiological Signals ◽  
Series Data ◽  
Time Frequency ◽  
Time Space ◽  
Deep Recurrent Neural Network

AbstractAutomated analysis of physiological time series is utilized for many clinical applications in medicine and life sciences. Long short-term memory (LSTM) is a deep recurrent neural network architecture used for classification of time-series data. Here time–frequency and time–space properties of time series are introduced as a robust tool for LSTM processing of long sequential data in physiology. Based on classification results obtained from two databases of sensor-induced physiological signals, the proposed approach has the potential for (1) achieving very high classification accuracy, (2) saving tremendous time for data learning, and (3) being cost-effective and user-comfortable for clinical trials by reducing multiple wearable sensors for data recording.

Sign in / Sign up

Export Citation Format

Share Document