scholarly journals Convolutional Neural Network and Long Short-Term Memory Models for Ice-Jam Prediction

2021 ◽  
Author(s):  
Fatemehalsadat Madaeni ◽  
Karem Chokmani ◽  
Rachid Lhissou ◽  
Saeid Homayuni ◽  
Yves Gauthier ◽  
...  
Keyword(s):  
Time Series ◽  
Short Term Memory ◽  
Weather Forecasting ◽  
Multivariate Time Series ◽  
Water Levels ◽  
Time Series Classification ◽  
Ice Jams ◽  
Ice Jam ◽  
Learning Techniques ◽  
Long Short Term Memory

Abstract. In cold regions, ice-jam events result in severe flooding due to a rapid rise in water levels upstream of the jam. These floods threaten human safety and damage properties and infrastructures as the floods resulting from ice-jams are sudden. Hence, the ice-jam prediction tools can give an early warning to increase response time and minimize the possible corresponding damages. However, the ice-jam prediction has always been a challenging problem as there is no analytical method available for this purpose. Nonetheless, ice jams form when some hydro-meteorological conditions happen, a few hours to a few days before the event. The ice-jam prediction problem can be considered as a binary multivariate time-series classification. Deep learning techniques have been successfully applied for time-series classification in many fields such as finance, engineering, weather forecasting, and medicine. In this research, we successfully applied CNN, LSTM, and combined CN-LSTM networks for ice-jam prediction for all the rivers in Quebec. The results show that the CN-LSTM model yields the best results in the validation and generalization with F1 scores of 0.82 and 0.91, respectively. This demonstrates that CNN and LSTM models are complementary, and a combination of them further improves classification.

scholarly journals A Novel LSTM for Multivariate Time Series with Massive Missingness

Sensors ◽  
2020 ◽  
Vol 20 (10) ◽  
pp. 2832
Author(s):  
Nazanin Fouladgar ◽  
Kary Främling
Keyword(s):  
Time Series ◽  
Short Term Memory ◽  
Time Series Prediction ◽  
Multivariate Time Series ◽  
Streaming Data ◽  
Short Term ◽  
Time Intervals ◽  
Long Short Term Memory ◽  
Real World Datasets ◽  
Novel Model

Multivariate time series with missing data is ubiquitous when the streaming data is collected by sensors or any other recording instruments. For instance, the outdoor sensors gathering different meteorological variables may encounter low material sensitivity to specific situations, leading to incomplete information gathering. This is problematic in time series prediction with massive missingness and different missing rate of variables. Contribution addressing this problem on the regression task of meteorological datasets by employing Long Short-Term Memory (LSTM), capable of controlling the information flow with its memory unit, is still missing. In this paper, we propose a novel model called forward and backward variable-sensitive LSTM (FBVS-LSTM) consisting of two decay mechanisms and some informative data. The model inputs are mainly the missing indicator, time intervals of missingness in both forward and backward direction and missing rate of each variable. We employ this information to address the so-called missing not at random (MNAR) mechanism. Separately learning the features of each parameter, the model becomes adapted to deal with massive missingness. We conduct our experiment on three real-world datasets for the air pollution forecasting. The results demonstrate that our model performed well along with other LSTM-derivation models in terms of prediction accuracy.

scholarly journals Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks

Sensors ◽  
2020 ◽  
Vol 20 (24) ◽  
pp. 7211
Author(s):  
Kun Zhou ◽  
Wenyong Wang ◽  
Teng Hu ◽  
Kai Deng
Keyword(s):  
Time Series ◽  
Short Term Memory ◽  
Time Series Classification ◽  
Training Process ◽  
Short Term ◽  
Generative Adversarial Network ◽  
Convolutional Network ◽  
Term Memory ◽  
Adversarial Network ◽  
Long Short Term Memory

Time series classification and forecasting have long been studied with the traditional statistical methods. Recently, deep learning achieved remarkable successes in areas such as image, text, video, audio processing, etc. However, research studies conducted with deep neural networks in these fields are not abundant. Therefore, in this paper, we aim to propose and evaluate several state-of-the-art neural network models in these fields. We first review the basics of representative models, namely long short-term memory and its variants, the temporal convolutional network and the generative adversarial network. Then, long short-term memory with autoencoder and attention-based models, the temporal convolutional network and the generative adversarial model are proposed and applied to time series classification and forecasting. Gaussian sliding window weights are proposed to speed the training process up. Finally, the performances of the proposed methods are assessed using five optimizers and loss functions with the public benchmark datasets, and comparisons between the proposed temporal convolutional network and several classical models are conducted. Experiments show the proposed models’ effectiveness and confirm that the temporal convolutional network is superior to long short-term memory models in sequence modeling. We conclude that the proposed temporal convolutional network reduces time consumption to around 80% compared to others while retaining the same accuracy. The unstable training process for generative adversarial network is circumvented by tuning hyperparameters and carefully choosing the appropriate optimizer of “Adam”. The proposed generative adversarial network also achieves comparable forecasting accuracy with traditional methods.

Using Machine Learning Algorithms on Prediction of Stock Price

2020 ◽  
Vol 12 (2) ◽  
pp. 84-99
Author(s):  
Li-Pang Chen
Keyword(s):  
Machine Learning ◽  
Stock Price ◽  
Short Term Memory ◽  
Machine Learning Algorithms ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Short Term ◽  
Learning Techniques ◽  
Historical Database ◽  
Long Short Term Memory

In this paper, we investigate analysis and prediction of the time-dependent data. We focus our attention on four different stocks are selected from Yahoo Finance historical database. To build up models and predict the future stock price, we consider three different machine learning techniques including Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN) and Support Vector Regression (SVR). By treating close price, open price, daily low, daily high, adjusted close price, and volume of trades as predictors in machine learning methods, it can be shown that the prediction accuracy is improved.

scholarly journals A Novel Channel and Temporal-Wise Attention in Convolutional Networks for Multivariate Time Series Classification

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 212247-212257
Author(s):  
Xu Cheng ◽  
Peihua Han ◽  
Guoyuan Li ◽  
Shengyong Chen ◽  
Houxiang Zhang
Keyword(s):  
Time Series ◽  
Multivariate Time Series ◽  
Time Series Classification ◽  
Convolutional Networks
Sign in / Sign up

Export Citation Format

Share Document