scholarly journals DWNet: Dual-Window Deep Neural Network for Time Series Prediction

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Jin Fan ◽  
Yipan Huang ◽  
Ke Zhang ◽  
Sen Wang ◽  
Jinhua Chen ◽  
...  
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Accuracy ◽  
Deep Neural Network ◽  
Time Series Prediction ◽  
Multivariate Time Series ◽  
Local Information ◽  
Global Information ◽  
Short Sequence ◽  
Dual Window

Multivariate time series prediction is a very important task, which plays a huge role in climate, economy, and other fields. We usually use an Attention-based Encoder-Decoder network to deal with multivariate time series prediction because the attention mechanism makes it easier for the model to focus on the really important attributes. However, the Encoder-Decoder network has the problem that the longer the length of the sequence is, the worse the prediction accuracy is, which means that the Encoder-Decoder network cannot process long series and therefore cannot obtain detailed historical information. In this paper, we propose a dual-window deep neural network (DWNet) to predict time series. The dual-window mechanism allows the model to mine multigranularity dependencies of time series, such as local information obtained from a short sequence and global information obtained from a long sequence. Our model outperforms nine baseline methods in four different datasets.

scholarly journals Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting

Electronics ◽  
2019 ◽  
Vol 8 (8) ◽  
pp. 876 ◽  
Author(s):  
Renzhuo Wan ◽  
Shuping Mei ◽  
Jun Wang ◽  
Min Liu ◽  
Fan Yang
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Accuracy ◽  
Time Series Data ◽  
Short Term Memory ◽  
Time Series Prediction ◽  
Multivariate Time Series ◽  
Series Data ◽  
Asymmetric Structure ◽  
Convolutional Network

Multivariable time series prediction has been widely studied in power energy, aerology, meteorology, finance, transportation, etc. Traditional modeling methods have complex patterns and are inefficient to capture long-term multivariate dependencies of data for desired forecasting accuracy. To address such concerns, various deep learning models based on Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) methods are proposed. To improve the prediction accuracy and minimize the multivariate time series data dependence for aperiodic data, in this article, Beijing PM2.5 and ISO-NE Dataset are analyzed by a novel Multivariate Temporal Convolution Network (M-TCN) model. In this model, multi-variable time series prediction is constructed as a sequence-to-sequence scenario for non-periodic datasets. The multichannel residual blocks in parallel with asymmetric structure based on deep convolution neural network is proposed. The results are compared with rich competitive algorithms of long short term memory (LSTM), convolutional LSTM (ConvLSTM), Temporal Convolution Network (TCN) and Multivariate Attention LSTM-FCN (MALSTM-FCN), which indicate significant improvement of prediction accuracy, robust and generalization of our model.

scholarly journals A Dual-Attention Recurrent Neural Network Method for Deep Cone Thickener Underflow Concentration Prediction

Sensors ◽  
2020 ◽  
Vol 20 (5) ◽  
pp. 1260
Author(s):  
Zhaolin Yuan ◽  
Jinlong Hu ◽  
Di Wu ◽  
Xiaojuan Ban
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Accuracy ◽  
Time Series Prediction ◽  
Experimental Result ◽  
Common Error ◽  
Neural Network Method ◽  
Multiple Sensors ◽  
Network Method ◽  
Deep Cone Thickener

This paper focuses on the time series prediction problem for underflow concentration of deep cone thickener. It is commonly used in the industrial sedimentation process. In this paper, we introduce a dual attention neural network method to model both spatial and temporal features of the data collected from multiple sensors in the thickener to predict underflow concentration. The concentration is the key factor for future mining process. This model includes encoder and decoder. Their function is to capture spatial and temporal importance separately from input data, and output more accurate prediction. We also consider the domain knowledge in modeling process. Several supplementary constructed features are examined to enhance the final prediction accuracy in addition to the raw data from sensors. To test the feasibility and efficiency of this method, we select an industrial case based on Industrial Internet of Things (IIoT). This Tailings Thickener is from FLSmidth with multiple sensors. The comparative results support this method has favorable prediction accuracy, which is more than 10% lower than other time series prediction models in some common error indices. We also try to interpret our method with additional ablation experiments for different features and attention mechanisms. By employing mean absolute error index to evaluate the models, experimental result reports that enhanced features and dual-attention modules reduce error of fitting ~5% and ~11%, respectively.

A New Prediction Method for Chaotic Time Series

2013 ◽  
Vol 380-384 ◽  
pp. 1673-1676
Author(s):  
Juan Du
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Accuracy ◽  
Time Series Prediction ◽  
Prediction Method ◽  
Cumulative Effect ◽  
Training Data ◽  
Training Algorithm ◽  
Learning Speed ◽  
Sunspot Data

In order to show the time cumulative effect in the process for the time series prediction, the process neural network is taken. The training algorithm of modified particle swarm is used to the model for the learning speed. The training data is sunspot data from 1700 to 2007. Simulation result shows that the prediction model and algorithm has faster training speed and prediction accuracy than the artificial neural network.

Sign in / Sign up

Export Citation Format

Share Document