Neural Network Techniques for Time Series Prediction: A Review

2019 ◽  
Vol 3 (3) ◽  
Author(s):  
Muhammad Faheem Mushtaq ◽  
Urooj Akram ◽  
Muhammad Aamir ◽  
Haseeb Ali ◽  
Muhammad Zulqarnain
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Time Series Data ◽  
Weather Prediction ◽  
Time Series Prediction ◽  
Series Data ◽  
Prediction Problem ◽  
Neural Network Models ◽  
Physical Time

It is important to predict a time series because many problems that are related to prediction such as health prediction problem, climate change prediction problem and weather prediction problem include a time component. To solve the time series prediction problem various techniques have been developed over many years to enhance the accuracy of forecasting. This paper presents a review of the prediction of physical time series applications using the neural network models. Neural Networks (NN) have appeared as an effective tool for forecasting of time series.  Moreover, to resolve the problems related to time series data, there is a need of network with single layer trainable weights that is Higher Order Neural Network (HONN) which can perform nonlinearity mapping of input-output. So, the developers are focusing on HONN that has been recently considered to develop the input representation spaces broadly. The HONN model has the ability of functional mapping which determined through some time series problems and it shows the more benefits as compared to conventional Artificial Neural Networks (ANN). The goal of this research is to present the reader awareness about HONN for physical time series prediction, to highlight some benefits and challenges using HONN.

GRU-corr Neural Network Optimized by Improved PSO Algorithm for Time Series Prediction

2020 ◽  
Vol 29 (07n08) ◽  
pp. 2040010
Author(s):  
Shao-Pei Ji ◽  
Yu-Long Meng ◽  
Liang Yan ◽  
Gui-Shan Dong ◽  
Dong Liu
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Time Series Data ◽  
Time Series Prediction ◽  
Prediction Method ◽  
Pso Algorithm ◽  
Series Data ◽  
Multi Scale ◽  
Network Parameters ◽  
Angle Data

Time series data from real problems have nonlinear, non-smooth, and multi-scale composite characteristics. This paper first proposes a gated recurrent unit-correction (GRU-corr) network model, which adds a correction layer to the GRU neural network. Then, a adaptive staged variation PSO (ASPSO) is proposed. Finally, to overcome the drawbacks of the imprecise selection of the GRU-corr network parameters and obtain the high-precision global optimization of network parameters, weight parameters and the hidden nodes number of GRU-corr is optimized by ASPSO, and a time series prediction model (ASPSO-GRU-corr) is proposed based on the GRU-corr optimized by ASPSO. In the experiment, a comparative analysis of the optimization performance of ASPSO on a benchmark function was performed to verify its validity, and then the ASPSO-GRU-corr model is used to predict the ship motion cross-sway angle data. The results show that, ASPSO has better optimization performance and convergence speed compared with other algorithms, while the ASPSO-GRU-corr has higher generalization performance and lower architecture complexity. The ASPSO-GRU-corr can reveal the intrinsic multi-scale composite features of the time series, which is a reliable nonlinear and non-steady time series prediction method.

scholarly journals A hybrid elman neural network predictor for time series prediction

2018 ◽  
Vol 7 (2.20) ◽  
pp. 159 ◽  
Author(s):  
N Mohana Sundaram ◽  
S N. Sivanandam
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Time Delay ◽  
Adaptive Learning ◽  
Time Series Data ◽  
Time Series Prediction ◽  
Series Data ◽  
Elman Neural Network ◽  
Dynamic Processing ◽  
Elman Recurrent Neural Network

Artificial Neural Networks have become popular in the world of prediction and forecasting due to their nonlinear nonparametric adaptive-learning property. They become an important tool in data analysis and data mining applications. Elman neural network due to its recurrent nature and dynamic processing capabilities can perform the prediction process with a good range of accuracy. In this paper an Elman recurrent Neural Network is hybridised with a time delay called a tap delay line for time series prediction process to improve its performance. The Elman neural network with the time delay inputs is trained tested and validated using the solar sun spot time series data that contains the monthly mean sunspot numbers for a 240 year period having 2899 data values. The results confirm that the proposed Elman network hybridised with time delay inputs can predict the time series with more accurately and effectively than the existing methods.  

A Hybrid Wind Speed Prediction Approach Based on Ensemble Empirical Mode Decomposition and BO-LSTM Neural Networks for Digital Twin

2020 ◽  
Author(s):  
Weifei Hu ◽  
Yihan He ◽  
Zhenyu Liu ◽  
Jianrong Tan ◽  
Ming Yang ◽  
...  
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Wind Speed ◽  
Empirical Mode Decomposition ◽  
Time Series Data ◽  
Time Series Prediction ◽  
Ensemble Empirical Mode Decomposition ◽  
Series Data ◽  
Digital Twin ◽  
Mode Decomposition

Abstract Precise time series prediction serves as an important role in constructing a Digital Twin (DT). The various internal and external interferences result in highly non-linear and stochastic time series data sampled from real situations. Although artificial Neural Networks (ANNs) are often used to forecast time series for their strong self-learning and nonlinear fitting capabilities, it is a challenging and time-consuming task to obtain the optimal ANN architecture. This paper proposes a hybrid time series prediction model based on ensemble empirical mode decomposition (EEMD), long short-term memory (LSTM) neural networks, and Bayesian optimization (BO). To improve the predictability of stochastic and nonstationary time series, the EEMD method is implemented to decompose the original time series into several components, each of which is composed of single-frequency and stationary signal, and a residual signal. The decomposed signals are used to train the BO-LSTM neural networks, in which the hyper-parameters of the LSTM neural networks are fine-tuned by the BO algorithm. The following time series data are predicted by summating all the predictions of the decomposed signals based on the trained neural networks. To evaluate the performance of the proposed hybrid method (EEMD-BO-LSTM), this paper conducts a case study of wind speed time series prediction and has a comprehensive comparison between the proposed method and other approaches including the persistence model, ARIMA, LSTM neural networks, B0-LSTM neural networks, and EEMD-LSTM neural networks. Results show an improved prediction accuracy using the EEMD-BO-LSTM method by multiple accuracy metrics.

Fusion Process Neural Networks Classifier Oriented Time Series

2019 ◽  
Vol 16 (10) ◽  
pp. 4059-4063
Author(s):  
Ge Li ◽  
Hu Jing ◽  
Chen Guangsheng
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Feature Extraction ◽  
Time Series Data ◽  
Learning Algorithm ◽  
Series Data ◽  
Time Varying ◽  
Synthetic Control ◽  
Classification Feature

Based on the consideration of complementary advantages, different wavelet, fractal and statistical methods are integrated to complete the classification feature extraction of time series. Combined with the advantage of process neural networks that processing time-varying information, we propose a fusion classifier with process neural network oriented time series. Be taking advantage of the multi-fractal processing nonlinear feature of time series data classification, the strong adaptability of the wavelet technique for time series data and the effect of statistical features on the classification of time series data, we can achieve the classification feature extraction of time series. Additionally, using time-varying input characteristics of process neural networks, the pattern matching of timevarying input information and space-time aggregation operation is realized. The feature extraction of time series with the above three methods is fused to the distance calculation between time-varying inputs and cluster space in process neural networks. We provide the process neural network fusion to the learning algorithm and optimize the calculation process of the time series classifier. Finally, we report the performance of our classification method using Synthetic Control Charts data from the UCI dataset and illustrate the advantage and validity of the proposed method.

scholarly journals Evolutionary product unit based neural networks for hydrological time series analysis

2010 ◽  
Vol 13 (4) ◽  
pp. 825-841 ◽  
Author(s):  
Dulakshi S. K. Karunasingha ◽  
A. W. Jayawardena ◽  
W. K. Li
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Meteorological Data ◽  
Time Series Prediction ◽  
Network Models ◽  
Engineering Analysis ◽  
Neural Network Models ◽  
Mlp Neural Network ◽  
Evolutionary Product

Artificial Neural Networks (ANNs) are now widely used in many areas of science, medicine, finance and engineering. Analysis and prediction of time series of hydrological/and meteorological data is one such application. Problems that still exist in the application of ANN's are the lack of transparency and the expertise needed for training. An evolutionary algorithm-based method to train a type of neural networks called Product Units Based Neural Networks (PUNN) has been proposed in a 2006 study. This study investigates the applicability of this type of neural networks to hydrological time series prediction. The technique, with a few small changes to improve the performance, is applied to some benchmark time series as well as to a real hydrological time series for prediction. The results show that evolutionary PUNN produce more transparent models compared to widely used multilayer perceptron (MLP) neural network models. It is also seen that training of PUNN models requires less expertise compared to MLPs.

scholarly journals A New Method of Mixed Gas Identification Based on a Convolutional Neural Network for Time Series Classification

Sensors ◽  
2019 ◽  
Vol 19 (9) ◽  
pp. 1960 ◽  
Author(s):  
Lu Han ◽  
Chongchong Yu ◽  
Kaitai Xiao ◽  
Xia Zhao
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Convolutional Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Time Series Classification ◽  
Mixed Gas ◽  
Gas Identification ◽  
Mixed Gases

This paper proposes a new method of mixed gas identification based on a convolutional neural network for time series classification. In view of the superiority of convolutional neural networks in the field of computer vision, we applied the concept to the classification of five mixed gas time series data collected by an array of eight MOX gas sensors. Existing convolutional neural networks are mostly used for processing visual data, and are rarely used in gas data classification and have great limitations. Therefore, the idea of mapping time series data into an analogous-image matrix data is proposed. Then, five kinds of convolutional neural networks—VGG-16, VGG-19, ResNet18, ResNet34 and ResNet50—were used to classify and compare five kinds of mixed gases. By adjusting the parameters of the convolutional neural networks, the final gas recognition rate is 96.67%. The experimental results show that the method can classify the gas data quickly and effectively, and effectively combine the gas time series data with classical convolutional neural networks, which provides a new idea for the identification of mixed gases.

scholarly journals On the prediction of solar activity using different neural network models

1996 ◽  
Vol 14 (1) ◽  
pp. 20-26 ◽  
Author(s):  
F. Fessant ◽  
S. Bengio ◽  
D. Collobert
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Series ◽  
Solar Activity ◽  
Time Series Prediction ◽  
Network Models ◽  
Accurate Prediction ◽  
Experimental Results ◽  
Neural Network Models ◽  
Telecommunication Companies

Abstract. Accurate prediction of ionospheric parameters is crucial for telecommunication companies. These parameters rely strongly on solar activity. In this paper, we analyze the use of neural networks for sunspot time series prediction. Three types of models are tested and experimental results are reported for a particular sunspot time series: the IR5 index.

scholarly journals Multivariate Temporal Convolutional Network: A Deep Neural Networks Approach for Multivariate Time Series Forecasting

Electronics ◽  
2019 ◽  
Vol 8 (8) ◽  
pp. 876 ◽  
Author(s):  
Renzhuo Wan ◽  
Shuping Mei ◽  
Jun Wang ◽  
Min Liu ◽  
Fan Yang
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Prediction Accuracy ◽  
Time Series Data ◽  
Short Term Memory ◽  
Time Series Prediction ◽  
Multivariate Time Series ◽  
Series Data ◽  
Asymmetric Structure ◽  
Convolutional Network

Multivariable time series prediction has been widely studied in power energy, aerology, meteorology, finance, transportation, etc. Traditional modeling methods have complex patterns and are inefficient to capture long-term multivariate dependencies of data for desired forecasting accuracy. To address such concerns, various deep learning models based on Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN) methods are proposed. To improve the prediction accuracy and minimize the multivariate time series data dependence for aperiodic data, in this article, Beijing PM2.5 and ISO-NE Dataset are analyzed by a novel Multivariate Temporal Convolution Network (M-TCN) model. In this model, multi-variable time series prediction is constructed as a sequence-to-sequence scenario for non-periodic datasets. The multichannel residual blocks in parallel with asymmetric structure based on deep convolution neural network is proposed. The results are compared with rich competitive algorithms of long short term memory (LSTM), convolutional LSTM (ConvLSTM), Temporal Convolution Network (TCN) and Multivariate Attention LSTM-FCN (MALSTM-FCN), which indicate significant improvement of prediction accuracy, robust and generalization of our model.

Sign in / Sign up

Export Citation Format

Share Document