Multiscaled Neural Autoregressive Distributed Lag: A New Empirical Mode Decomposition Model for Nonlinear Time Series Forecasting

2020 ◽  
Vol 30 (08) ◽  
pp. 2050039 ◽  
Author(s):  
Foued Saâdaoui ◽  
Othman Ben Messaoud

Forecasting has always been the cornerstone of machine learning and statistics. Despite the great evolution of the time series theory, forecasters are still in the hunt for better models to make more accurate decisions. The huge advances in neural networks over the last years has led to the emergence of a new generation of effective models replacing classic econometric models. It is in this direction that we propose, in this paper, a new multiscaled Feedforward Neural Network (FNN), with the aim of forecasting multivariate time series. This new model, called Empirical Mode Decomposition (EMD)-based Neural ARDL, is inspired from the well-known Autoregressive Distributed Lag (ARDL) model being our proposal founded upon the concepts of nonlinearity, EMD-multiresolution and neural networks. These features give the model the ability to effectively capture many nonlinear patterns like the ones often present in econophysical time series, such as nonlinear trends, seasonal effects, long-range dependency, etc. The proposed algorithm can be summarized into the following four basic tasks: (i) EMD breaking-down multivariate time series into different resolution levels, (ii) feeding EMD components from the same levels into a number of feedforward neural ARDL models, (iii) from one level to the next, extrapolating the component corresponding to the response variable (scalar output) a number of steps ahead, and finally, (iv) recombining level-by-level forecasts into a single output. An optimal learning scheme is rigorously designed for efficiently training the new proposed architecture. The approach is finally tested and compared to a number of powerful benchmark models, where experiments are conducted on real-world data.

2020 ◽  
Vol 143 (5) ◽  
Author(s):  
Weifei Hu ◽  
Yihan He ◽  
Zhenyu Liu ◽  
Jianrong Tan ◽  
Ming Yang ◽  
...  

Abstract Precise time series prediction serves as an important role in constructing a digital twin (DT). The various internal and external interferences result in highly nonlinear and stochastic time series. Although artificial neural networks (ANNs) are often used to forecast time series because of their strong self-learning and nonlinear fitting capabilities, it is a challenging and time-consuming task to obtain the optimal ANN architecture. This paper proposes a hybrid time series prediction model based on an ensemble empirical mode decomposition (EEMD), long short-term memory (LSTM) neural networks, and Bayesian optimization (BO). To improve the predictability of stochastic and nonstationary time series, the EEMD method is implemented to decompose the original time series into several components (each component is a single-frequency and stationary signal) and a residual signal. The decomposed signals are used to train the neural networks, in which the hyperparameters are fine-tuned by the BO algorithm. The following time series data are predicted by summating all the predictions of the decomposed signals based on the trained neural networks. To evaluate the performance of the proposed EEMD-BO-LSTM neural networks, this paper conducts two case studies (the wind speed prediction and the wave height prediction) and implements a comprehensive comparison between the proposed method and other approaches including the persistence model, autoregressive integrated moving average (ARIMA) model, LSTM neural networks, BO-LSTM neural networks, and EEMD-LSTM neural networks. The results show an improved prediction accuracy using the proposed method by multiple accuracy metrics.


Author(s):  
Weifei Hu ◽  
Yihan He ◽  
Zhenyu Liu ◽  
Jianrong Tan ◽  
Ming Yang ◽  
...  

Abstract Precise time series prediction serves as an important role in constructing a Digital Twin (DT). The various internal and external interferences result in highly non-linear and stochastic time series data sampled from real situations. Although artificial Neural Networks (ANNs) are often used to forecast time series for their strong self-learning and nonlinear fitting capabilities, it is a challenging and time-consuming task to obtain the optimal ANN architecture. This paper proposes a hybrid time series prediction model based on ensemble empirical mode decomposition (EEMD), long short-term memory (LSTM) neural networks, and Bayesian optimization (BO). To improve the predictability of stochastic and nonstationary time series, the EEMD method is implemented to decompose the original time series into several components, each of which is composed of single-frequency and stationary signal, and a residual signal. The decomposed signals are used to train the BO-LSTM neural networks, in which the hyper-parameters of the LSTM neural networks are fine-tuned by the BO algorithm. The following time series data are predicted by summating all the predictions of the decomposed signals based on the trained neural networks. To evaluate the performance of the proposed hybrid method (EEMD-BO-LSTM), this paper conducts a case study of wind speed time series prediction and has a comprehensive comparison between the proposed method and other approaches including the persistence model, ARIMA, LSTM neural networks, B0-LSTM neural networks, and EEMD-LSTM neural networks. Results show an improved prediction accuracy using the EEMD-BO-LSTM method by multiple accuracy metrics.


2021 ◽  
Vol 12 (2) ◽  
pp. 294
Author(s):  
Agus Widarjono ◽  
M. B. Hendrie Anto ◽  
Faaza Fakhrunnas

This study investigates whether Islamic rural banks perform better than conventional rural banks as their competitor in Indonesia. To measure Islamic rural banks' financial performance, we apply financial stability using Z-score and profitability using the return on assets. We use monthly time series data from January 2009 to December 2018. The dynamic regression of the Autoregressive Distributed Lag (ARDL) model is then employed. The results report that the Z-Score of Islamic rural banks is higher than the Z-Score of conventional rural banks. This finding shows that Islamic rural banks are less risky than conventional rural banks. However, the Islamic rural banks' financial stability is very vulnerable to changes in equity, output, and inflation than conventional rural banks. Although the Islamic rural banks' profit rate is lower compared to conventional rural banks, it is considered more stable. The profit of Islamic rural banks is affected by size, equity, domestic output, and inflation.


Sign in / Sign up

Export Citation Format

Share Document