Training Recurrent Neural Network Using Multistream Extended Kalman Filter on Multicore Processor and Cuda Enabled Graphic Processor Unit

Author(s):  
Michal Čerňanský
Author(s):  
Muhammad Asaduddin Hazazi ◽  
Agus Sihabuddin

Artificial Neural Networks (ANN) especially Recurrent Neural Network (RNN) have been widely used to predict currency exchange rates. The learning algorithm that is commonly used in ANN is Stochastic Gradient Descent (SGD). One of the advantages of SGD is that the computational time needed is relatively short. But SGD also has weaknesses, including SGD requiring several hyperparameters such as the regularization parameter. Besides that SGD relatively requires a lot of epoch to reach convergence. Extended Kalman Filter (EKF) as a learning algorithm on RNN is used to replace SGD with the hope of a better level of accuracy and convergence rate. This study uses IDR / USD exchange rate data from 31 August 2015 to 29 August 2018 with 70% data as training data and 30% data as test data. This research shows that RNN-EKF produces better convergent speeds and better accuracy compared to RNN-SGD.


2013 ◽  
Vol 46 (20) ◽  
pp. 23-26 ◽  
Author(s):  
Konstantin Yu. Kotov ◽  
Alexandr S. Maltsev ◽  
Maxim A. Sobolev

Sign in / Sign up

Export Citation Format

Share Document