scholarly journals Implementasi Jaringan Syaraf Tiruan Recurrent Menggunakan Gradient Descent Adaptive Learning Rate and Momentum Untuk Pendugaan Curah Hujan

2011 ◽  
Vol 2 (1) ◽  
pp. 23
Author(s):  
Afan Galih Salman ◽  
Yen Lina Prasetio
Keyword(s):  
Neural Network ◽  
Adaptive Learning ◽  
Gradient Descent ◽  
Learning Rate ◽  
Training Data ◽  
Wave Radiation ◽  
Elman Neural Network ◽  
Adaptive Learning Rate ◽  
Testing Data ◽  
Data Group

The artificial neural network (ANN) technology in rainfall prediction can be done using the learning approach. The ANN prediction accuracy is measured by the determination coefficient (R2) and root mean square error (RMSE). This research implements Elman’s Recurrent ANN which is heuristically optimized based on el-nino southern oscilation (ENSO) variables: wind, southern oscillation index (SOI), sea surface temperatur (SST) dan outgoing long wave radiation (OLR) to forecast regional monthly rainfall in Bongan Bali. The heuristic learning optimization done is basically a performance development of standard gradient descent learning algorithm into training algorithms: gradient descent momentum and adaptive learning rate. The patterns of input data affect the performance of Recurrent Elman neural network in estimation process. The first data group that is 75% training data and 25% testing data produce the maximum R2 leap 74,6% while the second data group that is 50% training data and 50% testing data produce the maximum R2 leap 49,8%.

scholarly journals Implementasi Jaringan Syaraf Tiruan Recurrent Dengan Metode Pembelajaran Gradient Descent Adaptive Learning Rate Untuk Pendugaan Curah Hujan Berdasarkan Peubah Enso

2010 ◽  
Vol 1 (2) ◽  
pp. 418
Author(s):  
Afan Galih Salman ◽  
Yen Lina Prasetio
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Adaptive Learning ◽  
Gradient Descent ◽  
Learning Rate ◽  
Training Data ◽  
Testing Data ◽  
Artificial Neural ◽  
Artificial Neural Network Ann ◽  
Data Group

The use of technology of technology Artificial Neural Network (ANN) in prediction of rainfall can be done using the learning approach. ANN prediction accuracy measured by the coefficient of determination (R2) and Root Mean Square Error (RMSE).This research employ a recurrent optimized heuristic Artificial Neural Network (ANN) Recurrent Elman gradient descent adaptive learning rate approach using El-Nino Southern Oscilation (ENSO) variable, namely Wind, Southern Oscillation Index (SOI), Sea Surface Temperatur (SST) dan Outgoing Long Wave Radiation (OLR) to forecast regional monthly rainfall. The patterns of input data affect the performance of Recurrent Elman neural network in estimation process. The first data group that is 75% training data and 25% testing data produce the maximum R2 69.2% at leap 0 while the second data group that is 50% training data & 50% testing data produce the maximum R2 53.6%.at leap 0 Our result on leap 0 is better than leap 1,2 or 3. 

scholarly journals Analisis Error dan Epoch dengan Pengembangan Adaptive Learning Rate dan Parameter Momentum pada Metode Backpropagation

2018 ◽  
Vol 3 (2) ◽  
Author(s):  
Zahratul Fitri
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Adaptive Learning ◽  
Learning Rate ◽  
Backpropagation Algorithm ◽  
Adaptive Learning Rate ◽  
Best Value ◽  
Artificial Neural Network Ann ◽  
Parameter Values ◽  
Value Of Learning

Abstrak— Algoritma backpropagation merupakan bagian dari Jaringan Syaraf Tiruan (JST) yang memiliki beberapa layar tersembunyi. Algoritma backpropagation juga merupakan multi-layer yang banyak digunakan untuk menyelesaikan persoalan yang luas, akan tetapi, algoritma backpropagation juga memiliki kelamahan pada proses pembelajaran yang cukup lambat. Pada penelitian ini penulis menganalisis bagaimana mengembangkan algoritma backpropagation dengan menggunakan learning rate dan parameter momentum untuk meminimalisir error dan epoch yang akurat sebagai proses menghitung perubahan bobot. Dari hasil penelitian diperoleh bahwa pengembangan yang dilakukan memperoleh nilai paling baik pada nilai momentum yaitu 0,9 dan 1.0 dan nilai learning rate yaitu > 0,7. Hal ini membuktikan bahwa nilai pembelajaran dengan menggunakan nilai parameter momentum dan nilai learning rate diatas sangat baik digunakan sebagai percepatan laju konvergensi.Kata kunci— Algoritma Backpropagation, Parameter Momentum, Adaptive Learning Rate . Abstract— Backpropagation algorithm is part of an Artificial Neural Network (ANN), which has some hidden screen. Backpropagation algorithm is also a multi-layer finish that is widely used for large problems, however, the backpropagation algorithm also has weaknesses in the learning process is quite slow. In this study the authors analyze how to develop a backpropagation algorithm using learning rate and momentum parameters to minimize the error and accurate epoch as the process of calculating the weight change. The result showed that the development is carried out to obtain best value on the momentum value of 0.9 and 1.0 and the value of learning rate is> 0.7. It is proved that the value of learning by using the parameter values of momentum and learning rate values above are best used as a convergence rate acceleration.Keywords— Backpropagation Algorithm, Parameter of Momentum, Adaptive   Learning Rate

Sign in / Sign up

Export Citation Format

Share Document