An Improved Back Propagation Leaning Algorithm Using Second Order Methods with Gain Parameter

Nazri Mohd Nawi;  ; Noor Haliza Mohamed Saufi; Avon Budiyono; Norhamreeza Abdul Hamid; Muhammad Zubair Rehman; Azizul Azhar Ramli;  ;  ;  ;  ;

doi:10.30880/ijie.2018.10.06.002

An Improved Back Propagation Leaning Algorithm Using Second Order Methods with Gain Parameter

International Journal of Integrated Engineering ◽

10.30880/ijie.2018.10.06.002 ◽

2018 ◽

Vol 10 (6) ◽

Author(s):

Nazri Mohd Nawi ◽

◽

Noor Haliza Mohamed Saufi ◽

Avon Budiyono ◽

Norhamreeza Abdul Hamid ◽

...

Keyword(s):

Back Propagation ◽

Second Order ◽

Gain Parameter ◽

Second Order Methods

Download Full-text

Spectral bundle methods for non-convex maximum eigenvalue functions: second-order methods

Mathematical Programming ◽

10.1007/s10107-005-0635-y ◽

2005 ◽

Vol 104 (2-3) ◽

pp. 729-747 ◽

Cited By ~ 19

Author(s):

Dominikus Noll ◽

Pierre Apkarian

Keyword(s):

Second Order ◽

Bundle Methods ◽

Maximum Eigenvalue ◽

Second Order Methods

Download Full-text

A stable second order method for training back propagation networks

10.2514/6.1993-4533 ◽

1993 ◽

Author(s):

Philip Nachtsheim

Keyword(s):

Back Propagation ◽

Second Order ◽

Order Method

Download Full-text

Phase error and stability of second order methods for hyperbolic problems. II

Journal of Computational Physics ◽

10.1016/0021-9991(74)90087-4 ◽

1974 ◽

Vol 15 (2) ◽

pp. 251-265 ◽

Cited By ~ 8

Author(s):

David Gottlieb ◽

Eli Turkel

Keyword(s):

Phase Error ◽

Second Order ◽

Hyperbolic Problems ◽

Second Order Methods

Download Full-text

Oracle complexity of second-order methods for smooth convex optimization

Mathematical Programming ◽

10.1007/s10107-018-1293-1 ◽

2018 ◽

Vol 178 (1-2) ◽

pp. 327-360 ◽

Cited By ~ 6

Author(s):

Yossi Arjevani ◽

Ohad Shamir ◽

Ron Shiff

Keyword(s):

Convex Optimization ◽

Second Order ◽

Smooth Convex ◽

Oracle Complexity ◽

Smooth Convex Optimization ◽

Second Order Methods

Download Full-text

Learning Efficiency Improvement of Back Propagation Algorithm by Adaptively Changing Gain Parameter together with Momentum and Learning Rate

Software Engineering and Computer Systems - Communications in Computer and Information Science ◽

10.1007/978-3-642-22203-0_68 ◽

2011 ◽

pp. 812-824 ◽

Cited By ~ 1

Author(s):

Norhamreeza Abdul Hamid ◽

Nazri Mohd Nawi ◽

Rozaida Ghazali ◽

Mohd Najib Mohd Salleh

Keyword(s):

Back Propagation ◽

Learning Rate ◽

Efficiency Improvement ◽

Back Propagation Algorithm ◽

Gain Parameter ◽

Learning Efficiency ◽

Propagation Algorithm

Download Full-text

Second-Order Methods in Variational Data Assimilation

10.1007/978-3-030-77722-7_7 ◽

2021 ◽

pp. 155-183

Author(s):

François-Xavier Le Dimet ◽

Victor Shutyaev

Keyword(s):

Data Assimilation ◽

Second Order ◽

Variational Data Assimilation ◽

Second Order Methods

Download Full-text

Second-order methods for error propagation in variational data assimilation

Advanced Data Assimilation for Geosciences ◽

10.1093/acprof:oso/9780198723844.003.0014 ◽

2014 ◽

pp. 319-348

Author(s):

F.-X. Le Dimet ◽

I. Gejadze ◽

V. Shutyaev

Keyword(s):

Data Assimilation ◽

Error Propagation ◽

Second Order ◽

Variational Data Assimilation ◽

Second Order Methods

Download Full-text

Learning to Learn Second-Order Back-Propagation for CNNs Using LSTMs

2018 24th International Conference on Pattern Recognition (ICPR) ◽

10.1109/icpr.2018.8546078 ◽

2018 ◽

Author(s):

Anirban Roy ◽

Sinisa Todorovic

Keyword(s):

Back Propagation ◽

Second Order ◽

Learning To Learn

Download Full-text

On the construction of symmetric second order methods for ODEs

Applied Mathematics Letters ◽

10.1016/j.aml.2019.05.026 ◽

2019 ◽

Vol 98 ◽

pp. 41-48

Author(s):

Sergio Blanes

Keyword(s):

Second Order ◽

Second Order Methods

Download Full-text

Distributed Second-Order Methods With Increasing Number of Working Nodes

IEEE Transactions on Automatic Control ◽

10.1109/tac.2019.2922191 ◽

2020 ◽

Vol 65 (2) ◽

pp. 846-853

Author(s):

Natasa Krklec Jerinkic ◽

Dusan Jakovetic ◽

Natasa Krejic ◽

Dragana Bajovic

Keyword(s):

Second Order ◽

Second Order Methods

Download Full-text