On the convergence and improvement of stochastic normalized gradient descent

Science China Information Sciences ◽

10.1007/s11432-020-3023-7 ◽

2021 ◽

Vol 64 (3) ◽

Author(s):

Shen-Yi Zhao ◽

Yin-Peng Xie ◽

Wu-Jun Li

Keyword(s):

Gradient Descent ◽

Normalized Gradient

Download Full-text

A normalized gradient descent algorithm for nonlinear adaptive filters using a gradient adaptive step size

IEEE Signal Processing Letters ◽

10.1109/97.969448 ◽

2001 ◽

Vol 8 (11) ◽

pp. 295-297 ◽

Author(s):

D.P. Mandic ◽

A.I. Hanna ◽

M. Razaz

Keyword(s):

Gradient Descent ◽

Adaptive Filters ◽

Step Size ◽

Adaptive Step Size ◽

Descent Algorithm ◽

Gradient Descent Algorithm ◽

Normalized Gradient ◽

Download Full-text

Normalized Gradient Descent for Variational Quantum Algorithms

10.1109/qce52317.2021.00015 ◽

2021 ◽

Author(s):

Yudai Suzuki ◽

Hiroshi Yano ◽

Rudy Raymond ◽

Naoki Yamamoto

Keyword(s):

Gradient Descent ◽

Quantum Algorithms ◽

Normalized Gradient

Download Full-text

Blind DFE based on NLMS algorithm with generalized normalized gradient descent regularization

OCEANS 2009 ◽

10.23919/oceans.2009.5422117 ◽

2009 ◽

Author(s):

Abderrazak Abdaoui ◽

Christophe Laot

Keyword(s):

Gradient Descent ◽

Nlms Algorithm ◽

Normalized Gradient

Download Full-text

Generalized Normalized Gradient Descent Algorithm with Direct Update of the Step-Size Parameter

2007 International Symposium on Signals, Circuits and Systems ◽

10.1109/isscs.2007.4292681 ◽

2007 ◽

Author(s):

Constantin Paleologu ◽

Calin Vladeanu ◽

Silviu Ciochina ◽

Andrei Alexandru Enescu

Keyword(s):

Gradient Descent ◽

Size Parameter ◽

Step Size ◽

Descent Algorithm ◽

Gradient Descent Algorithm ◽

Normalized Gradient

Download Full-text

Revisiting Normalized Gradient Descent: Fast Evasion of Saddle Points

IEEE Transactions on Automatic Control ◽

10.1109/tac.2019.2914998 ◽

2019 ◽

Vol 64 (11) ◽

pp. 4818-4824 ◽

Author(s):

Ryan Murray ◽

Brian Swenson ◽

Soummya Kar

Keyword(s):

Gradient Descent ◽

Saddle Points ◽

Normalized Gradient

Download Full-text

A Generalized Normalized Gradient Descent Algorithm

IEEE Signal Processing Letters ◽

10.1109/lsp.2003.821649 ◽

2004 ◽

Vol 11 (2) ◽

pp. 115-118 ◽

Author(s):

D.P. Mandic

Keyword(s):

Gradient Descent ◽

Descent Algorithm ◽

Gradient Descent Algorithm ◽

Normalized Gradient

Download Full-text

Generalized Normalized Gradient Descent Based Control Algorithm for Solar PV Integrated 3P4W Distribution System

2018 8th IEEE India International Conference on Power Electronics (IICPE) ◽

10.1109/iicpe.2018.8709340 ◽

2018 ◽

Author(s):

Gaurav Modi ◽

Shailendra Kumar ◽

Bhim Singh

Keyword(s):

Distribution System ◽

Gradient Descent ◽

Control Algorithm ◽

Solar Pv ◽

Normalized Gradient

Download Full-text

Generalized Normalized Gradient Descent Algorithm Based on Estimated a Posteriori Error

2008 10th International Conference on Advanced Communication Technology ◽

10.1109/icact.2008.4493703 ◽

2008 ◽

Author(s):

Minsung Hur ◽

Jin Yong Choi ◽

Jong-Seob Baek ◽

JongSoo Seo

Keyword(s):

Gradient Descent ◽

Posteriori Error ◽

A Posteriori ◽

A Posteriori Error ◽

Descent Algorithm ◽

Gradient Descent Algorithm ◽

Normalized Gradient

Download Full-text

Natural Gradient Descent of Complex-Valued Neural Networks Invariant under Rotations

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences ◽

10.1587/transfun.e102.a.1988 ◽

2019 ◽

Vol E102.A (12) ◽

pp. 1988-1996

Author(s):

Jun-ichi MUKUNO ◽

Hajime MATSUI

Keyword(s):

Neural Networks ◽

Gradient Descent ◽

Natural Gradient ◽

Download Full-text

An Estimation Algorithm of Attitude and Heading Under Homogenous Field Based on Improved Gradient Descent Method

2020 27th Saint Petersburg International Conference on Integrated Navigation Systems (ICINS) ◽

10.23919/icins43215.2020.9133763 ◽

2020 ◽

Author(s):

Xiao-Kang Yang ◽

Gong-Min Yan ◽

Si-Hai Li

Keyword(s):

Gradient Descent ◽

Estimation Algorithm ◽

Descent Method ◽

Gradient Descent Method

Download Full-text