Semistability of Steepest Descent with Momentum for Quadratic Functions
Keyword(s):
Two steepest-descent algorithms with momentum for quadratic functions are considered. For a given learning rate, the sufficient and necessary conditions for the semistability of the steepest-descent algorithms with momentum are established. Moreover, the optimal momentum factors that generally make for the fastest convergence are obtained.
2017 ◽
Vol E100.A
(9)
◽
pp. 2013-2020
2019 ◽
Vol 75
(6)
◽
pp. 814-826