Convergence analysis of smoothed stochastic gradient-type algorithm

1987 ◽  
Vol 18 (6) ◽  
pp. 1061-1078 ◽  
Author(s):  
NADAV BERMAN ◽  
ARIE FEUER ◽  
ELIAS WAHNON
Keyword(s):  
Convergence Analysis ◽  
Stochastic Gradient ◽  
Type Algorithm ◽  
Gradient Type

scholarly journals A stochastic gradient type algorithm for closed-loop problems

2007 ◽  
Vol 119 (1) ◽  
pp. 51-78 ◽  
Author(s):  
Kengy Barty ◽  
Jean-Sébastien Roy ◽  
Cyrille Strugarek
Keyword(s):  
Closed Loop ◽  
Stochastic Gradient ◽  
Type Algorithm ◽  
Gradient Type

scholarly journals An efficient three-term conjugate gradient-type algorithm for monotone nonlinear equations

2020 ◽  
Author(s):  
Jamilu Sabi'u ◽  
Abdullah Shah
Keyword(s):  
Global Convergence ◽  
Nonlinear Equations ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Numerical Results ◽  
Search Direction ◽  
Projection Technique ◽  
Type Algorithm ◽  
Gradient Type

In this article, we proposed two Conjugate Gradient (CG) parameters using the modified Dai-{L}iao condition and the descent three-term CG search direction. Both parameters are incorporated with the projection technique for solving large-scale monotone nonlinear equations. Using the Lipschitz and monotone assumptions, the global convergence of methods has been proved. Finally, numerical results are provided to illustrate the robustness of the proposed methods.

A gradient-type algorithm with backward inertial steps associated to a nonconvex minimization problem

2019 ◽  
Vol 84 (2) ◽  
pp. 485-512 ◽  
Author(s):  
Cristian Daniel Alecsa ◽  
Szilárd Csaba László ◽  
Adrian Viorel
Keyword(s):  
Minimization Problem ◽  
Nonconvex Minimization ◽  
Type Algorithm ◽  
Gradient Type

scholarly journals A gradient-type algorithm for constrained optimization with application to microstructure optimization

2020 ◽  
Vol 25 (5) ◽  
pp. 1729-1755
Author(s):  
Cristian Barbarosie ◽  
◽  
Anca-Maria Toader ◽  
Sérgio Lopes ◽  
Keyword(s):  
Constrained Optimization ◽  
Type Algorithm ◽  
Gradient Type

scholarly journals A convergence analysis for a class of practical variance-reduction stochastic gradient MCMC

2018 ◽  
Vol 62 (1) ◽  
Author(s):  
Changyou Chen ◽  
Wenlin Wang ◽  
Yizhe Zhang ◽  
Qinliang Su ◽  
Lawrence Carin
Keyword(s):  
Convergence Analysis ◽  
Variance Reduction ◽  
Stochastic Gradient

scholarly journals A gradient-type algorithm optimizing the coupling between matrices

2008 ◽  
Vol 429 (5-6) ◽  
pp. 1229-1242 ◽  
Author(s):  
Catherine Fraikin ◽  
Yurii Nesterov ◽  
Paul Van Dooren
Keyword(s):  
Type Algorithm ◽  
Gradient Type
Sign in / Sign up

Export Citation Format

Share Document