A derivative-free nonmonotone line search and its application to the spectral residual method

2008 ◽  
Vol 29 (3) ◽  
pp. 814-825 ◽  
Author(s):  
W. Cheng ◽  
D.-H. Li
Keyword(s):  
Line Search ◽  
Nonmonotone Line Search ◽  
Residual Method ◽  
Spectral Residual ◽  
Derivative Free

scholarly journals The “global” convergence of Broyden-like methods with suitable line search

1986 ◽  
Vol 28 (1) ◽  
pp. 75-92 ◽  
Author(s):  
Anderas Griewank
Keyword(s):  
Global Convergence ◽  
Iterative Methods ◽  
Level Set ◽  
Superlinear Convergence ◽  
Line Search ◽  
Divided Difference ◽  
Inverse Function ◽  
System Of Nonlinear Equations ◽  
Derivative Free ◽  
Quasi Newton

Iterative methods for solving a square system of nonlinear equations g(x) = 0 often require that the sum of squares residual γ (x) ≡ ½∥g(x)∥2 be reduced at each step. Since the gradient of γ depends on the Jacobian ∇g, this stabilization strategy is not easily implemented if only approximations Bk to ∇g are available. Therefore most quasi-Newton algorithms either include special updating steps or reset Bk to a divided difference estimate of ∇g whenever no satisfactory progress is made. Here the need for such back-up devices is avoided by a derivative-free line search in the range of g. Assuming that the Bk are generated from an rbitrary B0 by fixed scale updates, we establish superlinear convergence from within any compact level set of γ on which g has a differentiable inverse function g−1.

Sign in / Sign up

Export Citation Format

Share Document