scholarly journals A Modified Hestenes-Stiefel-Type Derivative-Free Method for Large-Scale Nonlinear Monotone Equations

Mathematics ◽  
2020 ◽  
Vol 8 (2) ◽  
pp. 168 ◽  
Author(s):  
Zhifeng Dai ◽  
Huan Zhu
Keyword(s):  
Global Convergence ◽  
Large Scale ◽  
Line Search ◽  
System Of Nonlinear Equations ◽  
Inexact Newton Method ◽  
Monotone Equations ◽  
Smoothing Methods ◽  
Derivative Free ◽  
Derivative Free Method ◽  
Nonlinear Monotone Equations

The goal of this paper is to extend the modified Hestenes-Stiefel method to solve large-scale nonlinear monotone equations. The method is presented by combining the hyperplane projection method (Solodov, M.V.; Svaiter, B.F. A globally convergent inexact Newton method for systems of monotone equations, in: M. Fukushima, L. Qi (Eds.)Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods, Kluwer Academic Publishers. 1998, 355-369) and the modified Hestenes-Stiefel method in Dai and Wen (Dai, Z.; Wen, F. Global convergence of a modified Hestenes-Stiefel nonlinear conjugate gradient method with Armijo line search. Numer Algor. 2012, 59, 79-93). In addition, we propose a new line search for the derivative-free method. Global convergence of the proposed method is established if the system of nonlinear equations are Lipschitz continuous and monotone. Preliminary numerical results are given to test the effectiveness of the proposed method.

scholarly journals A modified Perry-type derivative-free projection method for solving large-scale nonlinear monotone equations

2021 ◽  
Author(s):  
Mompati Koorapetse ◽  
P Kaelo ◽  
S Kooepile-Reikeletseng
Keyword(s):  
Global Convergence ◽  
Projection Method ◽  
Conjugate Gradient ◽  
Gradient Method ◽  
Large Scale ◽  
Numerical Results ◽  
Projection Technique ◽  
Monotone Equations ◽  
Derivative Free ◽  
Nonlinear Monotone Equations

In this paper, a new modified Perry-type derivative-free projection method for solving large-scale nonlinear monotone equations is presented. The method is developed by combining a modified Perry's conjugate gradient method with the hyperplane projection technique. Global convergence and numerical results of the proposed method are established. Preliminary numerical results show that the proposed method is promising and efficient compared to some existing methods in the literature.

scholarly journals The “global” convergence of Broyden-like methods with suitable line search

1986 ◽  
Vol 28 (1) ◽  
pp. 75-92 ◽  
Author(s):  
Anderas Griewank
Keyword(s):  
Global Convergence ◽  
Iterative Methods ◽  
Level Set ◽  
Superlinear Convergence ◽  
Line Search ◽  
Divided Difference ◽  
Inverse Function ◽  
System Of Nonlinear Equations ◽  
Derivative Free ◽  
Quasi Newton

Iterative methods for solving a square system of nonlinear equations g(x) = 0 often require that the sum of squares residual γ (x) ≡ ½∥g(x)∥2 be reduced at each step. Since the gradient of γ depends on the Jacobian ∇g, this stabilization strategy is not easily implemented if only approximations Bk to ∇g are available. Therefore most quasi-Newton algorithms either include special updating steps or reset Bk to a divided difference estimate of ∇g whenever no satisfactory progress is made. Here the need for such back-up devices is avoided by a derivative-free line search in the range of g. Assuming that the Bk are generated from an rbitrary B0 by fixed scale updates, we establish superlinear convergence from within any compact level set of γ on which g has a differentiable inverse function g−1.

scholarly journals Derivative-free method based on DFP updating formula for solving convex constrained nonlinear monotone equations and application

2021 ◽  
Vol 6 (8) ◽  
pp. 8792-8814
Author(s):  
Aliyu Muhammed Awwal ◽  
◽  
Poom Kumam ◽  
Kanokwan Sitthithakerngkiet ◽  
Abubakar Muhammad Bakoji ◽  
...  
Keyword(s):  
Monotone Equations ◽  
Derivative Free ◽  
Derivative Free Method ◽  
Nonlinear Monotone Equations

scholarly journals A method with inertial extrapolation step for convex constrained monotone equations

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Abdulkarim Hassan Ibrahim ◽  
Poom Kumam ◽  
Auwal Bala Abubakar ◽  
Jamilu Abubakar
Keyword(s):  
Global Convergence ◽  
Theoretical Analysis ◽  
Nonlinear Equations ◽  
Large Scale ◽  
Descent Direction ◽  
Monotone Equations ◽  
Derivative Free ◽  
Speed Up ◽  
Sufficient Descent ◽  
Inertial Extrapolation

AbstractIn recent times, various algorithms have been incorporated with the inertial extrapolation step to speed up the convergence of the sequence generated by these algorithms. As far as we know, very few results exist regarding algorithms of the inertial derivative-free projection method for solving convex constrained monotone nonlinear equations. In this article, the convergence analysis of a derivative-free iterative algorithm (Liu and Feng in Numer. Algorithms 82(1):245–262, 2019) with an inertial extrapolation step for solving large scale convex constrained monotone nonlinear equations is studied. The proposed method generates a sufficient descent direction at each iteration. Under some mild assumptions, the global convergence of the sequence generated by the proposed method is established. Furthermore, some experimental results are presented to support the theoretical analysis of the proposed method.

scholarly journals Sufficient Descent Conjugate Gradient Methods for Solving Convex Constrained Nonlinear Monotone Equations

2014 ◽  
Vol 2014 ◽  
pp. 1-12 ◽  
Author(s):  
San-Yang Liu ◽  
Yuan-Yuan Huang ◽  
Hong-Wei Jiao
Keyword(s):  
Global Convergence ◽  
Projection Method ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Monotone Equations ◽  
Mild Conditions ◽  
Sufficient Descent ◽  
Nonlinear Monotone Equations

Two unified frameworks of some sufficient descent conjugate gradient methods are considered. Combined with the hyperplane projection method of Solodov and Svaiter, they are extended to solve convex constrained nonlinear monotone equations. Their global convergence is proven under some mild conditions. Numerical results illustrate that these methods are efficient and can be applied to solve large-scale nonsmooth equations.

Sign in / Sign up

Export Citation Format

Share Document