Global convergence of the general three-term conjugate gradient methods with the relaxed strong wolfe line-search

2001 ◽  
Vol 16 (1) ◽  
pp. 58-62
Author(s):  
Xu Zeshui ◽  
Yue Zhenjun
Keyword(s):  
Global Convergence ◽  
Conjugate Gradient ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

scholarly journals Two New Conjugate Gradient Methods for Unconstrained Optimization

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Meixing Liu ◽  
Guodong Ma ◽  
Jianghua Yin
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Globally Convergent ◽  
Sufficient Descent ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

The conjugate gradient method is very effective in solving large-scale unconstrained optimal problems. In this paper, on the basis of the conjugate parameter of the conjugate descent (CD) method and the second inequality in the strong Wolfe line search, two new conjugate parameters are devised. Using the strong Wolfe line search to obtain the step lengths, two modified conjugate gradient methods are proposed for general unconstrained optimization. Under the standard assumptions, the two presented methods are proved to be sufficient descent and globally convergent. Finally, preliminary numerical results are reported to show that the proposed methods are promising.

scholarly journals Global Convergence of a Modified LS Method

2012 ◽  
Vol 2012 ◽  
pp. 1-9
Author(s):  
Liu JinKui ◽  
Du Xianglin
Keyword(s):  
Global Convergence ◽  
Numerical Experiments ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Uniformly Convex ◽  
Unconstrained Optimization Problems ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

The LS method is one of the effective conjugate gradient methods in solving the unconstrained optimization problems. The paper presents a modified LS method on the basis of the famous LS method and proves the strong global convergence for the uniformly convex functions and the global convergence for general functions under the strong Wolfe line search. The numerical experiments show that the modified LS method is very effective in practice.

scholarly journals Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

2021 ◽  
Vol 3 (2) ◽  
pp. 67-82
Author(s):  
Ladan Arman ◽  
Yuanming Xu ◽  
Long Liping
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Sufficient Descent Condition ◽  
Unconstrained Optimization Problems ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

Abstract In this paper, based on the efficient Conjugate Descent (CD) method, two generalized CD algorithms are proposed to solve the unconstrained optimization problems. These methods are three-term conjugate gradient methods which the generated directions by using the conjugate gradient parameters and independent of the line search satisfy in the sufficient descent condition. Furthermore, under the strong Wolfe line search, the global convergence of the proposed methods are proved. Also, the preliminary numerical results on the CUTEst collection are presented to show effectiveness of our methods.

scholarly journals A New Modified Three-Term Hestenes–Stiefel Conjugate Gradient Method with Sufficient Descent Property and Its Global Convergence

2018 ◽  
Vol 2018 ◽  
pp. 1-13 ◽  
Author(s):  
Bakhtawar Baluch ◽  
Zabidin Salleh ◽  
Ahmad Alhawarat
Keyword(s):  
Global Convergence ◽  
Conjugate Gradient Method ◽  
Conjugate Gradient ◽  
Gradient Method ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Sufficient Descent Property ◽  
Descent Property ◽  
Sufficient Descent

This paper describes a modified three-term Hestenes–Stiefel (HS) method. The original HS method is the earliest conjugate gradient method. Although the HS method achieves global convergence using an exact line search, this is not guaranteed in the case of an inexact line search. In addition, the HS method does not usually satisfy the descent property. Our modified three-term conjugate gradient method possesses a sufficient descent property regardless of the type of line search and guarantees global convergence using the inexact Wolfe–Powell line search. The numerical efficiency of the modified three-term HS method is checked using 75 standard test functions. It is known that three-term conjugate gradient methods are numerically more efficient than two-term conjugate gradient methods. Importantly, this paper quantifies how much better the three-term performance is compared with two-term methods. Thus, in the numerical results, we compare our new modification with an efficient two-term conjugate gradient method. We also compare our modification with a state-of-the-art three-term HS method. Finally, we conclude that our proposed modification is globally convergent and numerically efficient.

scholarly journals Several Guaranteed Descent Conjugate Gradient Methods for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-14
Author(s):  
San-Yang Liu ◽  
Yuan-Yuan Huang
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Numerical Results ◽  
Conjugate Gradient Methods ◽  
Descent Condition ◽  
Wolfe Line Search ◽  
Large Scale Unconstrained Optimization

This paper investigates a general form of guaranteed descent conjugate gradient methods which satisfies the descent conditiongkTdk≤-1-1/4θkgk2  θk>1/4and which is strongly convergent whenever the weak Wolfe line search is fulfilled. Moreover, we present several specific guaranteed descent conjugate gradient methods and give their numerical results for large-scale unconstrained optimization.

Global convergence of a new spectral conjugate gradient by using Strong Wolfe line search

2015 ◽  
Vol 9 ◽  
pp. 3105-3117 ◽  
Author(s):  
Norhaslinda Zull ◽  
Mohd Rivaie ◽  
Mustafa Mamat ◽  
Zabidin Salleh ◽  
Zahrahtul Amani
Keyword(s):  
Global Convergence ◽  
Conjugate Gradient ◽  
Line Search ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search ◽  
Spectral Conjugate Gradient

Global convergence of a modified Fletcher–Reeves conjugate gradient method with Wolfe line search

2019 ◽  
Vol 13 (04) ◽  
pp. 2050081
Author(s):  
Badreddine Sellami ◽  
Mohamed Chiheb Eddine Sellami
Keyword(s):  
Conjugate Gradient ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradients ◽  
Gradient Algorithm ◽  
Conjugacy Condition ◽  
Sufficient Descent Condition ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

In this paper, we are concerned with the conjugate gradient methods for solving unconstrained optimization problems. we propose a modified Fletcher–Reeves (abbreviated FR) [Function minimization by conjugate gradients, Comput. J. 7 (1964) 149–154] conjugate gradient algorithm satisfying a parametrized sufficient descent condition with a parameter [Formula: see text] is proposed. The parameter [Formula: see text] is computed by means of the conjugacy condition, thus an algorithm which is a positive multiplicative modification of the Hestenes and Stiefel (abbreviated HS) [Methods of conjugate gradients for solving linear systems, J. Res. Nat. Bur. Standards Sec. B 48 (1952) 409–436] algorithm is obtained, which produces a descent search direction at every iteration that the line search satisfies the Wolfe conditions. Under appropriate conditions, we show that the modified FR method with the strong Wolfe line search is globally convergent of uniformly convex functions. We also present extensive preliminary numerical experiments to show the efficiency of the proposed method.

Sign in / Sign up

Export Citation Format

Share Document