scholarly journals Two Modified Three-Term Type Conjugate Gradient Methods and Their Global Convergence for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-9 ◽  
Author(s):  
Zhongbo Sun ◽  
Yantao Tian ◽  
Hongyang Li
Keyword(s):  
Global Convergence ◽  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugacy Condition ◽  
Conjugate Gradient Algorithms ◽  
Gradient Algorithms ◽  
Wolfe Line Search ◽  
Term Type

Two modified three-term type conjugate gradient algorithms which satisfy both the descent condition and the Dai-Liao type conjugacy condition are presented for unconstrained optimization. The first algorithm is a modification of the Hager and Zhang type algorithm in such a way that the search direction is descent and satisfies Dai-Liao’s type conjugacy condition. The second simple three-term type conjugate gradient method can generate sufficient decent directions at every iteration; moreover, this property is independent of the steplength line search. Also, the algorithms could be considered as a modification of the MBFGS method, but with differentzk. Under some mild conditions, the given methods are global convergence, which is independent of the Wolfe line search for general functions. The numerical experiments show that the proposed methods are very robust and efficient.

scholarly journals Global convergence of new three terms conjugate gradient for unconstrained optimization

2021 ◽  
Vol 11 (1) ◽  
pp. 1-9
Author(s):  
Ahmed Anwer Mustafa ◽  
Salah Gazi Shareef
Keyword(s):  
Global Convergence ◽  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Optimization Problems ◽  
Step Size ◽  
Conjugacy Condition ◽  
Sufficient Descent Condition ◽  
Conjugate Gradient Algorithms ◽  
Gradient Algorithms ◽  
Descent Condition

In this paper, a new formula of 𝛽𝑘 is suggested for the conjugate gradient method of solving unconstrained optimization problems based on three terms and step size of cubic. Our new proposed CG method has descent condition, sufficient descent condition, conjugacy condition, and global convergence properties. Numerical comparisons with two standard conjugate gradient algorithms show that this algorithm is very effective depending on the number of iterations and the number of functions evaluated.

scholarly journals A new conjugate gradient algorithms using conjugacy condition for solving unconstrained optimization

2021 ◽  
Vol 24 (3) ◽  
pp. 1647
Author(s):  
Aseel M. Qasim ◽  
Zinah F. Salih ◽  
Basim A. Hassan
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Conjugacy Condition ◽  
Simple Modification ◽  
Conjugate Gradient Algorithms ◽  
Gradient Algorithms ◽  
Nonlinear Conjugate Gradient ◽  
Nonlinear Conjugate Gradient Methods

The primarily objective of this paper which is indicated in the field of conjugate gradient algorithms for unconstrained optimization problems and algorithms is to show the advantage of the new proposed algorithm in comparison with the standard method which is denoted as. Hestenes Stiefel method, as we know the coefficient conjugate parameter is very crucial for this reason, we proposed a simple modification of the coefficient conjugate gradient which is used to derived the new formula for the conjugate gradient update parameter described in this paper. Our new modification is based on the conjugacy situation for nonlinear conjugate gradient methods which is given by the conjugacy condition for nonlinear conjugate gradient methods and added a nonnegative parameter to suggest the new extension of the method. Under mild Wolfe conditions, the global convergence theorem and lemmas are also defined and proved. The proposed method's efficiency is programming and demonstrated by the numerical instances, which were very encouraging.

scholarly journals A Dai-Liao Hybrid Hestenes-Stiefel and Fletcher-Revees Methods for Unconstrained Optimization

2021 ◽  
Vol 2 (1) ◽  
pp. 33
Author(s):  
Nasiru Salihu ◽  
Mathew Remilekun Odekunle ◽  
Also Mohammed Saleh ◽  
Suraj Salihu
Keyword(s):  
Unconstrained Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Convex Combination ◽  
Gradient Methods ◽  
Approximate Solutions ◽  
Step Size ◽  
Conjugacy Condition ◽  
Inexact Line Search ◽  
Wolfe Line Search

Some problems have no analytical solution or too difficult to solve by scientists, engineers, and mathematicians, so the development of numerical methods to obtain approximate solutions became necessary. Gradient methods are more efficient when the function to be minimized continuously in its first derivative. Therefore, this article presents a new hybrid Conjugate Gradient (CG) method to solve unconstrained optimization problems. The method requires the first-order derivatives but overcomes the steepest descent method’s shortcoming of slow convergence and needs not to save or compute the second-order derivatives needed by the Newton method. The CG update parameter is suggested from the Dai-Liao conjugacy condition as a convex combination of Hestenes-Stiefel and Fletcher-Revees algorithms by employing an optimal modulating choice parameterto avoid matrix storage. Numerical computation adopts an inexact line search to obtain the step-size that generates a decent property, showing that the algorithm is robust and efficient. The scheme converges globally under Wolfe line search, and it’s like is suitable in compressive sensing problems and M-tensor systems.

scholarly journals Several Guaranteed Descent Conjugate Gradient Methods for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-14
Author(s):  
San-Yang Liu ◽  
Yuan-Yuan Huang
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Numerical Results ◽  
Conjugate Gradient Methods ◽  
Descent Condition ◽  
Wolfe Line Search ◽  
Large Scale Unconstrained Optimization

This paper investigates a general form of guaranteed descent conjugate gradient methods which satisfies the descent conditiongkTdk≤-1-1/4θkgk2  θk>1/4and which is strongly convergent whenever the weak Wolfe line search is fulfilled. Moreover, we present several specific guaranteed descent conjugate gradient methods and give their numerical results for large-scale unconstrained optimization.

Global convergence of a modified Fletcher–Reeves conjugate gradient method with Wolfe line search

2019 ◽  
Vol 13 (04) ◽  
pp. 2050081
Author(s):  
Badreddine Sellami ◽  
Mohamed Chiheb Eddine Sellami
Keyword(s):  
Conjugate Gradient ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradients ◽  
Gradient Algorithm ◽  
Conjugacy Condition ◽  
Sufficient Descent Condition ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

In this paper, we are concerned with the conjugate gradient methods for solving unconstrained optimization problems. we propose a modified Fletcher–Reeves (abbreviated FR) [Function minimization by conjugate gradients, Comput. J. 7 (1964) 149–154] conjugate gradient algorithm satisfying a parametrized sufficient descent condition with a parameter [Formula: see text] is proposed. The parameter [Formula: see text] is computed by means of the conjugacy condition, thus an algorithm which is a positive multiplicative modification of the Hestenes and Stiefel (abbreviated HS) [Methods of conjugate gradients for solving linear systems, J. Res. Nat. Bur. Standards Sec. B 48 (1952) 409–436] algorithm is obtained, which produces a descent search direction at every iteration that the line search satisfies the Wolfe conditions. Under appropriate conditions, we show that the modified FR method with the strong Wolfe line search is globally convergent of uniformly convex functions. We also present extensive preliminary numerical experiments to show the efficiency of the proposed method.

scholarly journals A new family of Dai-Liao conjugate gradient methods with modified secant equation for unconstrained optimization

2021 ◽  
Author(s):  
Yutao Zheng
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Conjugacy Condition ◽  
New Family ◽  
Secant Equation ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search ◽  
Modified Secant Equation

In this paper, a new family of Dai-Liao--type conjugate gradient methods are proposed for unconstrained optimization problem. In the new methods, the modified secant equation used in [H. Yabe and M. Takano, Comput. Optim. Appl., 28: 203--225, 2004] is considered in Dai and Liao's conjugacy condition. Under some certain assumptions, we show that our methods are globally convergent for general functions with strong Wolfe line search. Numerical results illustrate that our proposed methods can outperform some existing ones.

scholarly journals A Global Convergence of LS-CD Hybrid Conjugate Gradient Method

2013 ◽  
Vol 2013 ◽  
pp. 1-5 ◽  
Author(s):  
Xiangfei Yang ◽  
Zhijun Luo ◽  
Xiaoyu Dai
Keyword(s):  
Global Convergence ◽  
Conjugate Gradient Method ◽  
Conjugate Gradient ◽  
Gradient Method ◽  
Line Search ◽  
Conjugate Gradient Algorithms ◽  
Gradient Algorithms ◽  
Unconstrained Optimization Problem ◽  
Hybrid Conjugate Gradient Method ◽  
Modified Conjugate Gradient Method

Conjugate gradient method is one of the most effective algorithms for solving unconstrained optimization problem. In this paper, a modified conjugate gradient method is presented and analyzed which is a hybridization of known LS and CD conjugate gradient algorithms. Under some mild conditions, the Wolfe-type line search can guarantee the global convergence of the LS-CD method. The numerical results show that the algorithm is efficient.

scholarly journals The Global Convergence of a New Mixed Conjugate Gradient Method for Unconstrained Optimization

2012 ◽  
Vol 2012 ◽  
pp. 1-14
Author(s):  
Yang Yueting ◽  
Cao Mingyuan
Keyword(s):  
Global Convergence ◽  
Unconstrained Optimization ◽  
Conjugate Gradient Method ◽  
Conjugate Gradient ◽  
Gradient Method ◽  
Line Search ◽  
Nonlinear Conjugate Gradient Method ◽  
Nonlinear Conjugate Gradient ◽  
Wolfe Line Search ◽  
Theoretical Analyses

We propose and generalize a new nonlinear conjugate gradient method for unconstrained optimization. The global convergence is proved with the Wolfe line search. Numerical experiments are reported which support the theoretical analyses and show the presented methods outperforming CGDESCENT method.

scholarly journals Two New Conjugate Gradient Methods for Unconstrained Optimization

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-13
Author(s):  
Meixing Liu ◽  
Guodong Ma ◽  
Jianghua Yin
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Globally Convergent ◽  
Sufficient Descent ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

The conjugate gradient method is very effective in solving large-scale unconstrained optimal problems. In this paper, on the basis of the conjugate parameter of the conjugate descent (CD) method and the second inequality in the strong Wolfe line search, two new conjugate parameters are devised. Using the strong Wolfe line search to obtain the step lengths, two modified conjugate gradient methods are proposed for general unconstrained optimization. Under the standard assumptions, the two presented methods are proved to be sufficient descent and globally convergent. Finally, preliminary numerical results are reported to show that the proposed methods are promising.

Sign in / Sign up

Export Citation Format

Share Document