Two sufficient descent three-term conjugate gradient methods for unconstrained optimization problems with applications in compressive sensing

2021 ◽  
Author(s):  
Yufeng Liu ◽  
Zhibin Zhu ◽  
Benxin Zhang
Keyword(s):  
Compressive Sensing ◽  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Sufficient Descent

scholarly journals Nonlinear Conjugate Gradient Methods with Wolfe Type Line Search

2013 ◽  
Vol 2013 ◽  
pp. 1-5 ◽  
Author(s):  
Yuan-Yuan Chen ◽  
Shou-Qiang Du
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Convergence Results ◽  
Nonlinear Conjugate Gradient ◽  
Nonlinear Conjugate Gradient Methods

Nonlinear conjugate gradient method is one of the useful methods for unconstrained optimization problems. In this paper, we consider three kinds of nonlinear conjugate gradient methods with Wolfe type line search for unstrained optimization problems. Under some mild assumptions, the global convergence results of the given methods are proposed. The numerical results show that the nonlinear conjugate gradient methods with Wolfe type line search are efficient for some unconstrained optimization problems.

scholarly journals The Hybrid BFGS-CG Method in Solving Unconstrained Optimization Problems

2014 ◽  
Vol 2014 ◽  
pp. 1-6 ◽  
Author(s):  
Mohd Asrul Hery Ibrahim ◽  
Mustafa Mamat ◽  
Wah June Leong
Keyword(s):  
Unconstrained Optimization ◽  
Hybrid Method ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Large Scale Unconstrained Optimization ◽  
Quasi Newton

In solving large scale problems, the quasi-Newton method is known as the most efficient method in solving unconstrained optimization problems. Hence, a new hybrid method, known as the BFGS-CG method, has been created based on these properties, combining the search direction between conjugate gradient methods and quasi-Newton methods. In comparison to standard BFGS methods and conjugate gradient methods, the BFGS-CG method shows significant improvement in the total number of iterations and CPU time required to solve large scale unconstrained optimization problems. We also prove that the hybrid method is globally convergent.

scholarly journals Two-versions of descent conjugate gradient methods for large-scale unconstrained optimization

2021 ◽  
Vol 22 (3) ◽  
pp. 1643
Author(s):  
Hawraz N. Jabbar ◽  
Basim A. Hassan
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Large Scale ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Taylor Series Expansion ◽  
Conjugate Gradient Methods ◽  
Unconstrained Optimization Problems ◽  
Gradient Type ◽  
Large Scale Unconstrained Optimization

<p>The conjugate gradient methods are noted to be exceedingly valuable for solving large-scale unconstrained optimization problems since it needn't the storage of matrices. Mostly the parameter conjugate is the focus for conjugate gradient methods. The current paper proposes new methods of parameter of conjugate gradient type to solve problems of large-scale unconstrained optimization. A Hessian approximation in a diagonal matrix form on the basis of second and third-order Taylor series expansion was employed in this study. The sufficient descent property for the proposed algorithm are proved. The new method was converged globally. This new algorithm is found to be competitive to the algorithm of fletcher-reeves (FR) in a number of numerical experiments.</p>

scholarly journals Some generalized three-term conjugate gradient methods based on CD approach for unconstrained optimization problems

2021 ◽  
Vol 3 (2) ◽  
pp. 67-82
Author(s):  
Ladan Arman ◽  
Yuanming Xu ◽  
Long Liping
Keyword(s):  
Unconstrained Optimization ◽  
Conjugate Gradient ◽  
Line Search ◽  
Optimization Problems ◽  
Gradient Methods ◽  
Conjugate Gradient Methods ◽  
Sufficient Descent Condition ◽  
Unconstrained Optimization Problems ◽  
Strong Wolfe Line Search ◽  
Wolfe Line Search

Abstract In this paper, based on the efficient Conjugate Descent (CD) method, two generalized CD algorithms are proposed to solve the unconstrained optimization problems. These methods are three-term conjugate gradient methods which the generated directions by using the conjugate gradient parameters and independent of the line search satisfy in the sufficient descent condition. Furthermore, under the strong Wolfe line search, the global convergence of the proposed methods are proved. Also, the preliminary numerical results on the CUTEst collection are presented to show effectiveness of our methods.

Sign in / Sign up

Export Citation Format

Share Document