scholarly journals THE BARZILAI AND BORWEIN GRADIENT METHOD WITH NONMONOTONE LINE SEARCH FOR NONSMOOTH CONVEX OPTIMIZATION PROBLEMS

2012 ◽  
Vol 17 (2) ◽  
pp. 203-216 ◽  
Author(s):  
Gonglin Yuan ◽  
Zengxin Wei
Keyword(s):  
Line Search ◽  
Optimization Problems ◽  
Nonmonotone Line Search ◽  
Gradient Algorithm ◽  
Search Technique ◽  
Nonsmooth Problems ◽  
Smooth Optimization ◽  
Line Search Technique ◽  
Nonsmooth Convex Minimization ◽  
The Given

The Barzilai and Borwein gradient algorithm has received a great deal of attention in recent decades since it is simple and effective for smooth optimization problems. Whether can it be extended to solve nonsmooth problems? In this paper, we answer this question positively. The Barzilai and Borwein gradient algorithm combined with a nonmonotone line search technique is proposed for nonsmooth convex minimization. The global convergence of the given algorithm is established under suitable conditions. Numerical results show that this method is efficient.

scholarly journals A Conjugate Gradient Algorithm under Yuan-Wei-Lu Line Search Technique for Large-Scale Minimization Optimization Models

2018 ◽  
Vol 2018 ◽  
pp. 1-11 ◽  
Author(s):  
Xiangrong Li ◽  
Songhua Wang ◽  
Zhongzhou Jin ◽  
Hongtruong Pham
Keyword(s):  
Conjugate Gradient ◽  
Large Scale ◽  
Line Search ◽  
Optimization Problems ◽  
Conjugate Gradient Algorithm ◽  
Gradient Algorithm ◽  
Search Technique ◽  
Inexact Line Search ◽  
Line Search Technique ◽  
Large Scale Unconstrained Optimization

This paper gives a modified Hestenes and Stiefel (HS) conjugate gradient algorithm under the Yuan-Wei-Lu inexact line search technique for large-scale unconstrained optimization problems, where the proposed algorithm has the following properties: (1) the new search direction possesses not only a sufficient descent property but also a trust region feature; (2) the presented algorithm has global convergence for nonconvex functions; (3) the numerical experiment showed that the new algorithm is more effective than similar algorithms.

scholarly journals A Nonmonotone Weighting Self-Adaptive Trust Region Algorithm for Unconstrained Nonconvex Optimization

2015 ◽  
Vol 2015 ◽  
pp. 1-8
Author(s):  
Yunlong Lu ◽  
Weiwei Yang ◽  
Wenyu Li ◽  
Xiaowei Jiang ◽  
Yueting Yang
Keyword(s):  
Nonconvex Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Search Technique ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Line Search Technique ◽  
Self Adaptive

A new trust region method is presented, which combines nonmonotone line search technique, a self-adaptive update rule for the trust region radius, and the weighting technique for the ratio between the actual reduction and the predicted reduction. Under reasonable assumptions, the global convergence of the method is established for unconstrained nonconvex optimization. Numerical results show that the new method is efficient and robust for solving unconstrained optimization problems.

A Simulated Annealing-Based Barzilai–Borwein Gradient Method for Unconstrained Optimization Problems

2019 ◽  
Vol 36 (04) ◽  
pp. 1950017 ◽  
Author(s):  
Wen-Li Dong ◽  
Xing Li ◽  
Zheng Peng
Keyword(s):  
Simulated Annealing ◽  
Unconstrained Optimization ◽  
Gradient Method ◽  
Line Search ◽  
High Efficiency ◽  
Optimization Problems ◽  
Search Technique ◽  
Unconstrained Optimization Problems ◽  
Armijo Line Search ◽  
Line Search Technique

In this paper, we propose a simulated annealing-based Barzilai–Borwein (SABB) gradient method for unconstrained optimization problems. The SABB method accepts the Barzilai–Borwein (BB) step by a simulated annealing rule. If the BB step cannot be accepted, the Armijo line search is used. The global convergence of the SABB method is established under some mild conditions. Numerical experiments indicate that, compared to some existing BB methods using nonmonotone line search technique, the SABB method performs well with high efficiency.

scholarly journals A Line-Search-Based Partial Proximal Alternating Directions Method for Separable Convex Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Yu-hua Zeng ◽  
Yu-fei Yang ◽  
Zheng Peng
Keyword(s):  
Convex Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Proximal Point Method ◽  
Search Technique ◽  
Proximal Point ◽  
Separable Convex Optimization ◽  
Line Search Technique ◽  
Alternating Directions Method ◽  
Proximal Term

We propose an appealing line-search-based partial proximal alternating directions (LSPPAD) method for solving a class of separable convex optimization problems. These problems under consideration are common in practice. The proposed method solves two subproblems at each iteration: one is solved by a proximal point method, while the proximal term is absent from the other. Both subproblems admit inexact solutions. A line search technique is used to guarantee the convergence. The convergence of the LSPPAD method is established under some suitable conditions. The advantage of the proposed method is that it provides the tractability of the subproblem in which the proximal term is absent. Numerical tests show that the LSPPAD method has better performance compared with the existing alternating projection based prediction-correction (APBPC) method if both are employed to solve the described problem.

Nonmonotone conic trust region method with line search technique for bound constrained optimization

2019 ◽  
Vol 53 (3) ◽  
pp. 787-805
Author(s):  
Lijuan Zhao
Keyword(s):  
Constrained Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Affine Scaling ◽  
Search Technique ◽  
Region Method ◽  
Bound Constrained Optimization ◽  
Line Search Technique

In this paper, we propose a nonmonotone trust region method for bound constrained optimization problems, where the bounds are dealt with by affine scaling technique. Differing from the traditional trust region methods, the subproblem in our algorithm is based on a conic model. Moreover, when the trial point isn’t acceptable by the usual trust region criterion, a line search technique is used to find an acceptable point. This procedure avoids resolving the trust region subproblem, which may reduce the total computational cost. The global convergence and Q-superlinear convergence of the algorithm are established under some mild conditions. Numerical results on a series of standard test problems are reported to show the effectiveness of the new method.

Sign in / Sign up

Export Citation Format

Share Document