Nonmonotone trust region algorithm for unconstrained optimization problems

2010 ◽  
Vol 217 (8) ◽  
pp. 4274-4281 ◽  
Author(s):  
Wu Qing-jun
Keyword(s):  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems

scholarly journals A Novel Self-Adaptive Trust Region Algorithm for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Yunlong Lu ◽  
Wenyu Li ◽  
Mingyuan Cao ◽  
Yueting Yang
Keyword(s):  
Objective Function ◽  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Convergence Properties ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Piecewise Function ◽  
Self Adaptive

A new self-adaptive rule of trust region radius is introduced, which is given by a piecewise function on the ratio between the actual and predicted reductions of the objective function. A self-adaptive trust region method for unconstrained optimization problems is presented. The convergence properties of the method are established under reasonable assumptions. Preliminary numerical results show that the new method is significant and robust for solving unconstrained optimization problems.

scholarly journals A Filter and Nonmonotone Adaptive Trust Region Line Search Method for Unconstrained Optimization

Symmetry ◽  
2020 ◽  
Vol 12 (4) ◽  
pp. 656
Author(s):  
Quan Qu ◽  
Xianfeng Ding ◽  
Xinyi Wang
Keyword(s):  
Unconstrained Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Hessian Matrix ◽  
Trust Region ◽  
Approximate Model ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Line Search Method ◽  
Quasi Newton

In this paper, a new nonmonotone adaptive trust region algorithm is proposed for unconstrained optimization by combining a multidimensional filter and the Goldstein-type line search technique. A modified trust region ratio is presented which results in more reasonable consistency between the accurate model and the approximate model. When a trial step is rejected, we use a multidimensional filter to increase the likelihood that the trial step is accepted. If the trial step is still not successful with the filter, a nonmonotone Goldstein-type line search is used in the direction of the rejected trial step. The approximation of the Hessian matrix is updated by the modified Quasi-Newton formula (CBFGS). Under appropriate conditions, the proposed algorithm is globally convergent and superlinearly convergent. The new algorithm shows better performance in terms of the Dolan–Moré performance profile. Numerical results demonstrate the efficiency and robustness of the proposed algorithm for solving unconstrained optimization problems.

scholarly journals A Nonmonotone Weighting Self-Adaptive Trust Region Algorithm for Unconstrained Nonconvex Optimization

2015 ◽  
Vol 2015 ◽  
pp. 1-8
Author(s):  
Yunlong Lu ◽  
Weiwei Yang ◽  
Wenyu Li ◽  
Xiaowei Jiang ◽  
Yueting Yang
Keyword(s):  
Nonconvex Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Search Technique ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Line Search Technique ◽  
Self Adaptive

A new trust region method is presented, which combines nonmonotone line search technique, a self-adaptive update rule for the trust region radius, and the weighting technique for the ratio between the actual reduction and the predicted reduction. Under reasonable assumptions, the global convergence of the method is established for unconstrained nonconvex optimization. Numerical results show that the new method is efficient and robust for solving unconstrained optimization problems.

Parameterize the Center of the Trust Region for Solving Quadratic Interpolation Models

2011 ◽  
Vol 52-54 ◽  
pp. 920-925
Author(s):  
Qing Hua Zhou ◽  
Yan Geng ◽  
Ya Rui Zhang ◽  
Feng Xia Xu
Keyword(s):  
Optimization Problems ◽  
Trust Region Method ◽  
Main Idea ◽  
Trust Region ◽  
Search Region ◽  
Trust Region Algorithm ◽  
Unconstrained Optimization Problems ◽  
Simplex Search ◽  
Quadratic Interpolation ◽  
Derivative Free

The derivative free trust region algorithm was considered for solving the unconstrained optimization problems. This paper introduces a novel methodology that modified the center of the trust region in order to improve the search region. The main idea is parameterizing the center of the trust region based on the ideas of multi-directional search and simplex search algorithms. The scope of the new region was so expanded by introducing a parameter as to we can find a better descent directions. Experimental results reveal that the new method is more effective than the classic trust region method on the testing problems.

A randomized nonmonotone adaptive trust region method based on the simulated annealing strategy for unconstrained optimization

2019 ◽  
Vol 12 (3) ◽  
pp. 389-399
Author(s):  
Saman Babaie-Kafaki ◽  
Saeed Rezaee
Keyword(s):  
Simulated Annealing ◽  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Test Problems ◽  
Content Type ◽  
Unconstrained Optimization Problems ◽  
Randomization Scheme ◽  
Enhance Efficiency

PurposeThe purpose of this paper is to employ stochastic techniques to increase efficiency of the classical algorithms for solving nonlinear optimization problems.Design/methodology/approachThe well-known simulated annealing strategy is employed to search successive neighborhoods of the classical trust region (TR) algorithm.FindingsAn adaptive formula for computing the TR radius is suggested based on an eigenvalue analysis conducted on the memoryless Broyden-Fletcher-Goldfarb-Shanno updating formula. Also, a (heuristic) randomized adaptive TR algorithm is developed for solving unconstrained optimization problems. Results of computational experiments on a set of CUTEr test problems show that the proposed randomization scheme can enhance efficiency of the TR methods.Practical implicationsThe algorithm can be effectively used for solving the optimization problems which appear in engineering, economics, management, industry and other areas.Originality/valueThe proposed randomization scheme improves computational costs of the classical TR algorithm. Especially, the suggested algorithm avoids resolving the TR subproblems for many times.

Sign in / Sign up

Export Citation Format

Share Document