Nonmonotone adaptive trust-region method for unconstrained optimization problems

2005 ◽  
Vol 163 (1) ◽  
pp. 489-504 ◽  
Author(s):  
Jinhua Fu ◽  
Wenyu Sun
Keyword(s):  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Region Method ◽  
Unconstrained Optimization Problems

A new self-adaptive trust region method for unconstrained optimization

2011 ◽  
Vol 18 (9) ◽  
pp. 1303-1309 ◽  
Author(s):  
Zhaocheng Cui ◽  
Boying Wu
Keyword(s):  
Unconstrained Optimization ◽  
Superlinear Convergence ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Convergence Properties ◽  
Region Method ◽  
Unconstrained Optimization Problems ◽  
Global And Superlinear Convergence ◽  
Self Adaptive

In this paper, we propose a new self-adaptive trust region method for unconstrained optimization problems and develop some convergence properties. In our algorithm, we use the previous and current iterative information to define a suitable trust region radius at each iteration. The global and superlinear convergence properties of the algorithm are established under reasonable assumptions. Preliminary numerical results show that the new method is efficient and attractive for solving unconstrained optimization problems.

scholarly journals A Nonmonotone Adaptive Trust Region Method Based on Conic Model for Unconstrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-8
Author(s):  
Zhaocheng Cui
Keyword(s):  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
New Method ◽  
Convergence Properties ◽  
Initial Trust ◽  
Conic Model ◽  
Region Method ◽  
Unconstrained Optimization Problems

We propose a nonmonotone adaptive trust region method for unconstrained optimization problems which combines a conic model and a new update rule for adjusting the trust region radius. Unlike the traditional adaptive trust region methods, the subproblem of the new method is the conic minimization subproblem. Moreover, at each iteration, we use the last and the current iterative information to define a suitable initial trust region radius. The global and superlinear convergence properties of the proposed method are established under reasonable conditions. Numerical results show that the new method is efficient and attractive for unconstrained optimization problems.

Based on GA Mixed with Trust Region Method Solving Nonlinear Least Square Problems

2011 ◽  
Vol 141 ◽  
pp. 92-97
Author(s):  
Miao Hu ◽  
Tai Yong Wang ◽  
Bo Geng ◽  
Qi Chen Wang ◽  
Dian Peng Li
Keyword(s):  
Genetic Algorithm ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Least Square ◽  
Search Range ◽  
Genetic Search ◽  
Region Method ◽  
Unconstrained Optimization Problems ◽  
Least Square Problems

Nonlinear least square is one of the unconstrained optimization problems. In order to solve the least square trust region sub-problem, a genetic algorithm (GA) of global convergence was applied, and the premature convergence of genetic algorithms was also overcome through optimizing the search range of GA with trust region method (TRM), and the convergence rate of genetic algorithm was increased by the randomness of the genetic search. Finally, an example of banana function was established to verify the GA, and the results show the practicability and precision of this algorithm.

A randomized nonmonotone adaptive trust region method based on the simulated annealing strategy for unconstrained optimization

2019 ◽  
Vol 12 (3) ◽  
pp. 389-399
Author(s):  
Saman Babaie-Kafaki ◽  
Saeed Rezaee
Keyword(s):  
Simulated Annealing ◽  
Unconstrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Test Problems ◽  
Content Type ◽  
Unconstrained Optimization Problems ◽  
Randomization Scheme ◽  
Enhance Efficiency

PurposeThe purpose of this paper is to employ stochastic techniques to increase efficiency of the classical algorithms for solving nonlinear optimization problems.Design/methodology/approachThe well-known simulated annealing strategy is employed to search successive neighborhoods of the classical trust region (TR) algorithm.FindingsAn adaptive formula for computing the TR radius is suggested based on an eigenvalue analysis conducted on the memoryless Broyden-Fletcher-Goldfarb-Shanno updating formula. Also, a (heuristic) randomized adaptive TR algorithm is developed for solving unconstrained optimization problems. Results of computational experiments on a set of CUTEr test problems show that the proposed randomization scheme can enhance efficiency of the TR methods.Practical implicationsThe algorithm can be effectively used for solving the optimization problems which appear in engineering, economics, management, industry and other areas.Originality/valueThe proposed randomization scheme improves computational costs of the classical TR algorithm. Especially, the suggested algorithm avoids resolving the TR subproblems for many times.

Sign in / Sign up

Export Citation Format

Share Document