scholarly journals An Active Set Trust-Region Method for Bound-Constrained Optimization

2021 ◽  
Author(s):  
Morteza Kimiaei
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Positive Definiteness ◽  
Active Set ◽  
Sufficient Descent Condition ◽  
Critical Measure ◽  
Complexity Result ◽  
Bound Constrained Optimization

AbstractThis paper discusses an active set trust-region algorithm for bound-constrained optimization problems. A sufficient descent condition is used as a computational measure to identify whether the function value is reduced or not. To get our complexity result, a critical measure is used which is computationally better than the other known critical measures. Under the positive definiteness of approximated Hessian matrices restricted to the subspace of non-active variables, it will be shown that unlimited zigzagging cannot occur. It is shown that our algorithm is competitive in comparison with the state-of-the-art solvers for solving an ill-conditioned bound-constrained least-squares problem.

Nonmonotone conic trust region method with line search technique for bound constrained optimization

2019 ◽  
Vol 53 (3) ◽  
pp. 787-805
Author(s):  
Lijuan Zhao
Keyword(s):  
Constrained Optimization ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region Method ◽  
Trust Region ◽  
Affine Scaling ◽  
Search Technique ◽  
Region Method ◽  
Bound Constrained Optimization ◽  
Line Search Technique

In this paper, we propose a nonmonotone trust region method for bound constrained optimization problems, where the bounds are dealt with by affine scaling technique. Differing from the traditional trust region methods, the subproblem in our algorithm is based on a conic model. Moreover, when the trial point isn’t acceptable by the usual trust region criterion, a line search technique is used to find an acceptable point. This procedure avoids resolving the trust region subproblem, which may reduce the total computational cost. The global convergence and Q-superlinear convergence of the algorithm are established under some mild conditions. Numerical results on a series of standard test problems are reported to show the effectiveness of the new method.

scholarly journals A Fractional Trust Region Method for Linear Equality Constrained Optimization

2016 ◽  
Vol 2016 ◽  
pp. 1-10 ◽  
Author(s):  
Honglan Zhu ◽  
Qin Ni ◽  
Liwei Zhang ◽  
Weiwei Yang
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Null Space ◽  
Trust Region Method ◽  
Trust Region ◽  
Test Problems ◽  
Fractional Model ◽  
Region Method ◽  
Linear Equality ◽  
Space Technique

A quasi-Newton trust region method with a new fractional model for linearly constrained optimization problems is proposed. We delete linear equality constraints by using null space technique. The fractional trust region subproblem is solved by a simple dogleg method. The global convergence of the proposed algorithm is established and proved. Numerical results for test problems show the efficiency of the trust region method with new fractional model. These results give the base of further research on nonlinear optimization.

scholarly journals A Derivative-Free Trust Region Algorithm with Nonmonotone Filter Technique for Bound Constrained Optimization

2018 ◽  
Vol 2018 ◽  
pp. 1-13
Author(s):  
Jing Gao ◽  
Jian Cao ◽  
Yueting Yang
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Trust Region ◽  
Computational Time ◽  
Test Problems ◽  
Trust Region Algorithm ◽  
Filter Technique ◽  
Derivative Free ◽  
Bound Constrained Optimization ◽  
Parameter Values

We propose a derivative-free trust region algorithm with a nonmonotone filter technique for bound constrained optimization. The derivative-free strategy is applied for special minimization functions in which derivatives are not all available. A nonmonotone filter technique ensures not only the trust region feature but also the global convergence under reasonable assumptions. Numerical experiments demonstrate that the new algorithm is effective for bound constrained optimization. Locally, optimal parameters with respect to overall computational time on a set of test problems are identified. The performance of the best choice of parameter values obtained by the algorithm we presented which differs from traditionally used values indicates that the algorithm proposed in this paper has a certain advantage for the nondifferentiable optimization problems.

scholarly journals LMBOPT: a limited memory method for bound-constrained optimization

2022 ◽  
Author(s):  
Morteza Kimiaei ◽  
Arnold Neumaier ◽  
Behzad Azmi
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Piecewise Linear ◽  
Convergence Theory ◽  
Active Set ◽  
Limited Memory ◽  
Constrained Problems ◽  
Problem Class ◽  
Bound Constrained Optimization ◽  
Problem Dimension

AbstractRecently, Neumaier and Azmi gave a comprehensive convergence theory for a generic algorithm for bound constrained optimization problems with a continuously differentiable objective function. The algorithm combines an active set strategy with a gradient-free line search along a piecewise linear search path defined by directions chosen to reduce zigzagging. This paper describes , an efficient implementation of this scheme. It employs new limited memory techniques for computing the search directions, improves by adding various safeguards relevant when finite precision arithmetic is used, and adds many practical enhancements in other details. The paper compares and several other solvers on the unconstrained and bound constrained problems from the collection and makes recommendations on which solver to use and when. Depending on the problem class, the problem dimension, and the precise goal, the best solvers are , , and .

Sign in / Sign up

Export Citation Format

Share Document