On Optimality Conditions for Nonlinear Conic Programming

Sequential optimality conditions play a major role in proving stronger global convergence results of numerical algorithms for nonlinear programming. Several extensions are described in conic contexts, in which many open questions have arisen. In this paper, we present new sequential optimality conditions in the context of a general nonlinear conic framework, which explains and improves several known results for specific cases, such as semidefinite programming, second-order cone programming, and nonlinear programming. In particular, we show that feasible limit points of sequences generated by the augmented Lagrangian method satisfy the so-called approximate gradient projection optimality condition and, under an additional smoothness assumption, the so-called complementary approximate Karush–Kuhn–Tucker condition. The first result was unknown even for nonlinear programming, and the second one was unknown, for instance, for semidefinite programming.

Sequential optimality conditions for cardinality-constrained optimization problems with applications

Recently, a new approach to tackle cardinality-constrained optimization problems based on a continuous reformulation of the problem was proposed. Following this approach, we derive a problem-tailored sequential optimality condition, which is satisfied at every local minimizer without requiring any constraint qualification. We relate this condition to an existing M-type stationary concept by introducing a weak sequential constraint qualification based on a cone-continuity property. Finally, we present two algorithmic applications: We improve existing results for a known regularization method by proving that it generates limit points satisfying the aforementioned optimality conditions even if the subproblems are only solved inexactly. And we show that, under a suitable Kurdyka–Łojasiewicz-type assumption, any limit point of a standard (safeguarded) multiplier penalty method applied directly to the reformulated problem also satisfies the optimality condition. These results are stronger than corresponding ones known for the related class of mathematical programs with complementarity constraints.

On the convergence of augmented Lagrangian strategies for nonlinear programming

Augmented Lagrangian (AL) algorithms are very popular and successful methods for solving constrained optimization problems. Recently, global convergence analysis of these methods has been dramatically improved by using the notion of sequential optimality conditions. Such conditions are necessary for optimality, regardless of the fulfillment of any constraint qualifications, and provide theoretical tools to justify stopping criteria of several numerical optimization methods. Here, we introduce a new sequential optimality condition stronger than previously stated in the literature. We show that a well-established safeguarded Powell–Hestenes–Rockafellar (PHR) AL algorithm generates points that satisfy the new condition under a Lojasiewicz-type assumption, improving and unifying all the previous convergence results. Furthermore, we introduce a new primal–dual AL method capable of achieving such points without the Lojasiewicz hypothesis. We then propose a hybrid method in which the new strategy acts to help the safeguarded PHR method when it tends to fail. We show by preliminary numerical tests that all the problems already successfully solved by the safeguarded PHR method remain unchanged, while others where the PHR method failed are now solved with an acceptable additional computational cost.

Strong complementary approximate Karush-Kuhn-Tucker conditions for multiobjective optimization problems

In this paper, we establish strong complementary approximate Karush- Kuhn-Tucker (SCAKKT) sequential optimality conditions for multiobjective optimization problems with equality and inequality constraints without any constraint qualifications and introduce a weak constraint qualification which assures the equivalence between SCAKKT and the strong Karush-Kuhn-Tucker (J Optim Theory Appl 80 (3): 483{500, 1994) conditions for multiobjective optimization problems.