scholarly journals End-to-End Constrained Optimization Learning: A Survey

2021 ◽  
Author(s):  
James Kotary ◽  
Ferdinando Fioretto ◽  
Pascal Van Hentenryck ◽  
Bryan Wilder
Keyword(s):  
Machine Learning ◽  
Constrained Optimization ◽  
Optimization Problems ◽  
Approximate Solutions ◽  
Optimization Methods ◽  
Combinatorial Problems ◽  
Logical Inference ◽  
Constrained Optimization Problems ◽  
Hybrid Machine ◽  
Learning Architectures

This paper surveys the recent attempts at leveraging machine learning to solve constrained optimization problems. It focuses on surveying the work on integrating combinatorial solvers and optimization methods with machine learning architectures. These approaches hold the promise to develop new hybrid machine learning and optimization methods to predict fast, approximate, solutions to combinatorial problems and to enable structural logical inference. This paper presents a conceptual review of the recent advancements in this emerging area.

scholarly journals A Novel Approach to Improve the Performance of Evolutionary Methods for Nonlinear Constrained Optimization

2012 ◽  
Vol 2012 ◽  
pp. 1-7 ◽  
Author(s):  
Alireza Rowhanimanesh ◽  
Sohrab Efati
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Optimization Methods ◽  
Search Space ◽  
Global Optimum ◽  
Constrained Optimization Problems ◽  
Nonlinear Constrained Optimization ◽  
Evolutionary Methods ◽  
Space Reduction ◽  
Reduced Space

Evolutionary methods are well-known techniques for solving nonlinear constrained optimization problems. Due to the exploration power of evolution-based optimizers, population usually converges to a region around global optimum after several generations. Although this convergence can be efficiently used to reduce search space, in most of the existing optimization methods, search is still continued over original space and considerable time is wasted for searching ineffective regions. This paper proposes a simple and general approach based on search space reduction to improve the exploitation power of the existing evolutionary methods without adding any significant computational complexity. After a number of generations when enough exploration is performed, search space is reduced to a small subspace around the best individual, and then search is continued over this reduced space. If the space reduction parameters (red_gen and red_factor) are adjusted properly, reduced space will include global optimum. The proposed scheme can help the existing evolutionary methods to find better near-optimal solutions in a shorter time. To demonstrate the power of the new approach, it is applied to a set of benchmark constrained optimization problems and the results are compared with a previous work in the literature.

Sequential Quadratic Programming

Acta Numerica ◽  
1995 ◽  
Vol 4 ◽  
pp. 1-51 ◽  
Author(s):  
Paul T. Boggs ◽  
Jon W. Tolle
Keyword(s):  
Quadratic Programming ◽  
Constrained Optimization ◽  
Sequential Quadratic Programming ◽  
Large Scale ◽  
Optimization Problems ◽  
Optimization Methods ◽  
Public Domain ◽  
Large Set ◽  
Constrained Optimization Problems ◽  
Nonlinearly Constrained Optimization

Since its popularization in the late 1970s, Sequential Quadratic Programming (SQP) has arguably become the most successful method for solving nonlinearly constrained optimization problems. As with most optimization methods, SQP is not a single algorithm, but rather a conceptual method from which numerous specific algorithms have evolved. Backed by a solid theoretical and computational foundation, both commercial and public-domain SQP algorithms have been developed and used to solve a remarkably large set of important practical problems. Recently large-scale versions have been devised and tested with promising results.

scholarly journals Multi-Objective Optimization Through Pareto Minimal Correction Subsets

2018 ◽  
Author(s):  
Miguel Terra-Neves ◽  
Inês Lynce ◽  
Vasco Manquinho
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
State Of The Art ◽  
Optimal Solution ◽  
Approximate Solutions ◽  
Pareto Optimal ◽  
Constrained Optimization Problems ◽  
Multi Objective ◽  
Wide Range ◽  
Constraint Set

A Minimal Correction Subset (MCS) of an unsatisfiable constraint set is a minimal subset of constraints that, if removed, makes the constraint set satisfiable. MCSs enjoy a wide range of applications, such as finding approximate solutions to constrained optimization problems. However, existing work on applying MCS enumeration to optimization problems focuses on the single-objective case. In this work, Pareto Minimal Correction Subsets (Pareto-MCSs) are proposed for approximating the Pareto-optimal solution set of multi-objective constrained optimization problems. We formalize and prove an equivalence relationship between Pareto-optimal solutions and Pareto-MCSs. Moreover, Pareto-MCSs and MCSs can be connected in such a way that existing state-of-the-art MCS enumeration algorithms can be used to enumerate Pareto-MCSs. Finally, experimental results on the multi-objective virtual machine consolidation problem show that the Pareto-MCS approach is competitive with state-of-the-art algorithms.

Plasma generation optimization: a new physically-based metaheuristic algorithm for solving constrained optimization problems

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Ali Kaveh ◽  
Hossein Akbari ◽  
Seyed Milad Hosseini
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
State Of The Art ◽  
Optimization Methods ◽  
Test Problems ◽  
Metaheuristic Algorithm ◽  
Constrained Optimization Problems ◽  
Content Type ◽  
Plasma Generation ◽  
Physically Based

Purpose This paper aims to present a new physically inspired meta-heuristic algorithm, which is called Plasma Generation Optimization (PGO). To evaluate the performance and capability of the proposed method in comparison to other optimization methods, two sets of test problems consisting of 13 constrained benchmark functions and 6 benchmark trusses are investigated numerically. The results indicate that the performance of the proposed method is competitive with other considered state-of-the-art optimization methods. Design/methodology/approach In this paper, a new physically-based metaheuristic algorithm called plasma generation optimization (PGO) algorithm is developed for solving constrained optimization problems. PGO is a population-based optimizer inspired by the process of plasma generation. In the proposed algorithm, each agent is considered as an electron. Movement of electrons and changing their energy levels are based on simulating excitation, de-excitation and ionization processes occurring through the plasma generation. In the proposed PGO, the global optimum is obtained when plasma is generated with the highest degree of ionization. Findings A new physically-based metaheuristic algorithm called the PGO algorithm is developed that is inspired from the process of plasma generation. Originality/value The results indicate that the performance of the proposed method is competitive with other state-of-the-art methods.

scholarly journals A Globally Convergent Parallel SSLE Algorithm for Inequality Constrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-6
Author(s):  
Zhijun Luo ◽  
Lirong Wang
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Linear Equations ◽  
Coefficient Matrix ◽  
Descent Direction ◽  
Constrained Optimization Problems ◽  
Inequality Constrained Optimization ◽  
Globally Convergent ◽  
Variable Distribution ◽  
Systems Of Linear Equations

A new parallel variable distribution algorithm based on interior point SSLE algorithm is proposed for solving inequality constrained optimization problems under the condition that the constraints are block-separable by the technology of sequential system of linear equation. Each iteration of this algorithm only needs to solve three systems of linear equations with the same coefficient matrix to obtain the descent direction. Furthermore, under certain conditions, the global convergence is achieved.

scholarly journals An Augmented Lagrangian Method for Cardinality-Constrained Optimization Problems

2021 ◽  
Author(s):  
Christian Kanzow ◽  
Andreas B. Raharja ◽  
Alexandra Schwartz
Keyword(s):  
Constrained Optimization ◽  
Numerical Experiments ◽  
Penalty Method ◽  
Augmented Lagrangian ◽  
Constraint Qualification ◽  
Optimization Problems ◽  
Augmented Lagrangian Method ◽  
Constrained Optimization Problems ◽  
Strongly Stationary ◽  
Type Constraint

AbstractA reformulation of cardinality-constrained optimization problems into continuous nonlinear optimization problems with an orthogonality-type constraint has gained some popularity during the last few years. Due to the special structure of the constraints, the reformulation violates many standard assumptions and therefore is often solved using specialized algorithms. In contrast to this, we investigate the viability of using a standard safeguarded multiplier penalty method without any problem-tailored modifications to solve the reformulated problem. We prove global convergence towards an (essentially strongly) stationary point under a suitable problem-tailored quasinormality constraint qualification. Numerical experiments illustrating the performance of the method in comparison to regularization-based approaches are provided.

Sign in / Sign up

Export Citation Format

Share Document