scholarly journals Sparse Solutions of a Class of Constrained Optimization Problems

2021 ◽  
Author(s):  
Lei Yang ◽  
Xiaojun Chen ◽  
Shuhuang Xiang
Keyword(s):  
Optimization Problems ◽  
Linear Equations ◽  
Solution Set ◽  
Optimal Solutions ◽  
Constrained Optimization Problems ◽  
Infinity Norm ◽  
Underdetermined System ◽  
The Matrix ◽  
Sparse Solutions ◽  
Theoretical Results

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing [Formula: see text] subject to [Formula: see text] for given [Formula: see text] and [Formula: see text]. We then study various properties of the optimal solutions of this problem. Specifically, without any condition on the matrix A, we provide upper bounds in cardinality and infinity norm for the optimal solutions and show that all optimal solutions must be on the boundary of the feasible set when [Formula: see text]. Moreover, for [Formula: see text], we show that the problem with [Formula: see text] has a finite number of optimal solutions and prove that there exists [Formula: see text] such that the solution set of the problem with any [Formula: see text] is contained in the solution set of the problem with p = 0, and there further exists [Formula: see text] such that the solution set of the problem with any [Formula: see text] remains unchanged. An estimation of such [Formula: see text] is also provided. In addition, to solve the constrained nonconvex non-Lipschitz Lp-L1 problem ([Formula: see text] and q = 1), we propose a smoothing penalty method and show that, under some mild conditions, any cluster point of the sequence generated is a stationary point of our problem. Some numerical examples are given to implicitly illustrate the theoretical results and show the efficiency of the proposed algorithm for the constrained Lp-L1 problem under different noises.

scholarly journals A Globally Convergent Parallel SSLE Algorithm for Inequality Constrained Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-6
Author(s):  
Zhijun Luo ◽  
Lirong Wang
Keyword(s):  
Constrained Optimization ◽  
Optimization Problems ◽  
Linear Equations ◽  
Coefficient Matrix ◽  
Descent Direction ◽  
Constrained Optimization Problems ◽  
Inequality Constrained Optimization ◽  
Globally Convergent ◽  
Variable Distribution ◽  
Systems Of Linear Equations

A new parallel variable distribution algorithm based on interior point SSLE algorithm is proposed for solving inequality constrained optimization problems under the condition that the constraints are block-separable by the technology of sequential system of linear equation. Each iteration of this algorithm only needs to solve three systems of linear equations with the same coefficient matrix to obtain the descent direction. Furthermore, under certain conditions, the global convergence is achieved.

An enhanced surrogate-assisted differential evolution for constrained optimization problems

2021 ◽  
Author(s):  
Rafael de Paula Garcia ◽  
Beatriz Souza Leite Pires de Lima ◽  
Afonso Celso de Castro Lemonge ◽  
Breno Pinheiro Jacob
Keyword(s):  
Differential Evolution ◽  
Optimization Problems ◽  
Optimization Procedure ◽  
Nearest Neighbors ◽  
Engineering Optimization ◽  
Optimal Solutions ◽  
Objective Functions ◽  
Constrained Optimization Problems ◽  
Engineering Problems ◽  
Complex Engineering

Abstract The application of Evolutionary Algorithms (EAs) to complex engineering optimization problems may present difficulties as they require many evaluations of the objective functions by computationally expensive simulation procedures. To deal with this issue, surrogate models have been employed to replace those expensive simulations. In this work, a surrogate-assisted evolutionary optimization procedure is proposed. The procedure combines the Differential Evolution method with a Anchor -nearest neighbors ( –NN) similarity-based surrogate model. In this approach, the database that stores the solutions evaluated by the exact model, which are used to approximate new solutions, is managed according to a merit scheme. Constraints are handled by a rank-based technique that builds multiple separate queues based on the values of the objective function and the violation of each constraint. Also, to avoid premature convergence of the method, a strategy that triggers a random reinitialization of the population is considered. The performance of the proposed method is assessed by numerical experiments using 24 constrained benchmark functions and 5 mechanical engineering problems. The results show that the method achieves optimal solutions with a remarkably reduction in the number of function evaluations compared to the literature.

scholarly journals An Alternative Approach for Nonlinear Optimization Problem with Caputo - Fabrizio Derivative

2018 ◽  
Vol 22 ◽  
pp. 01009 ◽  
Author(s):  
Fırat Evirgen ◽  
Mehmet Yavuz
Keyword(s):  
Mathematical Model ◽  
Optimization Problem ◽  
Optimization Problems ◽  
Variational Iteration Method ◽  
Test Problems ◽  
Optimal Solutions ◽  
Constrained Optimization Problems ◽  
Alternative Approach ◽  
Equality Constrained Optimization ◽  
The Mathematical Model

In this study, a fractional mathematical model with steepest descent direction is proposed to find optimal solutions for a class of nonlinear programming problem. In this sense, Caputo-Fabrizio derivative is adapted to the mathematical model. To demonstrate the solution trajectory of the mathematical model, we use the multistage variational iteration method (MVIM). Numerical simulations and comparisons on some test problems show that the mathematical model generated using Caputo-Fabrizio fractional derivative is both feasible and efficient to find optimal solutions for a certain class of equality constrained optimization problems.

On Some Properties of Semi-rings

2018 ◽  
pp. 35-50
Author(s):  
A. I. Belousov
Keyword(s):  
Linear Equations ◽  
Oriented Graph ◽  
Theoretical Computer Science ◽  
Alternative Methods ◽  
Main Role ◽  
Cost Matrix ◽  
Sequential Elimination ◽  
The Matrix ◽  
Systems Of Linear Equations ◽  
The Cost

The main objective of this paper is to prove a theorem according to which a method of successive elimination of unknowns in the solution of systems of linear equations in the semi-rings with iteration gives the really smallest solution of the system. The proof is based on the graph interpretation of the system and establishes a relationship between the method of sequential elimination of unknowns and the method for calculating a cost matrix of a labeled oriented graph using the method of sequential calculation of cost matrices following the paths of increasing ranks. Along with that, and in terms of preparing for the proof of the main theorem, we consider the following important properties of the closed semi-rings and semi-rings with iteration.We prove the properties of an infinite sum (a supremum of the sequence in natural ordering of an idempotent semi-ring). In particular, the proof of the continuity of the addition operation is much simpler than in the known issues, which is the basis for the well-known algorithm for solving a linear equation in a semi-ring with iteration.Next, we prove a theorem on the closeness of semi-rings with iteration with respect to solutions of the systems of linear equations. We also give a detailed proof of the theorem of the cost matrix of an oriented graph labeled above a semi-ring as an iteration of the matrix of arc labels.The concept of an automaton over a semi-ring is introduced, which, unlike the usual labeled oriented graph, has a distinguished "final" vertex with a zero out-degree.All of the foregoing provides a basis for the proof of the main theorem, in which the concept of an automaton over a semi-ring plays the main role.The article's results are scientifically and methodologically valuable. The proposed proof of the main theorem allows us to relate two alternative methods for calculating the cost matrix of a labeled oriented graph, and the proposed proofs of already known statements can be useful in presenting the elements of the theory of semi-rings that plays an important role in mathematical studies of students majoring in software technologies and theoretical computer science.

scholarly journals On quantitative stability in infinite-dimensional optimization under uncertainty

2021 ◽  
Author(s):  
M. Hoffhues ◽  
W. Römisch ◽  
T. M. Surowiec
Keyword(s):  
Stochastic Optimization ◽  
Constrained Optimization ◽  
Optimization Problems ◽  
Optimization Under Uncertainty ◽  
Optimal Solutions ◽  
Probability Metrics ◽  
Pde Constrained Optimization ◽  
Quantitative Stability ◽  
Infinite Dimensional ◽  
Optimal Value

AbstractThe vast majority of stochastic optimization problems require the approximation of the underlying probability measure, e.g., by sampling or using observations. It is therefore crucial to understand the dependence of the optimal value and optimal solutions on these approximations as the sample size increases or more data becomes available. Due to the weak convergence properties of sequences of probability measures, there is no guarantee that these quantities will exhibit favorable asymptotic properties. We consider a class of infinite-dimensional stochastic optimization problems inspired by recent work on PDE-constrained optimization as well as functional data analysis. For this class of problems, we provide both qualitative and quantitative stability results on the optimal value and optimal solutions. In both cases, we make use of the method of probability metrics. The optimal values are shown to be Lipschitz continuous with respect to a minimal information metric and consequently, under further regularity assumptions, with respect to certain Fortet-Mourier and Wasserstein metrics. We prove that even in the most favorable setting, the solutions are at best Hölder continuous with respect to changes in the underlying measure. The theoretical results are tested in the context of Monte Carlo approximation for a numerical example involving PDE-constrained optimization under uncertainty.

scholarly journals An Augmented Lagrangian Method for Cardinality-Constrained Optimization Problems

2021 ◽  
Author(s):  
Christian Kanzow ◽  
Andreas B. Raharja ◽  
Alexandra Schwartz
Keyword(s):  
Constrained Optimization ◽  
Numerical Experiments ◽  
Penalty Method ◽  
Augmented Lagrangian ◽  
Constraint Qualification ◽  
Optimization Problems ◽  
Augmented Lagrangian Method ◽  
Constrained Optimization Problems ◽  
Strongly Stationary ◽  
Type Constraint

AbstractA reformulation of cardinality-constrained optimization problems into continuous nonlinear optimization problems with an orthogonality-type constraint has gained some popularity during the last few years. Due to the special structure of the constraints, the reformulation violates many standard assumptions and therefore is often solved using specialized algorithms. In contrast to this, we investigate the viability of using a standard safeguarded multiplier penalty method without any problem-tailored modifications to solve the reformulated problem. We prove global convergence towards an (essentially strongly) stationary point under a suitable problem-tailored quasinormality constraint qualification. Numerical experiments illustrating the performance of the method in comparison to regularization-based approaches are provided.

Sign in / Sign up

Export Citation Format

Share Document