Afterword

2010 ◽  
pp. 269-272
Author(s):  
E. Parsopoulos Konstantinos ◽  
N. Vrahatis Michael
Keyword(s):  
Optimization Problems ◽  
Optimization Methods ◽  
Special Structure ◽  
Integer Optimization ◽  
Hybrid Schemes ◽  
Research Results ◽  
Global Minimizers ◽  
Classical Optimization

In the previous chapters, we presented the fundamental concepts and variants of PSO, as along with a multitude of recent research results. The reported results suggest that PSO can be a very useful tool for solving optimization problems from different scientific and technological fields, especially in cases where classical optimization methods perform poorly or their application involves formidable technical difficulties due to the problem’s special structure or nature. PSO was capable of addressing continuous and integer optimization problems, handling noisy and multiobjective cases, and producing efficient hybrid schemes in combination with specialized techniques or other algorithms in order to detect multiple (local or global) minimizers or control its own parameters.

scholarly journals Partially distributed outer approximation

2021 ◽  
Author(s):  
Alexander Murray ◽  
Timm Faulwasser ◽  
Veit Hagenmeyer ◽  
Mario E. Villanueva ◽  
Boris Houska
Keyword(s):  
Large Scale ◽  
Optimization Problems ◽  
Outer Approximation ◽  
Mixed Integer ◽  
Global Optimality ◽  
Integer Optimization ◽  
Global Minimizers ◽  
Outer Approximation Method ◽  
Coupling Constraints ◽  
Outer Approximation Algorithm

AbstractThis paper presents a novel partially distributed outer approximation algorithm, named PaDOA, for solving a class of structured mixed integer convex programming problems to global optimality. The proposed scheme uses an iterative outer approximation method for coupled mixed integer optimization problems with separable convex objective functions, affine coupling constraints, and compact domain. PaDOA proceeds by alternating between solving large-scale structured mixed-integer linear programming problems and partially decoupled mixed-integer nonlinear programming subproblems that comprise much fewer integer variables. We establish conditions under which PaDOA converges to global minimizers after a finite number of iterations and verify these properties with an application to thermostatically controlled loads and to mixed-integer regression.

scholarly journals Research and Study of the Hybrid Algorithms Based on the Collective Behavior of Fish Schools and Classical Optimization Methods

Algorithms ◽  
2020 ◽  
Vol 13 (4) ◽  
pp. 85 ◽  
Author(s):  
Liliya A. Demidova ◽  
Artyom V. Gorchakov
Keyword(s):  
Collective Behavior ◽  
Hybrid Algorithm ◽  
Gradient Descent ◽  
Optimization Problems ◽  
Computation Time ◽  
Optimization Methods ◽  
Hybrid Algorithms ◽  
Fish Schools ◽  
Fish School ◽  
Classical Optimization

Inspired by biological systems, swarm intelligence algorithms are widely used to solve multimodal optimization problems. In this study, we consider the hybridization problem of an algorithm based on the collective behavior of fish schools. The algorithm is computationally inexpensive compared to other population-based algorithms. Accuracy of fish school search increases with the increase of predefined iteration count, but this also affects computation time required to find a suboptimal solution. We propose two hybrid approaches, intending to improve the evolutionary-inspired algorithm accuracy by using classical optimization methods, such as gradient descent and Newton’s optimization method. The study shows the effectiveness of the proposed hybrid algorithms, and the strong advantage of the hybrid algorithm based on fish school search and gradient descent. We provide a solution for the linearly inseparable exclusive disjunction problem using the developed algorithm and a perceptron with one hidden layer. To demonstrate the effectiveness of the algorithms, we visualize high dimensional loss surfaces near global extreme points. In addition, we apply the distributed version of the most effective hybrid algorithm to the hyperparameter optimization problem of a neural network.

Performance-Enhancing Techniques

2010 ◽  
pp. 133-148
Author(s):  
E. Parsopoulos Konstantinos ◽  
N. Vrahatis Michael
Keyword(s):  
Integer Programming ◽  
Objective Function ◽  
Penalty Function ◽  
Optimization Problems ◽  
Function Approach ◽  
Integer Optimization ◽  
Local Minimizers ◽  
Global Minimizers ◽  
Integer Programming Problems ◽  
Penalty Function Approach

This chapter presents techniques that have proved to be very useful in enhancing the performance of PSO in various optimization problem types. They consist of transformations of either the objective function or the problem variables, enabling PSO to alleviate local minimizers, detect multiple minimizers, handle constraints, and solve integer optimization problems. The chapter begins with a short discussion on the filled functions approach, and then presents the stretching technique as an alternative for alleviating local minimizers. Next, we present the deflection and repulsion techniques, as a means for detecting multiple global minimizers with PSO, followed by a penalty function approach for constraint handling. The chapter closes with the description of two rounding schemes that enable the continuous, real-valued PSO to solve integer programming problems. All techniques are thoroughly described and graphically illustrated whenever possible.

Software suite for determining the tilts of tower-type structures according to terrestrial laser scanning

2020 ◽  
Vol 961 (7) ◽  
pp. 2-7
Author(s):  
A.V. Zubov ◽  
N.N. Eliseeva
Keyword(s):  
Laser Scanning ◽  
Optimization Problems ◽  
Optimization Methods ◽  
User Participation ◽  
Software Suite ◽  
Current State ◽  
Visual Basic For Applications ◽  
Operational Data ◽  
Theoretical Developments

The authors describe a software suite for determining tilt degrees of tower-type structures according to ground laser scanning indication. Defining the tilt of the pipe is carried out with a set of measured data through approximating the sections by circumferences. They are constructed using one of the simplest search engine optimization methods (evolutionary algorithm). Automatic filtering the scan of the current section from distorting data is performed by the method of assessing the quality of models constructed with that of least squares. The software was designed using Visual Basic for Applications. It contains several blocks (subprograms), with each of them performing a specific task. The developed complex enables obtaining operational data on the current state of the object with minimal user participation in the calculation process. The software suite is the result of practical implementing theoretical developments on the possibilities of using search methods at solving optimization problems in geodetic practice.

scholarly journals An Analysis of a KNN Perturbation Operator: An Application to the Binarization of Continuous Metaheuristics

Mathematics ◽  
2021 ◽  
Vol 9 (3) ◽  
pp. 225
Author(s):  
José García ◽  
Gino Astorga ◽  
Víctor Yepes
Keyword(s):  
Transfer Functions ◽  
Optimization Problems ◽  
Optimization Methods ◽  
Set Covering ◽  
Covering Problem ◽  
Perturbation Operator ◽  
K Nearest Neighbors ◽  
Combinatorial Optimization Problems ◽  
Box Plots ◽  
Metaheuristic Techniques

The optimization methods and, in particular, metaheuristics must be constantly improved to reduce execution times, improve the results, and thus be able to address broader instances. In particular, addressing combinatorial optimization problems is critical in the areas of operational research and engineering. In this work, a perturbation operator is proposed which uses the k-nearest neighbors technique, and this is studied with the aim of improving the diversification and intensification properties of metaheuristic algorithms in their binary version. Random operators are designed to study the contribution of the perturbation operator. To verify the proposal, large instances of the well-known set covering problem are studied. Box plots, convergence charts, and the Wilcoxon statistical test are used to determine the operator contribution. Furthermore, a comparison is made using metaheuristic techniques that use general binarization mechanisms such as transfer functions or db-scan as binarization methods. The results obtained indicate that the KNN perturbation operator improves significantly the results.

scholarly journals Assessing the Performance of Interactive Multiobjective Optimization Methods

2021 ◽  
Vol 54 (4) ◽  
pp. 1-27
Author(s):  
Bekir Afsar ◽  
Kaisa Miettinen ◽  
Francisco Ruiz
Keyword(s):  
Multiobjective Optimization ◽  
Decision Maker ◽  
Optimization Problems ◽  
Optimization Methods ◽  
Interactive Methods ◽  
Value Functions ◽  
Technical Aspects ◽  
Preference Information ◽  
Multiobjective Optimization Problems ◽  
Human Decision

Interactive methods are useful decision-making tools for multiobjective optimization problems, because they allow a decision-maker to provide her/his preference information iteratively in a comfortable way at the same time as (s)he learns about all different aspects of the problem. A wide variety of interactive methods is nowadays available, and they differ from each other in both technical aspects and type of preference information employed. Therefore, assessing the performance of interactive methods can help users to choose the most appropriate one for a given problem. This is a challenging task, which has been tackled from different perspectives in the published literature. We present a bibliographic survey of papers where interactive multiobjective optimization methods have been assessed (either individually or compared to other methods). Besides other features, we collect information about the type of decision-maker involved (utility or value functions, artificial or human decision-maker), the type of preference information provided, and aspects of interactive methods that were somehow measured. Based on the survey and on our own experiences, we identify a series of desirable properties of interactive methods that we believe should be assessed.

Optimization Design of Trusses Based on Covariance Matrix Adaptation Evolution Strategy Algorithm

2012 ◽  
Vol 215-216 ◽  
pp. 133-137
Author(s):  
Guo Shao Su ◽  
Yan Zhang ◽  
Zhen Xing Wu ◽  
Liu Bin Yan
Keyword(s):  
Stochastic Optimization ◽  
Covariance Matrix ◽  
Optimization Problems ◽  
Fitness Function ◽  
Optimization Methods ◽  
Evolution Strategy ◽  
Covariance Matrix Adaptation ◽  
Study Results ◽  
Highly Nonlinear ◽  
Adaptation Evolution

Covariance matrix adaptation evolution strategy algorithm (CMA-ES) is a newly evolution algorithm. It has become a powerful tool for solving highly nonlinear multi-peak optimization problems. In many real-world optimization problems, the location of multiple optima is often required in a search space. In order to evaluate the solution, thousands of fitness function evaluations are involved that is a time consuming or expensive processes. Therefore, conventional stochastic optimization methods meet a special challenge for a very large number of problem function evaluations. Aiming to overcome the shortcoming of stochastic optimization methods in the high calculation cost, a truss optimal method based on CMA-ES algorithm is proposed and applied to solve the section and shape optimization problems of trusses. The study results show that the method is feasible and has the advantages of high accuracy, high efficiency and easy implementation.

Nondegenerate Piecewise Linear Systems: A Finite Newton Algorithm and Applications in Machine Learning

2012 ◽  
Vol 24 (4) ◽  
pp. 1047-1084 ◽  
Author(s):  
Xiao-Tong Yuan ◽  
Shuicheng Yan
Keyword(s):  
Linear Systems ◽  
Optimization Problems ◽  
Piecewise Linear ◽  
Optimization Methods ◽  
Coefficient Matrix ◽  
Learning Problems ◽  
Support Vector ◽  
Data Sets ◽  
Piecewise Linear Systems ◽  
Vector Machines

We investigate Newton-type optimization methods for solving piecewise linear systems (PLSs) with nondegenerate coefficient matrix. Such systems arise, for example, from the numerical solution of linear complementarity problem, which is useful to model several learning and optimization problems. In this letter, we propose an effective damped Newton method, PLS-DN, to find the exact (up to machine precision) solution of nondegenerate PLSs. PLS-DN exhibits provable semiiterative property, that is, the algorithm converges globally to the exact solution in a finite number of iterations. The rate of convergence is shown to be at least linear before termination. We emphasize the applications of our method in modeling, from a novel perspective of PLSs, some statistical learning problems such as box-constrained least squares, elitist Lasso (Kowalski & Torreesani, 2008 ), and support vector machines (Cortes & Vapnik, 1995 ). Numerical results on synthetic and benchmark data sets are presented to demonstrate the effectiveness and efficiency of PLS-DN on these problems.

Solving Mono- and Multi-Objective Problems Using Hybrid Evolutionary Algorithms and Nelder-Mead Method

2021 ◽  
Vol 12 (4) ◽  
pp. 98-116
Author(s):  
Noureddine Boukhari ◽  
Fatima Debbat ◽  
Nicolas Monmarché ◽  
Mohamed Slimane
Keyword(s):  
Convergence Rate ◽  
Optimization Problem ◽  
Optimization Problems ◽  
State Of The Art ◽  
Hybrid Approach ◽  
Optimization Methods ◽  
Global Optimum ◽  
Stochastic Methods ◽  
Local Optima ◽  
Portfolio Optimization Problem

Evolution strategies (ES) are a family of strong stochastic methods for global optimization and have proved their capability in avoiding local optima more than other optimization methods. Many researchers have investigated different versions of the original evolution strategy with good results in a variety of optimization problems. However, the convergence rate of the algorithm to the global optimum stays asymptotic. In order to accelerate the convergence rate, a hybrid approach is proposed using the nonlinear simplex method (Nelder-Mead) and an adaptive scheme to control the local search application, and the authors demonstrate that such combination yields significantly better convergence. The new proposed method has been tested on 15 complex benchmark functions and applied to the bi-objective portfolio optimization problem and compared with other state-of-the-art techniques. Experimental results show that the performance is improved by this hybridization in terms of solution eminence and strong convergence.

scholarly journals Recent Design Optimization Methods for Energy-Efficient Electric Motors and Derived Requirements for a New Improved Method—Part 1

Proceedings ◽  
2018 ◽  
Vol 2 (22) ◽  
pp. 1400
Author(s):  
Johannes Schmelcher ◽  
Max Kleine Büning ◽  
Kai Kreisköther ◽  
Dieter Gerling ◽  
Achim Kampker
Keyword(s):  
Rare Earth ◽  
Design Optimization ◽  
Energy Efficient ◽  
Degrees Of Freedom ◽  
High Efficiency ◽  
Optimization Problems ◽  
Computing Time ◽  
Optimization Methods ◽  
Electric Motors ◽  
Electric Cars

Energy-efficient electric motors are gathering an increased attention since they are used in electric cars or to reduce operational costs, for instance. Due to their high efficiency, permanent-magnet synchronous motors are used progressively more. However, the need to use rare-earth magnets for such high-efficiency motors is problematic not only in regard to the cost but also in socio-political and environmental aspects. Therefore, an increasing effort has to be put in finding the best design possible. The goals to achieve are, among others, to reduce the amount of rare-earth magnet material but also to increase the efficiency. In the first part of this multipart paper, characteristics of optimization problems in engineering and general methods to solve them are presented. In part two, different approaches to the design optimization problem of electric motors are highlighted. The last part will evaluate the different categories of optimization methods with respect to the criteria: degrees of freedom, computing time and the required user experience. As will be seen, there is a conflict of objectives regarding the criteria mentioned above. Requirements, which a new optimization method has to fulfil in order to solve the conflict of objectives will be presented in this last paper.

Sign in / Sign up

Export Citation Format

Share Document