scholarly journals Comparison of parallel infill sampling criteria based on Kriging surrogate model

2022 ◽  
Vol 12 (1) ◽  
Author(s):  
Cong Chen ◽  
Jiaxin Liu ◽  
Pingfei Xu
Keyword(s):  
Optimization Problems ◽  
Expected Improvement ◽  
Efficient Global Optimization ◽  
Test Problems ◽  
Local Optimum ◽  
Concentration Problem ◽  
Key Issues ◽  
The Common ◽  
Optimization Efficiency ◽  
Infill Sampling

AbstractOne of the key issues that affect the optimization effect of the efficient global optimization (EGO) algorithm is to determine the infill sampling criterion. Therefore, this paper compares the common efficient parallel infill sampling criterion. In addition, the pseudo-expected improvement (EI) criterion is introduced to minimizing the predicted (MP) criterion and the probability of improvement (PI) criterion, which helps to improve the problem of MP criterion that is easy to fall into local optimum. An adaptive distance function is proposed, which is used to avoid the concentration problem of update points and also improves the global search ability of the infill sampling criterion. Seven test problems were used to evaluate these criteria to verify the effectiveness of these methods. The results show that the pseudo method is also applicable to PI and MP criteria. The DMP and PEI criteria are the most efficient and robust. The actual engineering optimization problems can more directly show the effects of these methods. So these criteria are applied to the inverse design of RAE2822 airfoil. The results show the criterion including the MP has higher optimization efficiency.

scholarly journals Tabu efficient global optimization with applications in additive manufacturing

2021 ◽  
Author(s):  
Long Wang ◽  
Theodore T. Allen ◽  
Michael A. Groeber
Keyword(s):  
Global Optimization ◽  
Additive Manufacturing ◽  
Optimization Problems ◽  
Direct Methods ◽  
Expected Improvement ◽  
Efficient Global Optimization ◽  
Test Problems ◽  
Gaussian Stochastic Process ◽  
Constrained Problems ◽  
Computational Performance

AbstractMethods based on Gaussian stochastic process (GSP) models and expected improvement (EI) functions have been promising for box-constrained expensive optimization problems. These include robust design problems with environmental variables having set-type constraints. However, the methods that combine GSP and EI sub-optimizations suffer from the following problem, which limits their computational performance. Efficient global optimization (EGO) methods often repeat the same or nearly the same experimental points. We present a novel EGO-type constraint-handling method that maintains a so-called tabu list to avoid past points. Our method includes two types of penalties for the key “infill” optimization, which selects the next test runs. We benchmark our tabu EGO algorithm with five alternative approaches, including DIRECT methods using nine test problems and two engineering examples. The engineering examples are based on additive manufacturing process parameter optimization informed using point-based thermal simulations and robust-type quality constraints. Our test problems span unconstrained, simply constrained, and robust constrained problems. The comparative results imply that tabu EGO offers very promising computational performance for all types of black-box optimization in terms of convergence speed and the quality of the final solution.

scholarly journals A Comparative Study of Infill Sampling Criteria for Computationally Expensive Constrained Optimization Problems

Symmetry ◽  
2020 ◽  
Vol 12 (10) ◽  
pp. 1631
Author(s):  
Kittisak Chaiyotha ◽  
Tipaluck Krityakierne
Keyword(s):  
Constrained Optimization ◽  
Process Model ◽  
Structural Engineering ◽  
Optimization Problems ◽  
Bayesian Optimization ◽  
Expected Improvement ◽  
Constrained Optimization Problems ◽  
Computationally Expensive ◽  
Physical Phenomena ◽  
Infill Sampling

Engineering optimization problems often involve computationally expensive black-box simulations of underlying physical phenomena. This paper compares the performance of four constrained optimization algorithms relying on a Gaussian process model and an infill sampling criterion under the framework of Bayesian optimization. The four infill sampling criteria include expected feasible improvement (EFI), constrained expected improvement (CEI), stepwise uncertainty reduction (SUR), and augmented Lagrangian (AL). Numerical tests were rigorously performed on a benchmark set consisting of nine constrained optimization problems with features commonly found in engineering, as well as a constrained structural engineering design optimization problem. Based upon several measures including statistical analysis, our results suggest that, overall, the EFI and CEI algorithms are significantly more efficient and robust than the other two methods, in the sense of providing the most improvement within a very limited number of objective and constraint function evaluations, and also in the number of trials for which a feasible solution could be located.

AN IMPROVED POPULATION BASED OPTIMIZATION SOLUTION METHOD BY COMBINING LOCAL AND GLOBAL SEARCHING

2007 ◽  
Vol 16 (05) ◽  
pp. 907-915
Author(s):  
WEI JIANG ◽  
XIAO-LONG WANG ◽  
XIU-LI PANG
Keyword(s):  
Local Search ◽  
Objective Function ◽  
Optimization Problems ◽  
Population Based ◽  
Search Algorithms ◽  
Global Search ◽  
Local Optimum ◽  
Hard Problems ◽  
The Common ◽  
Optimum Solution

Optimization Solution Task is a typical and important task in many applications. Many optimization problems have been proved to be NP-hard problems, which cannot be solved by some predefined mathematic formulae. In this case, computer aided method is very helpful. While some local search algorithms are easily to fall into a local optimum solution. On contrast, the population based methods, such as Genetic Algorithms, Artificial Immune System, Autonomy Oriented Computing, are global search algorithms. However, they are not good at the local search. In this paper, an improved method is proposed by combining the local and global search ability, so as to improve the performance in terms of the convergence speed and the convergence reliability. We construct a generic form to deal with the common objective function space or the objective function with the partial derivative. In addition, we present an n-hold method in population based evolution method. The experiments indicate that our approach can effectively improve the convergence reliability, which is much concerned in some applications with the expensive executing expense.

Trust Region Based Mode Pursuing Sampling Method for Global Optimization of High Dimensional Design Problems

2015 ◽  
Vol 137 (2) ◽  
Author(s):  
George H. Cheng ◽  
Adel Younis ◽  
Kambiz Haji Hajikolaei ◽  
G. Gary Wang
Keyword(s):  
Global Optimization ◽  
Optimization Problems ◽  
Trust Region ◽  
Standard Test ◽  
Black Box ◽  
High Dimensional ◽  
Efficient Global Optimization ◽  
Test Problems ◽  
Design Problems ◽  
Design Variables

Mode pursuing sampling (MPS) was developed as a global optimization algorithm for design optimization problems involving expensive black box functions. MPS has been found to be effective and efficient for design problems of low dimensionality, i.e., the number of design variables is less than 10. This work integrates the concept of trust regions into the MPS framework to create a new algorithm, trust region based mode pursuing sampling (TRMPS2), with the aim of dramatically improving performance and efficiency for high dimensional problems. TRMPS2 is benchmarked against genetic algorithm (GA), dividing rectangles (DIRECT), efficient global optimization (EGO), and MPS using a suite of standard test problems and an engineering design problem. The results show that TRMPS2 performs better on average than GA, DIRECT, EGO, and MPS for high dimensional, expensive, and black box (HEB) problems.

An exploitation-enhanced multi-objective efficient global optimization algorithm for expensive aerodynamic shape optimizations

2021 ◽  
pp. 095441002110324
Author(s):  
Feng Deng ◽  
Ning Qin
Keyword(s):  
Global Optimization ◽  
Shape Optimization ◽  
Optimization Algorithm ◽  
Optimization Problems ◽  
Efficient Global Optimization ◽  
Test Problems ◽  
Aerodynamic Shape Optimization ◽  
Aerodynamic Shape ◽  
Multi Objective ◽  
Complex Landscape

The traditional multi-objective efficient global optimization (EGO) algorithms have been hybridized and adapted to solving the expensive aerodynamic shape optimization problems based on high-fidelity numerical simulations. Although the traditional EGO algorithms are highly efficient in solving some of the optimization problems with very complex landscape, it is not preferred to solve most of the aerodynamic shape optimization problems with relatively low-degree multi-modal design spaces. A new infill criterion encouraging more local exploitation has been proposed by hybridizing two traditional multi-objective expected improvements (EIs), namely, statistical multi-objective EI and expected hypervolume improvement, in order to improve their robustness and efficiency in aerodynamic shape optimization. Different analytical test problems and aerodynamic shape optimization problems have been investigated. In comparison with traditional multi-objective EI algorithms and a standard evolutionary multi-objective optimization algorithm, the proposed method is shown to be more robust and efficient in the tests due to its hybrid characteristics, easier handling of sub-optimization problems, and enhanced exploitation capability.

A heuristic algorithm solving bilevel toll optimization problems

2016 ◽  
Vol 27 (1) ◽  
pp. 31-51 ◽  
Author(s):  
Vyacheslav V. Kalashnikov ◽  
Roberto Carlos Herrera Maldonado ◽  
José-Fernando Camacho-Vallejo ◽  
Nataliya I. Kalashnykova
Keyword(s):  
Heuristic Algorithm ◽  
Numerical Experiments ◽  
Optimization Problems ◽  
Test Problems ◽  
Local Optimum ◽  
Toll Roads ◽  
Filled Function ◽  
Private Company ◽  
Content Type ◽  
Upper Level

Purpose – One of the most important problems concerning the toll roads is the setting of an appropriate cost for traveling through private arcs of a transportation network. The purpose of this paper is to consider this problem by stating it as a bilevel programming (BLP) model. At the upper level, one has a public regulator or a private company that manages the toll roads seeking to increase its profits. At the lower level, several companies-users try to satisfy the existing demand for transportation of goods and/or passengers, and simultaneously, to select the routes so as to minimize their travel costs. In other words, what is sought is kind of a balance of costs that bring the highest profit to the regulating company (the upper level) and are still attractive enough to the users (the lower level). Design/methodology/approach – With the aim of providing a solution to the BLP problem in question, a direct algorithm based on sensitivity analysis (SA) is proposed. In order to make it easier to move (if necessary) from a local maximum of the upper level objective function to another, the well-known “filled function (FF)” method is used. Findings – The paper proposes and tests two versions of the heuristic algorithm to solve the toll optimization problem (TOP) based upon SA for linear programming (LP) problems. The algorithm makes use of an SA procedure for the LP problem at the lower level, as well as of the “filled” function technicalities in order to reach the global optimum when “jammed” at some local optimum. Numerical experiments with a series of small and medium dimension test problems show the proposed algorithm’s robustness and decent convergence characteristics. Practical implications – Numerical experiments with a series of small- and medium dimension test problems show the proposed algorithm’s robustness and reasonable convergence characteristics. In particular, while ceding in efficiency to other algorithms when solving small problems, the proposed method wins in the case of medium (higher dimensional) test models. Because of that, one can expect a serious real-life impact on the TOP when the proposed methods and/or their improved versions are developed further to be applicable in practice in the near future. Originality/value – The proposed algorithms are original and perform well when solving small and medium test numerical problems. The proposed heuristics aim at filling in a gap in a series of numerical approaches to the solution of TOP problem listed in the Introduction. To the authors knowledge, no systematic attempts to apply the SA tools to the toll assigned problem have been recently made. Moreover, the combination of these powerful tools with the “FFs” techniques brings forward some new global optimization ideas. Exactly these features build up the knowledge this specific paper offers in relation to previous relevant works.

scholarly journals Elite Exploitation: A Combination of Mathematical Concept and EMO Approach for Multi-Objective Decision Making

Symmetry ◽  
2021 ◽  
Vol 13 (1) ◽  
pp. 136
Author(s):  
Wenxiao Li ◽  
Yushui Geng ◽  
Jing Zhao ◽  
Kang Zhang ◽  
Jianxin Liu
Keyword(s):  
Decision Making ◽  
Optimization Problems ◽  
Hybrid Genetic Algorithm ◽  
Decision Makers ◽  
Superior Performance ◽  
Test Problems ◽  
Mathematical Function ◽  
Hyperbolic Tangent ◽  
Nsga Ii ◽  
Multi Objective

This paper explores the combination of a classic mathematical function named “hyperbolic tangent” with a metaheuristic algorithm, and proposes a novel hybrid genetic algorithm called NSGA-II-BnF for multi-objective decision making. Recently, many metaheuristic evolutionary algorithms have been proposed for tackling multi-objective optimization problems (MOPs). These algorithms demonstrate excellent capabilities and offer available solutions to decision makers. However, their convergence performance may be challenged by some MOPs with elaborate Pareto fronts such as CFs, WFGs, and UFs, primarily due to the neglect of diversity. We solve this problem by proposing an algorithm with elite exploitation strategy, which contains two parts: first, we design a biased elite allocation strategy, which allocates computation resources appropriately to elites of the population by crowding distance-based roulette. Second, we propose a self-guided fast individual exploitation approach, which guides elites to generate neighbors by a symmetry exploitation operator, which is based on mathematical hyperbolic tangent function. Furthermore, we designed a mechanism to emphasize the algorithm’s applicability, which allows decision makers to adjust the exploitation intensity with their preferences. We compare our proposed NSGA-II-BnF with four other improved versions of NSGA-II (NSGA-IIconflict, rNSGA-II, RPDNSGA-II, and NSGA-II-SDR) and four competitive and widely-used algorithms (MOEA/D-DE, dMOPSO, SPEA-II, and SMPSO) on 36 test problems (DTLZ1–DTLZ7, WGF1–WFG9, UF1–UF10, and CF1–CF10), and measured using two widely used indicators—inverted generational distance (IGD) and hypervolume (HV). Experiment results demonstrate that NSGA-II-BnF exhibits superior performance to most of the algorithms on all test problems.

Improved Particle Swarm Optimization Algorithm and its Application Based on the Aggregation Degree

2013 ◽  
Vol 427-429 ◽  
pp. 1934-1938
Author(s):  
Zhong Rong Zhang ◽  
Jin Peng Liu ◽  
Ke De Fei ◽  
Zhao Shan Niu
Keyword(s):  
Particle Swarm Optimization ◽  
Optimization Algorithm ◽  
Particle Swarm Optimization Algorithm ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Population Diversity ◽  
Function Optimization ◽  
Local Optimum ◽  
Swarm Optimization ◽  
Improved Particle Swarm Optimization

The aim is to improve the convergence of the algorithm, and increase the population diversity. Adaptively particles of groups fallen into local optimum is adjusted in order to realize global optimal. by judging groups spatial location of concentration and fitness variance. At the same time, the global factors are adjusted dynamically with the action of the current particle fitness. Four typical function optimization problems are drawn into simulation experiment. The results show that the improved particle swarm optimization algorithm is convergent, robust and accurate.

Sign in / Sign up

Export Citation Format

Share Document