Efficient Computation of Probabilistic Dominance in Multi-objective Optimization

2021 ◽  
Vol 1 (4) ◽  
pp. 1-26
Author(s):  
Faramarz Khosravi ◽  
Alexander Rass ◽  
Jürgen Teich

Real-world problems typically require the simultaneous optimization of multiple, often conflicting objectives. Many of these multi-objective optimization problems are characterized by wide ranges of uncertainties in their decision variables or objective functions. To cope with such uncertainties, stochastic and robust optimization techniques are widely studied aiming to distinguish candidate solutions with uncertain objectives specified by confidence intervals, probability distributions, sampled data, or uncertainty sets. In this scope, this article first introduces a novel empirical approach for the comparison of candidate solutions with uncertain objectives that can follow arbitrary distributions. The comparison is performed through accurate and efficient calculations of the probability that one solution dominates the other in terms of each uncertain objective. Second, such an operator can be flexibly used and combined with many existing multi-objective optimization frameworks and techniques by just substituting their standard comparison operator, thus easily enabling the Pareto front optimization of problems with multiple uncertain objectives. Third, a new benchmark for evaluating uncertainty-aware optimization techniques is introduced by incorporating different types of uncertainties into a well-known benchmark for multi-objective optimization problems. Fourth, the new comparison operator and benchmark suite are integrated into an existing multi-objective optimization framework that features a selection of multi-objective optimization problems and algorithms. Fifth, the efficiency in terms of performance and execution time of the proposed comparison operator is evaluated on the introduced uncertainty benchmark. Finally, statistical tests are applied giving evidence of the superiority of the new comparison operator in terms of \epsilon -dominance and attainment surfaces in comparison to previously proposed approaches.

2020 ◽  
Author(s):  
Xiang Yi ◽  
Xiaowei Yang ◽  
Han Huang ◽  
Jiahai Wang

Constrained multi-objective optimization problems exist widely in real-world applications, and they involve a simultaneous optimization of multiple and often conflicting objectives subject to several equality and/or inequality constraints. To deal with these problems, a crucial issue is how to handle constraints effectively. This paper proposes a simple yet effective constrained decomposition-based multi-objective evolutionary algorithm. In the proposal, the evolutionary process is divided into two stages in which constraints are handled differently. In the first stage, constraints are totally ignored and the population is pulled toward the unconstrained Pareto-optimal front (PF) by optimizing objectives only. This can help the proposed algorithm handle well problems with the following features, i.e., the constrained PF has an intersection with the unconstrained counterpart, and there are infeasible regions blocking the way of convergence. In the second stage, with the purpose of approximating the constrained PF well,constraint satisfaction is emphasized over objective minimization.Moreover, different evolutionary frameworks are adopted in the two stages to promote the performance of the algorithm as much as possible. The proposed algorithm is comprehensively compared with several state-of-the-art algorithms on 39 problems (with 266 test instances in total), including one real-world problem (with 36 instances) in search-based software engineering. As shown by the experimental results, the new algorithm performs best on the majority of these problems, particularly on those with the aforementioned features. In summary, the suggested algorithm provides an effective way of handling constrained multi-objective optimization problems.


2020 ◽  
Author(s):  
Xiang Yi ◽  
Xiaowei Yang ◽  
Han Huang ◽  
Jiahai Wang

Constrained multi-objective optimization problems exist widely in real-world applications, and they involve a simultaneous optimization of multiple and often conflicting objectives subject to several equality and/or inequality constraints. To deal with these problems, a crucial issue is how to handle constraints effectively. This paper proposes a simple yet effective constrained decomposition-based multi-objective evolutionary algorithm. In the proposal, the evolutionary process is divided into two stages in which constraints are handled differently. In the first stage, constraints are totally ignored and the population is pulled toward the unconstrained Pareto-optimal front (PF) by optimizing objectives only. This can help the proposed algorithm handle well problems with the following features, i.e., the constrained PF has an intersection with the unconstrained counterpart, and there are infeasible regions blocking the way of convergence. In the second stage, with the purpose of approximating the constrained PF well,constraint satisfaction is emphasized over objective minimization.Moreover, different evolutionary frameworks are adopted in the two stages to promote the performance of the algorithm as much as possible. The proposed algorithm is comprehensively compared with several state-of-the-art algorithms on 39 problems (with 266 test instances in total), including one real-world problem (with 36 instances) in search-based software engineering. As shown by the experimental results, the new algorithm performs best on the majority of these problems, particularly on those with the aforementioned features. In summary, the suggested algorithm provides an effective way of handling constrained multi-objective optimization problems.


2020 ◽  
Author(s):  
Xiang Yi ◽  
Xiaowei Yang ◽  
Han Huang ◽  
Jiahai Wang

Constrained multi-objective optimization problems exist widely in real-world applications, and they involve a simultaneous optimization of multiple and often conflicting objectives subject to several equality and/or inequality constraints. To deal with these problems, a crucial issue is how to handle constraints effectively. This paper proposes a simple yet effective constrained decomposition-based multi-objective evolutionary algorithm. In the proposal, the evolutionary process is divided into two stages in which constraints are handled differently. In the first stage, constraints are totally ignored and the population is pulled toward the unconstrained Pareto-optimal front (PF) by optimizing objectives only. This can help the proposed algorithm handle well problems with the following features, i.e., the constrained PF has an intersection with the unconstrained counterpart, and there are infeasible regions blocking the way of convergence. In the second stage, with the purpose of approximating the constrained PF well,constraint satisfaction is emphasized over objective minimization.Moreover, different evolutionary frameworks are adopted in the two stages to promote the performance of the algorithm as much as possible. The proposed algorithm is comprehensively compared with several state-of-the-art algorithms on 39 problems (with 266 test instances in total), including one real-world problem (with 36 instances) in search-based software engineering. As shown by the experimental results, the new algorithm performs best on the majority of these problems, particularly on those with the aforementioned features. In summary, the suggested algorithm provides an effective way of handling constrained multi-objective optimization problems.


2020 ◽  
Author(s):  
Xiang Yi ◽  
Xiaowei Yang ◽  
Han Huang ◽  
Jiahai Wang

Constrained multi-objective optimization problems exist widely in real-world applications, and they involve a simultaneous optimization of multiple and often conflicting objectives subject to several equality and/or inequality constraints. To deal with these problems, a crucial issue is how to handle constraints effectively. This paper proposes a simple yet effective constrained decomposition-based multi-objective evolutionary algorithm. In the proposal, the evolutionary process is divided into two stages in which constraints are handled differently. In the first stage, constraints are totally ignored and the population is pulled toward the unconstrained Pareto-optimal front (PF) by optimizing objectives only. This can help the proposed algorithm handle well problems with the following features, i.e., the constrained PF has an intersection with the unconstrained counterpart, and there are infeasible regions blocking the way of convergence. In the second stage, with the purpose of approximating the constrained PF well,constraint satisfaction is emphasized over objective minimization.Moreover, different evolutionary frameworks are adopted in the two stages to promote the performance of the algorithm as much as possible. The proposed algorithm is comprehensively compared with several state-of-the-art algorithms on 39 problems (with 266 test instances in total), including one real-world problem (with 36 instances) in search-based software engineering. As shown by the experimental results, the new algorithm performs best on the majority of these problems, particularly on those with the aforementioned features. In summary, the suggested algorithm provides an effective way of handling constrained multi-objective optimization problems.


A test blueprint/test template, also known as the table of specifications, represents the structure of a test. It has been highly recommended in assessment textbook to carry out the preparation of a test with a test blueprint. This chapter focuses on modeling a dynamic test paper template using multi-objective optimization algorithm and makes use of the template in dynamic generation of examination test paper. Multi-objective optimization-based models are realistic models for many complex optimization problems. Modeling a dynamic test paper template, similar to many real-life problems, includes solving multiple conflicting objectives satisfying the template specifications.


Author(s):  
Saad M. Alzahrani ◽  
Naruemon Wattanapongsakorn

Nowadays, most real-world optimization problems consist of many and often conflicting objectives to be optimized simultaneously. Although, many current Multi-Objective optimization algorithms can efficiently solve problems with 3 or less objectives, their performance deteriorates proportionally with the increasing of the objectives number. Furthermore, in many situations the decision maker (DM) is not interested in all trade-off solutions obtained but rather interested in a single optimum solution or a small set of those trade-offs. Therefore, determining an optimum solution or a small set of trade-off solutions is a difficult task. However, an interesting method for finding such solutions is identifying solutions in the Knee region. Solutions in the Knee region can be considered the best obtained solution in the obtained trade-off set especially if there is no preference or equally important objectives. In this paper, a pruning strategy was used to find solutions in the Knee region of Pareto optimal fronts for some benchmark problems obtained by NSGA-II, MOEA/D-DE and a promising new Multi-Objective optimization algorithm NSGA-III. Lastly, those knee solutions found were compared and evaluated using a generational distance performance metric, computation time and a statistical one-way ANOVA test.


Author(s):  
Nitin Uniyal ◽  
Sangeeta Pant ◽  
Anuj Kumar

Optimization has been a hot topic due to its inevitably in the development of new algorithms in almost every applied branch of Mathematics. Despite the broadness of optimization techniques in research fields, there is always an open scope of further refinement. We present here an overview of nature-inspired optimization with a subtle background of fundamentals and classification and their reliability applications. An attempt has been made to exhibit the contrast nature of multi objective optimization as compared to single objective optimization. Though there are various techniques to achieve the optimality in optimization problems but nature inspired algorithms have proved to be very efficient and gained special attention in modern research problems. The purpose of this article is to furnish the foundation of few nature inspired optimization techniques and their reliability applications to an interested researcher.


2020 ◽  
Vol 13 (1) ◽  
Author(s):  
Shailesh S. Kadre ◽  
Vipin K. Tripathi

Multi-objective optimization problems (MOOP) involve minimization of more than one objective functions and all of them are to be simultaneously minimized. The solution of these problems involves a large number of iterations. The multi- objective optimization problems related structural optimization of complex engineering structures is usually solved with finite element analysis (FEA). The solution time required to solve these FEA based solutions are very high. So surrogate models or meta- models are used to approximate the finite element solution during the optimization process. These surrogate assisted multi- objective optimization techniques are very commonly used in the current literature. These optimization techniques use evolutionary algorithm and it is very difficult to guarantee the convergence of the final solution, especially in the cases where the budget of costly function evaluations is low. In such cases, it is required to increase the efficiency of surrogate models in terms of accuracy and total efforts required to find the final solutions.In this paper, an advanced surrogate assisted multi- objective optimization algorithm (ASMO) is developed. This algorithm can handle linear, equality and non- linear constraints and can be applied to both benchmark and engineering application problems. This algorithm does not require any prior knowledge for the selection of surrogate models. During the optimization process, best single and mixture surrogate models are automatically selected. The advanced surrogate models are created by MATSuMoTo, the MATLAB based tool box. These mixture models are built by Dempster- Shafer theory (DST). This theory has a capacity to handle multiple model characteristics for the selection of best models. By adopting this strategy, it is ensured that most accurate surrogate models are selected. There can be different kind of surrogate models for objective and constraint functions. Multi-objective optimization of machine tool spindle is studied as the test problem for this algorithm and it is observed that the proposed strategy is able to find the non- dominated solutions with minimum number of costly function evaluations. The developed method can be applied to other benchmark and engineering applications.


2011 ◽  
Vol 211-212 ◽  
pp. 818-822 ◽  
Author(s):  
Bing Kun Zhu ◽  
Li Hong Xu ◽  
Hai Gen Hu

Multi-objective optimization is a challenging research topic because it involves the simultaneous optimization of several complex and conflicting objectives. However multi-objectivity is only one aspect of real-world applications and there is a growing interest in the optimization of solutions that are insensitive to parametric variations as well. A new robust preference multi-objective optimization algorithm is proposed in this paper, and the robust measurement of solution is designed based on Latin Hypercube Sampling, which is embedded in the optimization process to guide the optimization direction and help the better robust solution have more chance to survive. In order to obtain different preference of the robust solutions, a new fitness scheme is also presented. Through the adjustment of fitness function parameter preference, robust solutions can be obtained. Results suggest that the proposed algorithm has a bias towards the region where the preference robust solutions lie.


Author(s):  
Pei Cao ◽  
Zhaoyan Fan ◽  
Robert Gao ◽  
Jiong Tang

Multi-objective optimization problems are frequently encountered in engineering analyses. Optimization techniques in practical applications are devised and evaluated mostly for specific problems, and thus may not be generally applicable when applications vary. In this study we formulate a probability matching based hyper-heuristic scheme, then propose four low-level heuristics which can work coherently with the single point search algorithm MOSA/R (Multi-Objective Simulated Annealing Algorithm based on Re-pick) towards multi-objective optimization problems of various properties, namely DTLZ and UF test instances. Making use of the domination amount, crowding distance and hypervolume calculations, the hyper-heuristic scheme could meet different optimization requirements. The approach developed (MOSA/R-HH) exhibits better and more robust performance compared to AMOSA, NSGA-II and MOEA/D as illustrated in the numerical tests. The outcome of this research may potentially benefit various design and manufacturing practices.


Sign in / Sign up

Export Citation Format

Share Document