Localization for Solving Noisy Multi-Objective Optimization Problems

2009 ◽  
Vol 17 (3) ◽  
pp. 379-409 ◽  
Author(s):  
Lam T. Bui ◽  
Hussein A. Abbass ◽  
Daryl Essam
Keyword(s):  
Evolutionary Algorithm ◽  
Optimization Problems ◽  
Search Space ◽  
Local Models ◽  
Multi Objective Optimization ◽  
Global Models ◽  
Average Performance ◽  
Multi Objective ◽  
Wide Range ◽  
Filter Noise

This paper investigates the use of a framework of local models in the context of noisy evolutionary multi-objective optimization. Within this framework, the search space is explicitly divided into several nonoverlapping hyperspheres. A direction of improvement, which is related to the average performance of the spheres, is used for moving solutions within each sphere. This helps the local models to filter noise and increase the robustness of the evolutionary algorithm in the presence of noise. A wide range of noisy problems we used for testing and the experimental results demonstrate the ability of local models to better filter noise in comparison with that of global models.

scholarly journals A Distributed Multifactorial Particle Swarm Optimization Approach

2021 ◽  
Author(s):  
Ahlem Aboud ◽  
Nizar Rokbani ◽  
Seyedali Mirjalili ◽  
Abdulrahman M. Qahtani ◽  
Omar Almutiry ◽  
...  
Keyword(s):  
Particle Swarm Optimization ◽  
Optimization Problems ◽  
Beta Function ◽  
Particle Swarm ◽  
Search Space ◽  
Optimization Approach ◽  
Multi Objective Optimization ◽  
Swarm Optimization ◽  
Multi Objective ◽  
New System

<p>Multifactorial Optimization (MFO) and Evolutionary Transfer Optimization (ETO) are new optimization challenging paradigms for which the multi-Objective Particle Swarm Optimization system (MOPSO) may be interesting despite limitations. MOPSO has been widely used in static/dynamic multi-objective optimization problems, while its potentials for multi-task optimization are not completely unveiled. This paper proposes a new Distributed Multifactorial Particle Swarm Optimization algorithm (DMFPSO) for multi-task optimization. This new system has a distributed architecture on a set of sub-swarms that are dynamically constructed based on the number of optimization tasks affected by each particle skill factor. DMFPSO is designed to deal with the issues of handling convergence and diversity concepts separately. DMFPSO uses Beta function to provide two optimized profiles with a dynamic switching behaviour. The first profile, Beta-1, is used for the exploration which aims to explore the search space toward potential solutions, while the second Beta-2 function is used for convergence enhancement. This new system is tested on 36 benchmarks provided by the CEC’2021 Evolutionary Transfer Multi-Objective Optimization Competition. Comparatives with the state-of-the-art methods are done using the Inverted General Distance (IGD) and Mean Inverted General Distance (MIGD) metrics. Based on the MSS metric, this proposal has the best results on most tested problems.</p>

A multi-objective evolutionary algorithm based on niche selection in solving irregular Pareto fronts

2021 ◽  
pp. 1-21
Author(s):  
Xin Li ◽  
Xiaoli Li ◽  
Kang Wang
Keyword(s):  
Evolutionary Algorithm ◽  
Optimization Problems ◽  
Optimal Solution ◽  
Benchmark Problems ◽  
Multi Objective Optimization ◽  
Multi Objective ◽  
Environmental Selection ◽  
Optimal Solution Set ◽  
Pareto Fronts

The key characteristic of multi-objective evolutionary algorithm is that it can find a good approximate multi-objective optimal solution set when solving multi-objective optimization problems(MOPs). However, most multi-objective evolutionary algorithms perform well on regular multi-objective optimization problems, but their performance on irregular fronts deteriorates. In order to remedy this issue, this paper studies the existing algorithms and proposes a multi-objective evolutionary based on niche selection to deal with irregular Pareto fronts. In this paper, the crowding degree is calculated by the niche method in the process of selecting parents when the non-dominated solutions converge to the first front, which improves the the quality of offspring solutions and which is beneficial to local search. In addition, niche selection is adopted into the process of environmental selection through considering the number and the location of the individuals in its niche radius, which improve the diversity of population. Finally, experimental results on 23 benchmark problems including MaF and IMOP show that the proposed algorithm exhibits better performance than the compared MOEAs.

Multi-Objective Evolutionary Algorithm Based on Two Reference Points Decomposition and Historical Information Prediction

2021 ◽  
Vol 01 ◽  
Author(s):  
Er-chao Li ◽  
Kang-wei Li
Keyword(s):  
Evolutionary Algorithm ◽  
Optimization Problems ◽  
Reference Points ◽  
Multi Objective Optimization ◽  
Test Function ◽  
Historical Information ◽  
Multi Objective ◽  
Nadir Point ◽  
Overall Performance ◽  
Better Than

Aims: The main purpose of this paper is to solve the issues that the poor quality of offspring solutions generated by traditional evolutionary operators, and that the inability of the evolutionary algorithm based on decomposition to better solve the multi-objective optimization problems (MOPs) with complicated Pareto fronts (PFs). Background: For some complicated multi-objective optimization problems, the effect of the multi-objective evolutionary algorithm based on decomposition (MOEA/D) is poor. For specific complicated problems, there is less research on improving the algorithm's performance by setting and adjusting the direction vector in the decomposition-based evolutionary algorithm. And considering that in the existing algorithms, the optimal solutions are selected according to the selection strategy in the selection stage, without considering if it could produce the better solutions in the stage of individual generation to achieve the optimization effect faster. As a result of these, a multi-objective evolutionary algorithm that is based on two reference points decomposition and historical information prediction is proposed. Objective: In order to verify the feasibility of the proposed strategy, the F-series test function with complicated PFs is used as the test function to simulate the proposed strategy. Method: Firstly, the evolutionary operator based on Historical Information Prediction (EHIP) is used to generate better offspring solutions to improve the convergence of the algorithm; secondly, the decomposition strategy based on ideal point and nadir point is used to select solutions to solve the MOPs with complicated PFs, and the decomposition method with augmentation term is used to improve the population diversity when selecting solutions according to the nadir point. Finally, the proposed algorithm is compared to several popular algorithms by the F-series test function, and the comparison is made according to the corresponding performance metrics. Result: The performance of the algorithm is improved obviously compared with the popular algorithms after using the EHIP. When the decomposition method with augmentation term is added, the performance of the proposed algorithm is better than the algorithm with only the EHIP on the whole. However, the overall performance is better than the popular algorithms. Conclusion and Prospect: The experimental results show that the overall performance of the proposed algorithm is superior to the popular algorithms. The EHIP can produce better quality offspring solutions, and the decomposition strategy based on two reference points can well solve the MOPs with complicated PFs. This paper mainly demonstrates the theory without testing the practical problems. The following research mainly focuses on the application of the proposed algorithm to the practical problems such as robot path planning.

scholarly journals Comparison of synchronous and asynchronous parallelization of extreme surrogate-assisted multi-objective evolutionary algorithm

2020 ◽  
Author(s):  
Tomohiro Harada ◽  
Misaki Kaidan ◽  
Ruck Thawonmas
Keyword(s):  
Machine Learning ◽  
Evolutionary Algorithm ◽  
Optimization Problems ◽  
Computing Time ◽  
The Other ◽  
Multi Objective Optimization ◽  
Multi Objective ◽  
Evaluation Time ◽  
Surrogate Function

Abstract This paper investigates the integration of a surrogate-assisted multi-objective evolutionary algorithm (MOEA) and a parallel computation scheme to reduce the computing time until obtaining the optimal solutions in evolutionary algorithms (EAs). A surrogate-assisted MOEA solves multi-objective optimization problems while estimating the evaluation of solutions with a surrogate function. A surrogate function is produced by a machine learning model. This paper uses an extreme learning surrogate-assisted MOEA/D (ELMOEA/D), which utilizes one of the well-known MOEA algorithms, MOEA/D, and a machine learning technique, extreme learning machine (ELM). A parallelization of MOEA, on the other hand, evaluates solutions in parallel on multiple computing nodes to accelerate the optimization process. We consider a synchronous and an asynchronous parallel MOEA as a master-slave parallelization scheme for ELMOEA/D. We carry out an experiment with multi-objective optimization problems to compare the synchronous parallel ELMOEA/D with the asynchronous parallel ELMOEA/D. In the experiment, we simulate two settings of the evaluation time of solutions. One determines the evaluation time of solutions by the normal distribution with different variances. On the other hand, another evaluation time correlates to the objective function value. We compare the quality of solutions obtained by the parallel ELMOEA/D variants within a particular computing time. The experimental results show that the parallelization of ELMOEA/D significantly reduces the computational time. In addition, the integration of ELMOEA/D with the asynchronous parallelization scheme obtains higher quality of solutions quicker than the synchronous parallel ELMOEA/D.

A Memetic Optimization Strategy Based on Dimension Reduction in Decision Space

2015 ◽  
Vol 23 (1) ◽  
pp. 69-100 ◽  
Author(s):  
Handing Wang ◽  
Licheng Jiao ◽  
Ronghua Shang ◽  
Shan He ◽  
Fang Liu
Keyword(s):  
Dimension Reduction ◽  
Optimization Problems ◽  
State Of The Art ◽  
Search Space ◽  
Optimization Strategy ◽  
Objective Functions ◽  
Multi Objective Optimization ◽  
Decision Space ◽  
Multi Objective ◽  
Decision Variables

There can be a complicated mapping relation between decision variables and objective functions in multi-objective optimization problems (MOPs). It is uncommon that decision variables influence objective functions equally. Decision variables act differently in different objective functions. Hence, often, the mapping relation is unbalanced, which causes some redundancy during the search in a decision space. In response to this scenario, we propose a novel memetic (multi-objective) optimization strategy based on dimension reduction in decision space (DRMOS). DRMOS firstly analyzes the mapping relation between decision variables and objective functions. Then, it reduces the dimension of the search space by dividing the decision space into several subspaces according to the obtained relation. Finally, it improves the population by the memetic local search strategies in these decision subspaces separately. Further, DRMOS has good portability to other multi-objective evolutionary algorithms (MOEAs); that is, it is easily compatible with existing MOEAs. In order to evaluate its performance, we embed DRMOS in several state of the art MOEAs to facilitate our experiments. The results show that DRMOS has the advantage in terms of convergence speed, diversity maintenance, and portability when solving MOPs with an unbalanced mapping relation between decision variables and objective functions.

The Hybrid Differential Evolution with Dynamic Scaling Mutation and Wrapper Local Search for Optimization Problems

2013 ◽  
Vol 479-480 ◽  
pp. 989-995
Author(s):  
Chun Liang Lu ◽  
Shih Yuan Chiu ◽  
Chih Hsu Hsu ◽  
Shi Jim Yen
Keyword(s):  
Local Search ◽  
Differential Evolution ◽  
Job Shop ◽  
Job Shop Scheduling ◽  
Optimization Problems ◽  
Search Space ◽  
Dynamic Scaling ◽  
Multi Objective ◽  
Wide Range ◽  
Single Objective

In this paper, an improved hybrid Differential Evolution (DE) is proposed to enhance optimization performance by cooperating Dynamic Scaling Mutation (DSM) and Wrapper Local Search (WLS) schemes. When evolution speed is standstill, DSM can improve searching ability to achieve better balance between exploitation and exploration in the search space. Furthermore, WLS can disturb individuals to fine tune the searching range around and then properly find better solutions in the evolution progress. The effective particle encoding representation named Particle Segment Operation-Machine Assignment (PSOMA) that we previously published is also applied to always produce feasible candidate solutions for hybrid DE model to solve the Flexible Job-Shop Scheduling Problem (FJSP). To test the performance of the proposed hybrid method, the experiments contain five frequently used CEC 2005 numerical functions and three representative FJSP benchmarks for single-objective and multi-objective optimization verifications, respectively. Compare the proposed method with the other related published algorithms, the simulation results indicate that our proposed method exhibits better performance for solving most the test functions for single-objective problems. In addition, the wide range of Pareto-optimal solutions and the more Gantt chart diversities can be obtained for the multi-objective FJSP in practical decision-making considerations.

scholarly journals ETEA: A Euclidean Minimum Spanning Tree-Based Evolutionary Algorithm for Multi-Objective Optimization

2014 ◽  
Vol 22 (2) ◽  
pp. 189-230 ◽  
Author(s):  
Miqing Li ◽  
Shengxiang Yang ◽  
Jinhua Zheng ◽  
Xiaohui Liu
Keyword(s):  
Evolutionary Algorithm ◽  
Spanning Tree ◽  
Euclidean Distance ◽  
Minimum Spanning Tree ◽  
Optimization Problems ◽  
Multi Objective Optimization ◽  
Position Information ◽  
Multi Objective ◽  
Environmental Selection ◽  
Fitness Value

The Euclidean minimum spanning tree (EMST), widely used in a variety of domains, is a minimum spanning tree of a set of points in space where the edge weight between each pair of points is their Euclidean distance. Since the generation of an EMST is entirely determined by the Euclidean distance between solutions (points), the properties of EMSTs have a close relation with the distribution and position information of solutions. This paper explores the properties of EMSTs and proposes an EMST-based evolutionary algorithm (ETEA) to solve multi-objective optimization problems (MOPs). Unlike most EMO algorithms that focus on the Pareto dominance relation, the proposed algorithm mainly considers distance-based measures to evaluate and compare individuals during the evolutionary search. Specifically, in ETEA, four strategies are introduced: (1) An EMST-based crowding distance (ETCD) is presented to estimate the density of individuals in the population; (2) A distance comparison approach incorporating ETCD is used to assign the fitness value for individuals; (3) A fitness adjustment technique is designed to avoid the partial overcrowding in environmental selection; (4) Three diversity indicators—the minimum edge, degree, and ETCD—with regard to EMSTs are applied to determine the survival of individuals in archive truncation. From a series of extensive experiments on 32 test instances with different characteristics, ETEA is found to be competitive against five state-of-the-art algorithms and its predecessor in providing a good balance among convergence, uniformity, and spread.

Sign in / Sign up

Export Citation Format

Share Document