Genetic Diversity as an Objective in Multi-Objective Evolutionary Algorithms

2003 ◽  
Vol 11 (2) ◽  
pp. 151-167 ◽  
Author(s):  
Andrea Toffolo ◽  
Ernesto Benini
Keyword(s):  
Genetic Diversity ◽  
Evolutionary Algorithms ◽  
Evolutionary Algorithm ◽  
Selection Pressure ◽  
Evaluation Method ◽  
State Of The Art ◽  
Search Space ◽  
Test Problems ◽  
Multi Objective ◽  
Diversity Evaluation

A key feature of an efficient and reliable multi-objective evolutionary algorithm is the ability to maintain genetic diversity within a population of solutions. In this paper, we present a new diversity-preserving mechanism, the Genetic Diversity Evaluation Method (GeDEM), which considers a distance-based measure of genetic diversity as a real objective in fitness assignment. This provides a dual selection pressure towards the exploitation of current non-dominated solutions and the exploration of the search space. We also introduce a new multi-objective evolutionary algorithm, the Genetic Diversity Evolutionary Algorithm (GDEA), strictly designed around GeDEM and then we compare it with other state-of-the-art algorithms on a well-established suite of test problems. Experimental results clearly indicate that the performance of GDEA is top-level.

scholarly journals An Entropy-Based Multiobjective Evolutionary Algorithm with an Enhanced Elite Mechanism

2012 ◽  
Vol 2012 ◽  
pp. 1-11 ◽  
Author(s):  
Yufang Qin ◽  
Junzhong Ji ◽  
Chunnian Liu
Keyword(s):  
Evolutionary Algorithm ◽  
Pareto Front ◽  
Optimization Problem ◽  
State Of The Art ◽  
Early Stage ◽  
Test Problems ◽  
Multiobjective Optimization Problem ◽  
Multi Objective Optimization ◽  
Nsga Ii ◽  
Multi Objective

Multiobjective optimization problem (MOP) is an important and challenging topic in the fields of industrial design and scientific research. Multi-objective evolutionary algorithm (MOEA) has proved to be one of the most efficient algorithms solving the multi-objective optimization. In this paper, we propose an entropy-based multi-objective evolutionary algorithm with an enhanced elite mechanism (E-MOEA), which improves the convergence and diversity of solution set in MOPs effectively. In this algorithm, an enhanced elite mechanism is applied to guide the direction of the evolution of the population. Specifically, it accelerates the population to approach the true Pareto front at the early stage of the evolution process. A strategy based on entropy is used to maintain the diversity of population when the population is near to the Pareto front. The proposed algorithm is executed on widely used test problems, and the simulated results show that the algorithm has better or comparative performances in convergence and diversity of solutions compared with two state-of-the-art evolutionary algorithms: NSGA-II, SPEA2 and the MOSADE.

scholarly journals Improved Lebesgue Indicator-Based Evolutionary Algorithm: Reducing Hypervolume Computations

Mathematics ◽  
2021 ◽  
Vol 10 (1) ◽  
pp. 19
Author(s):  
Saúl Zapotecas-Martínez ◽  
Abel García-Nájera ◽  
Adriana Menchaca-Méndez
Keyword(s):  
Evolutionary Algorithms ◽  
Evolutionary Algorithm ◽  
Lebesgue Measure ◽  
Pareto Front ◽  
Optimization Problems ◽  
State Of The Art ◽  
Computational Cost ◽  
Computational Time ◽  
Multi Objective Optimization ◽  
Multi Objective

One of the major limitations of evolutionary algorithms based on the Lebesgue measure for multi-objective optimization is the computational cost required to approximate the Pareto front of a problem. Nonetheless, the Pareto compliance property of the Lebesgue measure makes it one of the most investigated indicators in the designing of indicator-based evolutionary algorithms (IBEAs). The main deficiency of IBEAs that use the Lebesgue measure is their computational cost which increases with the number of objectives of the problem. On this matter, the investigation presented in this paper introduces an evolutionary algorithm based on the Lebesgue measure to deal with box-constrained continuous multi-objective optimization problems. The proposed algorithm implicitly uses the regularity property of continuous multi-objective optimization problems that has suggested effectiveness when solving continuous problems with rough Pareto sets. On the other hand, the survival selection mechanism considers the local property of the Lebesgue measure, thus reducing the computational time in our algorithmic approach. The emerging indicator-based evolutionary algorithm is examined and compared versus three state-of-the-art multi-objective evolutionary algorithms based on the Lebesgue measure. In addition, we validate its performance on a set of artificial test problems with various characteristics, including multimodality, separability, and various Pareto front forms, incorporating concavity, convexity, and discontinuity. For a more exhaustive study, the proposed algorithm is evaluated in three real-world applications having four, five, and seven objective functions whose properties are unknown. We show the high competitiveness of our proposed approach, which, in many cases, improved the state-of-the-art indicator-based evolutionary algorithms on the multi-objective problems adopted in our investigation.

A Decomposition-based Evolutionary Algorithm with Correlative Selection Mechanism for Many-objective Optimization

2020 ◽  
pp. 1-36
Author(s):  
Ruochen Liu ◽  
Ruinan Wang ◽  
Renyu Bian ◽  
Jing Liu ◽  
Licheng Jiao
Keyword(s):  
Evolutionary Algorithms ◽  
Evolutionary Algorithm ◽  
Reference Point ◽  
Optimization Problems ◽  
State Of The Art ◽  
Reference Points ◽  
Test Problems ◽  
Selection Mechanism ◽  
Multi Objective Optimization ◽  
Decomposition Approach

Decomposition-based evolutionary algorithms have been quite successful in dealing with multi-objective optimization problems. Recently, more and more researchers attempt to apply the decomposition approach to solve many-objective optimization problems. A many-objective evolutionary algorithm based on decomposition with correlative selection mechanism (MOEA/D-CSM) is also proposed to solve many-objective optimization problems in this paper. Since MOEA/D-SCM is based on a decomposition approach which adopts penalty boundary intersection (PBI), a set of reference points must be generated in advance. Thus, a new concept related to the set of reference points is introduced first, namely, the correlation between an individual and a reference point. Thereafter, a new selection mechanism based on the correlation is designed and called correlative selection mechanism. The correlative selection mechanism finds their correlative individuals for each reference point as soon as possible so that the diversity among population members is maintained. However, when a reference point has two or more correlative individuals, those worse correlative individuals may be removed from a population so that the solutions can be ensured to move towards the Pareto-optimal front. In a comprehensive experimental study, we apply MOEA/D-CSM to a number of many-objective test problems with 3 to 15 objec-tives and make a comparison with three state-of-the-art many-objective evolutionary algorithms, namely, NSGA-III, MOEA/D and RVEA. Experimental results show that the proposed MOEA/D-CSM can produce competitive results on most of the problems considered in this study.

scholarly journals Evolutionary Manytasking Optimization Based on Symbiosis in Biocoenosis

2019 ◽  
Vol 33 ◽  
pp. 4295-4303 ◽  
Author(s):  
Rung-Tzuo Liaw ◽  
Chuan-Kang Ting
Keyword(s):  
Evolutionary Algorithms ◽  
Evolutionary Algorithm ◽  
State Of The Art ◽  
The State ◽  
Experimental Results ◽  
Benchmark Problems ◽  
Good Estimator ◽  
Multiple Tasks ◽  
Effectiveness And Efficiency ◽  
Evolutionary Multitasking

Evolutionary multitasking is a significant emerging search paradigm that utilizes evolutionary algorithms to concurrently optimize multiple tasks. The multi-factorial evolutionary algorithm renders an effectual realization of evolutionary multitasking on two or three tasks. However, there remains room for improvement on the performance and capability of evolutionary multitasking. Beyond three tasks, this paper proposes a novel framework, called the symbiosis in biocoenosis optimization (SBO), to address evolutionary many-tasking optimization. The SBO leverages the notion of symbiosis in biocoenosis for transferring information and knowledge among different tasks through three major components: 1) transferring information through inter-task individual replacement, 2) measuring symbiosis through intertask paired evaluations, and 3) coordinating the frequency and quantity of transfer based on symbiosis in biocoenosis. The inter-task individual replacement with paired evaluations caters for estimation of symbiosis, while the symbiosis in biocoenosis provides a good estimator of transfer. This study examines the effectiveness and efficiency of the SBO on a suite of many-tasking benchmark problems, designed to deal with 30 tasks simultaneously. The experimental results show that SBO leads to better solutions and faster convergence than the state-of-the-art evolutionary multitasking algorithms. Moreover, the results indicate that SBO is highly capable of identifying the similarity between problems and transferring information appropriately.

Evaluating the ε-Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions

2005 ◽  
Vol 13 (4) ◽  
pp. 501-525 ◽  
Author(s):  
Kalyanmoy Deb ◽  
Manikanth Mohan ◽  
Shikhar Mishra
Keyword(s):  
Steady State ◽  
Evolutionary Algorithm ◽  
Optimization Problems ◽  
Computational Time ◽  
Test Problems ◽  
Pareto Optimal ◽  
Pareto Optimal Solutions ◽  
Optimal Solutions ◽  
Nsga Ii ◽  
Multi Objective

Since the suggestion of a computing procedure of multiple Pareto-optimal solutions in multi-objective optimization problems in the early Nineties, researchers have been on the look out for a procedure which is computationally fast and simultaneously capable of finding a well-converged and well-distributed set of solutions. Most multi-objective evolutionary algorithms (MOEAs) developed in the past decade are either good for achieving a well-distributed solutions at the expense of a large computational effort or computationally fast at the expense of achieving a not-so-good distribution of solutions. For example, although the Strength Pareto Evolutionary Algorithm or SPEA (Zitzler and Thiele, 1999) produces a much better distribution compared to the elitist non-dominated sorting GA or NSGA-II (Deb et al., 2002a), the computational time needed to run SPEA is much greater. In this paper, we evaluate a recently-proposed steady-state MOEA (Deb et al., 2003) which was developed based on the ε-dominance concept introduced earlier (Laumanns et al., 2002) and using efficient parent and archive update strategies for achieving a well-distributed and well-converged set of solutions quickly. Based on an extensive comparative study with four other state-of-the-art MOEAs on a number of two, three, and four objective test problems, it is observed that the steady-state MOEA is a good compromise in terms of convergence near to the Pareto-optimal front, diversity of solutions, and computational time. Moreover, the ε-MOEA is a step closer towards making MOEAs pragmatic, particularly allowing a decision-maker to control the achievable accuracy in the obtained Pareto-optimal solutions.

A Memetic Optimization Strategy Based on Dimension Reduction in Decision Space

2015 ◽  
Vol 23 (1) ◽  
pp. 69-100 ◽  
Author(s):  
Handing Wang ◽  
Licheng Jiao ◽  
Ronghua Shang ◽  
Shan He ◽  
Fang Liu
Keyword(s):  
Dimension Reduction ◽  
Optimization Problems ◽  
State Of The Art ◽  
Search Space ◽  
Optimization Strategy ◽  
Objective Functions ◽  
Multi Objective Optimization ◽  
Decision Space ◽  
Multi Objective ◽  
Decision Variables

There can be a complicated mapping relation between decision variables and objective functions in multi-objective optimization problems (MOPs). It is uncommon that decision variables influence objective functions equally. Decision variables act differently in different objective functions. Hence, often, the mapping relation is unbalanced, which causes some redundancy during the search in a decision space. In response to this scenario, we propose a novel memetic (multi-objective) optimization strategy based on dimension reduction in decision space (DRMOS). DRMOS firstly analyzes the mapping relation between decision variables and objective functions. Then, it reduces the dimension of the search space by dividing the decision space into several subspaces according to the obtained relation. Finally, it improves the population by the memetic local search strategies in these decision subspaces separately. Further, DRMOS has good portability to other multi-objective evolutionary algorithms (MOEAs); that is, it is easily compatible with existing MOEAs. In order to evaluate its performance, we embed DRMOS in several state of the art MOEAs to facilitate our experiments. The results show that DRMOS has the advantage in terms of convergence speed, diversity maintenance, and portability when solving MOPs with an unbalanced mapping relation between decision variables and objective functions.

scholarly journals Improving Clustering Methods By Exploiting Richness Of Text Data

2021 ◽  
Author(s):  
◽  
Abdul Wahid
Keyword(s):  
Evolutionary Algorithm ◽  
State Of The Art ◽  
Ensemble Methods ◽  
Text Clustering ◽  
Clustering Methods ◽  
Clustering Method ◽  
Clustering Ensemble ◽  
Text Data ◽  
Multi Objective ◽  
User Queries

<p>Clustering is an unsupervised machine learning technique, which involves discovering different clusters (groups) of similar objects in unlabeled data and is generally considered to be a NP hard problem. Clustering methods are widely used in a verity of disciplines for analyzing different types of data, and a small improvement in clustering method can cause a ripple effect in advancing research of multiple fields.  Clustering any type of data is challenging and there are many open research questions. The clustering problem is exacerbated in the case of text data because of the additional challenges such as issues in capturing semantics of a document, handling rich features of text data and dealing with the well known problem of the curse of dimensionality.  In this thesis, we investigate the limitations of existing text clustering methods and address these limitations by providing five new text clustering methods--Query Sense Clustering (QSC), Dirichlet Weighted K-means (DWKM), Multi-View Multi-Objective Evolutionary Algorithm (MMOEA), Multi-objective Document Clustering (MDC) and Multi-Objective Multi-View Ensemble Clustering (MOMVEC). These five new clustering methods showed that the use of rich features in text clustering methods could outperform the existing state-of-the-art text clustering methods.  The first new text clustering method QSC exploits user queries (one of the rich features in text data) to generate better quality clusters and cluster labels.  The second text clustering method DWKM uses probability based weighting scheme to formulate a semantically weighted distance measure to improve the clustering results.  The third text clustering method MMOEA is based on a multi-objective evolutionary algorithm. MMOEA exploits rich features to generate a diverse set of candidate clustering solutions, and forms a better clustering solution using a cluster-oriented approach.  The fourth and the fifth text clustering method MDC and MOMVEC address the limitations of MMOEA. MDC and MOMVEC differ in terms of the implementation of their multi-objective evolutionary approaches.  All five methods are compared with existing state-of-the-art methods. The results of the comparisons show that the newly developed text clustering methods out-perform existing methods by achieving up to 16\% improvement for some comparisons. In general, almost all newly developed clustering algorithms showed statistically significant improvements over other existing methods.  The key ideas of the thesis highlight that exploiting user queries improves Search Result Clustering(SRC); utilizing rich features in weighting schemes and distance measures improves soft subspace clustering; utilizing multiple views and a multi-objective cluster oriented method improves clustering ensemble methods; and better evolutionary operators and objective functions improve multi-objective evolutionary clustering ensemble methods.  The new text clustering methods introduced in this thesis can be widely applied in various domains that involve analysis of text data. The contributions of this thesis which include five new text clustering methods, will not only help researchers in the data mining field but also to help a wide range of researchers in other fields.</p>

scholarly journals Evolutionary Search with Multiple Utopian Reference Points in Decomposition-Based Multiobjective Optimization

Complexity ◽  
2019 ◽  
Vol 2019 ◽  
pp. 1-22 ◽  
Author(s):  
Wu Lin ◽  
Qiuzhen Lin ◽  
Zexuan Zhu ◽  
Jianqiang Li ◽  
Jianyong Chen ◽  
...  
Keyword(s):  
Evolutionary Algorithms ◽  
Reference Point ◽  
Ideal Point ◽  
Search Space ◽  
Weight Vector ◽  
Reference Points ◽  
Test Problems ◽  
Evolutionary Search ◽  
Multiobjective Evolutionary Algorithms ◽  
Nadir Point

Decomposition-based multiobjective evolutionary algorithms (MOEA/Ds) have become increasingly popular in recent years. In these MOEA/Ds, evolutionary search is guided by the used weight vectors in decomposition function to approximate the Pareto front (PF). Generally, the decomposition function will be constructed by the weight vectors and the reference point, which play an important role to balance convergence and diversity during the evolutionary search. However, in most existing MOEA/Ds, only one ideal point is used as the reference point for all the evolutionary search, which is harmful to search the entire PF when tackling the problems with difficult-to-approximate PF boundaries. To address the above problem, this paper proposes an evolutionary search method with multiple utopian reference points in MOEA/Ds. Similar to the existing MOEA/Ds, each solution is associated with one weight vector, which provides an evolutionary search direction, while the novelty of our approach is to use multiple utopian reference points, which can provide evolutionary search directions for different weight vectors. Corner solutions are used to approximate the nadir point and then multiple utopian reference points for evolutionary search can be constructed based on the ideal point and the nadir point, which are uniformly distributed on the coordinate axis or planes. The use of these utopian points can prevent solutions to gather in the same region of PF and helps to strike a good balance of exploration and exploitation in the search space. The performance of our proposed algorithm is validated on tackling 16 recently proposed test problems with difficult-to-approximate PF boundaries and empirically compared to eight state-of-the-art multiobjective evolutionary algorithms. The experimental results demonstrate the superiority of the proposed algorithm on solving most of the test problems adopted.

Research of Biogeography-Based Multi-Objective Evolutionary Algorithm

2011 ◽  
Vol 4 (2) ◽  
pp. 70-80 ◽  
Author(s):  
Hongwei Mo ◽  
Zhidan Xu
Keyword(s):  
Evolutionary Algorithm ◽  
Optimization Algorithm ◽  
Solution Set ◽  
Test Problems ◽  
Benchmark Test ◽  
Multi Objective ◽  
Simulation Results ◽  
Effectiveness And Efficiency ◽  
Evolutionary Operators ◽  
External Population

Biogeography-based optimization algorithm (BBO) is an optimization algorithm inspired by the migration of animals in nature. A new multi-objective evolutionary algorithm is proposed, which is called Biogeography-based multi-objective evolutionary algorithm (BBMOEA). The fitness assignment and the external population elitism of SPEA2 are adapted to ensure even distribution of the solution set. The population evolutionary operators of BBO are applied to the evolution of the external population to ensure the convergence of the solution set. Simulation results on benchmark test problems illustrate the effectiveness and efficiency of the proposed algorithm.

Sign in / Sign up

Export Citation Format

Share Document