Mathematical Optimization by Using Particle Swarm Optimization, Genetic Algorithm, and Differential Evolution and Its Similarities

2017 ◽  
pp. 325-358
Author(s):  
Shailendra Aote ◽  
Mukesh M. Raghuwanshi
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Differential Evolution ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Mathematical Optimization ◽  
Evolutionary Computing ◽  
Swarm Optimization

To solve the problems of optimization, various methods are provided in different domain. Evolutionary computing (EC) is one of the methods to solve these problems. Mostly used EC techniques are available like Particle Swarm Optimization (PSO), Genetic Algorithm (GA) and Differential Evolution (DE). These techniques have different working structure but the inner working structure is same. Different names and formulae are given for different task but ultimately all do the same. Here we tried to find out the similarities among these techniques and give the working structure in each step. All the steps are provided with proper example and code written in MATLAB, for better understanding. Here we started our discussion with introduction about optimization and solution to optimization problems by PSO, GA and DE. Finally, we have given brief comparison of these.

Mathematical Optimization by Using Particle Swarm Optimization, Genetic Algorithm, and Differential Evolution and Its Similarities

2021 ◽  
pp. 1-34
Author(s):  
Shailendra Aote ◽  
Mukesh M. Raghuwanshi
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Differential Evolution ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Mathematical Optimization ◽  
Evolutionary Computing ◽  
Swarm Optimization

To solve the problems of optimization, various methods are provided in different domain. Evolutionary computing (EC) is one of the methods to solve these problems. Mostly used EC techniques are available like Particle Swarm Optimization (PSO), Genetic Algorithm (GA) and Differential Evolution (DE). These techniques have different working structure but the inner working structure is same. Different names and formulae are given for different task but ultimately all do the same. Here we tried to find out the similarities among these techniques and give the working structure in each step. All the steps are provided with proper example and code written in MATLAB, for better understanding. Here we started our discussion with introduction about optimization and solution to optimization problems by PSO, GA and DE. Finally, we have given brief comparison of these.

scholarly journals A Modified NM-PSO Method for Parameter Estimation Problems of Models

2012 ◽  
Vol 2012 ◽  
pp. 1-12 ◽  
Author(s):  
An Liu ◽  
Erwie Zahara ◽  
Ming-Ta Yang
Keyword(s):  
Genetic Algorithm ◽  
Parameter Estimation ◽  
Particle Swarm Optimization ◽  
Differential Equations ◽  
Ordinary Differential Equations ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Swarm Optimization ◽  
Wide Range ◽  
Estimation Problems

Ordinary differential equations usefully describe the behavior of a wide range of dynamic physical systems. The particle swarm optimization (PSO) method has been considered an effective tool for solving the engineering optimization problems for ordinary differential equations. This paper proposes a modified hybrid Nelder-Mead simplex search and particle swarm optimization (M-NM-PSO) method for solving parameter estimation problems. The M-NM-PSO method improves the efficiency of the PSO method and the conventional NM-PSO method by rapid convergence and better objective function value. Studies are made for three well-known cases, and the solutions of the M-NM-PSO method are compared with those by other methods published in the literature. The results demonstrate that the proposed M-NM-PSO method yields better estimation results than those obtained by the genetic algorithm, the modified genetic algorithm (real-coded GA (RCGA)), the conventional particle swarm optimization (PSO) method, and the conventional NM-PSO method.

scholarly journals Performance of the Modified Dolphin Monitoring Operator for Weight Optimization of Skeletal Structures

2018 ◽  
Author(s):  
Ali Kaveh ◽  
S.R. Hoseini Vaez ◽  
Pedram Hosseini
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Structural Optimization ◽  
Differential Evolution ◽  
Optimization Problems ◽  
Harmony Search ◽  
Average Weight ◽  
Weight Optimization ◽  
Swarm Optimization ◽  
Population Dispersion

In this study, the Modified Dolphin Monitoring (MDM) operator is used to enhance the performance of some metaheuristic algorithms. The MDM is a recently presented operator that controls the population dispersion in each iteration. Algorithms are selected from some well-established algorithms. Here, this operator is applied on Differential Evolution (DE), Particle Swarm Optimization (PSO), Genetic Algorithm (GA), Vibrating Particles System (VPS), Enhanced Vibrating Particles System (EVPS), Colliding Bodied Optimization (CBO) and Harmony Search (HS) and the performance of these algorithms are evaluated with and without this operator on three well-known structural optimization problems. The results show the performance of this operator on these algorithms for the best, the worst, average and average weight of the first quarter of answers.

Research on an Improved Coordinating Method Based on Genetic Algorithms and Particle Swarm Optimization

2019 ◽  
Vol 13 (2) ◽  
pp. 18-29
Author(s):  
Rongrong Li ◽  
Linrun Qiu ◽  
Dongbo Zhang
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Bottom Layer ◽  
Pso Algorithm ◽  
Particle Swarm Algorithm ◽  
Swarm Optimization ◽  
Elite Group ◽  
Searching Ability

In this article, a hierarchical cooperative algorithm based on the genetic algorithm and the particle swarm optimization is proposed that the paper should utilize the global searching ability of genetic algorithm and the fast convergence speed of particle swarm optimization. The proposed algorithm starts from Individual organizational structure of subgroups and takes full advantage of the merits of the particle swarm optimization algorithm and the genetic algorithm (HCGA-PSO). The algorithm uses a layered structure with two layers. The bottom layer is composed of a series of genetic algorithm by subgroup that contributes to the global searching ability of the algorithm. The upper layer is an elite group consisting of the best individuals of each subgroup and the particle swarm algorithm is used to perform precise local search. The experimental results demonstrate that the HCGA-PSO algorithm has better convergence and stronger continuous search capability, which makes it suitable for solving complex optimization problems.

scholarly journals An Adaptive Hybrid Algorithm Based on Particle Swarm Optimization and Differential Evolution for Global Optimization

2014 ◽  
Vol 2014 ◽  
pp. 1-16 ◽  
Author(s):  
Xiaobing Yu ◽  
Jie Cao ◽  
Haiyan Shan ◽  
Li Zhu ◽  
Jun Guo
Keyword(s):  
Particle Swarm Optimization ◽  
Differential Evolution ◽  
Hybrid Algorithm ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Population Based ◽  
Stochastic Search ◽  
Adaptive Mutation ◽  
Swarm Optimization ◽  
Local Optima

Particle swarm optimization (PSO) and differential evolution (DE) are both efficient and powerful population-based stochastic search techniques for solving optimization problems, which have been widely applied in many scientific and engineering fields. Unfortunately, both of them can easily fly into local optima and lack the ability of jumping out of local optima. A novel adaptive hybrid algorithm based on PSO and DE (HPSO-DE) is formulated by developing a balanced parameter between PSO and DE. Adaptive mutation is carried out on current population when the population clusters around local optima. The HPSO-DE enjoys the advantages of PSO and DE and maintains diversity of the population. Compared with PSO, DE, and their variants, the performance of HPSO-DE is competitive. The balanced parameter sensitivity is discussed in detail.

Concurrent Societies Based on Genetic Algorithm and Particle Swarm Optimization

2010 ◽  
Vol 14 (1) ◽  
pp. 110-118
Author(s):  
Hrvoje Markovic ◽  
◽  
Fangyan Dong ◽  
Kaoru Hirota
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Nearest Neighbor ◽  
Optimization Problems ◽  
Fitness Function ◽  
Particle Swarm ◽  
Absolute Error ◽  
Population Based ◽  
Test Problems ◽  
Swarm Optimization

A parallel multi-population based metaheuristic optimization framework, called Concurrent Societies, inspired by human intellectual evolution, is proposed. It uses population based metaheuristics to evolve its populations, and fitness function approximations as representations of knowledge. By utilizing iteratively refined approximations it reduces the number of required evaluations and, as a byproduct, it produces models of the fitness function. The proposed framework is implemented as two Concurrent Societies: one based on genetic algorithm and one based on particle swarm optimization both using k -nearest neighbor regression as fitness approximation. The performance is evaluated on 10 standard test problems and compared to other commonly used metaheuristics. Results show that the usage of the framework considerably increases efficiency (by a factor of 7.6 to 977) and effectiveness (absolute error reduced by more than few orders of magnitude). The proposed framework is intended for optimization problems with expensive fitness functions, such as optimization in design and interactive optimization.

Evolving Particle Swarm Optimization Implemented by a Genetic Algorithm

2008 ◽  
Vol 12 (3) ◽  
pp. 284-289 ◽  
Author(s):  
Jenn-Long Liu ◽  
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Social Learning ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Search Space ◽  
Design Parameters ◽  
Search Process ◽  
Swarm Optimization ◽  
Learning Rates

Particle swarm optimization (PSO) is a promising evolutionary approach related to a particle moves over the search space with velocity, which is adjusted according to the flying experiences of the particle and its neighbors, and flies towards the better and better search area over the course of search process. Although the PSO is effective in solving the global optimization problems, there are some crucial user-input parameters, such as cognitive and social learning rates, affect the performance of algorithm since the search process of a PSO algorithm is nonlinear and complex. Consequently, a PSO with well-selected parameter settings may result in good performance. This work develops an evolving PSO based on the Clerc’s PSO to evaluate the fitness of objective function and a genetic algorithm (GA) to evolve the optimal design parameters to provide the usage of PSO. The crucial design parameters studied herein include the cognitive and social learning rates as well as constriction factor for the Clerc’s PSO. Several benchmarking cases are experimented to generalize a set of optimal parameters via the evolving PSO. Furthermore, the better parameters are applied to the engineering optimization of a pressure vessel design.

Particle Swarm Optimization by Improved Chaos Immune Genetic Algorithm

2014 ◽  
Vol 989-994 ◽  
pp. 2621-2624
Author(s):  
Shao Song Wan ◽  
Jian Cao ◽  
Qun Song Zhu
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Single Chip ◽  
Immune Genetic Algorithm ◽  
Swarm Optimization ◽  
Local Optima ◽  
Chaos Sequence ◽  
Multimodal Problems

In order to resolve these problems, we put forward a new design of the intelligent lock which is mainly based on the technology of wireless sensor network. Particle swarm optimization (PSO) is a recently proposed intelligent algorithm which is motivated by swarm intelligence. PSO has been shown to perform well on many benchmark and real-world optimization problems; it easily falls into local optima when solving complex multimodal problems. To avoid the local optimization, the algorithm renews population and enhances the diversity of population by using density calculation of immune theory and adjusting new chaos sequence. The paper gives the circuit diagram of the hardware components based on single chip and describe how to design the software. The experimental results show that the immune genetic algorithm based on chaos theory can search the result of the optimization and evidently improve the convergent speed and astringency.

scholarly journals Hybrid method for achieving Pareto front on economic emission dispatch

2020 ◽  
Vol 10 (4) ◽  
pp. 3358
Author(s):  
Kummari Rajesh ◽  
N. Visali
Keyword(s):  
Genetic Algorithm ◽  
Particle Swarm Optimization ◽  
Differential Evolution ◽  
Hybrid Method ◽  
Optimization Problem ◽  
Particle Swarm ◽  
Optimal Solution ◽  
Test System ◽  
Swarm Optimization ◽  
Metaheuristic Methods

In this paper hybrid method, Modified Nondominated Sorted Genetic Algorithm (MNSGA-II) and Modified Population Variant Differential Evolution(MPVDE) have been placed in effect in achieving the best optimal solution of Multiobjective economic emission load dispatch optimization problem. In this technique latter, one is used to enforce the assigned percent of the population and the remaining with the former one. To overcome the premature convergence in an optimization problem diversity preserving operator is employed, from the tradeoff curve the best optimal solution is predicted using fuzzy set theory. This methodology validated on IEEE 30 bus test system with six generators, IEEE 118 bus test system with fourteen generators and with a forty generators test system. The solutions are dissimilitude with the existing metaheuristic methods like Strength Pareto Evolutionary Algorithm-II, Multiobjective differential evolution, Multi-objective Particle Swarm optimization, Fuzzy clustering particle swarm optimization, Nondominated sorting genetic algorithm-II.

Sign in / Sign up

Export Citation Format

Share Document