Enhanced Particle Swarm Optimization via Reinforcement Learning

2021 ◽  
Author(s):  
G. Gary Wang ◽  
Di Wu
Author(s):  
Di Wu ◽  
G. Gary Wang

Abstract Particle swarm optimization (PSO) method is a well-known optimization algorithm, which shows good performance in solving different optimization problems. However, PSO usually suffers from slow convergence. In this paper, a reinforcement learning method is used to enhance PSO in convergence by replacing the uniformly distributed random number in the updating function by a random number generated from a well-selected normal distribution. The mean and variance of the normal distribution are estimated from the current state of each individual through a policy net. The historic behavior of the swarm group is learned to update the policy net and guide the selection of parameters of the normal distribution. The proposed algorithm is tested with numerical test functions and the results show that the convergence rate of PSO can be improved with the proposed Reinforcement Learning method (RL-PSO).


Author(s):  
Kai Yit Kok ◽  
Parvathy Rajendran

This paper presents an enhanced particle swarm optimization (PSO) for the path planning of unmanned aerial vehicles (UAVs). An evolutionary algorithm such as PSO is costly because every application requires different parameter settings to maximize the performance of the analyzed parameters. People generally use the trial-and-error method or refer to the recommended setting from general problems. The former is time consuming, while the latter is usually not the optimum setting for various specific applications. Hence, this study focuses on analyzing the impact of input parameters on the PSO performance in UAV path planning using various complex terrain maps with adequate repetitions to solve the tuning issue. Results show that inertial weight parameter is insignificant, and a 1.4 acceleration coefficient is optimum for UAV path planning. In addition, the population size between 40 and 60 seems to be the optimum setting based on the case studies.


Sign in / Sign up

Export Citation Format

Share Document