scholarly journals Automatic differentiation based for particle swarm optimization Steepest descent direction

2015 ◽  
Vol 1 (2) ◽  
pp. 90
Author(s):  
Aris Thobirin ◽  
Iwan Tri Riyadi Yanto
Keyword(s):  
Local Search ◽  
Automatic Differentiation ◽  
Optimization Methods ◽  
Global Optimum ◽  
Descent Direction ◽  
Benchmark Function ◽  
Swarm Optimization ◽  
Combination Methods ◽  
Gradient Based ◽  
Search Capability

Particle swam optimization (PSO) is one of the most effective optimization methods to find the global optimum point. In other hand, the descent direction (DD) is the gradient based method that has the local search capability. The combination of both methods is promising and interesting to get the method with effective global search capability and efficient local search capability. However, In many application, it is difficult or impossible to obtain the gradient exactly of an objective function. In this paper, we propose Automatic differentiation (AD) based for PSODD. we compare our methods on benchmark function. The results shown that the combination methods give us a powerful tool to find the solution.

scholarly journals An Adaptive Particle Swarm Optimization Algorithm for Unconstrained Optimization

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-18
Author(s):  
Feng Qian ◽  
Mohammad Reza Mahmoudi ◽  
Hamïd Parvïn ◽  
Kim-Hung Pho ◽  
Bui Anh Tuan
Keyword(s):  
Particle Swarm Optimization ◽  
Optimization Algorithm ◽  
Particle Swarm Optimization Algorithm ◽  
Optimization Problems ◽  
Particle Swarm ◽  
Optimization Methods ◽  
Global Optimum ◽  
Initial Population ◽  
Swarm Optimization ◽  
Conventional Optimization

Conventional optimization methods are not efficient enough to solve many of the naturally complicated optimization problems. Thus, inspired by nature, metaheuristic algorithms can be utilized as a new kind of problem solvers in solution to these types of optimization problems. In this paper, an optimization algorithm is proposed which is capable of finding the expected quality of different locations and also tuning its exploration-exploitation dilemma to the location of an individual. A novel particle swarm optimization algorithm is presented which implements the conditioning learning behavior so that the particles are led to perform a natural conditioning behavior on an unconditioned motive. In the problem space, particles are classified into several categories so that if a particle lies within a low diversity category, it would have a tendency to move towards its best personal experience. But, if the particle’s category is with high diversity, it would have the tendency to move towards the global optimum of that category. The idea of the birds’ sensitivity to its flying space is also utilized to increase the particles’ speed in undesired spaces in order to leave those spaces as soon as possible. However, in desirable spaces, the particles’ velocity is reduced to provide a situation in which the particles have more time to explore their environment. In the proposed algorithm, the birds’ instinctive behavior is implemented to construct an initial population randomly or chaotically. Experiments provided to compare the proposed algorithm with the state-of-the-art methods show that our optimization algorithm is one of the most efficient and appropriate ones to solve the static optimization problems.

scholarly journals Economic Load Dispatch Problem Based Biogeography Algorithm

2012 ◽  
pp. 92-97
Author(s):  
K.J.Vishnu Sudhan ◽  
R.S Saravana Kumar ◽  
A. Rathina Grace Monica
Keyword(s):  
Model Problem ◽  
Optimization Methods ◽  
Global Optimum ◽  
Economic Load Dispatch ◽  
Power Demand ◽  
Swarm Optimization ◽  
Quadratic Cost ◽  
Generation Cost ◽  
Thermal Generator ◽  
Quadratic Cost Function

In Recent Scenario, scarcity of energy source, ever growing Power demand, increasing in generation cost necessitate optimal economic dispatch. This paper includes Biogeography Algorithm to compute Economic Load Dispatch Problem for Thermal generator of power system. Biogeography Describes how the species arise, migrates from one habitat another and gets wipes out.In BGA model, problem solutions are represents as islands and sharing of features between solution is represented as immigration and emigration which searches for the global optimum mainly through two steps :migration and mutation. BGA has features in common with other biology-based optimization methods, such as GAs and particle swarm optimization (PSO). This makes BGA applicable to many of the same types of problems that GAs and PSO are used for, namely, high-dimension problems with multiple local optimal. To show the advantages of the proposed algorithm, it has been applied to two different test systems for solving ELD problems. First, a 3-generators system then a 6 generators system with simple quadratic cost function considering operating limit constraints is considered.

Adaptive Particle Swarm Optimization for Continuous Domain

2011 ◽  
Vol 204-210 ◽  
pp. 1139-1142
Author(s):  
Cheng Ming Qi
Keyword(s):  
Particle Swarm Optimization ◽  
Local Search ◽  
Particle Swarm Optimization Algorithm ◽  
Random Perturbation ◽  
Particle Swarm ◽  
Search Process ◽  
Benchmark Function ◽  
Swarm Optimization ◽  
Adaptive Particle Swarm Optimization ◽  
Pls Method

An Adaptive particle swarm optimization algorithm is proposed. Algorithm combines with pareto local search (PLS) method and adaptively adjusts flying time. During the search process, our algorithm can enhance the local search ability of particle swarm optimization (PSO) thought adding random perturbation to local search. The flying time of every particle in our algorithm can adaptively adjust with the evolutionary generations. Some optimization tests of the standard benchmark function confirm that our method has a stronger ability of global optimization.

scholarly journals Optimization Algorithms for Detection of Social Interactions

Algorithms ◽  
2020 ◽  
Vol 13 (6) ◽  
pp. 139 ◽  
Author(s):  
Vincenzo Cutello ◽  
Georgia Fargetta ◽  
Mario Pavone ◽  
Rocco A. Scollo
Keyword(s):  
Social Networks ◽  
Local Search ◽  
Social Interactions ◽  
Community Detection ◽  
Experimental Analysis ◽  
Search Strategy ◽  
Random Search ◽  
Optimization Methods ◽  
Research Areas ◽  
Greedy Optimization

Community detection is one of the most challenging and interesting problems in many research areas. Being able to detect highly linked communities in a network can lead to many benefits, such as understanding relationships between entities or interactions between biological genes, for instance. Two different immunological algorithms have been designed for this problem, called Opt-IA and Hybrid-IA, respectively. The main difference between the two algorithms is the search strategy and related immunological operators developed: the first carries out a random search together with purely stochastic operators; the last one is instead based on a deterministic Local Search that tries to refine and improve the current solutions discovered. The robustness of Opt-IA and Hybrid-IA has been assessed on several real social networks. These same networks have also been considered for comparing both algorithms with other seven different metaheuristics and the well-known greedy optimization Louvain algorithm. The experimental analysis conducted proves that Opt-IA and Hybrid-IA are reliable optimization methods for community detection, outperforming all compared algorithms.

Opinion Dynamics Optimization by Varying Susceptibility to Persuasion via Non-Convex Local Search

2021 ◽  
Vol 16 (2) ◽  
pp. 1-34
Author(s):  
Rediet Abebe ◽  
T.-H. HUBERT Chan ◽  
Jon Kleinberg ◽  
Zhibin Liang ◽  
David Parkes ◽  
...  
Keyword(s):  
Local Search ◽  
Objective Function ◽  
Iterative Process ◽  
Large Scale ◽  
Opinion Dynamics ◽  
Theoretical Models ◽  
Global Optimum ◽  
Local Optimum ◽  
Opinion Formation ◽  
Long Line

A long line of work in social psychology has studied variations in people’s susceptibility to persuasion—the extent to which they are willing to modify their opinions on a topic. This body of literature suggests an interesting perspective on theoretical models of opinion formation by interacting parties in a network: in addition to considering interventions that directly modify people’s intrinsic opinions, it is also natural to consider interventions that modify people’s susceptibility to persuasion. In this work, motivated by this fact, we propose an influence optimization problem. Specifically, we adopt a popular model for social opinion dynamics, where each agent has some fixed innate opinion, and a resistance that measures the importance it places on its innate opinion; agents influence one another’s opinions through an iterative process. Under certain conditions, this iterative process converges to some equilibrium opinion vector. For the unbudgeted variant of the problem, the goal is to modify the resistance of any number of agents (within some given range) such that the sum of the equilibrium opinions is minimized; for the budgeted variant, in addition the algorithm is given upfront a restriction on the number of agents whose resistance may be modified. We prove that the objective function is in general non-convex. Hence, formulating the problem as a convex program as in an early version of this work (Abebe et al., KDD’18) might have potential correctness issues. We instead analyze the structure of the objective function, and show that any local optimum is also a global optimum, which is somehow surprising as the objective function might not be convex. Furthermore, we combine the iterative process and the local search paradigm to design very efficient algorithms that can solve the unbudgeted variant of the problem optimally on large-scale graphs containing millions of nodes. Finally, we propose and evaluate experimentally a family of heuristics for the budgeted variant of the problem.

scholarly journals An Enhanced Multi-Objective Particle Swarm Optimization in Water Distribution Systems Design

Water ◽  
2021 ◽  
Vol 13 (10) ◽  
pp. 1334
Author(s):  
Mohamed R. Torkomany ◽  
Hassan Shokry Hassan ◽  
Amin Shoukry ◽  
Ahmed M. Abdelrazek ◽  
Mohamed Elkholy
Keyword(s):  
Particle Swarm Optimization ◽  
Local Search ◽  
Distribution Systems ◽  
Water Distribution ◽  
Water Distribution Systems ◽  
Particle Swarm ◽  
Large Network ◽  
Swarm Optimization ◽  
Original Algorithm ◽  
Multi Objective

The scarcity of water resources nowadays lays stress on researchers to develop strategies aiming at making the best benefit of the currently available resources. One of these strategies is ensuring that reliable and near-optimum designs of water distribution systems (WDSs) are achieved. Designing WDSs is a discrete combinatorial NP-hard optimization problem, and its complexity increases when more objectives are added. Among the many existing evolutionary algorithms, a new hybrid fast-convergent multi-objective particle swarm optimization (MOPSO) algorithm is developed to increase the convergence and diversity rates of the resulted non-dominated solutions in terms of network capital cost and reliability using a minimized computational budget. Several strategies are introduced to the developed algorithm, which are self-adaptive PSO parameters, regeneration-on-collision, adaptive population size, and using hypervolume quality for selecting repository members. A local search method is also coupled to both the original MOPSO algorithm and the newly developed one. Both algorithms are applied to medium and large benchmark problems. The results of the new algorithm coupled with the local search are superior to that of the original algorithm in terms of different performance metrics in the medium-sized network. In contrast, the new algorithm without the local search performed better in the large network.

Sign in / Sign up

Export Citation Format

Share Document