Unbiased Black-Box Complexities of Jump Functions

2015 ◽  
Vol 23 (4) ◽  
pp. 641-670 ◽  
Author(s):  
Benjamin Doerr ◽  
Carola Doerr ◽  
Timo Kötzing
Keyword(s):  
Polynomial Time ◽  
Optimization Algorithms ◽  
Optimal Solution ◽  
Search Space ◽  
Black Box ◽  
Jump Size ◽  
Small Constant ◽  
Jump Function

We analyze the unbiased black-box complexities of jump functions with small, medium, and large sizes of the fitness plateau surrounding the optimal solution. Among other results, we show that when the jump size is [Formula: see text], that is, when only a small constant fraction of the fitness values is visible, then the unbiased black-box complexities for arities 3 and higher are of the same order as those for the simple OneMax function. Even for the extreme jump function, in which all but the two fitness values [Formula: see text] and n are blanked out, polynomial time mutation-based (i.e., unary unbiased) black-box optimization algorithms exist. This is quite surprising given that for the extreme jump function almost the whole search space (all but a [Formula: see text] fraction) is a plateau of constant fitness. To prove these results, we introduce new tools for the analysis of unbiased black-box complexities, for example, selecting the new parent individual not only by comparing the fitnesses of the competing search points but also by taking into account the (empirical) expected fitnesses of their offspring.

scholarly journals Particle Swarm Optimization

2017 ◽  
pp. 614-635 ◽  
Author(s):  
Alaa Tharwat ◽  
Tarek Gaber ◽  
Aboul Ella Hassanien ◽  
Basem E. Elnaghi
Keyword(s):  
Particle Swarm Optimization ◽  
Optimization Algorithms ◽  
Particle Swarm ◽  
Optimal Solution ◽  
Parameter Tuning ◽  
Pso Algorithm ◽  
Search Space ◽  
Learning Problems ◽  
Swarm Optimization ◽  
Numerical Example

Optimization algorithms are necessary to solve many problems such as parameter tuning. Particle Swarm Optimization (PSO) is one of these optimization algorithms. The aim of PSO is to search for the optimal solution in the search space. This paper highlights the basic background needed to understand and implement the PSO algorithm. This paper starts with basic definitions of the PSO algorithm and how the particles are moved in the search space to find the optimal or near optimal solution. Moreover, a numerical example is illustrated to show how the particles are moved in a convex optimization problem. Another numerical example is illustrated to show how the PSO trapped in a local minima problem. Two experiments are conducted to show how the PSO searches for the optimal parameters in one-dimensional and two-dimensional spaces to solve machine learning problems.

scholarly journals Performance comparison of various probability gate assisted binary lightning search algorithm

2019 ◽  
Vol 8 (3) ◽  
pp. 299 ◽  
Author(s):  
Md Mainul Islam ◽  
Hussain Shareef ◽  
Mahmood Nagrial ◽  
Jamal Rizk ◽  
Ali Hellany ◽  
...  
Keyword(s):  
Transfer Functions ◽  
Search Algorithm ◽  
Optimization Algorithms ◽  
Optimal Solution ◽  
Search Space ◽  
Performance Comparison ◽  
Optimization Techniques ◽  
Natural Phenomenon ◽  
Heuristic Optimization ◽  
Quantum Bit

<div style="’text-align: justify;">Recently, many new nature-inspired optimization algorithms have been introduced to further enhance the computational intelligence optimization algorithms. Among them, lightning search algorithm(LSA) is a recent heuristic optimization method for resolving continuous problems. It mimics the natural phenomenon of lightning to find out the global optimal solution around the search space. In this paper, a suitable technique to formulate binary version of lightning search algorithm(BLSA) is presented. Three common probability transfer functions, namely, logistic sigmoid, tangent hyperbolic sigmoid and quantum bit rotating gate are investigated to be utilized in the original LSA. The performances of three transfer functions based BLSA is evaluated using various standard functions with different features and the results are compared with other four famous heuristic optimization techniques. The comparative study clearly reveals that tangent hyperbolic transfer function is the most suitable function that can be utilized in the binary version of LSA.</div>

scholarly journals Theoretical Analysis of Local Search and Simple Evolutionary Algorithms for the Generalized Travelling Salesperson Problem

2019 ◽  
Vol 27 (3) ◽  
pp. 525-558
Author(s):  
Mojgan Pourhassan ◽  
Frank Neumann
Keyword(s):  
Evolutionary Algorithms ◽  
Local Search ◽  
Polynomial Time ◽  
Theoretical Perspective ◽  
Optimal Solution ◽  
Search Space ◽  
Search Algorithms ◽  
Variable Neighbourhood Search ◽  
Local Search Algorithms ◽  
Travelling Salesperson Problem

The generalized travelling salesperson problem is an important NP-hard combinatorial optimization problem for which metaheuristics, such as local search and evolutionary algorithms, have been used very successfully. Two hierarchical approaches with different neighbourhood structures, namely a cluster-based approach and a node-based approach, have been proposed by Hu and Raidl ( 2008 ) for solving this problem. In this article, local search algorithms and simple evolutionary algorithms based on these approaches are investigated from a theoretical perspective. For local search algorithms, we point out the complementary abilities of the two approaches by presenting instances where they mutually outperform each other. Afterwards, we introduce an instance which is hard for both approaches when initialized on a particular point of the search space, but where a variable neighbourhood search combining them finds the optimal solution in polynomial time. Then we turn our attention to analysing the behaviour of simple evolutionary algorithms that use these approaches. We show that the node-based approach solves the hard instance of the cluster-based approach presented in Corus et al. ( 2016 ) in polynomial time. Furthermore, we prove an exponential lower bound on the optimization time of the node-based approach for a class of Euclidean instances.

Automatic Mining of Quantitative Association Rules with Gravitational Search Algorithm

2017 ◽  
Vol 27 (03) ◽  
pp. 343-372 ◽  
Author(s):  
Umit Can ◽  
Bilal Alatas
Keyword(s):  
Association Rules ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Fitness Function ◽  
Optimization Algorithms ◽  
Gravitational Search Algorithm ◽  
Search Space ◽  
Search Method ◽  
Quantitative Association Rules ◽  
Gravitational Search

The classical optimization algorithms are not efficient in solving complex search and optimization problems. Thus, some heuristic optimization algorithms have been proposed. In this paper, exploration of association rules within numerical databases with Gravitational Search Algorithm (GSA) has been firstly performed. GSA has been designed as search method for quantitative association rules from the databases which can be regarded as search space. Furthermore, determining the minimum values of confidence and support for every database which is a hard job has been eliminated by GSA. Apart from this, the fitness function used for GSA is very flexible. According to the interested problem, some parameters can be removed from or added to the fitness function. The range values of the attributes have been automatically adjusted during the time of mining of the rules. That is why there is not any requirements for the pre-processing of the data. Attributes interaction problem has also been eliminated with the designed GSA. GSA has been tested with four real databases and promising results have been obtained. GSA seems an effective search method for complex numerical sequential patterns mining, numerical classification rules mining, and clustering rules mining tasks of data mining.

Whale optimization algorithm based on lateral inhibition for image matching and vision-guided AUV docking

2020 ◽  
pp. 1-12
Author(s):  
Zheping Yan ◽  
Jinzhong Zhang ◽  
Jialing Tang
Keyword(s):  
Lateral Inhibition ◽  
Optimization Algorithm ◽  
Image Matching ◽  
Autonomous Underwater Vehicle ◽  
Optimal Solution ◽  
Search Space ◽  
Whale Optimization Algorithm ◽  
Inhibition Mechanism ◽  
Whale Optimization ◽  
Accuracy And Stability

The accuracy and stability of relative pose estimation of an autonomous underwater vehicle (AUV) and a target depend on whether the characteristics of the underwater image can be accurately and quickly extracted. In this paper, a whale optimization algorithm (WOA) based on lateral inhibition (LI) is proposed to solve the image matching and vision-guided AUV docking problem. The proposed method is named the LI-WOA. The WOA is motivated by the behavior of humpback whales, and it mainly imitates encircling prey, bubble-net attacking and searching for prey to obtain the globally optimal solution in the search space. The WOA not only balances exploration and exploitation but also has a faster convergence speed, higher calculation accuracy and stronger robustness than other approaches. The lateral inhibition mechanism can effectively perform image enhancement and image edge extraction to improve the accuracy and stability of image matching. The LI-WOA combines the optimization efficiency of the WOA and the matching accuracy of the LI mechanism to improve convergence accuracy and the correct matching rate. To verify its effectiveness and feasibility, the WOA is compared with other algorithms by maximizing the similarity between the original image and the template image. The experimental results show that the LI-WOA has a better average value, a higher correct rate, less execution time and stronger robustness than other algorithms. The LI-WOA is an effective and stable method for solving the image matching and vision-guided AUV docking problem.

scholarly journals Optimum Distribution System Expansion Planning Incorporating DG Based on N-1 Criterion for Sustainable System

2021 ◽  
Vol 13 (12) ◽  
pp. 6708
Author(s):  
Hamza Mubarak ◽  
Nurulafiqah Nadzirah Mansor ◽  
Hazlie Mokhlis ◽  
Mahazani Mohamad ◽  
Hasmaini Mohamad ◽  
...  
Keyword(s):  
Power Systems ◽  
Distribution System ◽  
Industrial Revolution ◽  
Optimal Solution ◽  
Search Space ◽  
Planning Problem ◽  
System Expansion ◽  
Optimum Distribution ◽  
Optimal Sizing ◽  
Expansion Planning

Demand for continuous and reliable power supply has significantly increased, especially in this Industrial Revolution 4.0 era. In this regard, adequate planning of electrical power systems considering persistent load growth, increased integration of distributed generators (DGs), optimal system operation during N-1 contingencies, and compliance to the existing system constraints are paramount. However, these issues need to be parallelly addressed for optimum distribution system planning. Consequently, the planning optimization problem would become more complex due to the various technical and operational constraints as well as the enormous search space. To address these considerations, this paper proposes a strategy to obtain one optimal solution for the distribution system expansion planning by considering N-1 system contingencies for all branches and DG optimal sizing and placement as well as fluctuations in the load profiles. In this work, a hybrid firefly algorithm and particle swarm optimization (FA-PSO) was proposed to determine the optimal solution for the expansion planning problem. The validity of the proposed method was tested on IEEE 33- and 69-bus systems. The results show that incorporating DGs with optimal sizing and location minimizes the investment and power loss cost for the 33-bus system by 42.18% and 14.63%, respectively, and for the 69-system by 31.53% and 12%, respectively. In addition, comparative studies were done with a different model from the literature to verify the robustness of the proposed method.

scholarly journals Benchmarking Quantum Annealing Against “Hard” Instances of the Bipartite Matching Problem

2021 ◽  
Vol 2 (2) ◽  
Author(s):  
Daniel Vert ◽  
Renaud Sirdey ◽  
Stéphane Louise
Keyword(s):  
Simulated Annealing ◽  
Polynomial Time ◽  
Optimal Solution ◽  
Quantum Computers ◽  
Quantum Annealing ◽  
Maximum Cardinality ◽  
Matching Problem ◽  
Bipartite Matching ◽  
Wave Device ◽  
D Wave

AbstractThis paper experimentally investigates the behavior of analog quantum computers as commercialized by D-Wave when confronted to instances of the maximum cardinality matching problem which is specifically designed to be hard to solve by means of simulated annealing. We benchmark a D-Wave “Washington” (2X) with 1098 operational qubits on various sizes of such instances and observe that for all but the most trivially small of these it fails to obtain an optimal solution. Thus, our results suggest that quantum annealing, at least as implemented in a D-Wave device, falls in the same pitfalls as simulated annealing and hence provides additional evidences suggesting that there exist polynomial-time problems that such a machine cannot solve efficiently to optimality. Additionally, we investigate the extent to which the qubits interconnection topologies explains these latter experimental results. In particular, we provide evidences that the sparsity of these topologies which, as such, lead to QUBO problems of artificially inflated sizes can partly explain the aforementioned disappointing observations. Therefore, this paper hints that denser interconnection topologies are necessary to unleash the potential of the quantum annealing approach.

scholarly journals Temporal concatenation for Markov decision processes

2021 ◽  
pp. 1-28
Author(s):  
Ruiyang Song ◽  
Kuang Xu
Keyword(s):  
Markov Decision Processes ◽  
Large Scale ◽  
Optimal Solution ◽  
Upper Bounds ◽  
Black Box ◽  
Decision Processes ◽  
Optimal Solutions ◽  
Wide Range ◽  
Markov Decision ◽  
Speed Up

We propose and analyze a temporal concatenation heuristic for solving large-scale finite-horizon Markov decision processes (MDP), which divides the MDP into smaller sub-problems along the time horizon and generates an overall solution by simply concatenating the optimal solutions from these sub-problems. As a “black box” architecture, temporal concatenation works with a wide range of existing MDP algorithms. Our main results characterize the regret of temporal concatenation compared to the optimal solution. We provide upper bounds for general MDP instances, as well as a family of MDP instances in which the upper bounds are shown to be tight. Together, our results demonstrate temporal concatenation's potential of substantial speed-up at the expense of some performance degradation.

Design Optimization Method for MR-Brake Actuators

2011 ◽  
Author(s):  
Ozan G. Erol ◽  
Hakan Gurocak ◽  
Berk Gonenc
Keyword(s):  
Optimal Solution ◽  
Volume Ratio ◽  
Optimization Methods ◽  
Search Space ◽  
Optimization Method ◽  
Friction Torque ◽  
Element Analysis ◽  
Taguchi Design Of Experiments ◽  
Variable Friction ◽  
Electronically Controllable

MR-brakes work by varying viscosity of a magnetorheological (MR) fluid inside the brake. This electronically controllable viscosity leads to variable friction torque generated by the actuator. A properly designed MR-brake can have a high torque-to-volume ratio which is quite desirable for an actuator. However, designing an MR-brake is a complex process as there are many parameters involved in the design which can affect the size and torque output significantly. The contribution of this study is a new design approach that combines the Taguchi design of experiments method with parameterized finite element analysis for optimization. Unlike the typical multivariate optimization methods, this approach can identify the dominant parameters of the design and allows the designer to only explore their interactions during the optimization process. This unique feature reduces the size of the search space and the time it takes to find an optimal solution. It normally takes about a week to design an MR-brake manually. Our interactive method allows the designer to finish the design in about two minutes. In this paper, we first present the details of the MR-brake design problem. This is followed by the details of our new approach. Next, we show how to design an MR-brake using this method. Prototype of a new brake was fabricated. Results of experiments with the prototype brake are very encouraging and are in close agreement with the theoretical performance predictions.

scholarly journals A Novel Method for Economic Dispatch with Across Neighborhood Search: A Case Study in a Provincial Power Grid, China

Complexity ◽  
2018 ◽  
Vol 2018 ◽  
pp. 1-18 ◽  
Author(s):  
Guojiang Xiong ◽  
Jing Zhang ◽  
Xufeng Yuan ◽  
Dongyuan Shi ◽  
Yu He ◽  
...  
Keyword(s):  
Power Grid ◽  
Economic Dispatch ◽  
Optimal Solution ◽  
Inequality Constraints ◽  
Search Space ◽  
Neighborhood Search ◽  
Solution Quality ◽  
Promising Alternative ◽  
Comparison Results ◽  
Population Based Algorithm

Economic dispatch (ED) is of cardinal significance for the power system operation. It is mathematically a typical complex nonlinear multivariable strongly coupled optimization problem with equality and inequality constraints, especially considering the valve-point effects. In order to effectively solve the problem, a simple yet very young and efficient population-based algorithm named across neighborhood search (ANS) is implemented in this paper. In ANS, a group of individuals collaboratively navigate through the search space for obtaining the optimal solution by simultaneously searching the neighborhoods of multiple superior solutions. Four benchmark test cases with diverse complexities and characteristics are firstly employed to comprehensively verify the feasibility and effectiveness of ANS. The experimental and comparison results fully demonstrate the superiority of ANS in terms of the final solution quality, convergence speed, robustness, and statistics. In addition, the sensitivities of ANS to variations of population size and across-search degree are studied. Furthermore, ANS is applied to a practical provincial power grid of China. All the comparison results consistently indicate that ANS is highly competitive and can be used as a promising alternative for ED problems.

Sign in / Sign up

Export Citation Format

Share Document