scholarly journals Simulated Annealing with Exploratory Sensing for Global Optimization

Algorithms ◽  
2020 ◽  
Vol 13 (9) ◽  
pp. 230
Author(s):  
Majid Almarashi ◽  
Wael Deabes ◽  
Hesham H. Amin ◽  
Abdel-Rahman Hedar
Keyword(s):  
Global Optimization ◽  
Simulated Annealing ◽  
Initial Temperature ◽  
Search Algorithm ◽  
Random Search ◽  
Search Space ◽  
Search Algorithms ◽  
Two Phases ◽  
Number Of Iterations

Simulated annealing is a well-known search algorithm used with success history in many search problems. However, the random walk of the simulated annealing does not benefit from the memory of visited states, causing excessive random search with no diversification history. Unlike memory-based search algorithms such as the tabu search, the search in simulated annealing is dependent on the choice of the initial temperature to explore the search space, which has little indications of how much exploration has been carried out. The lack of exploration eye can affect the quality of the found solutions while the nature of the search in simulated annealing is mainly local. In this work, a methodology of two phases using an automatic diversification and intensification based on memory and sensing tools is proposed. The proposed method is called Simulated Annealing with Exploratory Sensing. The computational experiments show the efficiency of the proposed method in ensuring a good exploration while finding good solutions within a similar number of iterations.

scholarly journals Heterogeneous Simulated Annealing Teams: An Optimizing Search Algorithm Inspired by Engineering Design Teams

2018 ◽  
Author(s):  
Christopher McComb ◽  
Jonathan Cagan ◽  
Kenneth Kotovsky
Keyword(s):  
Simulated Annealing ◽  
Engineering Design ◽  
Simulated Annealing Algorithm ◽  
Search Algorithm ◽  
Random Search ◽  
Design Teams ◽  
Design Cognition ◽  
Gradient Based ◽  
Multi Agent ◽  
Annealing Algorithms

Although insights uncovered by design cognition are often utilized to develop the methods used by human designers, using such insights to inform computational methodologies also has the potential to improve the performance of design algorithms. This paper uses insights from research on design cognition and design teams to inform a better simulated annealing search algorithm. Simulated annealing has already been established as a model of individual problem solving. This paper introduces the Heterogeneous Simulated Annealing Team (HSAT) algorithm, a multi-agent simulated annealing algorithm. Each agent controls an adaptive annealing schedule, allowing the team develop heterogeneous search strategies. Such diversity is a natural part of engineering design, and boosts performance in other multi-agent algorithms. Further, interaction between agents in HSAT is structured to mimic interaction between members of a design team. Performance is compared to several other simulated annealing algorithms, a random search algorithm, and a gradient-based algorithm. Compared to other algorithms, the team-based HSAT algorithm returns better average results with lower variance.

scholarly journals The Importance of Transfer Function in Solving Set-Union Knapsack Problem Based on Discrete Moth Search Algorithm

Mathematics ◽  
2018 ◽  
Vol 7 (1) ◽  
pp. 17 ◽  
Author(s):  
Yanhong Feng ◽  
Haizhong An ◽  
Xiangyun Gao
Keyword(s):  
Transfer Function ◽  
Knapsack Problem ◽  
Transfer Functions ◽  
Optimization Problems ◽  
Search Algorithm ◽  
Continuous Optimization ◽  
Search Space ◽  
Discrete Search ◽  
Continuous Optimization Problems

Moth search (MS) algorithm, originally proposed to solve continuous optimization problems, is a novel bio-inspired metaheuristic algorithm. At present, there seems to be little concern about using MS to solve discrete optimization problems. One of the most common and efficient ways to discretize MS is to use a transfer function, which is in charge of mapping a continuous search space to a discrete search space. In this paper, twelve transfer functions divided into three families, S-shaped (named S1, S2, S3, and S4), V-shaped (named V1, V2, V3, and V4), and other shapes (named O1, O2, O3, and O4), are combined with MS, and then twelve discrete versions MS algorithms are proposed for solving set-union knapsack problem (SUKP). Three groups of fifteen SUKP instances are employed to evaluate the importance of these transfer functions. The results show that O4 is the best transfer function when combined with MS to solve SUKP. Meanwhile, the importance of the transfer function in terms of improving the quality of solutions and convergence rate is demonstrated as well.

A Novel Non-Decreasing Temperature Based Simulated Annealing for Flow Shop Problems

2015 ◽  
Vol 764-765 ◽  
pp. 1390-1394
Author(s):  
Ruey Maw Chen ◽  
Frode Eika Sandnes
Keyword(s):  
Simulated Annealing ◽  
Flow Shop ◽  
State Of The Art ◽  
Computation Time ◽  
Search Space ◽  
Control Mechanisms ◽  
Flow Shop Problem ◽  
Simple Implementation ◽  
Two Phases ◽  
Permutation Schedule

The permutation flow shop problem (PFSP) is an NP-hard permutation sequencing scheduling problem, many meta-heuristics based schemes have been proposed for finding near optimal solutions. A simple insertion simulated annealing (SISA) scheme consisting of two phases is proposed for solving PFSP. First, to reduce the complexity, a simple insertion local search is conducted for constructing the solution. Second, to ensure continuous exploration in the search space, two non-decreasing temperature control mechanisms named Heating SA and Steady SA are introduced in a simulated annealing (SA) procedure. The Heating SA increases the exploration search ability and the Steady SA enhances the exploitation search ability. The most important feature of SISA is its simple implementation and low computation time complexity. Experimental results are compared with other state-of-the-art algorithms and reveal that SISA is able to efficiently yield good permutation schedule.

scholarly journals Combining Interval Branch and Bound and Stochastic Search

2014 ◽  
Vol 2014 ◽  
pp. 1-15
Author(s):  
Dhiranuch Bunnag
Keyword(s):  
Genetic Algorithm ◽  
Simulated Annealing ◽  
Branch And Bound ◽  
Lower Cost ◽  
Search Algorithms ◽  
Stochastic Search ◽  
Constrained Problems ◽  
Interval Branch And Bound ◽  
Unconstrained Problems

This paper presents global optimization algorithms that incorporate the idea of an interval branch and bound and the stochastic search algorithms. Two algorithms for unconstrained problems are proposed, the hybrid interval simulated annealing and the combined interval branch and bound and genetic algorithm. The numerical experiment shows better results compared to Hansen’s algorithm and simulated annealing in terms of the storage, speed, and number of function evaluations. The convergence proof is described. Moreover, the idea of both algorithms suggests a structure for an integrated interval branch and bound and genetic algorithm for constrained problems in which the algorithm is described and tested. The aim is to capture one of the solutions with higher accuracy and lower cost. The results show better quality of the solutions with less number of function evaluations compared with the traditional GA.

scholarly journals An Evolutionary Approach to Improve the Halftoning Process

Mathematics ◽  
2020 ◽  
Vol 8 (9) ◽  
pp. 1636
Author(s):  
Noé Ortega-Sánchez ◽  
Diego Oliva ◽  
Erik Cuevas ◽  
Marco Pérez-Cisneros ◽  
Angel A. Juan
Keyword(s):  
Visual Information ◽  
Search Algorithm ◽  
Harmony Search ◽  
Similarity Index ◽  
Structural Similarity ◽  
Search Space ◽  
Adaptive Method ◽  
Harmony Search Algorithm ◽  
Efficient Exploration

The techniques of halftoning are widely used in marketing because they reduce the cost of impression and maintain the quality of graphics. Halftoning converts a digital image into a binary image conformed by dots. The output of the halftoning contains less visual information; a possible benefit of this task is the reduction of ink when graphics are printed. The human eye is not able to detect the absence of information, but the printed image stills have good quality. The most used method for halftoning is called Floyd-Steinberger, and it defines a specific matrix for the halftoning conversion. However, most of the proposed techniques in halftoning use predefined kernels that do not permit adaptation to different images. This article introduces the use of the harmony search algorithm (HSA) for halftoning. The HSA is a popular evolutionary algorithm inspired by the musical improvisation. The different operators of the HSA permit an efficient exploration of the search space. The HSA is applied to find the best configuration of the kernel in halftoning; meanwhile, as an objective function, the use of the structural similarity index (SSIM) is proposed. A set of rules are also introduced to reduce the regular patterns that could be created by non-appropriate kernels. The SSIM is used due to the fact that it is a perception model used as a metric that permits comparing images to interpret the differences between them numerically. The aim of combining the HSA with the SSIM for halftoning is to generate an adaptive method that permits estimating the best kernel for each image based on its intrinsic attributes. The graphical quality of the proposed algorithm has been compared with classical halftoning methodologies. Experimental results and comparisons provide evidence regarding the quality of the images obtained by the proposed optimization-based approach. In this context, classical algorithms have a lower graphical quality in comparison with our proposal. The results have been validated by a statistical analysis based on independent experiments over the set of benchmark images by using the mean and standard deviation.

scholarly journals Random search with k -prototypes algorithm for clustering mixed datasets

2011 ◽  
Vol 467 (2132) ◽  
pp. 2387-2403 ◽  
Author(s):  
Duc-Truong Pham ◽  
Maria M. Suarez-Alvarez ◽  
Yuriy I. Prostov
Keyword(s):  
Optimization Algorithm ◽  
Random Search ◽  
Search Space ◽  
Population Based ◽  
The Other ◽  
Bees Algorithm ◽  
Neighbourhood Search ◽  
Promising Solution ◽  
Number Of Iterations ◽  
Selection Of

A new algorithm to cluster datasets with mixed numerical and categorical values is presented. The algorithm, called RANKPRO (random search with k -prototypes algorithm), combines the advantages of a recently introduced population-based optimization algorithm called the bees algorithm (BA) and k -prototypes algorithm. The BA works with elite and good solutions, and continues to look for other possible extrema solutions keeping the number of testing points constant. However, the improvement of promising solutions by the BA may be time-consuming because it is based on random neighbourhood search. On the other hand, an application of the k -prototypes algorithm to a promising solution may be very effective because it improves the solution at each iteration. The RANKPRO algorithm balances two objectives: it explores the search space effectively owing to random selection of new solutions, and improves promising solutions fast owing to employment of the k -prototypes algorithm. The efficiency of the new algorithm is demonstrated by clustering several datasets. It is shown that in the majority of the considered datasets when the average number of iterations that the k -prototypes algorithm needs to converge is over 10, the RANKPRO algorithm is more efficient than the k -prototypes algorithm.

scholarly journals Composite Differential Search Algorithm

2014 ◽  
Vol 2014 ◽  
pp. 1-15 ◽  
Author(s):  
Bo Liu
Keyword(s):  
Convergence Rate ◽  
Optimization Problem ◽  
Search Algorithm ◽  
Search Algorithms ◽  
Control Parameters ◽  
Original Algorithm ◽  
New Space ◽  
Random Method ◽  
Better Than

Differential search algorithm (DS) is a relatively new evolutionary algorithm inspired by the Brownian-like random-walk movement which is used by an organism to migrate. It has been verified to be more effective than ABC, JDE, JADE, SADE, EPSDE, GSA, PSO2011, and CMA-ES. In this paper, we propose four improved solution search algorithms, namely “DS/rand/1,” “DS/rand/2,” “DS/current to rand/1,” and “DS/current to rand/2” to search the new space and enhance the convergence rate for the global optimization problem. In order to verify the performance of different solution search methods, 23 benchmark functions are employed. Experimental results indicate that the proposed algorithm performs better than, or at least comparable to, the original algorithm when considering the quality of the solution obtained. However, these schemes cannot still achieve the best solution for all functions. In order to further enhance the convergence rate and the diversity of the algorithm, a composite differential search algorithm (CDS) is proposed in this paper. This new algorithm combines three new proposed search schemes including “DS/rand/1,” “DS/rand/2,” and “DS/current to rand/1” with three control parameters using a random method to generate the offspring. Experiment results show that CDS has a faster convergence rate and better search ability based on the 23 benchmark functions.

A Multilevel Hypergraph Partitioning Algorithm Based on Simulated Annealing

2013 ◽  
Vol 753-755 ◽  
pp. 2908-2911
Author(s):  
Yao Yuan Zeng ◽  
Wen Tao Zhao ◽  
Zheng Hua Wang
Keyword(s):  
Global Optimization ◽  
Simulated Annealing ◽  
Combinatorial Optimization ◽  
Unstructured Meshes ◽  
Running Time ◽  
Hypergraph Partitioning ◽  
Benchmark Suite ◽  
Partitioning Algorithm ◽  
Better Than

Multilevel hypergraph partitioning is a significant and extensively researched problem in combinatorial optimization. In this paper, we present a multilevel hypergraph partitioning algorithm based on simulated annealing approach for global optimization. Experiments on the benchmark suite of several unstructured meshes show that, for 2-, 4-, 8-, 16-and 32-way partitioning, although more running time was demanded, the quality of partition produced by our algorithm are on the average 14% and the maximum 22% better than those produced by partitioning software hMETIS in term of the SOED metric.

scholarly journals A bi-level optimization model for grouping constrained storage location assignment problems

2021 ◽  
Author(s):  
Jing Xie ◽  
Yi Mei ◽  
Andreas T Ernst ◽  
Xiaodong Li ◽  
Andy Song
Keyword(s):  
Tabu Search ◽  
Search Algorithm ◽  
Random Search ◽  
Search Space ◽  
Search Method ◽  
Fitness Evaluation ◽  
Random Search Method ◽  
Storage Location ◽  
Location Assignment ◽  
Upper Level

In this paper, a novel bi-level grouping optimization (BIGO) model is proposed for solving the storage location assignment problem with grouping constraint (SLAP-GC). A major challenge in this problem is the grouping constraint which restricts the number of groups each product can have and the locations of items in the same group. In SLAP-GC, the problem consists of two subproblems, one is how to group the items, and the other one is how to assign the groups to locations. It is an arduous task to solve the two subproblems simultaneously. To overcome this difficulty, we propose a BIGO. BIGO optimizes item grouping in the upper level, and uses the lower-level optimization to evaluate each item grouping. Sophisticated fitness evaluation and search operators are designed for both upper and lower level optimization so that the feasibility of solutions can be guaranteed, and the search can focus on promising areas in the search space. Based on the BIGO model, a multistart random search method and a tabu search algorithm are proposed. The experimental results on the real-world dataset validate the efficacy of the BIGO model and the advantage of the tabu search method over the random search method. © 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Sign in / Sign up

Export Citation Format

Share Document