A Bayesian Approach to Simulated Annealing

1989 ◽  
Vol 3 (4) ◽  
pp. 453-475 ◽  
Author(s):  
P.J.M. Van Laarhoven ◽  
C.G.E. Boender ◽  
E.H.L. Aarts ◽  
A. H. G. Rinnooy Kan
Keyword(s):  
Markov Chain ◽  
Simulated Annealing ◽  
Probability Distribution ◽  
Posterior Distribution ◽  
Prior Distribution ◽  
Numerical Experiments ◽  
Optimization Problems ◽  
Probabilistic Algorithm ◽  
Unknown Parameters ◽  
Combinatorial Optimization Problems

Simulated annealing is a probabilistic algorithm for approximately solving large combinatorial optimization problems. The algorithm can mathematically be described as the generation of a series of Markov chains, in which each Markov chain can be viewed as the outcome of a random experiment with unknown parameters (the probability of sampling a cost function value). Assuming a probability distribution on the values of the unknown parameters (the prior distribution) and given the sequence of configurations resulting from the generation of a Markov chain, we use Bayes's theorem to derive the posterior distribution on the values of the parameters. Numerical experiments are described which show that the posterior distribution can be used to predict accurately the behavior of the algorithm corresponding to the next Markov chain. This information is also used to derive optimal rules for choosing some of the parameters governing the convergence of the algorithm.

scholarly journals A randomized adaptive trust region line search method

2020 ◽  
Vol 10 (2) ◽  
pp. 259-263
Author(s):  
Saman Babaie-Kafaki ◽  
Saeed Rezaee
Keyword(s):  
Simulated Annealing ◽  
Numerical Experiments ◽  
Line Search ◽  
Optimization Problems ◽  
Trust Region ◽  
Search Method ◽  
Test Problems ◽  
Unconstrained Optimization Problems ◽  
Line Search Method ◽  
Region Line

Hybridizing the trust region, line search and simulated annealing methods, we develop a heuristic algorithm for solving unconstrained optimization problems. We make some numerical experiments on a set of CUTEr test problems to investigate efficiency of the suggested algorithm. The results show that the algorithm is practically promising.

Matched Field Processing Based on the Simulated Annealing

2013 ◽  
Vol 651 ◽  
pp. 879-884
Author(s):  
Qi Wang ◽  
Ying Min Wang ◽  
Yan Ni Gou
Keyword(s):  
Global Optimization ◽  
Simulated Annealing ◽  
Combinatorial Optimization ◽  
Mediterranean Sea ◽  
Optimization Problem ◽  
Optimization Problems ◽  
Combinatorial Optimization Problem ◽  
Matched Field Processing ◽  
Combinatorial Optimization Problems ◽  
Passive Localization

The matched field processing (MFP) for localization usually needs to match all the replica fields in the observation sea with the received fields, and then find the maximum peaks in the matched results, so how to find the maximum in the results effectively and quickly is a problem. As known the classical simulated annealing (CSA) which has the global optimization capability is used widely for combinatorial optimization problems. For passive localization the position of the source can be recognized as a combinatorial optimization problem about range and depth, so a new matched field processing based on CSA is proposed. In order to evaluate the performance of this method, the normal mode was used to calculate the replica field. Finally the algorithm was evaluated by the dataset in the Mediterranean Sea in 1994. Comparing to the conventional matched field passive localization (CMFP), it can be conclude that the new one can localize optimum peak successfully where the output power of CMFP is maximum, meanwhile it is faster than CMFP.

A Simulated Annealing to Solve Four-Stage Open Shops with Parallel Machines

2013 ◽  
Vol 330 ◽  
pp. 843-847 ◽  
Author(s):  
Fuh Der Chou ◽  
Hui Mei Wang
Keyword(s):  
Simulated Annealing ◽  
Parallel Machines ◽  
Optimization Problems ◽  
Light Emitting Diode ◽  
Processing Route ◽  
Computational Results ◽  
Light Emitting ◽  
Combinatorial Optimization Problems ◽  
Benchmark Solutions ◽  
Completion Times

This paper considers the scheduling problem of the four-stage open shop with parallel machines per stage observed in the chip sorting operation of light emitting diode (LED) testing. In this operation, each job (epiwafer) should be processed by the four working stages without predetermined processing route in order to separate specific LED grades. The considered problem is one of hard combinatorial optimization problems which have not been received much attention in the literature. Due to its computational complexity, in this study, two simulated annealing (SA) algorithms with different initial solutions are proposed to minimize total weighted completion times of jobs. A set of twenty benchmark solutions from a five-job problem is used to evaluate the performances of two SAs. Computational results reveal that the algorithms perform efficient and effective whatever the dimensions of problems are small or large.

SIMULATED ANNEALING SCHEMES IN TRANSIENTLY CHAOTIC NEURAL NETWORK MODEL

2004 ◽  
Vol 18 (17n19) ◽  
pp. 2579-2584 ◽  
Author(s):  
Y. C. FENG ◽  
X. CAI
Keyword(s):  
Neural Network ◽  
Simulated Annealing ◽  
Combinatorial Optimization ◽  
Neural Network Model ◽  
Approximation Method ◽  
Optimization Problems ◽  
Chaotic Neural Network ◽  
Combinatorial Optimization Problems ◽  
Search Speed ◽  
Evolution Function

A transiently chaotic neural network (TCNN) is an approximation method for combinatorial optimization problems. The evolution function of self-back connect weight, called annealing function, influences the accurate and search speed of TCNN model. This paper analyzes two common annealing schemes. Furthermore we proposed a new subsection exponential annealing function. Finally, we compared these annealing schemes in TSP problem.

scholarly journals Reconfigurable Stochastic neurons based on tin oxide/MoS2 hetero-memristors for simulated annealing and the Boltzmann machine

2021 ◽  
Vol 12 (1) ◽  
Author(s):  
Xiaodong Yan ◽  
Jiahui Ma ◽  
Tong Wu ◽  
Aoyang Zhang ◽  
Jiangbin Wu ◽  
...  
Keyword(s):  
Simulated Annealing ◽  
Combinatorial Optimization ◽  
Tin Oxide ◽  
Optimization Problems ◽  
Process Efficiency ◽  
Np Hard ◽  
Boltzmann Machine ◽  
Combinatorial Optimization Problems ◽  
Cooling Strategies ◽  
Neuromorphic Hardware

AbstractNeuromorphic hardware implementation of Boltzmann Machine using a network of stochastic neurons can allow non-deterministic polynomial-time (NP) hard combinatorial optimization problems to be efficiently solved. Efficient implementation of such Boltzmann Machine with simulated annealing desires the statistical parameters of the stochastic neurons to be dynamically tunable, however, there has been limited research on stochastic semiconductor devices with controllable statistical distributions. Here, we demonstrate a reconfigurable tin oxide (SnOx)/molybdenum disulfide (MoS2) heterogeneous memristive device that can realize tunable stochastic dynamics in its output sampling characteristics. The device can sample exponential-class sigmoidal distributions analogous to the Fermi-Dirac distribution of physical systems with quantitatively defined tunable “temperature” effect. A BM composed of these tunable stochastic neuron devices, which can enable simulated annealing with designed “cooling” strategies, is conducted to solve the MAX-SAT, a representative in NP-hard combinatorial optimization problems. Quantitative insights into the effect of different “cooling” strategies on improving the BM optimization process efficiency are also provided.

scholarly journals Estimates of objective function minimum for solving linear fractional unconstrained combinatorial optimization problems on arrangements

2021 ◽  
pp. 32-36
Author(s):  
Tetiana Barbolina
Keyword(s):  
Combinatorial Optimization ◽  
Objective Function ◽  
Numerical Experiments ◽  
Polynomial Algorithm ◽  
Optimization Problems ◽  
Finite Sequence ◽  
Feasible Set ◽  
Combinatorial Optimization Problems ◽  
Unconstrained Problems

The paper is devoted to the study of one class of Euclidean combinatorial optimization problems — combinatorial optimization problems on the general set of arrangements with linear fractional objective function and without additional (non-combinatorial) constraints. The paper substantiates the improvement of the polynomial algorithm for solving the specified class of problems. This algorithm foresees solving a finite sequence of linear unconstrained problems of combinatorial optimization on arrangements. The modification of the algorithm is based on the use of estimates of the objective function on the feasible set. This allows to exclude some of the problems from consideration and reduce the number of problems to be solved. The numerical experiments confirm the practical efficiency of the proposed approach.

Chaotic Walk in Simulated Annealing Search Space for Task Allocation in a Multiprocessing System

2013 ◽  
Vol 7 (3) ◽  
pp. 58-79 ◽  
Author(s):  
Ken Ferens ◽  
Darcy Cook ◽  
Witold Kinsner
Keyword(s):  
Simulated Annealing ◽  
Task Allocation ◽  
Intelligent Systems ◽  
Optimization Problems ◽  
Solution Space ◽  
Search Space ◽  
Global Optimum ◽  
Processor Allocation ◽  
Combinatorial Optimization Problems ◽  
Chaotic Simulated Annealing

This paper proposes the application of chaos in large search space problems, and suggests that this represents the next evolutionary step in the development of adaptive and intelligent systems towards cognitive machines and systems. Three different versions of chaotic simulated annealing (XSA) were applied to combinatorial optimization problems in multiprocessor task allocation. Chaotic walks in the solution space were taken to search for the global optimum or “good enough” task-to-processor allocation solutions. Chaotic variables were generated to set the number of perturbations made in each iteration of a XSA algorithm. In addition, parameters of a chaotic variable generator were adjusted to create different chaotic distributions with which to search the solution space. The results show that the convergence rate of the XSA algorithm is faster than simulated annealing when the solutions are far apart in the solution space. In particular, the XSA algorithms found simulated annealing’s best result on average about 4 times faster than simulated annealing.

Microcanonical Optimization Applied to the Traveling Salesman Problem

1998 ◽  
Vol 09 (01) ◽  
pp. 133-146 ◽  
Author(s):  
Alexandre Linhares ◽  
José R. A. Torreão
Keyword(s):  
Simulated Annealing ◽  
Traveling Salesman Problem ◽  
Optimization Problems ◽  
Search Algorithm ◽  
New Physics ◽  
Traveling Salesman ◽  
Tabu Search Algorithm ◽  
Combinatorial Optimization Problems ◽  
Microcanonical Annealing ◽  
The Traveling Salesman Problem

Optimization strategies based on simulated annealing and its variants have been extensively applied to the traveling salesman problem (TSP). Recently, there has appeared a new physics-based metaheuristic, called the microcanonical optimization algorithm (μO), which does not resort to annealing, and which has proven a superior alternative to the annealing procedures in various applications. Here we present the first performance evaluation of μO as applied to the TSP. When compared to three annealing strategies (simulated annealing, microcanonical annealing and Tsallis annealing), and to a tabu search algorithm, the microcanonical optimization has yielded the best overall results for several instances of the euclidean TSP. This confirms μO as a competitive approach for the solution of general combinatorial optimization problems.

Sign in / Sign up

Export Citation Format

Share Document