Convergence in Evolutionary Programs with Self-Adaptation

2001 ◽  
Vol 9 (2) ◽  
pp. 147-157 ◽  
Author(s):  
Garrison W. Greenwood ◽  
Qiji J. Zhu

Evolutionary programs are capable of finding good solutions to difficult optimization problems. Previous analysis of their convergence properties has normally assumed the strategy parameters are kept constant, although in practice these parameters are dynamically altered. In this paper, we propose a modified version of the 1/5-success rule for self-adaptation in evolution strategies (ES). Formal proofs of the long-term behavior produced by our self-adaptation method are included. Both elitist and non-elitist ES variants are analyzed. Preliminary tests indicate an ES with our modified self-adaptation method compares favorably to both a non-adapted ES and a 1/5-success rule adapted ES.

2013 ◽  
Vol 21 (1) ◽  
pp. 29-64 ◽  
Author(s):  
Rui Li ◽  
Michael T.M. Emmerich ◽  
Jeroen Eggermont ◽  
Thomas Bäck ◽  
M. Schütz ◽  
...  

Evolution strategies (ESs) are powerful probabilistic search and optimization algorithms gleaned from biological evolution theory. They have been successfully applied to a wide range of real world applications. The modern ESs are mainly designed for solving continuous parameter optimization problems. Their ability to adapt the parameters of the multivariate normal distribution used for mutation during the optimization run makes them well suited for this domain. In this article we describe and study mixed integer evolution strategies (MIES), which are natural extensions of ES for mixed integer optimization problems. MIES can deal with parameter vectors consisting not only of continuous variables but also with nominal discrete and integer variables. Following the design principles of the canonical evolution strategies, they use specialized mutation operators tailored for the aforementioned mixed parameter classes. For each type of variable, the choice of mutation operators is governed by a natural metric for this variable type, maximal entropy, and symmetry considerations. All distributions used for mutation can be controlled in their shape by means of scaling parameters, allowing self-adaptation to be implemented. After introducing and motivating the conceptual design of the MIES, we study the optimality of the self-adaptation of step sizes and mutation rates on a generalized (weighted) sphere model. Moreover, we prove global convergence of the MIES on a very general class of problems. The remainder of the article is devoted to performance studies on artificial landscapes (barrier functions and mixed integer NK landscapes), and a case study in the optimization of medical image analysis systems. In addition, we show that with proper constraint handling techniques, MIES can also be applied to classical mixed integer nonlinear programming problems.


2021 ◽  
Vol 1756 ◽  
pp. 147334
Author(s):  
Charles Budaszewski Pinto ◽  
Natividade de Sá Couto-Pereira ◽  
Felipe Kawa Odorcyk ◽  
Kamila Cagliari Zenki ◽  
Carla Dalmaz ◽  
...  

2021 ◽  
Vol 11 (2) ◽  
pp. 609
Author(s):  
Tadeusz Chyży ◽  
Monika Mackiewicz

The conception of special finite elements called multi-area elements for the analysis of structures with different stiffness areas has been presented in the paper. A new type of finite element has been determined in order to perform analyses and calculations of heterogeneous, multi-coherent, and layered structures using fewer finite elements and it provides proper accuracy of the results. The main advantage of the presented special multi-area elements is the possibility that areas of the structure with different stiffness and geometrical parameters can be described by single element integrated in subdivisions (sub-areas). The formulation of such elements has been presented with the example of one-dimensional elements. The main idea of developed elements is the assumption that the deformation field inside the element is dependent on its geometry and stiffness distribution. The deformation field can be changed and adjusted during the calculation process that is why such elements can be treated as self-adaptive. The application of the self-adaptation method on strain field should simplify the analysis of complex non-linear problems and increase their accuracy. In order to confirm the correctness of the established assumptions, comparative analyses have been carried out and potential areas of application have been indicated.


1997 ◽  
Vol 07 (11) ◽  
pp. 2487-2499 ◽  
Author(s):  
Rabbijah Guder ◽  
Edwin Kreuzer

In order to predict the long term behavior of nonlinear dynamical systems the generalized cell mapping is an efficient and powerful method for numerical analysis. For this reason it is of interest to know under what circumstances dynamical quantities of the generalized cell mapping (like persistent groups, stationary densities, …) reflect the dynamics of the system (attractors, invariant measures, …). In this article we develop such connections between the generalized cell mapping theory and the theory of nonlinear dynamical systems. We prove that the generalized cell mapping is a discretization of the Frobenius–Perron operator. By applying the results obtained for the Frobenius–Perron operator to the generalized cell mapping we outline for some classes of transformations that the stationary densities of the generalized cell mapping converges to an invariant measure of the system. Furthermore, we discuss what kind of measures and attractors can be approximated by this method.


2007 ◽  
Vol 133 (9) ◽  
pp. 1307-1315 ◽  
Author(s):  
M. Fragiacomo ◽  
R. M. Gutkowski ◽  
J. Balogh ◽  
R. S. Fast
Keyword(s):  

2015 ◽  
Vol 2015 ◽  
pp. 1-10 ◽  
Author(s):  
V. Gonuguntla ◽  
R. Mallipeddi ◽  
Kalyana C. Veluvolu

Differential evolution (DE) is simple and effective in solving numerous real-world global optimization problems. However, its effectiveness critically depends on the appropriate setting of population size and strategy parameters. Therefore, to obtain optimal performance the time-consuming preliminary tuning of parameters is needed. Recently, different strategy parameter adaptation techniques, which can automatically update the parameters to appropriate values to suit the characteristics of optimization problems, have been proposed. However, most of the works do not control the adaptation of the population size. In addition, they try to adapt each strategy parameters individually but do not take into account the interaction between the parameters that are being adapted. In this paper, we introduce a DE algorithm where both strategy parameters are self-adapted taking into account the parameter dependencies by means of a multivariate probabilistic technique based on Gaussian Adaptation working on the parameter space. In addition, the proposed DE algorithm starts by sampling a huge number of sample solutions in the search space and in each generation a constant number of individuals from huge sample set are adaptively selected to form the population that evolves. The proposed algorithm is evaluated on 14 benchmark problems of CEC 2005 with different dimensionality.


Author(s):  
Panpan Zhang ◽  
Anhui Gu

This paper is devoted to the long-term behavior of nonautonomous random lattice dynamical systems with nonlinear diffusion terms. The nonlinear drift and diffusion terms are not expected to be Lipschitz continuous but satisfy the continuity and growth conditions. We first prove the existence of solutions, and establish the existence of a multi-valued nonautonomous cocycle. We then show the existence and uniqueness of pullback attractors parameterized by sample parameters. Finally, we establish the measurability of this pullback attractor by the method based on the weak upper semicontinuity of the solutions.


Sign in / Sign up

Export Citation Format

Share Document