scholarly journals The Spiral Discovery Network as an Automated General-Purpose Optimization Tool

Complexity ◽  
2018 ◽  
Vol 2018 ◽  
pp. 1-8
Author(s):  
Adam B. Csapo
Keyword(s):  
Optimization Problems ◽  
General Purpose ◽  
Nonconvex Optimization Problems ◽  
Cognitive Artifact ◽  
Box Models ◽  
Simulation Based ◽  
Functional Patterns ◽  
Gradient Based ◽  
Update Rules ◽  
Discovery Method

The Spiral Discovery Method (SDM) was originally proposed as a cognitive artifact for dealing with black-box models that are dependent on multiple inputs with nonlinear and/or multiplicative interaction effects. Besides directly helping to identify functional patterns in such systems, SDM also simplifies their control through its characteristic spiral structure. In this paper, a neural network-based formulation of SDM is proposed together with a set of automatic update rules that makes it suitable for both semiautomated and automated forms of optimization. The behavior of the generalized SDM model, referred to as the Spiral Discovery Network (SDN), and its applicability to nondifferentiable nonconvex optimization problems are elucidated through simulation. Based on the simulation, the case is made that its applicability would be worth investigating in all areas where the default approach of gradient-based backpropagation is used today.

A Comprehensive Investigation of Ensembles of Gaussian-Based and Gradient-Based Transformed Reliability Analyses: When and How to Use Them

2016 ◽  
Author(s):  
Po Ting Lin ◽  
Wei-Hao Lu ◽  
Shu-Ping Lin
Keyword(s):  
Design Optimization ◽  
Design Space ◽  
Optimization Problems ◽  
Nonlinear Problems ◽  
Kernel Functions ◽  
Sensitivity Analyses ◽  
Normal Space ◽  
Highly Nonlinear ◽  
Standard Normal ◽  
Gradient Based

In the past few years, researchers have begun to investigate the existence of arbitrary uncertainties in the design optimization problems. Most traditional reliability-based design optimization (RBDO) methods transform the design space to the standard normal space for reliability analysis but may not work well when the random variables are arbitrarily distributed. It is because that the transformation to the standard normal space cannot be determined or the distribution type is unknown. The methods of Ensemble of Gaussian-based Reliability Analyses (EoGRA) and Ensemble of Gradient-based Transformed Reliability Analyses (EGTRA) have been developed to estimate the joint probability density function using the ensemble of kernel functions. EoGRA performs a series of Gaussian-based kernel reliability analyses and merged them together to compute the reliability of the design point. EGTRA transforms the design space to the single-variate design space toward the constraint gradient, where the kernel reliability analyses become much less costly. In this paper, a series of comprehensive investigations were performed to study the similarities and differences between EoGRA and EGTRA. The results showed that EGTRA performs accurate and effective reliability analyses for both linear and nonlinear problems. When the constraints are highly nonlinear, EGTRA may have little problem but still can be effective in terms of starting from deterministic optimal points. On the other hands, the sensitivity analyses of EoGRA may be ineffective when the random distribution is completely inside the feasible space or infeasible space. However, EoGRA can find acceptable design points when starting from deterministic optimal points. Moreover, EoGRA is capable of delivering estimated failure probability of each constraint during the optimization processes, which may be convenient for some applications.

scholarly journals Simulation-Based Power-Loss Optimization of General-Purpose High-Voltage SiC MOSFET Circuit Under High-Frequency Operation

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 23786-23794
Author(s):  
Abhishek Kar ◽  
Mitiko Miura-Mattausch ◽  
Mainak Sengupta ◽  
Dondee Navaroo ◽  
Hideyuki Kikuchihara ◽  
...  
Keyword(s):  
High Voltage ◽  
High Frequency ◽  
Power Loss ◽  
General Purpose ◽  
Simulation Based ◽  
High Frequency Operation

Multirow Intersection Cuts Based on the Infinity Norm

2021 ◽  
Author(s):  
Álinson S. Xavier ◽  
Ricardo Fukasawa ◽  
Laurent Poirrier
Keyword(s):  
Optimization Problems ◽  
Valid Inequalities ◽  
Linear Optimization ◽  
Computational Cost ◽  
General Purpose ◽  
Mixed Integer ◽  
Infinity Norm ◽  
Intersection Cuts ◽  
Linear Optimization Problems ◽  
Mixed Integer Linear Optimization

When generating multirow intersection cuts for mixed-integer linear optimization problems, an important practical question is deciding which intersection cuts to use. Even when restricted to cuts that are facet defining for the corner relaxation, the number of potential candidates is still very large, especially for instances of large size. In this paper, we introduce a subset of intersection cuts based on the infinity norm that is very small, works for relaxations having arbitrary number of rows and, unlike many subclasses studied in the literature, takes into account the entire data from the simplex tableau. We describe an algorithm for generating these inequalities and run extensive computational experiments in order to evaluate their practical effectiveness in real-world instances. We conclude that this subset of inequalities yields, in terms of gap closure, around 50% of the benefits of using all valid inequalities for the corner relaxation simultaneously, but at a small fraction of the computational cost, and with a very small number of cuts. Summary of Contribution: Cutting planes are one of the most important techniques used by modern mixed-integer linear programming solvers when solving a variety of challenging operations research problems. The paper advances the state of the art on general-purpose multirow intersection cuts by proposing a practical and computationally friendly method to generate them.

Finding Better Local Optima in Topology Optimization via Tunneling

2018 ◽  
Author(s):  
Shanglong Zhang ◽  
Julián A. Norato
Keyword(s):  
Topology Optimization ◽  
Optimization Problems ◽  
Structural Response ◽  
Free Form ◽  
Local Optima ◽  
Design Representation ◽  
Tunneling Method ◽  
Optimization Parameters ◽  
Gradient Based ◽  
Geometric Primitives

Topology optimization problems are typically non-convex, and as such, multiple local minima exist. Depending on the initial design, the type of optimization algorithm and the optimization parameters, gradient-based optimizers converge to one of those minima. Unfortunately, these minima can be highly suboptimal, particularly when the structural response is very non-linear or when multiple constraints are present. This issue is more pronounced in the topology optimization of geometric primitives, because the design representation is more compact and restricted than in free-form topology optimization. In this paper, we investigate the use of tunneling in topology optimization to move from a poor local minimum to a better one. The tunneling method used in this work is a gradient-based deterministic method that finds a better minimum than the previous one in a sequential manner. We demonstrate this approach via numerical examples and show that the coupling of the tunneling method with topology optimization leads to better designs.

scholarly journals Why Does Large Batch Training Result in Poor Generalization? A Comprehensive Explanation and a Better Strategy from the Viewpoint of Stochastic Optimization

2018 ◽  
Vol 30 (7) ◽  
pp. 2005-2023 ◽  
Author(s):  
Tomoumi Takase ◽  
Satoshi Oyama ◽  
Masahito Kurihara
Keyword(s):  
Gradient Descent ◽  
Optimization Problems ◽  
Descent Method ◽  
Batch Size ◽  
Gradient Descent Method ◽  
Neural Network Training ◽  
Nonconvex Optimization Problems ◽  
Large Batch ◽  
Network Training ◽  
Comprehensive Framework

We present a comprehensive framework of search methods, such as simulated annealing and batch training, for solving nonconvex optimization problems. These methods search a wider range by gradually decreasing the randomness added to the standard gradient descent method. The formulation that we define on the basis of this framework can be directly applied to neural network training. This produces an effective approach that gradually increases batch size during training. We also explain why large batch training degrades generalization performance, which previous studies have not clarified.

scholarly journals Improving the FLORIS wind plant model for compatibility with gradient-based optimization

2017 ◽  
Vol 41 (5) ◽  
pp. 313-329 ◽  
Author(s):  
Jared J Thomas ◽  
Pieter MO Gebraad ◽  
Andrew Ning
Keyword(s):  
Steady State ◽  
Wind Turbine ◽  
Case Studies ◽  
Wind Farm ◽  
Optimization Problems ◽  
Algorithmic Differentiation ◽  
Function Calls ◽  
Gradient Based ◽  
Wake Model ◽  
Yaw Angle

The FLORIS (FLOw Redirection and Induction in Steady-state) model, a parametric wind turbine wake model that predicts steady-state wake characteristics based on wind turbine position and yaw angle, was developed for optimization of control settings and turbine locations. This article provides details on changes made to the FLORIS model to make the model more suitable for gradient-based optimization. Changes to the FLORIS model were made to remove discontinuities and add curvature to regions of non-physical zero gradient. Exact gradients for the FLORIS model were obtained using algorithmic differentiation. A set of three case studies demonstrate that using exact gradients with gradient-based optimization reduces the number of function calls by several orders of magnitude. The case studies also show that adding curvature improves convergence behavior, allowing gradient-based optimization algorithms used with the FLORIS model to more reliably find better solutions to wind farm optimization problems.

Unsupervised color coding for visualizing image classification results

2017 ◽  
Vol 17 (2) ◽  
pp. 161-177 ◽  
Author(s):  
Simone Bianco ◽  
Raimondo Schettini
Keyword(s):  
Optimization Problems ◽  
General Purpose ◽  
Search Procedure ◽  
Color Coding ◽  
Class Label ◽  
Color Selection ◽  
Label Placement ◽  
Color Class ◽  
Local Search Procedure ◽  
Different Content

In this article, we describe a general purpose system that, given as input a segmented/classified image, automatically provides different visual outputs exploiting solid colors, color boundaries, and transparent colors. Moreover, if the names of the classes are given, the system automatically places a textual label in the less salient sub-region of the corresponding class. For color-class association and class label placement, we take into account the underlying image color and structure exploiting both saliency and superpixel representation. The color selection and the color-class association are formulated both as optimization problems and heuristically solved using a Local Search procedure. Results show the effectiveness of the proposed system on images having different content and different number of annotated regions.

Sign in / Sign up

Export Citation Format

Share Document