Accelerating gradient-based topology optimization design with dual-model artificial neural networks

2020 ◽  
Author(s):  
Chao Qian ◽  
Wenjing Ye
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Topology Optimization ◽  
Optimization Design ◽  
Dual Model ◽  
Gradient Based ◽  
Artificial Neural

Building hydrological single-model ensembles using artificial neural networks and a combinatorial optimization approach

2021 ◽  
Author(s):  
Juan F. Farfán-Durán ◽  
Luis Cea
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Goodness Of Fit ◽  
Hydrological Model ◽  
Hill Climbing ◽  
Single Model ◽  
Pearson Coefficient ◽  
Gradient Based ◽  
Artificial Neural ◽  
Model Ensembles

<p>In recent years, the application of model ensembles has received increasing attention in the hydrological modelling community due to the interesting results reported in several studies carried out in different parts of the world. The main idea of these approaches is to combine the results of the same hydrological model or a number of different hydrological models in order to obtain more robust, better-fitting models, reducing at the same time the uncertainty in the predictions. The techniques for combining models range from simple approaches such as averaging different simulations, to more complex techniques such as least squares, genetic algorithms and more recently artificial intelligence techniques such as Artificial Neural Networks (ANN).</p><p>Despite the good results that model ensembles are able to provide, the models selected to build the ensemble have a direct influence on the results. Contrary to intuition, it has been reported that the best fitting single models do not necessarily produce the best ensemble. Instead, better results can be obtained with ensembles that incorporate models with moderate goodness of fit. This implies that the selection of the single models might have a random component in order to maximize the results that ensemble approaches can provide.</p><p>The present study is carried out using hydrological data on an hourly scale between 2008 and 2015 corresponding to the Mandeo basin, located in the Northwest of Spain. In order to obtain 1000 single models, a hydrological model was run using 1000 sets of parameters sampled randomly in their feasible space. Then, we have classified the models in 3 groups with the following characteristics: 1) The 25 single models with highest Nash-Sutcliffe coefficient, 2) The 25 single models with the highest Pearson coefficient, and 3) The complete group of 1000 single models.</p><p>The ensemble models are built with 5 models as the input of an ANN and the observed series as the output. Then, we applied the Random-Restart Hill-Climbing (RRHC) algorithm choosing 5 random models in each iteration to re-train the ANN in order to identify a better ensemble. The algorithm is applied to build 50 ensembles in each group of models. Finally, the results are compared to those obtained by optimizing the model using a gradient-based method by means of the following goodness-of-fit measures: Nash-Sutcliffe (NSE) coefficient, adapted for high flows Nash-Sutcliffe (HF−NSE), adapted for low flows Nash-Sutcliffe (LF−W NSE) and coefficient of determination (R2).</p><p>The results show that the RRHC algorithm can identify adequate ensembles. The ensembles built using the group of models selected based on the NSE outperformed the model optimized by the gradient method in 64 % of the cases in at least 3 of 4 coefficients, both in the calibration and validation stages. Followed by the ensembles built with the group of models selected based on the Pearson coefficient with 56 %. In the case of the third group, no ensembles were identified that outperformed the gradient-based method. However, the most part of the ensembles outperformed the 1000 individual models.</p><p><strong>Keywords: Multi-model ensemble; Single-model ensemble; Artificial Neural Networks; Hydrological Model; Random-restart Hill-climbing</strong></p><p> </p>

Weights Direct Determination of Feedforward Neural Networks without Iterative BP-Training

2010 ◽  
pp. 197-225 ◽  
Author(s):  
Yunong Zhang ◽  
Ning Tan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Direct Determination ◽  
Bp Neural Networks ◽  
Learning Rates ◽  
The Neural Network ◽  
Gradient Based ◽  
Artificial Neural ◽  
Output Behavior

Artificial neural networks (ANN), especially with error back-propagation (BP) training algorithms, have been widely investigated and applied in various science and engineering fields. However, the BP algorithms are essentially gradient-based iterative methods, which adjust the neural-network weights to bring the network input/output behavior into a desired mapping by taking a gradient-based descent direction. This kind of iterative neural-network (NN) methods has shown some inherent weaknesses, such as, 1) the possibility of being trapped into local minima, 2) the difficulty in choosing appropriate learning rates, and 3) the inability to design the optimal or smallest NN-structure. To resolve such weaknesses of BP neural networks, we have asked ourselves a special question: Could neural-network weights be determined directly without iterative BP-training? The answer appears to be YES, which is demonstrated in this chapter with three positive but different examples. In other words, a new type of artificial neural networks with linearly-independent or orthogonal activation functions, is being presented, analyzed, simulated and verified by us, of which the neural-network weights and structure could be decided directly and more deterministically as well (in comparison with usual conventional BP neural networks).

Determination of S-N curves with the application of artificial neural networks

1999 ◽  
Vol 22 (8) ◽  
pp. 723-728 ◽  
Author(s):  
Artymiak ◽  
Bukowski ◽  
Feliks ◽  
Narberhaus ◽  
Zenner
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Artificial Neural

FUTURE OF ARTIFICIAL NEURAL NETWORKS IN SPACE EXPLORATION AND SPACE ENGINEERING

2018 ◽  
pp. 6-11
Author(s):  
Kobiljon Kh. Zoidov ◽  
◽  
Svetlana V. Ponomareva ◽  
Daniel I. Serebryansky ◽  
◽  
...  
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Space Exploration ◽  
Artificial Neural
Sign in / Sign up

Export Citation Format

Share Document