scholarly journals Neural Networks in an Adversarial Setting and Ill-Conditioned Weight Space

Author(s):  
Abhishek Sinha ◽  
Mayank Singh ◽  
Balaji Krishnamurthy
Keyword(s):  
1992 ◽  
Vol 19 (6) ◽  
pp. 559-564 ◽  
Author(s):  
K. Y. M Wong ◽  
A Rau ◽  
D Sherrington

Complexity ◽  
2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Yanjun Dai ◽  
Lin Su

In this article, an in-depth study and analysis of economic structure are carried out using a neural network fusion release algorithm. The method system defines the weight space and structure space of neural networks from the perspective of optimization theory, proposes a bionic optimization algorithm under the weight space and structure space, and establishes a neuroevolutionary method with shallow neural network and deep neural network as the research objects. In the shallow neuroevolutionary, the improved genetic algorithm (IGA) based on elite heuristic operation and migration strategy and the improved coyote optimization algorithm (ICOA) based on adaptive influence weights are proposed, and the shallow neuroevolutionary method based on IGA and the shallow neuroevolutionary method based on ICOA are applied to the weight space of backpropagation (BP) neural networks. In deep neuroevolutionary method, the structure space of convolutional neural network is proposed to solve the search space design of neural structure search (NAS), and the GA-based deep neuroevolutionary method under the structure space of convolutional neural network is proposed to solve the problem that numerous hyperparameters and network structure parameters can produce explosive combinations when designing deep learning models. The neural network fusion bionic algorithm used has the application value of exploring the spatial structure and dynamics of the socioeconomic system, improving the perception of the socioeconomic situation, and understanding the development law of society, etc. The idea is also verifiable through the present computer technology.


Author(s):  
A. Eleuteri ◽  
R. Tagliaferri ◽  
L. Milano ◽  
F. Acernese ◽  
M. De Laurentiis

2007 ◽  
Vol 362 (1479) ◽  
pp. 455-460 ◽  
Author(s):  
Colin R Tosh ◽  
Graeme D Ruxton

Artificial neural networks are becoming increasingly popular as predictive statistical tools in ecosystem ecology and as models of signal processing in behavioural and evolutionary ecology. We demonstrate here that a commonly used network in ecology, the three-layer feed-forward network, trained with the backpropagation algorithm, can be extremely sensitive to the stochastic variation in training data that results from random sampling of the same underlying statistical distribution, with networks converging to several distinct predictive states. Using a random walk procedure to sample error–weight space, and Sammon dimensional reduction of weight arrays, we demonstrate that these different predictive states are not artefactual, due to local minima, but lie at the base of major error troughs in the error–weight surface. We further demonstrate that various gross weight compositions can produce the same predictive state, suggesting the analogy of weight space as a ‘patchwork’ of multiple predictive states. Our results argue for increased inclusion of stochastic training replication and analysis into ecological and behavioural applications of artificial neural networks.


1999 ◽  
Vol 32 (2) ◽  
pp. 247-252
Author(s):  
Gu YuQiao ◽  
Huang WuQun ◽  
Chen TianLun

Sign in / Sign up

Export Citation Format

Share Document