DYNAMIC PROPERTIES OF A BIOLOGICALLY MOTIVATED NEURAL NETWORK MODEL

1992 ◽  
Vol 03 (04) ◽  
pp. 371-378 ◽  
Author(s):  
FRANÇOIS CHAPEAU BLONDEAU ◽  
GILBERT CHAUVET
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Transfer Function ◽  
Network Model ◽  
Neural Network Model ◽  
Dynamic Properties ◽  
Biological Significance ◽  
Neural Architecture ◽  
The Stability ◽  
Basic Features

We develop a neural network model based on prominent basic features of biological neural networks. The description keeps a simple but coherent link between the subneuronal, neuronal and network levels. In addition, the variables of the model are endowed with realistic numerical values together with their physical units. This permits to reach quantitative significance for the results. To describe the operation of the neuron, a transfer function is used that is believed to convey more biological significance compared to the usual sigmoid transfer function. It is shown that the dynamic properties of the network, which can vary from stability to chaos, are significantly influenced by the choice of the neuron transfer function. Constraints on the synaptic efficacies, as imposed by Dale’s rule, are also shown to modify the dynamic properties by increasing the stability of the network. A simple neural architecture is presented that leads to a controllable time evolution of the network activities.

Prediction of Dynamic Impedances Functions Using an Artificial Neural Network (ANN)

2012 ◽  
Vol 170-173 ◽  
pp. 3588-3593
Author(s):  
Sbartai Badreddine ◽  
Kamel Goudjil
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Dynamic Properties ◽  
Surface Foundation ◽  
Artificial Neural ◽  
Artificial Neural Network Ann ◽  
Impedance Functions

Artificial Neural Networks (ANN) has seen an explosion of interest over the last few years. Indeed, anywhere that there are problems of prediction, classification or control, neural networks are being introduced. Hence, the main objective of this paper is to develop a model to predict the response of the soil-structure interaction system without using the calculate code based on sophisticate numerical methods by the employment of a statistical approach based on an Artificial Neural Network model (ANN). In this study, a data base which relates the impedance functions to the geometrics characteristic of the foundation and the dynamic properties of the soil is implemented. This leads to develop a neural network model to predict impedances functions (all modes) of a rectangular surface foundation. Then the results are compared with unused data to check the ANN model’s validity.

scholarly journals ALGORITHMIC STABILITY OF DEEP LEARNING NEURAL NETWORKS IN RECOGNIZING THE MICROSTRUCTURE OF MATERIALS

2021 ◽  
Vol 21 (1) ◽  
pp. 159-166
Author(s):  
R.A. Klestov ◽  
◽  
A.V. Klyuev ◽  
V.Yu. Stolbov ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Network Model ◽  
Neural Network Model ◽  
Learning Process ◽  
Functional Materials ◽  
Quality Of Data ◽  
Algorithmic Stability ◽  
The Stability

The division of data for training a neural network into training and test data in various proportions to each other is investigated. The question is raised about how the quality of data distribution and their correct annotation can affect the final result of constructing a neural network model. The paper investigates the algorithmic stability of training a deep neural network in problems of recognition of the microstructure of materials. The study of the stability of the learning process makes it possible to estimate the performance of a neural network model on incomplete data distorted by up to 10%. Purpose. Research of the stability of the learning process of a neural network in the classification of microstructures of functional materials. Materials and methods. Artificial neural network is the main instrument on the basis of which produced the study. Different subtypes of deep convolutional networks are used such as VGG and ResNet. Neural networks are trained using an improved backpropagation method. The studied model is the frozen state of the neural network after a certain number of learning epochs. The amount of data excluded from the study was randomly distributed for each class in five different distributions. Results. Investigated neural network learning process. Results of experiments conducted computing training with gradual decrease in the number of input data. Distortions of calculation results when changing data with a step of 2 percent are investigated. The percentage of deviation was revealed, equal to 10, at which the trained neural network model loses its stability. Conclusion. The results obtained mean that with an established quantitative or qualitative deviation in the training or test set, the results obtained by training the network can hardly be trusted. Although the results of this study are applicable to a particular case, i.e., microstructure recognition problems using ResNet-152, the authors propose a simpler technique for studying the stability of deep learning neural networks based on the analysis of a test, not a training set.

scholarly journals Dynamic versus static neural network model for rainfall forecasting at Klang River Basin, Malaysia

2012 ◽  
Vol 16 (4) ◽  
pp. 1151-1169 ◽  
Author(s):  
A. El-Shafie ◽  
A. Noureldin ◽  
M. Taha ◽  
A. Hussain ◽  
M. Mukhlisin
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Model ◽  
Neural Network Model ◽  
Network Architecture ◽  
Rainfall Time Series ◽  
Hydrological Process ◽  
Multi Layer Perceptron ◽  
Rainfall Forecasting ◽  
Unseen Data

Abstract. Rainfall is considered as one of the major components of the hydrological process; it takes significant part in evaluating drought and flooding events. Therefore, it is important to have an accurate model for rainfall forecasting. Recently, several data-driven modeling approaches have been investigated to perform such forecasting tasks as multi-layer perceptron neural networks (MLP-NN). In fact, the rainfall time series modeling involves an important temporal dimension. On the other hand, the classical MLP-NN is a static and has a memoryless network architecture that is effective for complex nonlinear static mapping. This research focuses on investigating the potential of introducing a neural network that could address the temporal relationships of the rainfall series. Two different static neural networks and one dynamic neural network, namely the multi-layer perceptron neural network (MLP-NN), radial basis function neural network (RBFNN) and input delay neural network (IDNN), respectively, have been examined in this study. Those models had been developed for the two time horizons for monthly and weekly rainfall forecasting at Klang River, Malaysia. Data collected over 12 yr (1997–2008) on a weekly basis and 22 yr (1987–2008) on a monthly basis were used to develop and examine the performance of the proposed models. Comprehensive comparison analyses were carried out to evaluate the performance of the proposed static and dynamic neural networks. Results showed that the MLP-NN neural network model is able to follow trends of the actual rainfall, however, not very accurately. RBFNN model achieved better accuracy than the MLP-NN model. Moreover, the forecasting accuracy of the IDNN model was better than that of static network during both training and testing stages, which proves a consistent level of accuracy with seen and unseen data.

STABILITY AND BIFURCATION ANALYSIS ON A DELAYED NEURAL NETWORK MODEL

2005 ◽  
Vol 15 (09) ◽  
pp. 2883-2893 ◽  
Author(s):  
XIULING LI ◽  
JUNJIE WEI
Keyword(s):  
Neural Network ◽  
Hopf Bifurcation ◽  
Network Model ◽  
Neural Network Model ◽  
Center Manifold ◽  
Normal Form Theory ◽  
Center Manifold Theorem ◽  
Form Theory ◽  
Delayed Neural Network ◽  
The Stability

A simple delayed neural network model with four neurons is considered. Linear stability of the model is investigated by analyzing the associated characteristic equation. It is found that Hopf bifurcation occurs when the sum of four delays varies and passes a sequence of critical values. The stability and direction of the Hopf bifurcation are determined by applying the normal form theory and the center manifold theorem. An example is given and numerical simulations are performed to illustrate the obtained results. Meanwhile, the bifurcation set is provided in the appropriate parameter plane.

Credit Scoring Using Supervised and Unsupervised Neural Networks

2002 ◽  
pp. 154-166 ◽  
Author(s):  
David West ◽  
Cornelius Muchineuta
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Decision Support ◽  
Network Model ◽  
Neural Network Model ◽  
Credit Scoring ◽  
Self Organizing Map ◽  
Subprime Lending ◽  
The Neural Network ◽  
Combined Use

Some of the concerns that plague developers of neural network decision support systems include: (a) How do I understand the underlying structure of the problem domain; (b) How can I discover unknown imperfections in the data which might detract from the generalization accuracy of the neural network model; and (c) What variables should I include to obtain the best generalization properties in the neural network model? In this paper we explore the combined use of unsupervised and supervised neural networks to address these concerns. We develop and test a credit-scoring application using a self-organizing map and a multilayered feedforward neural network. The final product is a neural network decision support system that facilitates subprime lending and is flexible and adaptive to the needs of e-commerce applications.

Estimation of Polypropylene Melt Index through the Application of Stacked Neural Networks

2011 ◽  
Vol 187 ◽  
pp. 411-415
Author(s):  
Lu Yue Xia ◽  
Hai Tian Pan ◽  
Meng Fei Zhou ◽  
Yi Jun Cai ◽  
Xiao Fang Sun
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Model ◽  
Neural Network Model ◽  
Model Performance ◽  
Measurement Interval ◽  
Melt Index ◽  
Polypropylene Melt ◽  
Single Neural Network

Melt index is the most important parameter in determining the polypropylene grade. Since the lack of proper on-line instruments, its measurement interval and delay are both very long. This makes the quality control quite difficult. A modeling approach based on stacked neural networks is proposed to estimation the polypropylene melt index. Single neural network model generalization capability can be significantly improved by using stacked neural networks model. Proper determination of the stacking weights is essential for good stacked neural networks model performance, so determination of appropriate weights for combining individual networks using the criteria about minimization of sum of absolute prediction error is proposed. Application to real industrial data demonstrates that the polypropylene melt index can be successfully estimated using stacked neural networks. The results obtained demonstrate significant improvements in model accuracy, as a result of using stacked neural networks model, compared to using single neural network model.

Force Control of Robot Manipulator by Neural Network Model - Experiment and Evaluation of One-Degree-of-Freedom Manipulator -

1990 ◽  
Vol 2 (4) ◽  
pp. 273-281 ◽  
Author(s):  
Masatoshi Tokita ◽  
◽  
Toyokazu Mitsuoka ◽  
Toshio Fukuda ◽  
Takashi Kurihara ◽  
...  
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Force Control ◽  
Pid Controller ◽  
Robot Manipulator ◽  
Force Sensor ◽  
Robotic Manipulator ◽  
The Neural Network ◽  
The Stability

In this paper, a force control of a robotic manipulator based on a neural network model is proposed with consideration of the dynamics of both the force sensor and objects. This proposed system consists of the standard PID controller, the gains of which are augmented and adjusted depending on objects through a process of learning. The authors proposed a similar method previously for the force control of the robotic manipulator with consideration of dynamics of objects, but without consideration of dynamics of the force sensor, showing only simulation results. This paper shows the similar structure of the controller via the neural network model applicable to the cases with consideration of both effects and demonstrates that the proposed method shows the better performance than the conventional PID type of controller, yielding to the wider range of applications, consequently. Therefore, this method can be applied to the force/compliance control problems. The effects of the number of neurons and hidden layers of the neural network model are also discussed through the simulation and experimental results as well as the stability of the control system.

APPLYING NEURAL NETWORKS TO SOFTWARE RELIABILITY ASSESSMENT

2010 ◽  
Vol 17 (04) ◽  
pp. 313-329 ◽  
Author(s):  
NORMAN SCHNEIDEWIND
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Model ◽  
Neural Network Model ◽  
Software Reliability ◽  
Likelihood Estimation ◽  
Time To Failure ◽  
The Neural Network ◽  
Method Of Maximum Likelihood ◽  
Network Method

We adapt concepts from the field of neural networks to assess the reliability of software, employing cumulative failures, reliability, remaining failures, and time to failure metrics. In addition, the risk of not achieving reliability, remaining failure, and time to failure goals are assessed. The purpose of the assessment is to compare a criterion, derived from a neural network model, for estimating the parameters of software reliability metrics, with the method of maximum likelihood estimation. To our surprise the neural network method proved superior for all the reliability metrics that were assessed by virtue of yielding lower prediction error and risk. We also found that considerable adaptation of the neural network model was necessary to be meaningful for our application – only inputs, functions, neurons, weights, activation units, and outputs were required to characterize our application.

DYNAMIC OUTPUT FEEDBACK STABILIZATION FOR NONLINEAR SYSTEMS BASED ON STANDARD NEURAL NETWORK MODELS

2006 ◽  
Vol 16 (04) ◽  
pp. 305-317 ◽  
Author(s):  
MEIQIN LIU
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Nonlinear Systems ◽  
Network Model ◽  
Neural Network Model ◽  
Output Feedback ◽  
Control Design ◽  
Feedback Stabilization ◽  
Dynamic Output Feedback ◽  
Dynamic Output

A neural-model-based control design for some nonlinear systems is addressed. The design approach is to approximate the nonlinear systems with neural networks of which the activation functions satisfy the sector conditions. A novel neural network model termed standard neural network model (SNNM) is advanced for describing this class of approximating neural networks. Full-order dynamic output feedback control laws are then designed for the SNNMs with inputs and outputs to stabilize the closed-loop systems. The control design equations are shown to be a set of linear matrix inequalities (LMIs) which can be easily solved by various convex optimization algorithms to determine the control signals. It is shown that most neural-network-based nonlinear systems can be transformed into input-output SNNMs to be stabilization synthesized in a unified way. Finally, some application examples are presented to illustrate the control design procedures.

A NEURAL NETWORK MODEL FOR CREDIT RISK EVALUATION

2009 ◽  
Vol 19 (04) ◽  
pp. 285-294 ◽  
Author(s):  
ADNAN KHASHMAN
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Credit Risk ◽  
Network Model ◽  
Neural Network Model ◽  
Risk Evaluation ◽  
Evaluation System ◽  
Learning Algorithm ◽  
Back Propagation ◽  
Learning Schemes

Credit scoring is one of the key analytical techniques in credit risk evaluation which has been an active research area in financial risk management. This paper presents a credit risk evaluation system that uses a neural network model based on the back propagation learning algorithm. We train and implement the neural network to decide whether to approve or reject a credit application, using seven learning schemes and real world credit applications from the Australian credit approval datasets. A comparison of the system performance under the different learning schemes is provided, furthermore, we compare the performance of two neural networks; with one and two hidden layers following the ideal learning scheme. Experimental results suggest that neural networks can be effectively used in automatic processing of credit applications.

Sign in / Sign up

Export Citation Format

Share Document