scholarly journals Stabilization to Exponential Input-to-State Stability of a Class of Neural Networks with Delay by Observer-Based Aperiodic Intermittent Control

2021 ◽  
Vol 2021 ◽  
pp. 1-19
Author(s):  
Mengyue Li ◽  
Biwen Li ◽  
Yuan Wan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Time Delay ◽  
Intermittent Control ◽  
Activation Time ◽  
External Disturbances ◽  
Time Rate ◽  
The Neural Network ◽  
Event Triggered ◽  
Better Than

This study is devoted to investigating the stabilization to exponential input-to-state stability (ISS) of a class of neural networks with time delay and external disturbances under the observer-based aperiodic intermittent control (APIC). Compared with the general neural networks, the state of the neural network investigated is not yet fully available. Correspondingly, an observer-based APIC is constructed, and moreover, neither the observer nor the controller requires the information of time delay. Then, the stabilization to exponential ISS of the neural network is realized severally by the observer-based time-triggered APIC (T-APIC) and the observer-based event-triggered APIC (E-APIC), and corresponding criteria are given. Furthermore, the minimum activation time rate (MATR) of the observer-based T-APIC and the observer-based E-APIC is estimated, respectively. Finally, a numerical example is given, which not only verifies the effectiveness of our results but also shows that the observer-based E-APIC is superior to the observer-based T-APIC and the observer-based periodic intermittent control (PIC) in control times and the minimum activation time rate, and the function of the observer-based T-APIC is also better than the observer-based PIC.

Dynamics of Neural Networks as Nonlinear Systems with Several Equilibria

2011 ◽  
pp. 331-357 ◽  
Author(s):  
Daniela Danciu
Keyword(s):  
Neural Network ◽  
Dynamical System ◽  
Neural Networks ◽  
Time Delay ◽  
Dynamical Systems ◽  
Qualitative Properties ◽  
The Neural Network ◽  
The Neural Networks ◽  
Global Asymptotics ◽  
Dynamical Properties

Neural networks—both natural and artificial, are characterized by two kinds of dynamics. The first one is concerned with what we would call “learning dynamics”. The second one is the intrinsic dynamics of the neural network viewed as a dynamical system after the weights have been established via learning. The chapter deals with the second kind of dynamics. More precisely, since the emergent computational capabilities of a recurrent neural network can be achieved provided it has suitable dynamical properties when viewed as a system with several equilibria, the chapter deals with those qualitative properties connected to the achievement of such dynamical properties as global asymptotics and gradient-like behavior. In the case of the neural networks with delays, these aspects are reformulated in accordance with the state of the art of the theory of time delay dynamical systems.

scholarly journals Evaluation of 1-D tracer concentration profile in a small river by means of Multi-Layer Perceptron Neural Networks

2007 ◽  
Vol 11 (6) ◽  
pp. 1883-1896 ◽  
Author(s):  
A. Piotrowski ◽  
S. G. Wallis ◽  
J. J. Napiórkowski ◽  
P. M. Rowiński
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Cross Sections ◽  
Peak Concentration ◽  
Mass Conservation ◽  
Concentration Profiles ◽  
Flow Conditions ◽  
The Neural Network ◽  
The Neural Networks ◽  
Better Than

Abstract. The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on longitudinal dispersion coefficients, this new approach relies more heavily on measurements of concentration collected during tracer tests over a range of flow conditions, but fewer hydraulic and morphological data are needed. The study is based upon 26 tracer experiments performed in a small river in Edinburgh, UK (Murray Burn) at various flow rates in a 540 m long reach. The only data used in this study were concentration measurements collected at 4 cross-sections, distances between the cross-sections and the injection site, time, as well as flow rate and water velocity, obtained according to the data measured at the 1st and 2nd cross-sections. The four main features of concentration versus time profiles at a particular cross-section, namely the peak concentration, the arrival time of the peak at the cross-section, and the shapes of the rising and falling limbs of the profile are modeled, and for each of them a separately designed neural network was used. There was also a variant investigated in which the conservation of the injected mass was assured by adjusting the predicted peak concentration. The neural network methods were compared with the unit peak attenuation curve concept. In general the neural networks predicted the main features of the concentration profiles satisfactorily. The predicted peak concentrations were generally better than those obtained using the unit peak attenuation method, and the method with mass-conservation assured generally performed better than the method that did not account for mass-conservation. Predictions of peak travel time were also better using the neural networks than the unit peak attenuation method. Including more data into the neural network training set clearly improved the prediction of the shapes of the concentration profiles. Similar improvements in peak concentration were less significant and the travel time prediction appeared to be largely unaffected.

Endek Classification Based On GLCM Using Artificial Neural Networks with Adam Optimization

2020 ◽  
Vol 9 (2) ◽  
pp. 285
Author(s):  
Putu Wahyu Tirta Guna ◽  
Luh Arida Ayu Ayu Rahning Putri
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Back Propagation ◽  
Classification Problem ◽  
Model Accuracy ◽  
Computing Power ◽  
The Neural Network ◽  
Extraction Algorithm ◽  
Better Than

Not many people know that endek cloth itself has 4 known variances. .Nowadays. Computing and classification algorithm can be implemented to solve classification problem with respect to the features data as input. We can use this computing power to digitalize these endek pattern. The features extraction algorithm used in this research is GLCM. Where these data will act as input for the neural network model later. There is a lot of optimizer algorithm to use in back propagation phase. In this research we  prefer to use adam which is one of the newest and most popular optimizer algorithm. To compare its performace we also use SGD which is older and popular optimizer algorithm. Later we find that adam algorithm generate 33% accuracy which is better than what SGD algorithm give, it is 23% accuracy. Longer epoch also give affect for overall model accuracy.

scholarly journals Evaluation of 1-D tracer concentration profile in a small river by means of Multi-Layer Perceptron Neural Networks

2007 ◽  
Vol 4 (4) ◽  
pp. 2739-2768 ◽  
Author(s):  
A. Piotrowski ◽  
S. G. Wallis ◽  
J. J. Napiórkowski ◽  
P. M. Rowinski
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Cross Sections ◽  
Peak Concentration ◽  
Mass Conservation ◽  
Concentration Profiles ◽  
Flow Conditions ◽  
The Neural Network ◽  
The Neural Networks ◽  
Better Than

Abstract. The prediction of temporal concentration profiles of a transported pollutant in a river is still a subject of ongoing research efforts worldwide. The present paper is aimed at studying the possibility of using Multi-Layer Perceptron Neural Networks to evaluate the whole concentration versus time profile at several cross-sections of a river under various flow conditions, using as little information about the river system as possible. In contrast with the earlier neural networks based work on longitudinal dispersion coefficients, this new approach relies more heavily on measurements of concentration collected during tracer tests over a range of flow conditions, but fewer hydraulic and morphological data are needed. The study is based upon 26 tracer experiments performed in a small river in Edinburgh, UK (Murray Burn) at various flow rates in a 540 m long reach. The only data used in this study were concentration measurements collected at 4 cross-sections, distances between the cross-sections and the injection site, time, as well as flow rate and water velocity, obtained according to the data measured at the 1st and 2nd cross-sections. The four main features of concentration versus time profiles at a particular cross-section, namely the peak concentration, the arrival time of the peak at the cross-section, and the shapes of the rising and falling limbs of the profile are modeled, and for each of them a separately designed neural network was used. There was also a variant investigated in which the conservation of the injected mass was assured by adjusting the predicted peak concentration. The neural network methods were compared with the unit peak attenuation curve concept. In general the neural networks predicted the main features of the concentration profiles satisfactorily. The predicted peak concentrations were generally better than those obtained using the unit peak attenuation method, and the method with mass-conservation assured generally performed better than the method that did not account for mass-conservation. Predictions of peak travel time were also better using the neural networks than the unit peak attenuation method. Including more data into the neural network training set clearly improved the prediction of the shapes of the concentration profiles. Similar improvements in peak concentration were less significant and the travel time prediction appeared to be largely unaffected.

scholarly journals COMPARISON OF LINEAR REGRESSIONS AND NEURAL NETWORKS FOR FORECASTING ELECTRICITY CONSUMPTION

2020 ◽  
Vol 16 (2) ◽  
pp. 135-140
Author(s):  
Tyas Setiyorini ◽  
Frieyadie Frieyadie
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Linear Regression ◽  
Electricity Consumption ◽  
Nonlinear Problems ◽  
Complex Data ◽  
The Neural Network ◽  
The Neural Networks ◽  
Linear Regressions ◽  
Better Than

Electricity has a major role in humans that is very necessary for daily life. Forecasting of electricity consumption can guide the government's strategy for the use and development of energy in the future. But the complex and non-linear electricity consumption dataset is a challenge. Traditional time series models in such as linear regression are unable to solve nonlinear and complex data-related problems. While neural networks can overcome the problems of nonlinear and complex data relationships. This was proven in the experiments in this study. Experiments carried out with linear regressions and neural networks on the electricity consumption dataset A and the electricity consumption dataset B. Then the RMSE results are compared on the linear regressions and neural networks of the two datasets. On the electricity consumption dataset, A obtained by RMSE of 0.032 used the linear regression, and RMSE of 0.015 used the neural network. On the electricity consumption, dataset B obtained by RMSE of 0.488 used the linear regression, and RMSE of 0.466 used the neural network. The use of neural networks shows a smaller RMSE value compared to the use of linear regressions. This shows that neural networks can overcome nonlinear problems in the electricity consumption dataset A and the electricity consumption dataset B. So that the neural networks are afforded to improve performance better than linear regressions.  This study to prove that there is a nonlinear relationship in the electricity consumption dataset used in this study, and compare which performance is better between using linear regression and neural networks.

Index Tracking Method Based on the Neural Networks and its Empirical Study

2011 ◽  
Vol 267 ◽  
pp. 974-978
Author(s):  
Jian Fu Li ◽  
Ying Sheng Su
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Empirical Study ◽  
Good Method ◽  
Index Tracking ◽  
Tracking Problem ◽  
Tracking Method ◽  
The Neural Network ◽  
The Neural Networks ◽  
Better Than

In this paper, the neural network is used to improve the structure of assets allocation of index tracking portfolio. The empirical results shows that the performance of index tracking based on the neural networks is better than that of other methods mentioned in the literatures. The index tracking approach based on neural networks is a good method for index tracking problem.

SCORING MODELING BASED ON NEURAL NETWORKS FOR DETERMINING A BANK BORROWER'S RATING

2020 ◽  
Vol 2020 (10) ◽  
pp. 54-62
Author(s):  
Oleksii VASYLIEV ◽  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Architecture ◽  
Statistical Data ◽  
Activation Function ◽  
Decision Making Process ◽  
Neural Network Architecture ◽  
Acceptable Accuracy ◽  
The Neural Network ◽  
Sigmoid Activation Function

The problem of applying neural networks to calculate ratings used in banking in the decision-making process on granting or not granting loans to borrowers is considered. The task is to determine the rating function of the borrower based on a set of statistical data on the effectiveness of loans provided by the bank. When constructing a regression model to calculate the rating function, it is necessary to know its general form. If so, the task is to calculate the parameters that are included in the expression for the rating function. In contrast to this approach, in the case of using neural networks, there is no need to specify the general form for the rating function. Instead, certain neural network architecture is chosen and parameters are calculated for it on the basis of statistical data. Importantly, the same neural network architecture can be used to process different sets of statistical data. The disadvantages of using neural networks include the need to calculate a large number of parameters. There is also no universal algorithm that would determine the optimal neural network architecture. As an example of the use of neural networks to determine the borrower's rating, a model system is considered, in which the borrower's rating is determined by a known non-analytical rating function. A neural network with two inner layers, which contain, respectively, three and two neurons and have a sigmoid activation function, is used for modeling. It is shown that the use of the neural network allows restoring the borrower's rating function with quite acceptable accuracy.

scholarly journals Discretization and machine learning approximation of BSDEs with a constraint on the Gains-process

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Idris Kharroubi ◽  
Thomas Lim ◽  
Xavier Warin
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Differential Equations ◽  
Numerical Experiments ◽  
Optimization Problem ◽  
Learning Approach ◽  
The Neural Network ◽  
Machine Learning Approach ◽  
Mesh Grid

AbstractWe study the approximation of backward stochastic differential equations (BSDEs for short) with a constraint on the gains process. We first discretize the constraint by applying a so-called facelift operator at times of a grid. We show that this discretely constrained BSDE converges to the continuously constrained one as the mesh grid converges to zero. We then focus on the approximation of the discretely constrained BSDE. For that we adopt a machine learning approach. We show that the facelift can be approximated by an optimization problem over a class of neural networks under constraints on the neural network and its derivative. We then derive an algorithm converging to the discretely constrained BSDE as the number of neurons goes to infinity. We end by numerical experiments.

Application of neural networks in predictions of brake wear particulate matter emission

2021 ◽  
pp. 095440702110363
Author(s):  
Saša Vasiljević ◽  
Jasna Glišović ◽  
Nadica Stojanović ◽  
Ivan Grujić
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Particulate Matter ◽  
Traffic Control ◽  
World Health ◽  
Vehicle Speed ◽  
System Pressure ◽  
The Neural Network ◽  
Vehicle Systems ◽  
Brake Wear

According to the World Health Organization, air pollution with PM10 and PM2.5 (PM-particulate matter) is a significant problem that can have serious consequences for human health. Vehicles, as one of the main sources of PM10 and PM2.5 emissions, pollute the air and the environment both by creating particles by burning fuel in the engine, and by wearing of various elements in some vehicle systems. In this paper, the authors conducted the prediction of the formation of PM10 and PM2.5 particles generated by the wear of the braking system using a neural network (Artificial Neural Networks (ANN)). In this case, the neural network model was created based on the generated particles that were measured experimentally, while the validity of the created neural network was checked by means of a comparative analysis of the experimentally measured amount of particles and the prediction results. The experimental results were obtained by testing on an inertial braking dynamometer, where braking was performed in several modes, that is under different braking parameters (simulated vehicle speed, brake system pressure, temperature, braking time, braking torque). During braking, the concentration of PM10 and PM2.5 particles was measured simultaneously. The total of 196 measurements were performed and these data were used for training, validation, and verification of the neural network. When it comes to simulation, a comparison of two types of neural networks was performed with one output and with two outputs. For each type, network training was conducted using three different algorithms of backpropagation methods. For each neural network, a comparison of the obtained experimental and simulation results was performed. More accurate prediction results were obtained by the single-output neural network for both particulate sizes, while the smallest error was found in the case of a trained neural network using the Levenberg-Marquardt backward propagation algorithm. The aim of creating such a prediction model is to prove that by using neural networks it is possible to predict the emission of particles generated by brake wear, which can be further used for modern traffic systems such as traffic control. In addition, this wear algorithm could be applied on other vehicle systems, such as a clutch or tires.

scholarly journals A Neural Network Decomposition Algorithm for Mapping on Crossbar-Based Computing Systems

Electronics ◽  
2020 ◽  
Vol 9 (9) ◽  
pp. 1526 ◽  
Author(s):  
Choongmin Kim ◽  
Jacob A. Abraham ◽  
Woochul Kang ◽  
Jaeyong Chung
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Predictive Performance ◽  
Fixed Number ◽  
Decomposition Algorithm ◽  
Computing Systems ◽  
Network Decomposition ◽  
Von Neumann ◽  
Analog Computing ◽  
The Neural Network

Crossbar-based neuromorphic computing to accelerate neural networks is a popular alternative to conventional von Neumann computing systems. It is also referred as processing-in-memory and in-situ analog computing. The crossbars have a fixed number of synapses per neuron and it is necessary to decompose neurons to map networks onto the crossbars. This paper proposes the k-spare decomposition algorithm that can trade off the predictive performance against the neuron usage during the mapping. The proposed algorithm performs a two-level hierarchical decomposition. In the first global decomposition, it decomposes the neural network such that each crossbar has k spare neurons. These neurons are used to improve the accuracy of the partially mapped network in the subsequent local decomposition. Our experimental results using modern convolutional neural networks show that the proposed method can improve the accuracy substantially within about 10% extra neurons.

Sign in / Sign up

Export Citation Format

Share Document