Symbiotic coevolution of artificial neural networks and training data sets

1998 ◽  
pp. 511-520 ◽  
Author(s):  
Helmut A. Mayer
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Training Data ◽  
Data Sets ◽  
Artificial Neural ◽  
And Training

scholarly journals Simulation of flood flow in a river system using artificial neural networks

2005 ◽  
Vol 9 (4) ◽  
pp. 313-321 ◽  
Author(s):  
R. R. Shrestha ◽  
S. Theobald ◽  
F. Nestmann
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Flow Simulation ◽  
Simulation Models ◽  
River System ◽  
Training Data ◽  
Data Sets ◽  
Network Training ◽  
Artificial Neural ◽  
Flood Flow

Abstract. Artificial neural networks (ANNs) provide a quick and flexible means of developing flood flow simulation models. An important criterion for the wider applicability of the ANNs is the ability to generalise the events outside the range of training data sets. With respect to flood flow simulation, the ability to extrapolate beyond the range of calibrated data sets is of crucial importance. This study explores methods for improving generalisation of the ANNs using three different flood events data sets from the Neckar River in Germany. An ANN-based model is formulated to simulate flows at certain locations in the river reach, based on the flows at upstream locations. Network training data sets consist of time series of flows from observation stations. Simulated flows from a one-dimensional hydrodynamic numerical model are integrated for network training and validation, at a river section where no measurements are available. Network structures with different activation functions are considered for improving generalisation. The training algorithm involved backpropagation with the Levenberg-Marquardt approximation. The ability of the trained networks to extrapolate is assessed using flow data beyond the range of the training data sets. The results of this study indicate that the ANN in a suitable configuration can extend forecasting capability to a certain extent beyond the range of calibrated data sets.

scholarly journals DEVELOPING AND TRAINING MODEL OF ARTIFICIAL NEURAL NETWORK FOR CREATING DECISION SUPPORT SYSTEMS

2020 ◽  
Vol 2020 (3) ◽  
pp. 61-73
Author(s):  
Anna Olegovna Chupakova ◽  
Sergey Vital'evich Gudin ◽  
Renat Shamil'evich Khabibulin
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Decision Support ◽  
Decision Support Systems ◽  
Support Systems ◽  
Training Data ◽  
Advantages And Disadvantages ◽  
Artificial Neural ◽  
And Training

The article highlights the significant increase of industrial capacities and automation of production, which requires taking effective management decisions by a responsible person. There have been outlined the important achievements of the scientists in application of the artificial neural networks in the various fields of activity and decision support systems involving the information analysis and processing with the results obtained. There has been proposed a review of publications on training artificial neural networks and on their efficient application in solving problems of classification, prediction and control. The most common structures of neural networks, their advantages and disadvantages, as well as the methods used to create training data arrays have been studied. A comparative analysis of using various structures of artificial neural networks and the effectiveness of existing teaching methods and the prospects for their use has been carried out. There has been defined the most preferred neural network topology for solving problems of fire safety management at the production facilities as an active decision support system. Using the analysis results, the most common and effective training methods have been identified, application of which is appropriate for developing and training various types of neural networks. The use of the technology is well grounded for reducing the errors in data processing, the financial costs for ensuring security, as well as for possible using the neural networks in the decision support systems to optimize these systems.

scholarly journals Autonomous flight cycles and extreme landings of airliners beyond the current limits and capabilities using artificial neural networks

2021 ◽  
Author(s):  
Haitham Baomar ◽  
Peter J. Bentley
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Weather Conditions ◽  
Extreme Weather ◽  
Training Data ◽  
Aviation Industry ◽  
Control Models ◽  
Novel Approach ◽  
Network Modules ◽  
Artificial Neural

AbstractWe describe the Intelligent Autopilot System (IAS), a fully autonomous autopilot capable of piloting large jets such as airliners by learning from experienced human pilots using Artificial Neural Networks. The IAS is capable of autonomously executing the required piloting tasks and handling the different flight phases to fly an aircraft from one airport to another including takeoff, climb, cruise, navigate, descent, approach, and land in simulation. In addition, the IAS is capable of autonomously landing large jets in the presence of extreme weather conditions including severe crosswind, gust, wind shear, and turbulence. The IAS is a potential solution to the limitations and robustness problems of modern autopilots such as the inability to execute complete flights, the inability to handle extreme weather conditions especially during approach and landing where the aircraft’s speed is relatively low, and the uncertainty factor is high, and the pilots shortage problem compared to the increasing aircraft demand. In this paper, we present the work done by collaborating with the aviation industry to provide training data for the IAS to learn from. The training data is used by Artificial Neural Networks to generate control models automatically. The control models imitate the skills of the human pilot when executing all the piloting tasks required to pilot an aircraft between two airports. In addition, we introduce new ANNs trained to control the aircraft’s elevators, elevators’ trim, throttle, flaps, and new ailerons and rudder ANNs to counter the effects of extreme weather conditions and land safely. Experiments show that small datasets containing single demonstrations are sufficient to train the IAS and achieve excellent performance by using clearly separable and traceable neural network modules which eliminate the black-box problem of large Artificial Intelligence methods such as Deep Learning. In addition, experiments show that the IAS can handle landing in extreme weather conditions beyond the capabilities of modern autopilots and even experienced human pilots. The proposed IAS is a novel approach towards achieving full control autonomy of large jets using ANN models that match the skills and abilities of experienced human pilots and beyond.

scholarly journals Estimation of electrical resistivity using artificial neural networks: a case study from Lublin Basin, SE Poland

2021 ◽  
Author(s):  
Jakub Ważny ◽  
Michał Stefaniuk ◽  
Adam Cygal
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Training Data ◽  
Multilayer Perceptrons ◽  
Borehole Data ◽  
Geological Interpretation ◽  
Se Poland ◽  
Geological Conditions ◽  
Artificial Neural ◽  
Reliable Solution

AbstractArtificial neural networks method (ANNs) is a common estimation tool used for geophysical applications. Considering borehole data, when the need arises to supplement a missing well log interval or whole logging—ANNs provide a reliable solution. Supervised training of the network on a reliable set of borehole data values with further application of this network on unknown wells allows creation of synthetic values of missing geophysical parameters, e.g., resistivity. The main assumptions for boreholes are: representation of similar geological conditions and the use of similar techniques of well data collection. In the analyzed case, a set of Multilayer Perceptrons were trained on five separate chronostratigraphic intervals of borehole, considered as training data. The task was to predict missing deep laterolog (LLD) logging in a borehole representing the same sequence of layers within the Lublin Basin area. Correlation between well logs data exceeded 0.8. Subsequently, magnetotelluric parametric soundings were modeled and inverted on both boreholes. Analysis showed that congenial Occam 1D models had better fitting of TM mode of MT data in each case. Ipso facto, synthetic LLD log could be considered as a basis for geophysical and geological interpretation. ANNs provided solution for supplementing datasets based on this analytical approach.

scholarly journals Opportunities and Constraints in Applying Artificial Neural Networks (ANNs) in Food Authentication. Honey—A Case Study

2021 ◽  
Vol 11 (15) ◽  
pp. 6723
Author(s):  
Ariana Raluca Hategan ◽  
Romulus Puscas ◽  
Gabriela Cristea ◽  
Adriana Dehelean ◽  
Francois Guyon ◽  
...  
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Training Sample ◽  
Training Data ◽  
Elemental Content ◽  
Neural Structure ◽  
Food Authentication ◽  
Data Set ◽  
Artificial Neural

The present work aims to test the potential of the application of Artificial Neural Networks (ANNs) for food authentication. For this purpose, honey was chosen as the working matrix. The samples were originated from two countries: Romania (50) and France (53), having as floral origins: acacia, linden, honeydew, colza, galium verum, coriander, sunflower, thyme, raspberry, lavender and chestnut. The ANNs were built on the isotope and elemental content of the investigated honey samples. This approach conducted to the development of a prediction model for geographical recognition with an accuracy of 96%. Alongside this work, distinct models were developed and tested, with the aim of identifying the most suitable configurations for this application. In this regard, improvements have been continuously performed; the most important of them consisted in overcoming the unwanted phenomenon of over-fitting, observed for the training data set. This was achieved by identifying appropriate values for the number of iterations over the training data and for the size and number of the hidden layers and by introducing of a dropout layer in the configuration of the neural structure. As a conclusion, ANNs can be successfully applied in food authenticity control, but with a degree of caution with respect to the “over optimization” of the correct classification percentage for the training sample set, which can lead to an over-fitted model.

scholarly journals Applicability of Artificial Neural Networks to Predict Mechanical and Permeability Properties of Volcanic Scoria-Based Concrete

2018 ◽  
Vol 2018 ◽  
pp. 1-16 ◽  
Author(s):  
Aref M. al-Swaidani ◽  
Waed T. Khwies
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Network Architecture ◽  
Supplementary Cementitious Material ◽  
Natural Pozzolans ◽  
Long Time ◽  
Ann Models ◽  
Artificial Neural ◽  
And Performance ◽  
And Training

Numerous volcanic scoria (VS) cones are found in many places worldwide. Many of them have not yet been investigated, although few of which have been used as a supplementary cementitious material (SCM) for a long time. The use of natural pozzolans as cement replacement could be considered as a common practice in the construction industry due to the related economic, ecologic, and performance benefits. In the current paper, the effect of VS on the properties of concrete was investigated. Twenty-one concrete mixes with three w/b ratios (0.5, 0.6, and 0.7) and seven replacement levels of VS (0%, 10%, 15%, 20%, 25%, 30%, and 35%) were produced. The investigated concrete properties were the compressive strength, the water permeability, and the concrete porosity. Artificial neural networks (ANNs) were used for prediction of the investigated properties. Feed-forward backpropagation neural networks have been used. The ANN models have been established by incorporation of the laboratory experimental data and by properly choosing the network architecture and training processes. This study shows that the use of ANN models provided a more accurate tool to capture the effects of five parameters (cement content, volcanic scoria content, water content, superplasticizer content, and curing time) on the investigated properties. This prediction makes it possible to design VS-based concretes for a desired strength, water impermeability, and porosity at any given age and replacement level. Some correlations between the investigated properties were derived from the analysed data. Furthermore, the sensitivity analysis showed that all studied parameters have a strong effect on the investigated properties. The modification of the microstructure of VS-based cement paste has been observed, as well.

Combining BP with PSO algorithms in weights optimisation and ANNs training for mass appraisal of properties

2018 ◽  
Vol 11 (2) ◽  
pp. 290-314 ◽  
Author(s):  
Joseph Awoamim Yacim ◽  
Douw Gert Brand Boshoff
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Predictive Accuracy ◽  
Back Propagation ◽  
Particle Swarm ◽  
Particle Swarm Optimisation ◽  
Content Type ◽  
Attribute Weights ◽  
Artificial Neural ◽  
And Training

Purpose The paper aims to investigate the application of particle swarm optimisation and back propagation in weights optimisation and training of artificial neural networks within the mass appraisal industry and to compare the performance with standalone back propagation, genetic algorithm with back propagation and regression models. Design/methodology/approach The study utilised linear regression modelling before the semi-log and log-log models with a sample of 3,242 single-family dwellings. This was followed by the hybrid systems in the selection of optimal attribute weights and training of the artificial neural networks. Also, the standalone back propagation algorithm was used for the network training, and finally, the performance of each model was evaluated using accuracy test statistics. Findings The study found that combining particle swarm optimisation with back propagation in global and local search for attribute weights enhances the predictive accuracy of artificial neural networks. This also enhances transparency of the process, because it shows relative importance of attributes. Research limitations/implications A robust assessment of the models’ predictive accuracy was inhibited by fewer accuracy test statistics found in the software. The research demonstrates the efficacy of combining two models in the assessment of property values. Originality/value This work demonstrated the practicability of combining particle swarm optimisation with back propagation algorithms in finding optimal weights and training of the artificial neural networks within the mass appraisal environment.

Convolutional Neural Network

2022 ◽  
pp. 1559-1575
Author(s):  
Mário Pereira Véstias
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Machine Learning Algorithms ◽  
Training Data ◽  
Machine Learning Model ◽  
Artificial Neural

Machine learning is the study of algorithms and models for computing systems to do tasks based on pattern identification and inference. When it is difficult or infeasible to develop an algorithm to do a particular task, machine learning algorithms can provide an output based on previous training data. A well-known machine learning model is deep learning. The most recent deep learning models are based on artificial neural networks (ANN). There exist several types of artificial neural networks including the feedforward neural network, the Kohonen self-organizing neural network, the recurrent neural network, the convolutional neural network, the modular neural network, among others. This article focuses on convolutional neural networks with a description of the model, the training and inference processes and its applicability. It will also give an overview of the most used CNN models and what to expect from the next generation of CNN models.

Sign in / Sign up

Export Citation Format

Share Document