Conquering the Needle-in-a-Haystack: How Correlated Input Variables Beneficially Alter the Fitness Landscape for Neural Networks

2009 ◽  
pp. 80-91 ◽  
Author(s):  
Stephen D. Turner ◽  
Marylyn D. Ritchie ◽  
William S. Bush
Keyword(s):  
Neural Networks ◽  
Fitness Landscape ◽  
Input Variables

Prediction Modeling of PM-10 in Chiangmai City Moat by Using Artificial Neural Networks

2015 ◽  
Vol 781 ◽  
pp. 628-631 ◽  
Author(s):  
Rati Wongsathan ◽  
Issaravuth Seedadan ◽  
Metawat Kavilkrue
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Prediction Model ◽  
Chiang Mai ◽  
Adverse Health Effects ◽  
High Pollution ◽  
Artificial Neural ◽  
Input Variables ◽  
Pm 10 ◽  
Respiratory Conditions

A mathematical prediction model has been developed in order to detect particles with a diameter of 10 micrometers or less (PM-10) that are responsible for adverse health effects because of their ability to cause serious respiratory conditions in areas of high pollution such as Chiang Mai City moat area. The prediction model is based on 3 types of Artificial Neural Networks (ANNs), including Multi-layer perceptron (MLP-NN), Radial basis function (RBF-NN), and hybrid of RBF and Genetic algorithm (RBF-NN-GA). The model uses 8 input variables to predict PM-10, consisting of 4 air pollution substances ( CO, O3, NO2 and SO2) and 4 meteorological variables related PM-10 (wind speed, temperature, atmospheric pressure and relative humidity). These 3 types of ANN have proved efficient instrument in predicting the PM-10. However, the performance of RBF-NN was superior in comparison with MLP-NN and RBF-NN-GA respectively.

scholarly journals High-throughput phenotyping of two plant-size traits of Eucalyptus species using neural networks

2021 ◽  
Author(s):  
Marcus Vinicius Vieira Borges ◽  
Janielle de Oliveira Garcia ◽  
Tays Silva Batista ◽  
Alexsandra Nogueira Martins Silva ◽  
Fabio Henrique Rojo Baio ◽  
...  
Keyword(s):  
Neural Networks ◽  
High Throughput ◽  
Mean Squared Error ◽  
Vegetation Indices ◽  
Plant Size ◽  
Eucalyptus Species ◽  
Forest Inventories ◽  
Spectral Bands ◽  
High Throughput Phenotyping ◽  
Input Variables

AbstractIn forest modeling to estimate the volume of wood, artificial intelligence has been shown to be quite efficient, especially using artificial neural networks (ANNs). Here we tested whether diameter at breast height (DBH) and the total plant height (Ht) of eucalyptus can be predicted at the stand level using spectral bands measured by an unmanned aerial vehicle (UAV) multispectral sensor and vegetation indices. To do so, using the data obtained by the UAV as input variables, we tested different configurations (number of hidden layers and number of neurons in each layer) of ANNs for predicting DBH and Ht at stand level for different Eucalyptus species. The experimental design was randomized blocks with four replicates, with 20 trees in each experimental plot. The treatments comprised five Eucalyptus species (E. camaldulensis, E. uroplylla, E. saligna, E. grandis, and E. urograndis) and Corymbria citriodora. DBH and Ht for each plot at the stand level were measured seven times in separate overflights by the UAV, so that the multispectral sensor could obtain spectral bands to calculate vegetation indices (VIs). ANNs were then constructed using spectral bands and VIs as input layers, in addition to the categorical variable (species), to predict DBH and Ht at the stand level simultaneously. This report represents one of the first applications of high-throughput phenotyping for plant size traits in Eucalyptus species. In general, ANNs containing three hidden layers gave better statistical performance (higher estimated r, lower estimated root mean squared error–RMSE) due to their greater capacity for self-learning. Among these ANNs, the best contained eight neurons in the first layer, seven in the second, and five in the third (8 − 7 − 5). The results reported here reveal the potential of using the generated models to perform accurate forest inventories based on spectral bands and VIs obtained with a UAV multispectral sensor and ANNs, reducing labor and time.

scholarly journals Modelling and Prediction of Monthly Global Irradiation Using Different Prediction Models

Energies ◽  
2021 ◽  
Vol 14 (8) ◽  
pp. 2332
Author(s):  
Cecilia Martinez-Castillo ◽  
Gonzalo Astray ◽  
Juan Carlos Mejuto
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Random Forests ◽  
Prediction Models ◽  
Meteorological Station ◽  
Ann Model ◽  
Global Irradiation ◽  
Artificial Neural ◽  
Input Variables ◽  
Using Data

Different prediction models (multiple linear regression, vector support machines, artificial neural networks and random forests) are applied to model the monthly global irradiation (MGI) from different input variables (latitude, longitude and altitude of meteorological station, month, average temperatures, among others) of different areas of Galicia (Spain). The models were trained, validated and queried using data from three stations, and each best model was checked in two independent stations. The results obtained confirmed that the best methodology is the ANN model which presents the lowest RMSE value in the validation and querying phases 1226 kJ/(m2∙day) and 1136 kJ/(m2∙day), respectively, and predict conveniently for independent stations, 2013 kJ/(m2∙day) and 2094 kJ/(m2∙day), respectively. Given the good results obtained, it is convenient to continue with the design of artificial neural networks applied to the analysis of monthly global irradiation.

scholarly journals Generalization of Patterns by Identification with Polynomial Neural Network

2010 ◽  
Vol 61 (2) ◽  
pp. 120-124 ◽  
Author(s):  
Ladislav Zjavka
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Functional Dependence ◽  
Polynomial Neural Network ◽  
New Type ◽  
Input Variables ◽  
The Brain ◽  
Functional Output ◽  
Simplified Form

Generalization of Patterns by Identification with Polynomial Neural Network Artificial neural networks (ANN) in general classify patterns according to their relationship, they are responding to related patterns with a similar output. Polynomial neural networks (PNN) are capable of organizing themselves in response to some features (relations) of the data. Polynomial neural network for dependence of variables identification (D-PNN) describes a functional dependence of input variables (not entire patterns). It approximates a hyper-surface of this function with multi-parametric particular polynomials forming its functional output as a generalization of input patterns. This new type of neural network is based on GMDH polynomial neural network and was designed by author. D-PNN operates in a way closer to the brain learning as the ANN does. The ANN is in principle a simplified form of the PNN, where the combinations of input variables are missing.

scholarly journals Artificial Neural Networks, Sequence-to-Sequence LSTMs, and Exogenous Variables as Analytical Tools for NO2 (Air Pollution) Forecasting: A Case Study in the Bay of Algeciras (Spain)

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1770
Author(s):  
Javier González-Enrique ◽  
Juan Jesús Ruiz-Aguilar ◽  
José Antonio Moscoso-López ◽  
Daniel Urda ◽  
Lipika Deka ◽  
...  
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Short Term Memory ◽  
Prediction Method ◽  
Monitoring Network ◽  
Exogenous Variables ◽  
Prediction Horizon ◽  
Artificial Neural ◽  
Input Variables ◽  
Analytical Tools

This study aims to produce accurate predictions of the NO2 concentrations at a specific station of a monitoring network located in the Bay of Algeciras (Spain). Artificial neural networks (ANNs) and sequence-to-sequence long short-term memory networks (LSTMs) were used to create the forecasting models. Additionally, a new prediction method was proposed combining LSTMs using a rolling window scheme with a cross-validation procedure for time series (LSTM-CVT). Two different strategies were followed regarding the input variables: using NO2 from the station or employing NO2 and other pollutants data from any station of the network plus meteorological variables. The ANN and LSTM-CVT exogenous models used lagged datasets of different window sizes. Several feature ranking methods were used to select the top lagged variables and include them in the final exogenous datasets. Prediction horizons of t + 1, t + 4 and t + 8 were employed. The exogenous variables inclusion enhanced the model’s performance, especially for t + 4 (ρ ≈ 0.68 to ρ ≈ 0.74) and t + 8 (ρ ≈ 0.59 to ρ ≈ 0.66). The proposed LSTM-CVT method delivered promising results as the best performing models per prediction horizon employed this new methodology. Additionally, per each parameter combination, it obtained lower error values than ANNs in 85% of the cases.

Predicting carcass energy content and composition in broilers using the group method of data handling-type neural networks

2010 ◽  
Vol 149 (2) ◽  
pp. 249-254 ◽  
Author(s):  
A. FARIDI ◽  
M. MOTTAGHITALAB ◽  
H. DARMANI-KUHI ◽  
J. FRANCE ◽  
H. AHMADI
Keyword(s):  
Neural Networks ◽  
Body Weight ◽  
Goodness Of Fit ◽  
Carcass Composition ◽  
Poultry Meat ◽  
Alternative Methods ◽  
Group Method ◽  
Meat Production ◽  
Data Handling ◽  
Input Variables

SUMMARYThe success of poultry meat production has been strongly related to improvements in growth and carcass yield, mainly by increasing breast proportion and reducing carcass fat. Conventional laboratory techniques for determining carcass composition are expensive, cumbersome and time consuming. These disadvantages have prompted a search for alternative methods. In this respect, the potential benefits from modelling growth are considerable. Neural networks (NNs) are a relatively new option for modelling growth in animal production systems. One self-organizing sub-model of artificial NN is the group method of data handling-type NN (GMDH-type NN). The present study aimed at applying the GMDH-type NNs to data from two studies with broilers in order to predict carcass energy (CEn, MJ/g) content and relative growth (g/g of body weight) of carcass components (carcass protein, breast muscle, leg and thigh muscles, carcass fat, abdominal fat, skin fat and visceral fat). The effective input variables involved in the prediction of CEn and carcass fat content using data from the first study were dietary metabolizable energy (ME, kJ/kg), crude protein (CP, g/kg of diet), fat (g/kg of diet) and crude fibre (CF, g/kg of diet). For data from the second study, the effective input variables involved in the prediction of carcass components were dietary ME (MJ/kg), CP (g/kg of diet), methionine (g/kg of diet), lysine (g/kg of diet) and body weight (kg). Quantitative examination of the goodness of fit, using R2 and error measurement indices, for the predictive models proposed by the GMDH-type NN revealed close agreement between observed and predicted values of CEn and carcass components.

Hybrid Wavelet-Neuro-Fuzzy Systems of Computational Intelligence in Data Mining Tasks

2017 ◽  
pp. 787-825
Author(s):  
Yevgeniy Bodyanskiy ◽  
Olena Vynokurova ◽  
Oleksii Tyshchenko
Keyword(s):  
Data Mining ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Learning Process ◽  
Computational Intelligence ◽  
Group Method ◽  
Learning Criterion ◽  
Adjustment Procedure ◽  
Artificial Neural ◽  
Input Variables

This work is devoted to synthesis of adaptive hybrid systems based on the Computational Intelligence (CI) methods (especially artificial neural networks (ANNs)) and the Group Method of Data Handling (GMDH) ideas to get new qualitative results in Data Mining, Intelligent Control and other scientific areas. The GMDH-artificial neural networks (GMDH-ANNs) are currently well-known. Their nodes are two-input N-Adalines. On the other hand, these ANNs can require a considerable number of hidden layers for a necessary approximation quality. Introduced Q-neurons can provide a higher quality using the quadratic approximation. Their main advantage is a high learning rate. Universal approximating properties of the GMDH-ANNs can be achieved with the help of compartmental R-neurons representing a two-input RBFN with the grid partitioning of the input variables' space. An adjustment procedure of synaptic weights as well as both centers and receptive fields is provided. At the same time, Epanechnikov kernels (their derivatives are linear to adjusted parameters) can be used instead of conventional Gauss functions in order to increase a learning process rate. More complex tasks deal with stochastic time series processing. This kind of tasks can be solved with the help of the introduced adaptive W-neurons (wavelets). Learning algorithms are characterized by both tracking and smoothing properties based on the quadratic learning criterion. Robust algorithms which eliminate an influence of abnormal outliers on the learning process are introduced too. Theoretical results are illustrated by multiple experiments that confirm the proposed approach's effectiveness.

Fundamentals of Higher Order Neural Networks for Modeling and Simulation

2013 ◽  
pp. 103-133 ◽  
Author(s):  
Madan M. Gupta ◽  
Ivo Bukovsky ◽  
Noriyasu Homma ◽  
Ashu M. G. Solo ◽  
Zeng-Guang Hou
Keyword(s):  
Neural Networks ◽  
Modeling And Simulation ◽  
Learning Algorithm ◽  
Nonlinear Approximation ◽  
Higher Order ◽  
Higher Order Neural Networks ◽  
High Dynamic ◽  
Input Variables ◽  
Continuous Dynamic

In this chapter, the authors provide fundamental principles of Higher Order Neural Units (HONUs) and Higher Order Neural Networks (HONNs) for modeling and simulation. An essential core of HONNs can be found in higher order weighted combinations or correlations between the input variables and HONU. Except for the high quality of nonlinear approximation of static HONUs, the capability of dynamic HONUs for the modeling of dynamic systems is shown and compared to conventional recurrent neural networks when a practical learning algorithm is used. In addition, the potential of continuous dynamic HONUs to approximate high dynamic order systems is discussed, as adaptable time delays can be implemented. By using some typical examples, this chapter describes how and why higher order combinations or correlations can be effective for modeling of systems.

Sign in / Sign up

Export Citation Format

Share Document