scholarly journals Attribute Selection Impact on Linear and Nonlinear Regression Models for Crop Yield Prediction

2014 ◽  
Vol 2014 ◽  
pp. 1-10 ◽  
Author(s):  
Alberto Gonzalez-Sanchez ◽  
Juan Frausto-Solis ◽  
Waldo Ojeda-Bustamante
Keyword(s):  
Linear Regression ◽  
Real Data ◽  
Absolute Error ◽  
Correlation Factor ◽  
Attribute Selection ◽  
Data Driven ◽  
Yield Prediction ◽  
Nonlinear Regression Models ◽  
Modeling Techniques ◽  
Data Driven Modeling

Efficient cropping requires yield estimation for each involved crop, where data-driven models are commonly applied. In recent years, some data-driven modeling technique comparisons have been made, looking for the best model to yield prediction. However, attributes are usually selected based on expertise assessment or in dimensionality reduction algorithms. A fairer comparison should include the best subset of features for each regression technique; an evaluation including several crops is preferred. This paper evaluates the most common data-driven modeling techniques applied to yield prediction, using a complete method to define the best attribute subset for each model. Multiple linear regression, stepwise linear regression, M5′ regression trees, and artificial neural networks (ANN) were ranked. The models were built using real data of eight crops sowed in an irrigation module of Mexico. To validate the models, three accuracy metrics were used: the root relative square error (RRSE), relative mean absolute error (RMAE), and correlation factor (R). The results show that ANNs are more consistent in the best attribute subset composition between the learning and the training stages, obtaining the lowest average RRSE (86.04%), lowest average RMAE (8.75%), and the highest average correlation factor (0.63).

Data-Driven Modeling Techniques to Estimate Dispersion Relations of Structural Components

2018 ◽  
Author(s):  
Vijaya V. N. Sriram Malladi ◽  
Mohammad I. Albakri ◽  
Pablo A. Tarazaga ◽  
Serkan Gugercin
Keyword(s):  
Frequency Response ◽  
Dispersion Relations ◽  
Data Driven ◽  
Response Functions ◽  
Structural Components ◽  
Frequency Range ◽  
Frequency Response Functions ◽  
Material Inhomogeneity ◽  
Modeling Techniques ◽  
Data Driven Modeling

Dispersion relations describe the frequency-dependent nature of elastic waves propagating in structures. Experimental determination of dispersion relations of structural components, such as the floor of a building, can be a tedious task, due to material inhomogeneity, complex boundary conditions, and the physical dimensions of the structure under test. In this work, data-driven modeling techniques are utilized to reconstruct dispersion relations over a predetermined frequency range. The feasibility of this approach is demonstrated on a one-dimensional beam where an exact solution of the dispersion relations is attainable. Frequency response functions of the beam are obtained numerically over the frequency range of 0–50kHz. Data-driven dynamical model, constructed by the vector fitting approach, is then deployed to develop a state-space model based on the simulated frequency response functions at 16 locations along the beam. This model is then utilized to construct dispersion relations of the structure through a series of numerical simulations. The techniques discussed in this paper are especially beneficial to such scenarios where it is neither possible to find analytical solutions to wave equations, nor it is feasible to measure dispersion curves experimentally. In the present work, actual experimental data is left for future work, but the complete framework is presented here.

scholarly journals Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology – Part 1: Concepts and methodology

2009 ◽  
Vol 6 (6) ◽  
pp. 7055-7093 ◽  
Author(s):  
A. Elshorbagy ◽  
G. Corzo ◽  
S. Srinivasulu ◽  
D. P. Solomatine
Keyword(s):  
Polynomial Regression ◽  
Predictive Accuracy ◽  
Lower Layer ◽  
Data Driven ◽  
Support Vector ◽  
K Nearest Neighbors ◽  
Evolutionary Polynomial Regression ◽  
Modeling Techniques ◽  
Modeling Experiment ◽  
Data Driven Modeling

Abstract. A comprehensive data driven modeling experiment is presented in two-part paper. In this first part, an extensive data-driven modeling experiment is proposed. The most important concerns regarding the way data driven modeling (DDM) techniques and data were handled, compared, and evaluated, and the basis on which findings and conclusions were drawn are discussed. A concise review of key articles that presented comparisons among various DDM techniques is presented. Six DDM techniques, namely, neural networks, genetic programming, evolutionary polynomial regression, support vector machines, M5 model trees, and K-nearest neighbors are proposed and explained. Multiple linear regression and naïve models are also suggested as baseline for comparison with the various techniques. Five datasets from Canada and Europe representing evapotranspiration, upper and lower layer soil moisture content, and rainfall-runoff process are described and proposed for the modeling experiment. Twelve different realizations (groups) from each dataset are created by a procedure involving random sampling. Each group contains three subsets; training, cross-validation, and testing. Each modeling technique is proposed to be applied to each of the 12 groups of each dataset. This way, both predictive accuracy and uncertainty of the modeling techniques can be evaluated. The implementation of the modeling techniques, results and analysis, and the findings of the modeling experiment are deferred to the second part of this paper.

scholarly journals An Evaluation of COVID-19 in Italy: A data-driven modeling analysis

2020 ◽  
Author(s):  
Yongmei Ding ◽  
Liyuan Gao
Keyword(s):  
Real Data ◽  
Data Driven ◽  
The Novel ◽  
State Variables ◽  
Infected People ◽  
Modeling Analysis ◽  
Travel Restrictions ◽  
Novel Coronavirus ◽  
Data Driven Modeling ◽  
Global Travel

Abstract The novel coronavirus (COVID-19) that has been spreading worldwide since December 2019 has sickened millions of people, shut down major cities and some countries, prompted unprecedented global travel restrictions. Real data-driven modeling is an effort to help evaluate and curb the spread of the novel virus. Lockdowns and the effectiveness of reduction in the contacts in Italy has been measured via our modified model, with the addition of auxiliary and state variables that represent contacts, contacts with infected, conversion rate, latent propagation. Results show the decrease in infected people due to stay-at-home orders and tracing quarantine intervention. The effect of quarantine and centralized medical treatment was also measured through numerical modeling analysis.

Data-driven modeling techniques for indoor CO2 estimation

2017 ◽  
Author(s):  
Bob Vergauwen ◽  
Oscar Mauricio Agudelo ◽  
Raj Thilak Rajan ◽  
Frank Pasveer ◽  
Bart De Moor
Keyword(s):  
Data Driven ◽  
Modeling Techniques ◽  
Data Driven Modeling

Data-driven Crowd Modeling Techniques: A Survey

2022 ◽  
Vol 32 (1) ◽  
pp. 1-33
Author(s):  
Jinghui Zhong ◽  
Dongrui Li ◽  
Zhixing Huang ◽  
Chengyu Lu ◽  
Wentong Cai
Keyword(s):  
Game Design ◽  
State Of The Art ◽  
Crowd Simulation ◽  
Data Driven ◽  
Future Research ◽  
Crowd Modeling ◽  
The Past ◽  
Modeling Techniques ◽  
Comprehensive Survey ◽  
Data Driven Modeling

Data-driven crowd modeling has now become a popular and effective approach for generating realistic crowd simulation and has been applied to a range of applications, such as anomaly detection and game design. In the past decades, a number of data-driven crowd modeling techniques have been proposed, providing many options for people to generate virtual crowd simulation. This article provides a comprehensive survey of these state-of-the-art data-driven modeling techniques. We first describe the commonly used datasets for crowd modeling. Then, we categorize and discuss the state-of-the-art data-driven crowd modeling methods. After that, data-driven crowd model validation techniques are discussed. Finally, six promising future research topics of data-driven crowd modeling are discussed.

scholarly journals Usage of statistical modeling techniques in surface and groundwater level prediction

2020 ◽  
Vol 69 (3) ◽  
pp. 248-265 ◽  
Author(s):  
Klemen Kenda ◽  
Jože Peternelj ◽  
Nikos Mellios ◽  
Dimitris Kofinas ◽  
Matej Čerin ◽  
...  
Keyword(s):  
Statistical Modeling ◽  
Large Scale ◽  
Heterogeneous Data ◽  
Data Driven ◽  
Gradient Boosting ◽  
Feature Generation ◽  
Modeling Techniques ◽  
Regression Techniques ◽  
Data Driven Modeling ◽  
Groundwater Level Prediction

Abstract The paper presents a thorough evaluation of the performance of different statistical modeling techniques in ground- and surface-level prediction scenarios as well as some aspects of the application of data-driven modeling in practice (feature generation, feature selection, heterogeneous data fusion, hyperparameter tuning, and model evaluation). Twenty-one different regression and classification techniques were tested. The results reveal that batch regression techniques are superior to incremental techniques in terms of accuracy and that among them gradient boosting, random forest and linear regression perform best. On the other hand, introduced incremental models are cheaper to build and update and could still yield good enough results for certain large-scale applications.

scholarly journals Experimental investigation of the predictive capabilities of data driven modeling techniques in hydrology - Part 2: Application

2010 ◽  
Vol 14 (10) ◽  
pp. 1943-1961 ◽  
Author(s):  
A. Elshorbagy ◽  
G. Corzo ◽  
S. Srinivasulu ◽  
D. P. Solomatine
Keyword(s):  
Soil Moisture ◽  
Case Studies ◽  
Data Driven ◽  
Modeling Technique ◽  
Actual Evapotranspiration ◽  
Support Vector ◽  
Rainfall Runoff ◽  
Highly Nonlinear ◽  
Modeling Techniques ◽  
Data Driven Modeling

Abstract. In this second part of the two-part paper, the data driven modeling (DDM) experiment, presented and explained in the first part, is implemented. Inputs for the five case studies (half-hourly actual evapotranspiration, daily peat soil moisture, daily till soil moisture, and two daily rainfall-runoff datasets) are identified, either based on previous studies or using the mutual information content. Twelve groups (realizations) were randomly generated from each dataset by randomly sampling without replacement from the original dataset. Neural networks (ANNs), genetic programming (GP), evolutionary polynomial regression (EPR), Support vector machines (SVM), M5 model trees (M5), K-nearest neighbors (K-nn), and multiple linear regression (MLR) techniques are implemented and applied to each of the 12 realizations of each case study. The predictive accuracy and uncertainties of the various techniques are assessed using multiple average overall error measures, scatter plots, frequency distribution of model residuals, and the deterioration rate of prediction performance during the testing phase. Gamma test is used as a guide to assist in selecting the appropriate modeling technique. Unlike two nonlinear soil moisture case studies, the results of the experiment conducted in this research study show that ANNs were a sub-optimal choice for the actual evapotranspiration and the two rainfall-runoff case studies. GP is the most successful technique due to its ability to adapt the model complexity to the modeled data. EPR performance could be close to GP with datasets that are more linear than nonlinear. SVM is sensitive to the kernel choice and if appropriately selected, the performance of SVM can improve. M5 performs very well with linear and semi linear data, which cover wide range of hydrological situations. In highly nonlinear case studies, ANNs, K-nn, and GP could be more successful than other modeling techniques. K-nn is also successful in linear situations, and it should not be ignored as a potential modeling technique for hydrological applications.

scholarly journals Application of MGGP, ANN, MHBMO, GRG, and Linear Regression for Developing Daily Sediment Rating Curves

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Majid Niazkar ◽  
Mohammad Zakwan
Keyword(s):  
Nonlinear Regression ◽  
Empirical Model ◽  
Absolute Error ◽  
Data Driven ◽  
Discharge Data ◽  
Nonlinear Regression Models ◽  
Sediment Loads ◽  
Multigene Genetic Programming ◽  
Rating Curves ◽  
Artificial Neural Network Ann

A data-driven relationship between sediment and discharge of a river is among the most erratic relationships in river engineering due to the existence of an inevitable scatter in sediment rating curves. Recently, Multigene Genetic Programming (MGGP), as a machine learning (ML) method, has been proposed to develop data-driven models for various phenomena in the field of hydrology and water resource engineering. The present study explores the capability of MGGP-based models to develop daily sediment ratings of two gauging sites with 30-year sediment-discharge data, which was utilized previously in the literature. The results obtained by MGGP were compared with those achieved by an empirical model and Artificial Neural Network (ANN). The coefficients of the empirical model were calibrated using linear and nonlinear regression models (Generalized Reduced Gradient (GRG) and the Modified Honey Bee Mating Optimization (MHBMO) algorithm). According to the comparative analysis, the mean absolute error (MAE) at the two gauging stations reduced from 516.54 to 519.23 obtained by nonlinear regression to 447.26 and 504.23 achieved by MGGP, respectively. Similarly, all other performance indices indicated the suitability and accuracy of MGGP in developing sediment ratings. Therefore, it was demonstrated that ML-based models, particularly MGGP-based models, outperformed the empirical models for estimating sediment loads.

Sign in / Sign up

Export Citation Format

Share Document