scholarly journals Parameter Estimation in the Age of Degeneracy and Unidentifiability

Mathematics ◽  
2022 ◽  
Vol 10 (2) ◽  
pp. 170
Author(s):  
Dylan Lederman ◽  
Raghav Patel ◽  
Omar Itani ◽  
Horacio G. Rotstein
Keyword(s):  
Parameter Estimation ◽  
Dynamic Models ◽  
Inverse Function ◽  
Systematic Investigation ◽  
Model Parameters ◽  
Dynamic Complexity ◽  
Lack Of Information ◽  
Classical Studies ◽  
The Family ◽  
Model Dynamics

Parameter estimation from observable or experimental data is a crucial stage in any modeling study. Identifiability refers to one’s ability to uniquely estimate the model parameters from the available data. Structural unidentifiability in dynamic models, the opposite of identifiability, is associated with the notion of degeneracy where multiple parameter sets produce the same pattern. Therefore, the inverse function of determining the model parameters from the data is not well defined. Degeneracy is not only a mathematical property of models, but it has also been reported in biological experiments. Classical studies on structural unidentifiability focused on the notion that one can at most identify combinations of unidentifiable model parameters. We have identified a different type of structural degeneracy/unidentifiability present in a family of models, which we refer to as the Lambda-Omega (Λ-Ω) models. These are an extension of the classical lambda-omega (λ-ω) models that have been used to model biological systems, and display a richer dynamic behavior and waveforms that range from sinusoidal to square wave to spike like. We show that the Λ-Ω models feature infinitely many parameter sets that produce identical stable oscillations, except possible for a phase shift (reflecting the initial phase). These degenerate parameters are not identifiable combinations of unidentifiable parameters as is the case in structural degeneracy. In fact, reducing the number of model parameters in the Λ-Ω models is minimal in the sense that each one controls a different aspect of the model dynamics and the dynamic complexity of the system would be reduced by reducing the number of parameters. We argue that the family of Λ-Ω models serves as a framework for the systematic investigation of degeneracy and identifiability in dynamic models and for the investigation of the interplay between structural and other forms of unidentifiability resulting on the lack of information from the experimental/observational data.

scholarly journals Parameter estimation in the age of degeneracy and unidentifiability

2021 ◽  
Author(s):  
Dylan Lederman ◽  
Raghav Patel ◽  
Omar Itani ◽  
Horacio G. Rotstein
Keyword(s):  
Parameter Estimation ◽  
Dynamic Models ◽  
Inverse Function ◽  
Systematic Investigation ◽  
Model Parameters ◽  
Dynamic Complexity ◽  
Lack Of Information ◽  
Classical Studies ◽  
The Family ◽  
Model Dynamics

Parameter estimation from observable or experimental data is a crucial stage in any modeling study. Identifiability refers to one's ability to uniquely estimate the model parameters from the available data. Structural unidentifiability in dynamic models, the opposite of identifiability, is associated with the notion of degeneracy where multiple parameter sets produce the same pattern. Therefore, the inverse function of determining the model parameters from the data is not well defined. Degeneracy is not only a mathematical property of models, but it has also been reported in biological experiments. Classical studies on structural unidentifiability focused on the notion that one can at most identify combinations of unidentifiable model parameters. We have identified a different type of structural degeneracy/unidentifiability present in a family of models, which we refer to as the Lambda-Omega (\Ldaomega) models. These are an extension of the classical lambda-omega (\ldaomega) models that have been used to model biological systems, and display a richer dynamic behavior and waveforms that range from sinusoidal to square-wave to spike-like. We show that the \Ldaomega\, models feature infinitely many parameter sets that produce identical stable oscillations, except possible for a phase-shift (reflecting the initial phase). These degenerate parameters are not identifiable combinations of unidentifiable parameters as is the case in structural degeneracy. In fact, reducing the number of model parameters in the \Ldaomega\, models is minimal in the sense that each one controls a different aspect of the model dynamics and the dynamic complexity of the system would be reduced by reducing the number of parameters. We argue that the family of \Ldaomega\, models serves as a framework for the systematic investigation of degeneracy and identifiability in dynamic models and for the investigation of the interplay between structural and other forms of unidentifiability resulting on the lack of information from the experimental/observational data.

Genetic Algorithm-Based Maximum Likelihood Parameter Estimation for Transit Buses

2001 ◽  
Author(s):  
Jie Xiao ◽  
Bohdan T. Kulakowski
Keyword(s):  
Parameter Estimation ◽  
Maximum Likelihood ◽  
Dynamic Models ◽  
Estimation Method ◽  
Optimization Techniques ◽  
Model Parameters ◽  
Parameter Estimation Method ◽  
Transit Buses ◽  
Simulation And Control ◽  
And Control

Abstract Vehicle dynamic models include parameters that qualify the dependence of input forces and moments on state and control variables. The accuracy of the model parameter estimates is important for modeling, simulation, and control. In general, the most accurate method for determining values of model parameters is by direct measurement. However, some parameters of vehicle dynamics, such as suspension damping or moments of inertia, are difficult to measure accurately. This study aims at establishing an efficient and accurate parameter estimation method for developing dynamic models for transit buses, such that this method can be easily implemented for simulation and control design purposes. Based on the analysis of robustness, as well as accuracy and efficiency of optimization techniques, a parameter estimation method that integrates Genetic Algorithms and the Maximum Likelihood Estimation is proposed. Choices of output signals and estimation criterion are discussed involving an extensive sensitivity analysis of the predicted output with respect to model parameters. Other experiment-related aspects, such as imperfection of data acquisition, are also considered. Finally, asymptotic Cramer-Rao lower bounds for the covariance of estimated parameters are obtained. Computer simulation results show that the proposed method is superior to gradient-based methods in accuracy, as well as robustness to the initial guesses and measurement uncertainty.

scholarly journals Neural Computing Enhanced Parameter Estimation for Multi-Input and Multi-Output Total Non-Linear Dynamic Models

Entropy ◽  
2020 ◽  
Vol 22 (5) ◽  
pp. 510 ◽  
Author(s):  
Longlong Liu ◽  
Di Ma ◽  
Ahmad Taher Azar ◽  
Quanmin Zhu
Keyword(s):  
Neural Network ◽  
Parameter Estimation ◽  
Linear Model ◽  
Dynamic Models ◽  
Bench Test ◽  
Model Parameters ◽  
Linear Dynamic ◽  
Gradient Descent Algorithm ◽  
Non Linear ◽  
Linear Dynamic Models

In this paper, a gradient descent algorithm is proposed for the parameter estimation of multi-input and multi-output (MIMO) total non-linear dynamic models. Firstly, the MIMO total non-linear model is mapped to a non-completely connected feedforward neural network, that is, the parameters of the total non-linear model are mapped to the connection weights of the neural network. Then, based on the minimization of network error, a weight-updating algorithm, that is, an estimation algorithm of model parameters, is proposed with the convergence conditions of a non-completely connected feedforward network. In further determining the variables of the model set, a method of model structure detection is proposed for selecting a group of important items from the whole variable candidate set. In order to verify the usefulness of the parameter identification process, we provide a virtual bench test example for the numerical analysis and user-friendly instructions for potential applications.

scholarly journals Constrained Parameter Estimation for a Mechanistic Kinetic Model of Cobalt–Hydrogen Electrochemical Competition during a Cobalt Removal Process

Entropy ◽  
2021 ◽  
Vol 23 (4) ◽  
pp. 387
Author(s):  
Yiting Liang ◽  
Yuanhua Zhang ◽  
Yonggang Li
Keyword(s):  
Parameter Estimation ◽  
Kinetic Model ◽  
Model Parameters ◽  
Hydrogen Ions ◽  
Removal Process ◽  
Cobalt Removal ◽  
Estimation Scheme ◽  
Zinc Hydrometallurgy ◽  
The Impact ◽  
Parameter Estimation Scheme

A mechanistic kinetic model of cobalt–hydrogen electrochemical competition for the cobalt removal process in zinc hydrometallurgical was proposed. In addition, to overcome the parameter estimation difficulties arising from the model nonlinearities and the lack of information on the possible value ranges of parameters to be estimated, a constrained guided parameter estimation scheme was derived based on model equations and experimental data. The proposed model and the parameter estimation scheme have two advantages: (i) The model reflected for the first time the mechanism of the electrochemical competition between cobalt and hydrogen ions in the process of cobalt removal in zinc hydrometallurgy; (ii) The proposed constrained parameter estimation scheme did not depend on the information of the possible value ranges of parameters to be estimated; (iii) the constraint conditions provided in that scheme directly linked the experimental phenomenon metrics to the model parameters thereby providing deeper insights into the model parameters for model users. Numerical experiments showed that the proposed constrained parameter estimation algorithm significantly improved the estimation efficiency. Meanwhile, the proposed cobalt–hydrogen electrochemical competition model allowed for accurate simulation of the impact of hydrogen ions on cobalt removal rate as well as simulation of the trend of hydrogen ion concentration, which would be helpful for the actual cobalt removal process in zinc hydrometallurgy.

scholarly journals Determination of synchronous generator nonlinear model parameters based on power rejection tests using a gradient optimization algorithm

2017 ◽  
Vol 65 (4) ◽  
pp. 479-488 ◽  
Author(s):  
A. Boboń ◽  
A. Nocoń ◽  
S. Paszek ◽  
P. Pruski
Keyword(s):  
Parameter Estimation ◽  
Objective Function ◽  
Optimization Algorithm ◽  
Least Squares Method ◽  
Synchronous Generator ◽  
Operating Conditions ◽  
Model Parameters ◽  
State Variables ◽  
Starting Point ◽  
Gradient Optimization

AbstractThe paper presents a method for determining electromagnetic parameters of different synchronous generator models based on dynamic waveforms measured at power rejection. Such a test can be performed safely under normal operating conditions of a generator working in a power plant. A generator model was investigated, expressed by reactances and time constants of steady, transient, and subtransient state in the d and q axes, as well as the circuit models (type (3,3) and (2,2)) expressed by resistances and inductances of stator, excitation, and equivalent rotor damping circuits windings. All these models approximately take into account the influence of magnetic core saturation. The least squares method was used for parameter estimation. There was minimized the objective function defined as the mean square error between the measured waveforms and the waveforms calculated based on the mathematical models. A method of determining the initial values of those state variables which also depend on the searched parameters is presented. To minimize the objective function, a gradient optimization algorithm finding local minima for a selected starting point was used. To get closer to the global minimum, calculations were repeated many times, taking into account the inequality constraints for the searched parameters. The paper presents the parameter estimation results and a comparison of the waveforms measured and calculated based on the final parameters for 200 MW and 50 MW turbogenerators.

Efficiency of Linear and Non-Linear Classifiers for Gas Identification from Electrocatalytic Gas Sensor

2013 ◽  
Vol 20 (3) ◽  
pp. 501-512 ◽  
Author(s):  
Paweł Kalinowski ◽  
Łukasz Woźniak ◽  
Anna Strzelczyk ◽  
Piotr Jasinski ◽  
Grzegorz Jasinski
Keyword(s):  
Gas Sensor ◽  
Gas Sensors ◽  
Support Vector ◽  
Voltammetric Sensor ◽  
Linear Classifiers ◽  
Lack Of Information ◽  
The Family ◽  
Gas Identification ◽  
Auto Scaling ◽  
Nonlinear Support

Abstract Electrocatalytic gas sensors belong to the family of electrochemical solid state sensors. Their responses are acquired in the form of I-V plots as a result of application of cyclic voltammetry technique. In order to obtain information about the type of measured gas the multivariate data analysis and pattern classification techniques can be employed. However, there is a lack of information in literature about application of such techniques in case of standalone chemical sensors which are able to recognize more than one volatile compound. In this article we present the results of application of these techniques to the determination from a single electrocatalytic gas sensor of single concentrations of nitrogen dioxide, ammonia, sulfur dioxide and hydrogen sulfide. Two types of classifiers were evaluated, i.e. linear Partial Least Squares Discriminant Analysis (PLS-DA) and nonlinear Support Vector Machine (SVM). The efficiency of using PLS-DA and SVM methods are shown on both the raw voltammetric sensor responses and pre-processed responses using normalization and auto-scaling

scholarly journals Sexual scripts of persons with different types of sex education

2020 ◽  
pp. 55-73
Author(s):  
Вікторія ГУПАЛОВСЬКА ◽  
Ольга АВРАМЕНКО
Keyword(s):  
Sex Education ◽  
Well Being ◽  
Sexual Scripts ◽  
Sexual Education ◽  
Sexual Relations ◽  
Powerful Factor ◽  
Lack Of Information ◽  
The Family ◽  
Different Types ◽  
Healthy Relationship

Thanks to the chosen methods we were able to investigate the features of three types of sexual education in the family: repressive, avoidant and expressive. Persons with a repressive type of sex education are the least sexually well-off, and their sexual scenarios are geared to compliance with existing rules (religious, ethical) and exclude pleasure. Respondents with the avoidant type of upbringing try to know everything in their own experience, thus filling in the lack of information, overestimating the number of sexual relations and their presence, they are dominated by a hedonistic and playful approach to sex without burdening themselves to build a healthy relationship, as well as the level of sex. Individuals with the expressive type are most capable of building a harmonious relationship, the most sexual well-being, and their sexual scenarios are flexible and diverse. Sex education is a powerful factor in shaping one's own sexuality and the way it is realized, which is reflected in the sexual scenarios chosen by the person.

scholarly journals Efficient gradient-based parameter estimation for dynamic models using qualitative data

2021 ◽  
Author(s):  
Leonard Schmiester ◽  
Daniel Weindl ◽  
Jan Hasenauer
Keyword(s):  
Parameter Estimation ◽  
Qualitative Data ◽  
Dynamic Models ◽  
Unknown Parameters ◽  
Differential Equation Models ◽  
Gradient Calculation ◽  
Order Of Magnitude ◽  
Gradient Based ◽  
Objective Function Values

AbstractMotivationUnknown parameters of dynamical models are commonly estimated from experimental data. However, while various efficient optimization and uncertainty analysis methods have been proposed for quantitative data, methods for qualitative data are rare and suffer from bad scaling and convergence.ResultsHere, we propose an efficient and reliable framework for estimating the parameters of ordinary differential equation models from qualitative data. In this framework, we derive a semi-analytical algorithm for gradient calculation of the optimal scaling method developed for qualitative data. This enables the use of efficient gradient-based optimization algorithms. We demonstrate that the use of gradient information improves performance of optimization and uncertainty quantification on several application examples. On average, we achieve a speedup of more than one order of magnitude compared to gradient-free optimization. Additionally, in some examples, the gradient-based approach yields substantially improved objective function values and quality of the fits. Accordingly, the proposed framework substantially improves the parameterization of models from qualitative data.AvailabilityThe proposed approach is implemented in the open-source Python Parameter EStimation TOolbox (pyPESTO). All application examples and code to reproduce this study are available at https://doi.org/10.5281/zenodo.4507613.

scholarly journals Modular Dynamic Biomolecular Modelling: The Unification of Stoichiometry, Thermodynamics, Kinetics and Data

2021 ◽  
Author(s):  
Peter J. Gawthrop ◽  
Michael Pan ◽  
Edmund J. Crampin
Keyword(s):  
Dynamic Models ◽  
System Development ◽  
Kinetic Modelling ◽  
Simulation Models ◽  
Bond Graph ◽  
Model Parameters ◽  
Biomolecular Systems ◽  
Genome Wide ◽  
Estimation Of Model Parameters ◽  
Genome Scale

AbstractRenewed interest in dynamic simulation models of biomolecular systems has arisen from advances in genome-wide measurement and applications of such models in biotechnology and synthetic biology. In particular, genome-scale models of cellular metabolism beyond the steady state are required in order to represent transient and dynamic regulatory properties of the system. Development of such whole-cell models requires new modelling approaches. Here we propose the energy-based bond graph methodology, which integrates stoichiometric models with thermo-dynamic principles and kinetic modelling. We demonstrate how the bond graph approach intrinsically enforces thermodynamic constraints, provides a modular approach to modelling, and gives a basis for estimation of model parameters leading to dynamic models of biomolecular systems. The approach is illustrated using a well-established stoichiometric model of E. coli and published experimental data.

scholarly journals A Stochastic Harmonic Oscillator Temperature Model for the Valuation of Weather Derivatives

Mathematics ◽  
2021 ◽  
Vol 9 (22) ◽  
pp. 2890
Author(s):  
Alessio Giorgini ◽  
Rogemar S. Mamon ◽  
Marianito R. Rodrigo
Keyword(s):  
Sensitivity Analysis ◽  
Parameter Estimation ◽  
Harmonic Oscillator ◽  
Numerical Simulations ◽  
Model Parameters ◽  
Call Option ◽  
Temperature Model ◽  
Option Prices ◽  
Harmonic Oscillator Model ◽  
Temperature Dynamics

Stochastic processes are employed in this paper to capture the evolution of daily mean temperatures, with the goal of pricing temperature-based weather options. A stochastic harmonic oscillator model is proposed for the temperature dynamics and results of numerical simulations and parameter estimation are presented. The temperature model is used to price a one-month call option and a sensitivity analysis is undertaken to examine how call option prices are affected when the model parameters are varied.

Sign in / Sign up

Export Citation Format

Share Document