ABC of Statistics for Verification and Validation (V&V) of Simulations of High-Consequence Engineering Systems

Author(s):  
Jeffrey T. Fong

We begin this expository essay by reviewing, with examples from the materials and fabrication testing literature, what a typical engineer already knows about statistics. We then consider a central question in engineering decision making, i.e., given a computer simulation of high-consequence systems, how do we verify and validate (V & V) and what are the margins of errors of all the important predicted results? To answer this question, we assert that we need three basic tools that already exist in statistical and metrological sciences: (A) Error Analysis. (B) Experimental Design. (C) Uncertainty Analysis. Those three tools, to be known as A B C of statistics, were developed through a powerful linkage between the statistical and metrological sciences. By extending the key concepts of this linkage from physical experiments to numerical simulations, we propose a new approach to answering the V & V question posed earlier. The key concepts are: (1) Uncertainty as defined in ISO Guide to the Expression of Uncertainty in Measurement (1993). (2) Design of experiments prior to data collection in a randomized or orthogonal scheme to evaluate interactions among model variables. (3) Standard reference benchmarks for calibration, and inter-laboratory studies for “weighted” consensus mean. To illustrate the need for and to discuss the plausibility of this metrology-based approach to V & V, two example problems are presented: (a) the verification of 12 simulations of the deformation of a cantilever beam, and (b) the calculation of a mean time to failure for a uniformly loaded 100-column single-floor steel grillage on fire.

2015 ◽  
Vol 39 (2) ◽  
pp. 199-202
Author(s):  
Wojciech Batko ◽  
Renata Bal

Abstract The assessment of the uncertainty of measurement results, an essential problem in environmental acoustic investigations, is undertaken in the paper. An attention is drawn to the - usually omitted - problem of the verification of assumptions related to using the classic methods of the confidence intervals estimation, for the controlled measuring quantity. Especially the paper directs attention to the need of the verification of the assumption of the normal distribution of the measuring quantity set, being the base for the existing and binding procedures of the acoustic measurements assessment uncertainty. The essence of the undertaken problem concerns the binding legal and standard acts related to acoustic measurements and recommended in: 'Guide to the expression of uncertainty in measurement' (GUM) (OIML 1993), developed under the aegis of the International Bureau of Measures (BIPM). The model legitimacy of the hypothesis of the normal distribution of the measuring quantity set in acoustic measurements is discussed and supplemented by testing its likelihood on the environment acoustic results. The Jarque-Bery test based on skewness and flattening (curtosis) distribution measures was used for the analysis of results verifying the assumption. This test allows for the simultaneous analysis of the deviation from the normal distribution caused both by its skewness and flattening. The performed experiments concerned analyses of the distribution of sound levels: LD, LE, LN, LDWN, being the basic noise indicators in assessments of the environment acoustic hazards.


Electronics ◽  
2021 ◽  
Vol 10 (8) ◽  
pp. 876
Author(s):  
Igor Gonçalves ◽  
Laécio Rodrigues ◽  
Francisco Airton Silva ◽  
Tuan Anh Nguyen ◽  
Dugki Min ◽  
...  

Surveillance monitoring systems are highly necessary, aiming to prevent many social problems in smart cities. The internet of things (IoT) nowadays offers a variety of technologies to capture and process massive and heterogeneous data. Due to the fact that (i) advanced analyses of video streams are performed on powerful recording devices; while (ii) surveillance monitoring services require high availability levels in the way that the service must remain connected, for example, to a connection network that offers higher speed than conventional connections; and that (iii) the trust-worthy dependability of a surveillance system depends on various factors, it is not easy to identify which components/devices in a system architecture have the most impact on the dependability for a specific surveillance system in smart cities. In this paper, we developed stochastic Petri net models for a surveillance monitoring system with regard to varying several parameters to obtain the highest dependability. Two main metrics of interest in the dependability of a surveillance system including reliability and availability were analyzed in a comprehensive manner. The analysis results show that the variation in the number of long-term evolution (LTE)-based stations contributes to a number of nines (#9s) increase in availability. The obtained results show that the variation of the mean time to failure (MTTF) of surveillance cameras exposes a high impact on the reliability of the system. The findings of this work have the potential of assisting system architects in planning more optimized systems in this field based on the proposed models.


2021 ◽  
Vol 58 (2) ◽  
pp. 289-313
Author(s):  
Ruhul Ali Khan ◽  
Dhrubasish Bhattacharyya ◽  
Murari Mitra

AbstractThe performance and effectiveness of an age replacement policy can be assessed by its mean time to failure (MTTF) function. We develop shock model theory in different scenarios for classes of life distributions based on the MTTF function where the probabilities $\bar{P}_k$ of surviving the first k shocks are assumed to have discrete DMTTF, IMTTF and IDMTTF properties. The cumulative damage model of A-Hameed and Proschan [1] is studied in this context and analogous results are established. Weak convergence and moment convergence issues within the IDMTTF class of life distributions are explored. The preservation of the IDMTTF property under some basic reliability operations is also investigated. Finally we show that the intersection of IDMRL and IDMTTF classes contains the BFR family and establish results outlining the positions of various non-monotonic ageing classes in the hierarchy.


2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Adriaan M. H. van der Veen ◽  
Juris Meija ◽  
Antonio Possolo ◽  
David Brynn Hibbert

Abstract Many calculations for science or trade require the evaluation and propagation of measurement uncertainty. Although relative atomic masses (standard atomic weights) of elements in normal terrestrial materials and chemicals are widely used in science, the uncertainties associated with these values are not well understood. In this technical report, guidelines for the use of standard atomic weights are given. This use involves the derivation of a value and a standard uncertainty from a standard atomic weight, which is explained in accordance with the requirements of the Guide to the Expression of Uncertainty in Measurement. Both the use of standard atomic weights with the law of propagation of uncertainty and the Monte Carlo method are described. Furthermore, methods are provided for calculating uncertainties of relative molecular masses of substances and their mixtures. Methods are also outlined to compute material-specific atomic weights whose associated uncertainty may be smaller than the uncertainty associated with the standard atomic weights.


2020 ◽  
Vol 58 (8) ◽  
pp. 1182-1190 ◽  
Author(s):  
Ian Farrance ◽  
Robert Frenkel ◽  
Tony Badrick

AbstractThe long-anticipated ISO/TS 20914, Medical laboratories – Practical guidance for the estimation of measurement uncertainty, became publicly available in July 2019. This ISO document is intended as a guide for the practical application of estimating uncertainty in measurement (measurement uncertainty) in a medical laboratory. In some respects, the guide does indeed meet many of its stated objectives with numerous very detailed examples. Even though it is claimed that this ISO guide is based on the Evaluation of measurement data – Guide to the expression of uncertainty in measurement (GUM), JCGM 100:2008, it is with some concern that we believe several important statements and statistical procedures are incorrect, with others potentially misleading. The aim of this report is to highlight the major concerns which we have identified. In particular, we believe the following items require further comment: (1) The use of coefficient of variation and its potential for misuse requires clarification, (2) pooled variance and measurement uncertainty across changes in measuring conditions has been oversimplified and is potentially misleading, (3) uncertainty in the results of estimated glomerular filtration rate (eGFR) do not include all known uncertainties, (4) the international normalized ratio (INR) calculation is incorrect, (5) the treatment of bias uncertainty is considered problematic, (6) the rules for evaluating combined uncertainty in functional relationships are incomplete, and (7) specific concerns with some individual statements.


2011 ◽  
Vol 110-116 ◽  
pp. 2497-2503 ◽  
Author(s):  
Zdenek Vintr ◽  
Michal Vintr

Rolling bearings are usually considered to be non-repaired items the reliability of which is characterized by mean time to failure, or so called basic rating life. Reliability describes these parameters well in case the bearings are used in operation up to the very time the failure occurs, or during the time corresponding with basic rating life. In case of railway applications the bearings are often used in large groups and are preventively replaced after much shorter operating time as compared with their basic rating life. In the article there is a model which enables us to describe the bearings reliability in this specific case and to specify a number of failures which might be expected from a group of bearings during operating time, or to determine mean operating time between failures of bearings.


2018 ◽  
Vol 154 ◽  
pp. 01056
Author(s):  
Fifi Herni Mustofa ◽  
Ria Ferdian Utomo ◽  
Kusmaningrum Soemadi

PT Lucas Djaja is a company engaged in the pharmaceutical industry which produce sterile drugs and non-sterile. Filling machine has a high failure rate and expensive corrective maintenance cost. PT Lucas Djaja has a policy to perform engine maintenance by way of corrective maintenance. The study focused on the critical components, namely bearing R2, bearing 625 and bearing 626. When the replacement of the failure done by the company is currently using the formula mean time to failure with the result of bearing R2 at point 165 days, bearing 625 at a point 205 days, and bearing 626 at a point 182 days. Solutions generated by using age replacement method with minimization of total maintenance cost given on the bearing R2 at a point 60 days, bearing 625 at the point of 80 days and bearing 626 at a point 40 days.


Sign in / Sign up

Export Citation Format

Share Document