scholarly journals Sandia Verification and Validation Challenge Problem: A PCMM-Based Approach to Assessing Prediction Credibility

Author(s):  
Lauren L. Beghini ◽  
Patricia D. Hough

The process of establishing credibility in computational model predictions via verification and validation (V&V) encompasses a wide range of activities. Those activities are focused on collecting evidence that the model is adequate for the intended application and that the errors and uncertainties are quantified. In this work, we use the predictive capability maturity model (PCMM) as an organizing framework for evidence collection activities and summarizing our credibility assessment. We discuss our approaches to sensitivity analysis, model calibration, model validation, and uncertainty quantification and how they support our assessments in the solution verification, model validation, and uncertainty quantification elements of the PCMM. For completeness, we also include some limited assessment discussion for the remaining PCMM elements. Because the computational cost of performing V&V and the ensuing predictive calculations is substantial, we include discussion of our approach to addressing computational resource considerations, primarily through the use of response surface surrogates and multiple mesh fidelities.

Author(s):  
E. Yuliawati ◽  
Pratikto ◽  
Sugiono ◽  
O. Novareza

This study develops a method to measure the performance level of reverse logistics implementation operated by companies engaged in the construction machinery remanufacturing industry. A framework of reverse logistics performance measurement that focuses on the processes and resources is developed using the Capability Maturity Model approach. The framework was designed in three dimensions: front-end, engine, and back-end, with five levels of model maturity, i.e., initial, aware, defined, managed, and optimizing. The assessment was carried out through 25 indicators and model validation was done by implementing the proposed framework on three construction machinery remanufacturing companies in Indonesia. The results show that the three companies were at different maturity levels. Further analysis explains that the front-end dimension has the lowest score of a successful reverse logistics implementation. Therefore, companies that engage in a similar field should focus more on the front-end dimension to improve their overall reverse logistics performance.


2010 ◽  
Vol 20 (03) ◽  
pp. 477-517 ◽  
Author(s):  
J. TINSLEY ODEN ◽  
ANDREA HAWKINS ◽  
SERGE PRUDHOMME

While a large and growing literature exists on mathematical and computational models of tumor growth, to date tumor growth models are largely qualitative in nature, and fall far short of being able to provide predictive results important in life-and-death decisions. This is largely due to the enormous complexity of evolving biological and chemical processes in living tissue and the complex interactions of many cellular and vascular constituents in living organisms. Several new technologies have emerged, however, which could lead to significant progress in this important area: (i) the development of so-called phase-field, or diffuse-interface models, which can be developed using continuum mixture theory, and which provide a general framework for modeling the action of multiple interacting constituents. These are based on generalizations of the Cahn–Hilliard models for spinodal decomposition, and have been used recently in certain tumor growth theories; (ii) the emergence of predictive computational methods based on the use of statistical methods for calibration, model validation, and uncertainty quantification; (iii) advances in imaging, experimental cell biology, and other medical observational methodologies; and (iv) the advent of petascale computing that makes possible the resolution of features at scales and at speeds that were unattainable only a short time in the past. Here we develop a general phenomenological thermomechanical theory of mixtures that employs phase-field or diffuse interface models of surface energies and reactions and which provides a framework for generalizing existing theories of the types that are in use in tumor growth modeling. In principle, the framework provides for the effects of M solid constituents, which may undergo large deformations, and for the effect of N - M fluid constituents, which could include highly nonlinear, non-Newtonian fluids. We then describe several special cases which have the potential of providing acceptable models of tumor growth. We then describe the beginning steps of the development of Bayesian methods for statistical calibration, model validation, and uncertainty quantification, which, with further work, could produce a truly predictive tool for studying tumor growth. In particular, we outline the processes of statistical calibration and validation that can be employed to determine if tumor growth models, drawn from the broad class of models developed here, are valid for prediction of key quantities of interest critical to making decisions on various medical protocols. We also describe how uncertainties in such key quantities of interest can be quantified in ways that can be used to establish confidence in predicted outcomes.


Author(s):  
Edgardo Palza Vargas

We aim to improve quality in software engineering projects by introducing Verification and Validation (V&V) best practices in terms of process, artifacts, and quality performance indicators. We present a Quality Measurement Management Tool (QMT) in order to support quality activities and process. This tool is based on a measurement meta-model repository for collecting, storing, analyzing and reporting measurement data. It is important to note that the proposed QMT supports the IEEE Standard 1012 for Software Verification and Validation (management, acquisition, supply, development, operation, and maintenance), as well as measurement information needs to Capability Maturity Model Integration (CMMI) processes and products requirements. Our repository is generic, flexible, and integrated, supporting a dynamic measurement system. It was originally designed to support Ericsson Research Canada’s business information needs.


Author(s):  
Edgardo Palza Vargas

We aim to improve quality in software engineering projects by introducing Verification and Validation (V&V) best practices in terms of process, artifacts, and quality performance indicators. We present a Quality Measurement Management Tool (QMT) in order to support quality activities and process. This tool is based on a measurement meta-model repository for collecting, storing, analyzing and reporting measurement data. It is important to note that the proposed QMT supports the IEEE Standard 1012 for Software Verification and Validation (management, acquisition, supply, development, operation, and maintenance), as well as measurement information needs to Capability Maturity Model Integration (CMMI) processes and products requirements. Our repository is generic, flexible, and integrated, supporting a dynamic measurement system. It was originally designed to support Ericsson Research Canada’s business information needs.


Author(s):  
V. M. Krushnarao Kotteda ◽  
Anitha Kommu ◽  
Vinod Kumar ◽  
William Spotz

Abstract Fluidized beds are used in a wide range of applications in gasification, combustion, and process engineering. Multiphase flow in such applications involves numerous uncertain parameters. Uncertainty quantification provides uncertainty in syngas yield and efficiency of coal/biomass gasification in a power plant. Techniques such as sensitivity analysis are useful in identifying parameters that have the most influence on the quantities of interest. Also, it helps to decrease the computational cost of the uncertainty quantification and optimize the reactor. We carried out a nondeterministic analysis of flow in a biomass reactor. The flow in the reactor is simulated with National Energy Technology Laboratory’s open source multiphase fluid dynamics suite MFiX. It does not possess tools for uncertainty quantification. Therefore, we developed a C++ wrapper to integrate an uncertainty quantification toolkit developed at Sandia National Laboratory with MFiX. The wrapper exchanges uncertain input parameters and critical output parameters among Dakota and MFiX. We quantify uncertainty in key output parameters via a sampling method. In addition, sensitivity analysis is carried out for all eight uncertain input parameters namely particle-particle restitution coefficient, angle of internal friction, coefficient of friction between two-phases, velocity of the fluidizing agent at the inlet, velocity of the biomass particles at the inlet, diameter of the biomass particles, viscosity of the fluidizing agent, and the percentage of nitrogen/oxygen in the fluidizing agent.


2020 ◽  
Vol 32 (1) ◽  
pp. 81-100
Author(s):  
Taisa Guidini Gonçalves ◽  
Pierre Loslever ◽  
Káthia Marçal de Oliveira ◽  
Christophe Kolski

Abstract Do human–computer interaction (HCI) researchers agree about which HCI approaches should be used in the development of an interactive system? To address this question, we performed a study based on the engineering process areas (requirements development, technical solution, product integration, verification and validation) of the CMMI-DEV (Capability Maturity Model Integration for Development), a software engineering model commonly used in the industry. To carry out this study, a literature review was performed, a specific instrument was designed based on CMMI-DEV and interviews with 20 researchers from the HCI domain were conducted. Analyzing the interview data with monovariate and multivariate statistical approach (Multiple Correspondence Analysis - MCA), we find the greatest agreement occurred among researchers for HCI approaches that support verification and validation phases and the use of functional prototypes in some activities of the last phases of software development (technical solution and product integration). However, we identified lack of agreement among researchers regarding requirements development activities.


2021 ◽  
Author(s):  
Natasha North ◽  
Minette Coetzee

Abstract Background: Developing high-quality and sustainable training programmes to meet the increasing demand for specialist children’s nurses in African countries requires collaborative efforts by multiple stakeholders, systems and organisational tiers. This is made more challenging in the absence of a comprehensive framework for specialist nursing educational programme development. This project set out to develop a Capability Maturity Model in order to systematically describe the essential capacity required to establish a new specialist children’s nursing education programme in an African context. Methods: Previous Capability Maturity Models developed in the fields of nursing regulation and human resources for health information systems were used to guide the process of development. A six-stage process was followed to: identify necessary supportive conditions; specify levels of process maturity; develop domains; characterise levels of capability; consult with stakeholders; and finalise the model. Results: The process resulted in the identification of set of five step-wise progressions for each of five stakeholder activity domains, and the creation of a comprehensive Capability Maturity Model describing five levels of process maturity in relation to education, clinical and regulatory systems, human resources for health systems, and requirements related to overall stakeholder collaboration. Stakeholder consultation confirmed the accuracy and applicability of the model. Conclusions: The model successfully makes visible the wide range of regulatory and associated processes involved in developing a new educational programme for specialist nurses, including educational standards, quality assurance, scopes of practice, and systems for licensing and registering specialist children’s nurses. Stakeholders will be able to sue the model as a map to identify where they are in the process, and establish the resources and actions needed to make further progress.


Sign in / Sign up

Export Citation Format

Share Document