Guiding Simulation Model Verification by Model Checking

2010 ◽  
Vol 44-47 ◽  
pp. 3508-3513
Author(s):  
Wei Xia ◽  
Yi Ping Yao ◽  
Xiao Dong Mu ◽  
Fei Xing
Keyword(s):  
Model Checking ◽  
Simulation Model ◽  
Formal Methods ◽  
Important Determinant ◽  
Simulation Models ◽  
Systems Development ◽  
Model Verification ◽  
Model Driven ◽  
Simulation Speed ◽  
Simulation Systems

The accuracy and credibility of model is the most important determinant of development of Modeling and Simulation (M&S). There is a desperate need for an immediate practical solution to the problem of VV&A (Validation, Verification and Accreditation) of simulation systems. A discussion and experiment of the relative merits of informal methods and formal methods are provided in this paper. In spite of increasing simulation speed via parallelization, the number of problem cases that can be covered is not highly increased. On the other hand, formal methods have proven to be valuable techniques, but they require detailed specifications of systems and requirements, therefore they are not very accessible in practical simulation systems development. According to the exhaustiveness of formal methods, a Model Driven Architecture (MDA) based simulation VV&A framework guided by model checking is presented in this paper. This framework combines scalability of simulation with exhaustiveness of formal methods in order to get the best of both worlds for simulation model verification. It can provide more confidence in simulation models and increase the use of formal methods in the context of M&S by people that are not trained in formal techniques.

scholarly journals Model Driven Combat Effectiveness Simulation Systems Engineering

2020 ◽  
Vol 70 (1) ◽  
pp. 54-59
Author(s):  
Zhi Zhu ◽  
Yonglin Lei ◽  
Yifan Zhu
Keyword(s):  
Decision Making ◽  
Simulation Model ◽  
Conceptual Model ◽  
Systems Engineering ◽  
Simulation Models ◽  
Proof Of Concept ◽  
Model Driven Engineering ◽  
Model Driven ◽  
Combat Effectiveness ◽  
Simulation Systems

Model-driven engineering has become popular in the combat effectiveness simulation systems engineering during these last years. It allows to systematically develop a simulation model in a composable way. However, implementing a conceptual model is really a complex and costly job if this is not guided under a well-established framework. Hence this study attempts to explore methodologies for engineering the development of simulation models. For this purpose, we define an ontological metamodelling framework. This framework starts with ontology-aware system conceptual descriptions, and then refines and transforms them toward system models until they reach final executable implementations. As a proof of concept, we identify a set of ontology-aware modelling frameworks in combat systems specification, then an underwater targets search scenario is presented as a motivating example for running simulations and results can be used as a reference for decision-making behaviors.

scholarly journals The General Principles of the Transportation Simulation Model Development and Validation

2020 ◽  
Vol 15 ◽  
Keyword(s):  
Simulation Model ◽  
Model Validation ◽  
Management Strategies ◽  
Model Development ◽  
Simulation Models ◽  
Model Verification ◽  
Microscopic Simulation ◽  
Calibration Methods ◽  
Transportation Simulation ◽  
Development And Validation

Transportation simulation model development allows simulating traveller’s decisions, evaluating various transportation management strategies and complex solutions. The aim of the paper is to set the general principles of the transportation simulation model development and validation. The paper contains the overview of the transportation simulation models types with the examples from the conducted projects for the Riga city. The basic steps of the simulation model development procedure: initial data preparation and analysis, transportation model development and simulation, scenarios planning and evaluation, and simulation models outcomes evaluation are considered. Simulation model verification, validation and calibration definitions are given. The basic checks for the transportation macroscopic and microscopic simulation model validation are listed. A summary of the transportation simulation model validation and calibration methods and parameters is given.

scholarly journals THE MOST REALISTIC SURGICAL SIMULATION MODEL TO GAIN SKILLS IN LAPAROSCOPIC SURGERY IS THE CADAVERIC MODEL THIEL, ACCORDING TO OPINIONS OF DIFFERENT SPECIALIST SURGEONS

2021 ◽  
Vol 108 (Supplement_3) ◽  
Author(s):  
A Soler Silva ◽  
A Sanchís López ◽  
L Sánchez Guillén ◽  
D Triguero Cánovas ◽  
F López Rodríguez Arias ◽  
...  
Keyword(s):  
Laparoscopic Surgery ◽  
Simulation Model ◽  
Surgical Simulation ◽  
Simulation Models ◽  
Operation Room ◽  
Young Surgeon ◽  
General Surgeons ◽  
Conventional Models ◽  
Simulation Systems ◽  
Surgical Learning

Abstract INTRODUCTION Laparoscopic procedures are still a challenge for the surgeon residents and young surgeon physicians. Different learning systems have been used without achieving a realism faithful to the lived in the operation room. All existing surgical simulation systems should be compared, with the aim of identifying the most realistic of them, for improving the surgical learning. MATERIAL AND METHODS An 18-item survey was sent to different specialized surgeons (general surgeons, gynecologists and urologists) who participated in international postgraduate laparoscopic surgery courses on cadavers embalmed by Thiel method. Participants were asked to the differences and improving skills in each surgical procedure, about the different surgical simulation models that the participants had already used. Surgeons were asked if they would recommend doing it during residency to improve their confidence in the operating room. RESULTS Attendees (n = 104) had a response rate of 92% (96 replies). The 91.8% surgeons recognized that Thiel model was more realistic than others simulation methods. The 97.9 % of respondents believed that had improved their surgical skills. Globally, 96.9% (93) of the participants surveyed recommended the conducting of these courses with Thiel cadavers to different colleagues of other specialties as a reliable simulation measure during the residency period. CONCLUSIONS Participants in the laparoscopic surgery course on the cadaver Thiel recognized that this is more realistic surgical simulation model than conventional models, one of the best ways to gain confidence and improve laparoscopic skills in operation room for inexperienced surgeons.

Credibility Evaluation of Simulation Models

2013 ◽  
Vol 765-767 ◽  
pp. 713-716
Author(s):  
Qi Lin ◽  
Zhi Li
Keyword(s):  
Simulation Models ◽  
Systems Development ◽  
Simulation System ◽  
Verification And Validation ◽  
Evaluation Methodology ◽  
Space Tether ◽  
Evaluation Result ◽  
Evaluation Procedures ◽  
Simulation Systems

This paper discusses an evaluation methodology that can be used to assess the credibility of simulation models. The goal of verification and validation of simulation models will be described, together with a description of evaluation methodology and evaluation procedures. The credibility of simulation models can be evaluated using the method proposed here, which will be much meaningful to the simulation systems development. Taking a space Tether-net simulation system as an instance, the credibility evaluation result is provided.

scholarly journals Some Issues in the Testing of Computer Simulation Models

2016 ◽  
Vol 5 (1) ◽  
pp. 1-10
Author(s):  
David Murray-Smith
Keyword(s):  
Simulation Model ◽  
Model Validation ◽  
Simulation Models ◽  
Model Testing ◽  
Model Verification ◽  
Verification And Validation ◽  
Quality Data ◽  
Model Quality ◽  
Face Validation

The testing of simulation models has much in common with testing processes in other types of application involving software development. However, there are also important differences associated with the fact that simulation model testing involves two distinct aspects, which are known as verification and validation. Model validation is concerned with investigation of modelling errors and model limitations while verification involves checking that the simulation program is an accurate representation of the mathematical and logical structure of the underlying model. Success in model validation depends upon the availability of detailed information about all aspects of the system being modelled. It also may depend on the availability of high quality data from the system which can be used to compare its behaviour with that of the corresponding simulation model. Transparency, high standards of documentation and good management of simulation models and data sets are basic requirements in simulation model testing. Unlike most other areas of software testing, model validation often has subjective elements, with potentially important contributions from face- validation procedures in which experts give a subjective assessment of the fidelity of the model. Verification and validation processes are not simply applied once but must be used repeatedly throughout the model development process, with regressive testing principles being applied. Decisions about when a model is acceptable for the intended application inevitably involve some form of risk assessment. A case study concerned with the development and application of a simulation model of a hydro-turbine and electrical generator system is used to illustrate some of the issues arising in a typical control engineering application. Results from the case study suggest that it is important to bring together objective aspects of simulation model testing and the more subjective face- validation aspects in a coherent fashion. Suggestions are also made about the need for changes in approach in the teaching of simulation techniques to engineering students to give more emphasis to issues of model quality, testing and validation.

scholarly journals Guidelines to Calibrate a Multi-Residential Building Simulation Model Addressing Overheating Evaluation and Residents’ Influence

Buildings ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. 242
Author(s):  
Christoph Schünemann ◽  
David Schiela ◽  
Regine Ortlepp
Keyword(s):  
Simulation Model ◽  
Time Window ◽  
Residential Building ◽  
Simulation Models ◽  
Building Simulation ◽  
Night Time ◽  
Building Performance Simulation ◽  
Starting Point ◽  
3D Simulation Model ◽  
Building Physics

Can building performance simulation reproduce measured summertime indoor conditions of a multi-residential building in good conformity? This question is answered by calibrating simulated to monitored room temperatures of several rooms of a multi-residential building for an entire summer in two process steps. First, we did a calibration for several days without the residents being present to validate the building physics of the 3D simulation model. Second, the simulations were calibrated for the entire summer period, including the residents’ impact on evolving room temperature and overheating. As a result, a high degree of conformity between simulation and measurement could be achieved for all monitored rooms. The credibility of our results was secured by a detailed sensitivity analysis under varying meteorological conditions, shading situations, and window ventilation or room use in the simulation model. For top floor dwellings, a high overheating intensity was evoked by a combination of insufficient use of night-time window ventilation and non-heat-adapted residential behavior in combination with high solar gains and low heat storage capacities. Finally, the overall findings were merged into a process guideline to describe how a step-by-step calibration of residential building simulation models can be done. This guideline is intended to be a starting point for future discussions about the validity of the simplified boundary conditions which are often used in present-day standard overheating assessment.

scholarly journals Collision avoidance during group evasive manoeuvres: a comparison of real versus simulated swarms with manipulated vision and surface wave detectors

2014 ◽  
Vol 281 (1788) ◽  
pp. 20140812 ◽  
Author(s):  
William L. Romey ◽  
Magenta M. Miller ◽  
Jose M. Vidal
Keyword(s):  
Surface Wave ◽  
Sensory Modality ◽  
Simulation Models ◽  
Emergent Properties ◽  
Control Groups ◽  
Group Attraction ◽  
Group Motion ◽  
Coordinate Group ◽  
Group Movements ◽  
Simulation Systems

Coordinated group motion has been studied extensively both in real systems (flocks, swarms and schools) and in simulations (self-propelled particle (SPP) models using attraction and repulsion rules). Rarely are attraction and repulsion rules manipulated, and the resulting emergent behaviours of real and simulation systems are compared. We compare swarms of sensory-deprived whirligig beetles with matching simulation models. Whirligigs live at the water's surface and coordinate their grouping using their eyes and antennae. We filmed groups of beetles in which antennae or eyes had been unilaterally obstructed and measured individual and group behaviours. We then developed and compared eight SPP simulation models. Eye-less beetles formed larger diameter resting groups than antenna-less or control groups. Antenna-less groups collided more often with each other during evasive group movements than did eye-less or control groups. Simulations of antenna-less individuals produced no difference from a control (or a slight decrease) in group diameter. Simulations of eye-less individuals produced an increase in group diameter. Our study is important in (i) differentiating between group attraction and repulsion rules, (ii) directly comparing emergent properties of real and simulated groups, and (iii) exploring a new sensory modality (surface wave detection) to coordinate group movement.

Settings, Experimentation and Evaluation of the Simulation Models

2013 ◽  
Vol 309 ◽  
pp. 366-371 ◽  
Author(s):  
František Manlig ◽  
Radek Havlik ◽  
Alena Gottwaldova
Keyword(s):  
Simulation Model ◽  
New Technology ◽  
Simulation Models ◽  
Manufacturing Processes ◽  
Customer Requirements ◽  
Evaluation Functions ◽  
Operational Management ◽  
Minimum Number ◽  
User Friendly ◽  
Setting Parameters

This paper deals with research in computer simulation of manufacturing processes. The paper summarizes the procedures associated with developing the model, experimenting with and evaluating the model results. The key area is of experimentation with the simulation model and evaluation using indicators or multi-criteria functions. With regards to the experiment the crucial variables are the simulation model. The key ideas are to set the number of variables, depending on what a given simulation will be. For example, when introducing new technology into production, modify the type of warehouse, saving workers, thus economizing. The simulation models for the operational management uses simplified models, if possible, a minimum number of variables to obtain the result in shortest possible time. These models are more user friendly and the course will be conducted mostly in the background. An example of a criteria function is the number of parts produced or production time. Multi-criteria function has given us the opportunity to make better quality decisions. It is based on the composition of several parameters, including their weight to one end point. The type of evaluation functions, whether it is an indicator or criteria function is selected and based on customer requirements. In most cases it is recommended to use the multi-dimensional function. It gives us a more comprehensive view of the results from the model and facilitates decision-making. The result of this paper is a display of setting parameters for the experimentation on a sample model. Furthermore, the comparisons of results with a multi-criteria objective function and one-criterion indicator.

Assessment of urban flooding by dual drainage simulation model RisUrSim

2005 ◽  
Vol 52 (5) ◽  
pp. 257-264 ◽  
Author(s):  
T.G. Schmitt ◽  
M. Thomas ◽  
N. Ettrich
Keyword(s):  
Simulation Model ◽  
Surface Flow ◽  
Water Levels ◽  
Model Verification ◽  
Urban Drainage ◽  
Urban Flooding ◽  
Insurance Company ◽  
Drainage Systems ◽  
Engineering Research ◽  
Urban Drainage Systems

The European research project in the EUREKA framework, RisUrSim is presented with its overall objective to develop an integrated planning tool to allow cost effective management for urban drainage systems. The project consortium consisted of industrial mathematics and water engineering research institutes, municipal drainage works as well as an insurance company. The paper relates to the regulatory background of European Standard EN 752 and the need of a more detailed methodology to simulate urban flooding. The analysis of urban flooding caused by surcharged sewers in urban drainage systems leads to the necessity of a dual drainage modeling. A detailed dual drainage simulation model is described based upon hydraulic flow routing procedures for surface flow and pipe flow. Special consideration is given to the interaction between surface and sewer flow during surcharge conditions in order to most accurately compute water levels above ground as a basis for further assessments of possible damage costs. The model application is presented for a small case study in terms of data needs, model verification and first simulation results.

Sign in / Sign up

Export Citation Format

Share Document