scholarly journals Reducing the Cost of Model-Based Testing through Test Case Diversity

Author(s):  
Hadi Hemmati ◽  
Andrea Arcuri ◽  
Lionel Briand
2018 ◽  
Vol 26 (4) ◽  
pp. 1451-1482 ◽  
Author(s):  
João Felipe S. Ouriques ◽  
Emanuela G. Cartaxo ◽  
Patrícia D. L. Machado

2018 ◽  
Vol 2018 ◽  
pp. 1-14
Author(s):  
Paulo Diego Barbosa da Silva ◽  
Ana Maria Ambrosio ◽  
Emilia Villani

Operational simulators have a fundamental role in space programs. During a satellite operation, these simulators are essential for validating critical manoeuvres, testing new on-board software versions, and supporting the diagnosis of anomalies. With the purpose of reusing the operational simulators, the Brazilian National Institute for Space Research has proposed a new standard for the specification of the components that must be integrated in their in-house developed simulators. The new standard describes the behaviour of satellite subsystems using cause-effect tables that relate telecommands, electrical switches, equipment working states, energy consumption, telemetries, and operating modes of the subsystem. Using this new standard as input, this work proposes an approach that merges model-based testing and model checking to verify the correct implementation of new components in the satellite simulator. The verification approach consists of extracting state machines from the cause-effect tables and used it to automatically derive a test case suite. In order to validate the proposal, we applied it to three different satellite subsystems and assessed the results obtained from the test campaigns. In all the three cases, the proposed approach identified errors in the simulator components that were not initially detected by the traditional testing approach used at the Brazilian National Institute for Space Research.


Author(s):  
Aneesa Saeed ◽  
Siti Hafizah Ab Hamid ◽  
Asmiza Abdul Sani

Model-based testing (MBT) seems to be gaining interest in industry and academia due to its provision of systematic, automated and comprehensive testing. The challenge in MBT is to generate optimal test data to execute test cases. Recently, researchers have successfully applied search-based techniques (SBTs) by automating the search for an optimal set of test data at reasonable cost compared to other more expensive techniques. In real complex systems, effectiveness and cost of SBTs for MBT in industrial context are little known. The objective of this study is to empirically evaluate the cost and the effectiveness of SBTs for MBT on industrial case studies. We applied a model-driven approach and SBTs to automatically generate executable feasible test cases. The results show that the model-driven approach generated high number of infeasible test cases with less time while genetic algorithm (GA) and simulating annealing (SA) outperformed significantly random search (RS) with high generation time. We concluded that local SBTs are more appropriate to generate test data when the type of the constraints is simple. Current work on analyzing the cost and effectiveness on SBTs for MBT indicates possible enhancement using the model-driven approach to detect the infeasible paths and SBTs to achieve optimal success rate.


2018 ◽  
Vol 21 (1) ◽  
Author(s):  
Constanza Pérez ◽  
Beatriz Marín

[Context] The growing demand for high-quality software has caused the industry to incorporate processes to enable them to comply with these standards, but increasing the cost of development. A strategy to reduce this cost is to incorporate quality evaluations from early stages of software development. A technique that facilitates this evaluation is the model-based testing, which allows to generate test cases at early phases using as input the conceptual models of the system. [Objective] In this paper, we introduce TCGen, a tool that enables the automatic generation of abstract test cases starting from UML conceptual models. [Method] The design and implementation of TCGen, a technique that applies different testing criteria to class diagrams and state transition diagrams to generates test cases, is presented as a model-based testing approach. To do that, TCGen uses UML models, which are widely used at industry and a set of algorithms that recognize the concepts in the models in order to generate abstract test cases. [Results] An exploratory experimental evaluation has been performed to compare the TCGen tool with traditional testing. [Conclusions] Even though the exploratory evaluation shows promising results, it is necessary to perform more empirical evaluations in order to generalize the results. Abstract (in Spanish): [Contexto] La creciente demanda de software de alta calidad ha provocado que la industria incorpore procesos para permitirles cumplir con estos estándares, pero aumentando el costo del desarrollo. Una estrategia para reducir este costo es incorporar evaluaciones de calidad desde las primeras etapas del desarrollo del software. Una técnica que facilita esta evaluación es la prueba basada en modelos, que permite generar casos de prueba en fases tempranas utilizando como entrada los modelos conceptuales del sistema. [Objetivo] En este artículo, presentamos TCGen, una herramienta que permite la generación automática de casos de pruebas abstractas a partir de modelos conceptuales UML. [Método] El diseño e implementación de TCGen, una técnica que aplica diferentes criterios de prueba a los diagramas de clases y diagramas de transición de estados para generar casos de prueba, se presenta como un enfoque de prueba basado en modelos. Para hacer eso, TCGen utiliza modelos UML, que son ampliamente utilizados en la industria y un conjunto de algoritmos que reconocen los conceptos en los modelos para generar casos de prueba abstractos. [Resultados] Se realizó una evaluación experimental exploratoria para comparar la herramienta TCGen con las pruebas tradicionales. [Conclusiones] Aunque la evaluación exploratoria muestra resultados prometedores, es necesario realizar más evaluaciones empíricas para generalizar los resultados.  


2020 ◽  
Vol 16 (1) ◽  
Author(s):  
Defri Kurniawan ◽  
Danang Wahyu Utomo ◽  
Novita Kurnia Ningrum

Pembuatan kasus uji (<em>test case generation</em>) merupakan tahapan yang membutuhkan sumber daya terbesar yang memiliki pengaruh terhadap keefektifan dan efisiensi suatu pengujian perangkat lunak. Pembuatan <em>test case</em> menjadi salah satu topik penelitian paling manarik. Pengujian berbasis model (<em>model based testing</em>) diusulkan untuk membuat kasus uji pada Sistem Layanan Permohonan Rohaniwan Kementerian Agama Provinsi Jawa Tengah. Model yang diusulkan dalam pembuatan kasus uji dimulai dari kegiatan pengumpulan kebutuhan, menganalisa <em>use case</em> dan <em>class</em>, mengidentifikasi <em>state</em>, melakukan pemodelan perilaku (<em>behaviour modelling</em>) menggunakan<em> state machine diagram</em> dan membuat daftar kasus uji. Penelitian menunjukkan penggunaan model berbasis <em>state</em> mempu mendukung pembuatan kasus uji (<em>test case</em>) dan dapat mendeteksi perilaku (<em>behavior</em>) dari <em>response</em> sistem yang kurang sesuai terhadap inputan atau aksi yang diberikan oleh <em>user.</em>


Author(s):  
Swapan Bhattacharya ◽  
Ananya Kanjilal ◽  
Sabnam Sengupta

Software testing has gained immense importance in the present competitive world of developing software more quickly, more efficiently and more accurately. Testing activity is carried out throughout the lifecycle of software development and not only towards the end of development. Time and effort required to correct errors, detected later is much more compared to those, which are detected earlier. This has direct impact on costs and has led to a splurge of research activities in this domain. Model-based testing has recently gained attention with the popularization of modeling itself. It refers to testing and test case generation based on a model that describes the behavior of the system. The OMG initiative MDA has revolutionized the way models would be used for software development. There are a number of modeling techniques in use today- some have formal syntax like Z, VDM while some are semi-formal like UML. We have made a comprehensive summary of a considerable number of research works on Model Based testing. First, the issues, challenges and problems of model based testing have been discussed. Then the different methods developed for testing or test case generation based on the models are summarized. Finally a list of model based testing tools used for testing has been collectively presented.


Author(s):  
Arshpreet Kaur Sidhu ◽  
Sumeet Kaur Sehra

Testing of software is broadly divided into three types i.e., code based, model based and specification based. To find faults at early stage, model based testing can be used in which testing can be started from design phase. Furthermore, in this chapter, to generate new test cases and to ensure the quality of changed software, regression testing is used. Early detection of faults will not only reduce the cost, time and effort of developers but also will help finding risks. We are using structural metrics to check the effect of changes made to software. Finally, the authors suggest identifying metrics and analyze the results using NDepend simulator. If results show deviation from standards then again perform regression testing to improve the quality of software.


2010 ◽  
Vol 121-122 ◽  
pp. 1033-1037
Author(s):  
Wei Zheng ◽  
Hai Tao Xu ◽  
Lu Shuai Guan

With the rapidly development and widely acceptance of MDD(Model Based Design), MBT(Model Based Test) has been presented for many years, it matches test-first concept, has been widely accepted. In this paper, basic process of model based testing is presented firstly, after that, key technologies such as Model instruct, test case selection, test script running etc. are discussed. Actual test case with Specific Explorer is presented and test result analysis is presented.


Sign in / Sign up

Export Citation Format

Share Document