Correction to: Factorials Experiments, Covering Arrays, and Combinatorial Testing

Software testing is an essential activity to ensure the quality of software systems. Combinatorial testing is a method that facilitates the software testing process; it is based on an empirical evidence where almost all faults in a software component are due to the interaction of very few parameters. The test generation problem for combinatorial testing can be represented as the construction of a matrix that has certain properties; typically this matrix is a covering array. Covering arrays have a small number of tests, in comparison with an exhaustive approach, and provide a level of interaction coverage among the parameters involved. This paper presents a repository that contains binary covering arrays involving many levels of interaction. Also, it discusses the importance of covering array repositories in the construction of better covering arrays. In most of the cases, the size of the covering arrays included in the repository reported here are the best upper bounds known, moreover, the files containing the matrices of these covering arrays are available to be downloaded. The final purpose of our Binary Covering Arrays Repository (BCAR) is to provide software testing practitioners the best-known binary test-suites.

Download Full-text

Utilizing Combinatorial Testing on Discrete Event Simulation Models for Sustainable Manufacturing

Volume 2: 29th Computers and Information in Engineering Conference, Parts A and B ◽

10.1115/detc2009-86522 ◽

2009 ◽

Cited By ~ 4

Author(s):

Bjo¨rn Johansson ◽

Raghu Kacker ◽

Ru¨ediger Kessel ◽

Charles McLean ◽

Ram Sriram

Keyword(s):

Discrete Event Simulation ◽

Manufacturing Systems ◽

Discrete Event ◽

Sustainable Manufacturing ◽

Optimal Solution ◽

Computation Time ◽

Simulation Models ◽

Combinatorial Testing ◽

Covering Arrays ◽

Event Simulation

This paper describes how combinatorial testing using covering arrays can be implemented to optimize discrete event simulation models of manufacturing systems for measures of sustainability. Discrete event simulation models often have hundreds of parameters and many test values for each parameter. Generally the interactions between the parameter-values are not well understood; this can lead to sub-optimization of the system. Most optimization engines and software for discrete event simulation packages use full factorial designs, which require many runs and hence a lot of computation time. In this paper we introduce combinatorial testing using a test-suite generation tool called NIST-ACTS (National Institute of Standards and Technology - Advanced Combinatorial Test Suites) to dramatically decrease the number of runs required to detect the interactions and determine an optimal solution.

Download Full-text

Towards automated assessment generation in e-learning systems using combinatorial testing and Formal Concept Analysis

IEEE Access ◽

10.1109/access.2021.3070510 ◽

2021 ◽

pp. 1-1

Author(s):

Frano Skopljanac-Macina ◽

Ivona Zakarija ◽

Bruno Blaskovic

Keyword(s):

Formal Concept Analysis ◽

Concept Analysis ◽

Learning Systems ◽

Formal Concept ◽

Combinatorial Testing ◽

Automated Assessment ◽

E Learning

Download Full-text

Automatic Generation of Parallel Java Programs and their Validation using Combinatorial Testing Suites

2021 IEEE 6th International Conference on Computer and Communication Systems (ICCCS) ◽

10.1109/icccs52626.2021.9449249 ◽

2021 ◽

Author(s):

Calanna Salvatore ◽

Andrea Calvagna ◽

Andrea Fornaia ◽

Riccardo Torrisi ◽

Emiliano Tramontana

Keyword(s):

Automatic Generation ◽

Combinatorial Testing ◽

Java Programs

Download Full-text

Combinatorial Testing Approach for Cloud Mobility Service

Proceedings of the 2019 2nd Artificial Intelligence and Cloud Computing Conference ◽

10.1145/3375959.3375967 ◽

2019 ◽

Author(s):

Behailu Getachew Wolde ◽

Abiot Sinamo Boltana

Keyword(s):

Combinatorial Testing ◽

Mobility Service ◽

Testing Approach

Download Full-text

Combinatorial Testing in an Industrial Environment -- Analyzing the Applicability of a Tool

2014 9th International Conference on the Quality of Information and Communications Technology ◽

10.1109/quatic.2014.36 ◽

2014 ◽

Cited By ~ 1

Author(s):

Nelly Condori-Fernandez ◽

Peter M. Kruse ◽

Tanja E. J. Vos ◽

Etienne Brosse ◽

Alessandra Bagnato

Keyword(s):

Combinatorial Testing ◽

Industrial Environment

Download Full-text

New optimal covering arrays using an orderly algorithm

Discrete Mathematics Algorithms and Applications ◽

10.1142/s1793830918500118 ◽

2018 ◽

Vol 10 (01) ◽

pp. 1850011 ◽

Cited By ~ 1

Author(s):

Idelfonso Izquierdo-Marquez ◽

Jose Torres-Jimenez

Keyword(s):

Small Subset ◽

Computational Results ◽

Covering Array ◽

Covering Arrays ◽

Computational Search ◽

Minimum Number ◽

Orderly Algorithm

A covering array [Formula: see text] is an [Formula: see text] array such that every [Formula: see text] subarray covers at least once each [Formula: see text]-tuple from [Formula: see text] symbols. For given [Formula: see text], [Formula: see text], and [Formula: see text], the minimum number of rows for which exists a CA is denoted by [Formula: see text] (CAN stands for Covering Array Number) and the corresponding CA is optimal. Optimal covering arrays have been determined algebraically for a small subset of cases; but another alternative to find CANs is the use of computational search. The present work introduces a new orderly algorithm to construct non-isomorphic covering arrays; this algorithm is an improvement of a previously reported algorithm for the same purpose. The construction of non-isomorphic covering arrays is used to prove the nonexistence of certain covering arrays whose nonexistence implies the optimality of other covering arrays. From the computational results obtained, the following CANs were established: [Formula: see text] for [Formula: see text], [Formula: see text], and [Formula: see text]. In addition, the new result [Formula: see text], and the already known existence of [Formula: see text], imply [Formula: see text].

Download Full-text