An Empirical Evaluation of Mutation Testing for Improving The Test Quality of Web Application’s Security

Author(s):  
Solanke Vikas ◽  
2019 ◽  
Vol 44 (4) ◽  
pp. 379-405
Author(s):  
Tomasz Lewowski ◽  
Lech Madeyski

Abstract Background: Mutation testing is a widely explored technique used to evaluate the quality of software tests, but little attention has been given to its mathematical foundations. Aim: We provide a formal description of the core concepts in mutation testing, relations between them and conclusions that can be drawn from the presented model. Method: We introduce concepts of mutant space and patch space, and refer to patch merging procedure from the patch theory. We explicitly present constraints, such as location-dependence, that affect mutation operators. We also present a way to use introduced formalism with traditional operators proposed in other papers. Results: The proposed formalism allows to describe interactions between separate mutations using well-known abstract algebra notation. Conclusion: The presented formalism may substantially decrease the number of tested weak mutants and increase the number of valuable ones, while giving tools to partially address the problem of equivalent mutants, particularly for higher-order mutation testing. However, additional empirical evaluation is still needed.


2016 ◽  
Vol 20 (1) ◽  
pp. 1-10
Author(s):  
C. Heri Sulistiawan

Penelitian ini bertujuan untuk mendeskripsikan kualitas soal Ujian Sekolah Matematika program IPA dan kontribusi skor Ujian Sekolah terhadap nilai Ujian Nasional. Jenis penelitian ini deskriptif eksploratif dengan pendekatan survei. Populasi penelitian ini adalah enam SMA Swasta Yayasan Katolik di Kota Yogyakarta. Sampel adalah lima SMA yang representatif dalam menggambarkan ciri populasi. Naskah soal ditelaah tiga orang ahli untuk analisis kualitas soal secara kualitatif. Jawaban siswa dianalisis secara Teori Tes Klasik dan Teori Respons Butir untuk mengetahui kualitas soal secara kuantitatif. Skor Ujian Sekolah dikorelasikan terhadap nilai Ujian Nasional untuk mengukur kontribusinya. Hasil penelitian: (1) kualitas soal secara kualitatif adalah sangat baik (satu SMA), baik (dua SMA), cukup baik (satu SMA), dan kurang baik (satu SMA); (2) secara kuantitatif menurut Teori Tes Klasik adalah cukup baik (satu SMA), kurang baik (tiga SMA), dan tidak baik (satu SMA), dengan reliabilitas Alpha termasuk reliabel; (3) secara kuantitatif menurut Teori Respons Butir adalah baik (tiga SMA), cukup baik (satu SMA), dan kurang baik (satu SMA); (4) Indeks konsistensi analisis butir soal termasuk cukup konsisten; (5) korelasi skor Ujian Sekolah terhadap nilai Ujian Nasional termasuk kategori besar; (6) berdasarkan telaah validitas isi perangkat, lebih dari 90% soal valid dan skor Ujian Sekolah valid/akurat dalam memprediksi hasil Ujian Nasional.Kata kunci: kualitas soal, ujian sekolah, matematika, ujian nasional THE QUALITY OF MATHEMATICS SCHOOL EXAMINATION OF SCIENCE MAJOR AND ITS CONTRIBUTION TO THE RESULT OF NATIONAL EXAMINATIONAbstractThe purpose of this research is to describe the quality of Mathematics School Examination of Science Major and the contribution of School Examination scores to the result of National Examination. This research is a descriptive explorative research with survey approach. The population in this research are six Senior High Schools in Yogyakarta. The samples are five representative senior high schools to describe the characteristics of the population. The test was analyzed by three experts to find out the test quality qualitatively. The students’ answer was analyzed with Classic Test Theory and Item Response Theory to find out the test quality quantitatively. The School Examination score was correlated with the National Examination score to measure their contribution. The research result: (1) the school exam quality is very good (one school), good (two schools), quite good (one school), and not so good (one school); (2) Quantitatively based on Classic Test Theory are quite good (one school), not so good (three schools), dan poor (one school), by Alpha reliability is reliable; (3) Quantitatively based on Item Response Theory are good (three schools), quite good (one school), and not so good (one school); (4) The test item index consistency are quite consistent; (5) The correlation of the School Examination scores with the result of National Examination is in large categories; (6) Based on content validity study, more than 90% items are valid and scores of School Examination is valid/accurate in predicting the result of the National Examination.Keywords: the test quality, school examination, mathematics, national examination


2013 ◽  
Vol 378 ◽  
pp. 546-551 ◽  
Author(s):  
Joanna Strug ◽  
Barbara Strug

Mutation testing is an effective technique for assessing quality of tests provided for a system. However it suffers from high computational cost of executing mutants of the system. In this paper a method of classifying such mutants is proposed. This classification is based on using an edit distance kernel and k-NN classifier. Using the results of this classification it is possible to predict whether a mutant would be detected by tests or not. Thus the application of the approach can help to lower the number of mutants that have to be executed and so also to lower the cost of using the mutation testing.


2021 ◽  
Vol 13 (47) ◽  
pp. 139-139
Author(s):  
Vladimir V Drozdov

Background: Etiology of various gastrointestinal dysfunctions varies from infections and infestations to consequences of emotional stress and errors in animals’ nutrition. Taking this variability of etiology and pathogenesis into account, a lot depends not only on completeness of homeopathic history taking but also on the quality of laboratory studies. In our experience, coprology studies are especially complicated when persistent gastrointestinal disorders were preceded by massive use of allopathic remedies. This sometimes necessitates repeated examinations. That is why our interest in having reliable results and early detection of latent indigestion made us look for non-invasive methods which could be easy to use in animals but at the same time could reveal latent gastrointestinal pathology in animals. Aims: The study was aimed to determine the effect of a homeopathic medication Nux Vomica 6CH on detection of latent gastrointestinal pathology in small domestic animals. Method: Coprology studies were performed simultaneously with the use of sedimentation method and Fulleborn method (modification of Scherbovich). Infestations were diagnosed and characteristics of patient digestion were recorded. Feces test detected: 1. Presence of endoparasites (helminths, protozoa and yeast-like structures); 2. State of intestinal microflora (presence of different species and their balance with each other); 3. Degree of food absorbency (presence or lack of undigested protein, carbohydrates and fat); 4. Presence of inedible inclusions; 5. Presence of cells (lymphocytes, erythrocytes, intestinal epithelium, tumor fragments). If animal feces tests were non-informative, then all medications (except vitally important) were discontinued and Nux Vomica 6CH twice a day twenty minutes prior to food intake was prescribed for 6 days (4 globules dissolved in 10 ml of water). Results: 4500 coprology tests were performed during 3 years in cats and dogs. About 10% of the total number of examined animals (449 patients) produced very little information about the state of gastrointestinal systems at the first examination. When these cases were analyzed, the following reasons were found: long-term use of strong drugs, significant weakening of body immune system. As a result diagnostic tests were of very little value. These animals were treated by Nux Vomica 6CH for 6 days and then repeated feces test was performed. This produced a more informative picture of the state of gastrointestinal system and enabled to determine etiology and pathogenesis of the animal condition and prescribe necessary treatment. Conclusion. In such a way, Nux Vomica 6CH homeopathic remedy promoted effective optimization of coprology studies in animals. The suggested scheme of use for Nux Vomica 6CH significantly improves feces test quality. This in turn reduces time needed to choose strategy and tactics of treatment of small domestic animals with different chronic diseases.


2018 ◽  
Vol 41 (1) ◽  
pp. 53-73 ◽  
Author(s):  
Jennyfer Portilla Yela ◽  
José Rafael Tovar Cuevas

In this paper, we developed an empirical evaluation of four estimation procedures for the dependence parameter of the Gumbel-Barnett copula obtained from a Gumbel type I distribution. We used the maximum likelihood, moments and Bayesian methods and studied the performance of the estimates, assuming three dependence levels and 20 different sample sizes. For each method and scenario, a simulation study was conducted with 1000 runs and the quality of the estimator was evaluated using four different criteria. A Bayesian estimator assuming a Beta(a,b) as prior distribution, showed the best performance regardless the sample size and the dependence structure.


Sign in / Sign up

Export Citation Format

Share Document