Verifying Digital Components of Physical Systems: Experimental Evaluation of Test Quality

A. V. Laputenko; J. E. López; N. V. Yevtushenko

doi:10.1007/s11182-018-1317-6

Verifying Digital Components of Physical Systems: Experimental Evaluation of Test Quality

Russian Physics Journal ◽

10.1007/s11182-018-1317-6 ◽

2018 ◽

Vol 60 (11) ◽

pp. 2012-2018

Author(s):

A. V. Laputenko ◽

J. E. López ◽

N. V. Yevtushenko

Keyword(s):

Experimental Evaluation ◽

Test Quality ◽

Physical Systems ◽

Digital Components

Download Full-text

Mutation Testing for Effective Verification of Digital Components of Physical Systems

Russian Physics Journal ◽

10.1007/s11182-015-0622-6 ◽

2015 ◽

Vol 58 (8) ◽

pp. 1128-1133

Author(s):

N. G. Kushik ◽

N. V. Evtushenko ◽

S. N. Torgaev

Keyword(s):

Mutation Testing ◽

Physical Systems ◽

Digital Components

Download Full-text

Experimental Evaluation of Redundancy in Android Mutation Testing

International Journal of Software Engineering and Knowledge Engineering ◽

10.1142/s0218194018400193 ◽

2018 ◽

Vol 28 (11n12) ◽

pp. 1597-1618

Author(s):

Lin Deng ◽

Jeff Offutt

Keyword(s):

Mutation Analysis ◽

Experimental Evaluation ◽

Computational Cost ◽

Mutation Testing ◽

Test Quality ◽

Testing Technique ◽

Security Vulnerabilities ◽

Android Apps ◽

Mutation Operators ◽

The Cost

Because of the widespread usage of Android devices, the Android ecosystem has the highest numbers of users, developers, and app downloads. Researchers find that many Android apps are not sufficiently tested, which may lead to crashes, incorrect behaviors, and security vulnerabilities. Mutation testing is a syntax-based software testing technique that is very effective at designing high-quality tests and evaluating pre-existing tests. Our prior research designed and implemented Android mutation testing technique, and then used experiments to assess its strength. However, the high computational cost of Android mutation testing possibly limits its industrial application. This paper presents an experimental evaluation that investigates redundant mutation operators in Android mutation analysis. While maintaining the test quality, our goal is to reduce the cost by excluding redundant mutation operators or improving their design and implementation. In our evaluation, we first generate mutants and design mutation-adequate tests for each mutation operator. Then, we compute redundancy scores for each pair of mutation operators. Our evaluation results indicate that three operators (AODU, AOIU, and LOI) are redundant in Android mutation analysis. Other three operators (FOB, TVD, and ORL) are very hard to kill. One operator (MDL) needs improvement in its design to eliminate trivial mutants. We also identity subsumption relationships among operators (BWS subsumes BWD, ODL subsumes CDL, COD, and VDL).

Download Full-text