Metamorphic Testing Integer Overflow Faults of Mission Critical Program: A Case Study

For mission critical programs, integer overflow is one of the most dangerous faults. Different testing methods provide several effective ways to detect the defect. However, it is hard to validate the testing outputs, because the oracle of testing is not always available or too expensive to get, unless the program throws an exception obviously. In the present study, the authors conduct a case study, where the authors apply a metamorphic testing (MT) method to detect the integer overflow defect and alleviate the oracle problem in testing critical program of Traffic Collision Avoidance System (TCAS). Experimental results show that, in revealing typical integer mutations, compared with traditional safety property testing method, MT with a novel symbolic metamorphic relation is more effective than the traditional method in some cases.

Download Full-text

Case study: Applying formal methods to the Traffic Alert and Collision Avoidance System (TCAS) II

Proceedings of COMPASS'94 - 1994 IEEE 9th Annual Conference on Computer Assurance ◽

10.1109/cmpass.1994.318468 ◽

2002 ◽

Cited By ~ 2

Author(s):

J.J. Britt

Keyword(s):

Formal Methods ◽

Collision Avoidance ◽

Collision Avoidance System

Download Full-text

Test Methods in Safety Standards - Application of Human Factors Data -

Proceedings of the Human Factors Society Annual Meeting ◽

10.1177/154193129203601325 ◽

1992 ◽

Vol 36 (13) ◽

pp. 1034-1038

Author(s):

René Hoefnagels ◽

Marian Schoone-Harmsen

Keyword(s):

Human Factors ◽

Test Methods ◽

Consumer Products ◽

Testing Methods ◽

Safety Standards ◽

Safety Requirements ◽

Testing Method ◽

Accident Data ◽

Accident Scenarios

Safety standards for consumer products can offer an important contribution to accident reduction. This paper describes how effective testing methods for safety requirements, which are part of a safety standard, may be developed. In order to be effective, testing methods for the evaluation of products on aspects of safety must be valid, reproducible, and efficient. Various forms of testing methods are discussed with regard to their effectiveness. The development of testing methods for trapping hazards, which can be applied to all kinds of products, is described in a case study. For this purpose, a number of accident scenarios have been drawn from data on trapping hazards. In each scenario a testing method is described, and criteria based on human factors data is added. Accident scenarios have proved to be an extremely useful link between accident data and the simulation of performance on which a testing method can be based. Because human factors data is usually gathered for other purposes, implementation of this data in safety standards must be done with great caution. We recommend the use of man-models in testing methods for optimal results. Furthermore, we recommend the verification of test conditions and criteria by user trials or panel tests.

Download Full-text

Trust-Based Analysis of an Air Force Collision Avoidance System

Ergonomics in Design The Quarterly of Human Factors Applications ◽

10.1177/1064804615611274 ◽

2016 ◽

Vol 24 (1) ◽

pp. 9-12 ◽

Cited By ~ 15

Author(s):

Joseph B. Lyons ◽

Nhut T. Ho ◽

Kolina S. Koltai ◽

Gina Masequesmay ◽

Mark Skoog ◽

...

Keyword(s):

Best Practices ◽

Collision Avoidance ◽

Air Force ◽

Number Of Factors ◽

Trust In Automation ◽

Collision Avoidance System

This case study analyzes the factors that influence trust and acceptance among users (in this case, test pilots) of the Air Force’s Automatic Ground Collision Avoidance System. Our analyses revealed that test pilots’ trust depended on a number of factors, including the development of a nuisance-free algorithm, designing fly-up evasive maneuvers consistent with a pilot’s preferred behavior, and using training to assess, demonstrate, and verify the system’s reliability. These factors are consistent with the literature on trust in automation and could lead to best practices for automation design, testing, and acceptance.

Download Full-text