How to design an environment simulator for safety critical software testing

Author(s):  
Haiying Tu ◽  
Fangmei Wu
2020 ◽  
Vol 34 (09) ◽  
pp. 13576-13582
Author(s):  
Dusica Marijan ◽  
Arnaud Gotlieb

Machine learning has become prevalent across a wide variety of applications. Unfortunately, machine learning has also shown to be susceptible to deception, leading to errors, and even fatal failures. This circumstance calls into question the widespread use of machine learning, especially in safety-critical applications, unless we are able to assure its correctness and trustworthiness properties. Software verification and testing are established technique for assuring such properties, for example by detecting errors. However, software testing challenges for machine learning are vast and profuse - yet critical to address. This summary talk discusses the current state-of-the-art of software testing for machine learning. More specifically, it discusses six key challenge areas for software testing of machine learning systems, examines current approaches to these challenges and highlights their limitations. The paper provides a research agenda with elaborated directions for making progress toward advancing the state-of-the-art on testing of machine learning.


Electronics ◽  
2020 ◽  
Vol 9 (5) ◽  
pp. 797 ◽  
Author(s):  
Bongjoo Koo ◽  
Jungho Bae ◽  
Seogbong Kim ◽  
Kangmin Park ◽  
Hyungshin Kim

Finite-state machines (FSMs) and the W method have been widely used in software testing. However, the W method fails to detect post-processing errors in the implementation under test (IUT) because it ends testing when it encounters a previously visited state. To alleviate this issue, we propose an enhanced fault-detection W method. The proposed method does not stop the test, even if it has reached a previously visited state; it continues to test and check the points that the W method misses. Through various case studies, we demonstrated software testing using the W method and the proposed method. From the results, it can be inferred that the proposed method can more explicitly determine the consistency between design and implementation, and it is a better option for testing larger software. Unfortunately, the testing time of the proposed method is approximately 1.4 times longer than that of the W method because of the added paths. However, our method is more appropriate than the W method for software testing in safety-critical systems, even if this method is time consuming. This is because the error-free characteristics of a safety-critical system are more important than anything else. As a result, our method can be used to increase software reliability in safety-critical embedded systems.


IEEE Access ◽  
2018 ◽  
Vol 6 ◽  
pp. 8440-8451 ◽  
Author(s):  
Hee Eun Kim ◽  
Han Seong Son ◽  
Bo Gyung Kim ◽  
Jaehyun Cho ◽  
Sung Min Shin ◽  
...  

Author(s):  
Jonathan Jacky ◽  
Margus Veanes ◽  
Colin Campbell ◽  
Wolfram Schulte
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document