scholarly journals Applying Software Metrics to RNN for Early Reliability Evaluation

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Hao Zhang ◽  
Jie Zhang ◽  
Ke Shi ◽  
Hui Wang

Structural modeling is an important branch of software reliability modeling. It works in the early reliability engineering to optimize the architecture design and guide the later testing. Compared with traditional models using test data, structural models are often difficult to be applied due to lack of actual data. A software metrics-based method is presented here for empirical studies. The recurrent neural network (RNN) is used to process the metric data to identify defeat-prone code blocks, and a specified aggregation scheme is used to calculate the module reliability. Based on this, a framework is proposed to evaluate overall reliability for actual projects, in which algebraic tools are introduced to build the structural reliability model automatically and accurately. Studies in two open-source projects show that early evaluation results based on this framework are effective and the related methods have good applicability.

Author(s):  
Kehan Gao ◽  
Taghi M. Khoshgoftaar

Timely and accurate prediction of the quality of software modules in the early stages of the software development life cycle is very important in the field of software reliability engineering. With such predictions, a software quality assurance team can assign the limited quality improvement resources to the needed areas and prevent problems from occurring during system operation. Software metrics-based quality estimation models are tools that can achieve such predictions. They are generally of two types: a classification model that predicts the class membership of modules into two or more quality-based classes (Khoshgoftaar et al., 2005b), and a quantitative prediction model that estimates the number of faults (or some other quality factor) that are likely to occur in software modules (Ohlsson et al., 1998). In recent years, a variety of techniques have been developed for software quality estimation (Briand et al., 2002; Khoshgoftaar et al., 2002; Ohlsson et al., 1998; Ping et al., 2002), most of which are suited for either prediction or classification, but not for both. For example, logistic regression (Khoshgoftaar & Allen, 1999) can only be used for classification, whereas multiple linear regression (Ohlsson et al., 1998) can only be used for prediction. Some software quality estimation techniques, such as case-based reasoning (Khoshgoftaar & Seliya, 2003), can be used to calibrate both prediction and classification models, however, they require distinct modeling approaches for both types of models. In contrast to such software quality estimation methods, count models such as the Poisson regression model (PRM) and the zero-inflated Poisson (ziP) regression model (Khoshgoftaar et al., 2001) can be applied to yield both with just one modeling approach. Moreover, count models are capable of providing the probability that a module has a given number of faults. Despite the attractiveness of calibrating software quality estimation models with count modeling techniques, we feel that their application in software reliability engineering has been very limited (Khoshgoftaar et al., 2001). This study can be used as a basis for assessing the usefulness of count models for predicting the number of faults and quality-based class of software modules.


Author(s):  
Maria Ulan ◽  
Welf Löwe ◽  
Morgan Ericsson ◽  
Anna Wingkvist

AbstractA quality model is a conceptual decomposition of an abstract notion of quality into relevant, possibly conflicting characteristics and further into measurable metrics. For quality assessment and decision making, metrics values are aggregated to characteristics and ultimately to quality scores. Aggregation has often been problematic as quality models do not provide the semantics of aggregation. This makes it hard to formally reason about metrics, characteristics, and quality. We argue that aggregation needs to be interpretable and mathematically well defined in order to assess, to compare, and to improve quality. To address this challenge, we propose a probabilistic approach to aggregation and define quality scores based on joint distributions of absolute metrics values. To evaluate the proposed approach and its implementation under realistic conditions, we conduct empirical studies on bug prediction of ca. 5000 software classes, maintainability of ca. 15000 open-source software systems, and on the information quality of ca. 100000 real-world technical documents. We found that our approach is feasible, accurate, and scalable in performance.


Author(s):  
SHINJI INOUE ◽  
NAOKI IWAMOTO ◽  
SHIGERU YAMADA

This paper discusses an new approach for discrete-time software reliability growth modeling based on an discrete-time infinite server queueing model, which describes a debugging process in a testing phase. Our approach enables us to develop discrete-time software reliability growth models (SRGMs) which could not be developed under conventional discrete-time modeling approaches. This paper also discuss goodness-of-fit comparisons of our discrete-time SRGMs with conventional continuous-time SRGMs in terms of the criterion of the mean squared errors, and show numerical examples for software reliability analysis of our models by using actual data.


1993 ◽  
Vol 33 (15) ◽  
pp. 2265-2267 ◽  
Author(s):  
Kai-Yuan Cai ◽  
Chuan-Yuan Wen ◽  
Ming-Lian Zhang

Author(s):  
Shinji Inoue ◽  
Takaji Fujiwara ◽  
Shigeru Yamada

Safety integrity level (SIL)-based functional safety assessment is widely required in designing safety functions and checking their validity of electrical/electronic/programmable electronic (E/E/PE) safety-related systems after being issued IEC 61508 in 2010. For the hardware of E/E/PE safety-related systems, quantitative functional safety assessment based on target failure measures is needed for deciding or allocating the level of SIL. On the other hand, IEC 61508 does not provide any quantitative safety assessment method for allocating SIL for the software of E/E/PE safety-related systems because the software failure is treated as a systematic failure in IEC 61508. We discuss the needfulness of quantitative safety assessment for software of E/E/PE safety-related systems and propose mathematical fundamentals for conducting quantitative SIL-based safety assessment for the software of E/E/PE safety-related systems by applying the notion of software reliability modeling and assessment technologies. We show numerical examples for explaining how to use our approaches.


Sign in / Sign up

Export Citation Format

Share Document