A Synchronized Test Control Execution Model of Distributed Systems

2021 ◽  
pp. 1377-1395
Author(s):  
Salma Azzouzi ◽  
Sara Hsaini ◽  
My El Hassan Charaf
Keyword(s):  
Test Cases ◽  
Agent Based ◽  
Parallel Testing ◽  
Test Execution ◽  
Support Interaction ◽  
Distributed Testing ◽  
Implementation Under Test ◽  
Execution Model ◽  
Local Test ◽  
Control And Synchronization

Conformance testing may be seen as mean to execute an IUT (implementation under test) by carrying out test cases in order to observe whether the behavior of the IUT is conforming to its specifications. However, the development of distributed testing frameworks is more complex and the implementation of the parallel testing components (PTCs) should take into consideration the mechanisms and functions required to support interaction during PTC communication. In this article, the authors present another way to control the test execution of PTCs by introducing synchronization messages into the local test sequences. Then, they suggest an agent-based simulation to implement synchronized local test sequences and resolve the problem of control and synchronization.

A Synchronized Test Control Execution Model of Distributed Systems

2020 ◽  
Vol 12 (1) ◽  
pp. 1-17 ◽  
Author(s):  
Salma Azzouzi ◽  
Sara Hsaini ◽  
My El Hassan Charaf
Keyword(s):  
Test Cases ◽  
Agent Based ◽  
Parallel Testing ◽  
Test Execution ◽  
Distributed Testing ◽  
Implementation Under Test ◽  
Execution Model ◽  
Local Test ◽  
Control And Synchronization ◽  
Test Control

Conformance testing may be seen as mean to execute an IUT (implementation under test) by carrying out test cases in order to observe whether the behavior of the IUT is conforming to its specifications. However, the development of distributed testing frameworks is more complex and the implementation of the parallel testing components (PTCs) should take into consideration the mechanisms and functions required to support interaction during PTC communication. In this article, the authors present another way to control the test execution of PTCs by introducing synchronization messages into the local test sequences. Then, they suggest an agent-based simulation to implement synchronized local test sequences and resolve the problem of control and synchronization.

Parallel Test Prioritization

2022 ◽  
Vol 31 (1) ◽  
pp. 1-50
Author(s):  
Jianyi Zhou ◽  
Junjie Chen ◽  
Dan Hao
Keyword(s):  
Extensive Study ◽  
Good Choice ◽  
Regression Testing ◽  
Sequential Test ◽  
Testing Time ◽  
Parallel Test ◽  
Parallel Testing ◽  
Test Execution ◽  
Coverage Criterion ◽  
Test Prioritization

Although regression testing is important to guarantee the software quality in software evolution, it suffers from the widely known cost problem. To address this problem, existing researchers made dedicated efforts on test prioritization, which optimizes the execution order of tests to detect faults earlier; while practitioners in industry leveraged more computing resources to save the time cost of regression testing. By combining these two orthogonal solutions, in this article, we define the problem of parallel test prioritization, which is to conduct test prioritization in the scenario of parallel test execution to reduce the cost of regression testing. Different from traditional sequential test prioritization, parallel test prioritization aims at generating a set of test sequences, each of which is allocated in an individual computing resource and executed in parallel. In particular, we propose eight parallel test prioritization techniques by adapting the existing four sequential test prioritization techniques, by including and excluding testing time in prioritization. To investigate the performance of the eight parallel test prioritization techniques, we conducted an extensive study on 54 open-source projects and a case study on 16 commercial projects from Baidu , a famous search service provider with 600M monthly active users. According to the two studies, parallel test prioritization does improve the efficiency of regression testing, and cost-aware additional parallel test prioritization technique significantly outperforms the other techniques, indicating that this technique is a good choice for practical parallel testing. Besides, we also investigated the influence of two external factors, the number of computing resources and time allowed for parallel testing, and find that more computing resources indeed improve the performance of parallel test prioritization. In addition, we investigated the influence of two more factors, test granularity and coverage criterion, and find that parallel test prioritization can still accelerate regression testing in parallel scenario. Moreover, we investigated the benefit of parallel test prioritization on the regression testing process of continuous integration, considering both the cumulative acceleration performance and the overhead of prioritization techniques, and the results demonstrate the superiority of parallel test prioritization.

FlakyLoc: Flakiness Localization for Reliable Test Suites in Web Applications

2020 ◽  
Author(s):  
Jesús Morán ◽  
Cristian Augusto ◽  
Antonia Bertolino ◽  
Claudio De La Riva ◽  
Javier Tuya
Keyword(s):  
Environmental Factors ◽  
Web Application ◽  
Web Applications ◽  
Test Case ◽  
Test Cases ◽  
Root Cause ◽  
Test Execution ◽  
Fine Grain ◽  
Asynchronous Communications

Web application testing is a great challenge due to the management of complex asynchronous communications, the concurrency between the clients-servers, and the heterogeneity of resources employed. It is difficult to ensure that a test case is re-running in the same conditions because it can be executed in undesirable ways according to several environmental factors that are not easy to fine-grain control such as network bottlenecks, memory issues or screen resolution. These environmental factors can cause flakiness, which occurs when the same test case sometimes obtains one test outcome and other times another outcome in the same application due to the execution of environmental factors. The tester usually stops relying on flaky test cases because their outcome varies during the re-executions. To fix and reduce the flakiness it is very important to locate and understand which environmental factors cause the flakiness. This paper is focused on the localization of the root cause of flakiness in web applications based on the characterization of the different environmental factors that are not controlled during testing. The root cause of flakiness is located by means of spectrum-based localization techniques that analyse the test execution under different combinations of the environmental factors that can trigger the flakiness. This technique is evaluated with an educational web platform called FullTeaching. As a result, our technique was able to locate automatically the root cause of flakiness and provide enough information to both understand it and fix it.

AN INTELLIGENT AGENT FOR WEB ADVERTISEMENTS

2002 ◽  
Vol 13 (04) ◽  
pp. 531-554 ◽  
Author(s):  
VINCENT NG ◽  
MOK KWAN HO
Keyword(s):  
Rapid Growth ◽  
Pattern Mining ◽  
Intelligent Agent ◽  
Test Cases ◽  
Selection Algorithm ◽  
Agent Based ◽  
Gaussian Curve ◽  
Mining Algorithm ◽  
Internet Users ◽  
Order Pattern

The rapid growth of Internet users attracts advertisers to post their advertisements in Internet. The probabilistic selection algorithm was not satisfactory; while other advertising agents are unable to guarantee the quality due to insufficient and unstable user information. This paper describes a new advertising agent based on user information. The users' interests are discovered by the Order Pattern Mining algorithm first, then the Gaussian curve transformation is applied to represent their profiles. For the advertisements, we use the keywords from different categories to construct the advertisement profiles as Gaussian curves also. This allows us to select advertisements based on the intersections of the different profiles according to users' preferences in an effective and efficient mechanism. A prototype of the Intelligent Advertising Agent has been developed with Java and Oracle. From our evaluations, we observed that about 70% of the test cases are successful in making predictions which generated the most favorable category that the users are interested.

scholarly journals Problem Detection in Real-Time Systems by Trace Analysis

2016 ◽  
Vol 2016 ◽  
pp. 1-12 ◽  
Author(s):  
Mathieu Côté ◽  
Michel R. Dagenais
Keyword(s):  
Real Time ◽  
Critical Path ◽  
Test Cases ◽  
Real Time Systems ◽  
Scheduling Problems ◽  
New Approach ◽  
Execution Traces ◽  
Problem Detection ◽  
Execution Model ◽  
Time Systems

This paper focuses on the analysis of execution traces for real-time systems. Kernel tracing can provide useful information, without having to instrument the applications studied. However, the generated traces are often very large. The challenge is to retrieve only relevant data in order to find quickly complex or erratic real-time problems. We propose a new approach to help finding those problems. First, we provide a way to define the execution model of real-time tasks with the optional suggestions of a pattern discovery algorithm. Then, we show the resulting real-time jobs in a Comparison View, to highlight those that are problematic. Once some jobs that present irregularities are selected, different analyses are executed on the corresponding trace segments instead of the whole trace. This allows saving huge amount of time and execute more complex analyses. Our main contribution is to combine the critical path analysis with the scheduling information to detect scheduling problems. The efficiency of the proposed method is demonstrated with two test cases, where problems that were difficult to identify were found in a few minutes.

A Multi-Agent-Based Approach for Critical Components Identification and Testing

2017 ◽  
pp. 657-678
Author(s):  
D. Jeya Mala ◽  
R. Iswarya
Keyword(s):  
Crucial Role ◽  
Research Work ◽  
Software Systems ◽  
Test Cases ◽  
Agent Based ◽  
Multi Agent ◽  
Adequacy Criterion ◽  
Critical Components ◽  
Test Adequacy

In real time software systems, testing plays a crucial role as any of the critical components in these systems are left undetected, then inadvertent effects will happen which will lead to erroneous operations, system failure, high cost and resource wastage etc. To address this most important and the emergent problem, this research work proposes an effective method by means of multi-agents based approach to identify such critical components and execute test cases along the critical test paths which will aid in effectively covering them during testing. Finally, this paper also compared the performance with existing approaches in terms of time taken for the search process and the component coverage based test adequacy criterion to ensure quality of the software.

Image-Based Approach to Determining Regression Test Results of Dynamic Web Applications

2018 ◽  
Vol 28 (07) ◽  
pp. 1001-1025 ◽  
Author(s):  
Akihiro Hori ◽  
Shingo Takada ◽  
Toshiyuki Kurabayashi ◽  
Haruto Tanno
Keyword(s):  
Web Application ◽  
Web Applications ◽  
Regression Testing ◽  
Test Case ◽  
Test Cases ◽  
Test Results ◽  
Test Execution ◽  
Dynamic Web ◽  
Regression Test ◽  
Post Modification

Much work has been done on automating regression testing for applications. But most of them focus on test execution. Little work has been done on automatically determining if a test case passes or fails. This decision is often made by comparing the results of executing test cases on a base version of the application and post-modification version of the application. If the two results match, the test case passes, otherwise fails. However, to the best of our knowledge, there is no regression testing method for automatically deciding pass/fail of dynamic Web applications which use JavaScript or CSS. We propose a method that automatically decides if a dynamic Web application passes a regression test case. The basic idea is to obtain a screenshot each time the GUI of the Web application (i.e. Web page) changes its state, and then compare each corresponding screenshot to see if they match. The evaluation results showed that the accuracy rate of our approach is high and our approach can be considered as fast enough for practical use.

A Multi Agent Based Approach for Critical Components Identification and Testing

2014 ◽  
Vol 4 (1) ◽  
pp. 21-38 ◽  
Author(s):  
D. Jeya Mala ◽  
R. Iswarya
Keyword(s):  
Research Work ◽  
Software Systems ◽  
Test Cases ◽  
Critical Test ◽  
Agent Based ◽  
Multi Agent ◽  
Critical Components ◽  
Test Adequacy ◽  
Multi Agents

In real time software systems, testing plays a crucial role as any of the critical components in these systems are left undetected, then inadvertent effects will happen which will lead to erroneous operations, system failure, high cost and resource wastage etc. To address this most important and the emergent problem, this research work proposes an effective method by means of multi-agents based approach to identify such critical components and execute test cases along the critical test paths which will aid in effectively covering them during testing. Finally, this paper also compared the performance with existing approaches in terms of time taken for the search process and the component coverage based test adequacy criterion to ensure quality of the software.

Sign in / Sign up

Export Citation Format

Share Document