scholarly journals A factor framework for experimental design for performance evaluation of commercial cloud services

Author(s):  
Zheng Li ◽  
Liam O'Brien ◽  
He Zhang ◽  
Rainbow Cai
2013 ◽  
Vol 5 (3) ◽  
pp. 75-93
Author(s):  
Zheng Li ◽  
Liam O’Brien ◽  
He Zhang ◽  
Rajiv Ranjan

Appropriate performance evaluations of commercial Cloud services are crucial and beneficial for both customers and providers to understand the service runtime, while suitable experimental design and analysis would be vital for practical evaluation implementations. However, there seems to be a lack of effective methods for Cloud services performance evaluation. For example, in most of the existing evaluation studies, experimental factors (also called parameters or variables) were considered randomly and intuitively, experimental sample sizes were determined on the fly, and few experimental results were comprehensively analyzed. To address these issues, the authors suggest applying Design of Experiments (DOE) to Cloud services evaluation. To facilitate applying DOE techniques, this paper introduces an experimental factor framework and a set of DOE application scenarios. As such, new evaluators can explore and conveniently adapt our work to their own experiments for performance evaluation of commercial Cloud services.


2021 ◽  
pp. 8-17
Author(s):  
Amer Ramadan ◽  

This paper reports on an in-depth examination of the impact of the backing filesystems to Docker performance in the context of Linux container-based virtualization. The experimental design was a 3x3x4 arrangement, i.e., we considered three different numbers of Docker containers, three filesystems (Ext4, XFS and Btrfs), and four application workloads related to Web server I/O activity, e-mail server I/O activity, file server I/O activity and random file access I/O activity, respectively. The experimental results indicate that Ext4 is the most optimal filesystem, among the considered filesystems, for the considered experimental settings. In addition, the XFS filesystem is not suitable for workloads that are dominated by synchronous random write components (e.g., characteristical for mail workload), while the Btrfs filesystem is not suitable for workloads dominated by random write and sequential write components (e.g., file server workload).


2000 ◽  
Vol 8 (1) ◽  
pp. 7-22 ◽  
Author(s):  
Mary Jo Gagan

Vignettes have often been used to evaluate students or collect data in nursing research. The format is familiar to most nursing students as well as nurses and nurse researchers. This article presents the development and testing of the Nurse Practitioner Performance Tool (NPPT) which used vignettes as an approach to nurse practitioner performance evaluation. In this example, vignettes were used in a quasi-experimental design to collect data from Adult and Family Nurse Practitioners (A/FNP). The focus was on the diagnosis and intervention performance of the A/FNPs when addressing suspected cases of domestic violence.


Sensors ◽  
2019 ◽  
Vol 19 (20) ◽  
pp. 4559
Author(s):  
Park ◽  
Park

The middleware framework for IoT collaboration services should provide efficient solutions to context awareness and uncertainty issues among multiple collaboration domains. However, existing middleware frameworks are mostly limited to a single system, and developing self-adaptive IoT collaboration services using existing frameworks requires developers to take considerable time and effort. Furthermore, the developed IoT collaboration services are often dependent on a particular domain, which cannot easily be referenced in other domains. This paper proposes a cloud-based middleware framework that provides a set of cloud services for self-adaptive IoT collaboration services. The proposed middleware framework is generic in the sense that it clearly separates domain-dependent components from the layers that leverage existing middleware frameworks. In addition, the proposed framework allows developers to upload domain-dependent components onto the cloud, search for registered components, and launch Virtual Machine (VM) running a new MAPE cycle via a convenient web-based interface. The feasibility of the proposed framework has been shown with a simulation of an IoT collaboration service that traces a criminal suspect. The performance evaluation shows that the proposed middleware framework runs with an overhead of only 6% compared to pure Java-based middleware and is scalable as the number of VMs increases up to 16.


Sign in / Sign up

Export Citation Format

Share Document