scholarly journals Metrics for Offline Evaluation of Prognostic Performance

Author(s):  
Abhinav Saxena ◽  
Jose Celaya ◽  
Bhaskar Saha ◽  
Sankalita Saha ◽  
Kai Goebel

Prognostic performance evaluation has gained significant attention in the past few years.*Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Author(s):  
Owen Lo ◽  
Lu Fan ◽  
William J. Buchanan ◽  
Christoph Thuemmler

For increased awareness and adoption of e-Health implementations, results from evaluation must be catered towards three primary perspectives: organizational, end-user and technical perspective. This chapter addresses the issue of conducting performance evaluation of e-Health for the technical perspective. The authors present the design of metrics that enable them to evaluate the scalability, functionality and reliability of e-Health implementations. Using simulated patient data, experiments are conducted on an existing e-Health platform using their defined metrics. Results show that 100 simulated patient’s data may interact with the e-Health platform under evaluation with a maximum round-trip time latency value of 6.6 seconds. By building upon the techniques the authors have used to conduct performance evaluation of e-Health implementations, along with the design of methodologies to enable evaluation to take place for the two other perspectives, i.e. end-user and organizational perspectives, the authors hope to see greater support for this technology in the near future.


Author(s):  
Leonid Stoimenov

Research in information systems interoperability is motivated by the ever-increasing heterogeneity of the computer world. New generations of applications, such as geographic information systems (GISs), have much more demands in comparison to possibilities of legacy information systems and traditional database technology. The popularity of GIS in governmental and municipality institutions induce increasing amounts of available information (Stoimenov, Ðordevic-Kajan, & Stojanovic, 2000). In a local community environment (city services, local offices, local telecom, public utilities, water and power supply services, etc.), different information systems deal with huge amounts of available information, where most data in databases are geo-referenced. GIS applications often have to process geo-data obtained from various geo-information communities. Also, information that exists in different spatial database may be useful for many other GIS applications. Numerous legacy systems should be coupled with GIS systems, which present additional difficulties in developing end-user applications.


2020 ◽  
Vol 20 (6) ◽  
pp. 7-13
Author(s):  
Dong-Jin Yoon ◽  
Kwang-Mo Lim ◽  
Joo-Ha Lee

Recently, research focused on preventing the aging of masonry structures, and minimization of damage caused by earthquakes to these structures has gained significant attention. To improve the performance of these structures, an appropriate method is required for their performance evaluation. Generally, the equivalent strut model is employed for the performance evaluation of a masonry wall. However, this method is known to have limitations in implementing reinforced masonry and in reflecting the actual reinforcement effect. Appropriate evaluation techniques should be developed to implement the performance improvement methods developed in the future. Therefore, in this study, analysis methods were developed considering the nonlinear static analysis method for masonry elements. In addition, using these methods, the analysis considering the various reinforced thicknesses and shapes was performed, and the appropriate reinforcement methods were presented for these structures.


2019 ◽  
Vol 43 (3) ◽  
pp. 187-207
Author(s):  
Klodian Gradeci ◽  
Umberto Berardi

Probabilistic-based approaches for the performance evaluation of building envelopes to withstand mould growth have gained significant attention in recent years. In this article, a scoping review is performed to identify some current challenges and opportunities in probabilistic-based approaches. Therefore, the performance of a highly insulated wall is evaluated by applying a probabilistic-based methodology that accounts for several uncertainties and investigates their significance. A sensitivity analysis is performed according to the Morris method to understand the influence of each parameter and simplify the system representation of this case study. Deficiencies in terms of rain penetration and air leakage are accounted for. The mould growth risk is evaluated by integrating different mould models and assessment criteria. Overall, the performance of the investigated wall is found satisfactory in most of the cases, except when wind-driven rain penetration occurs. The study demonstrates that a probabilistic-based methodology enables a systematic approach to evaluate the performance of building constructions as it accounts for the involved uncertainties, provides a clear association of the microbial growth to its probability of occurrence and enables the identification of the dominant parameters, delivering more comprehensive conclusions.


2019 ◽  
Vol 9 (23) ◽  
pp. 5195 ◽  
Author(s):  
Linh Thi Truc Doan ◽  
Yousef Amer ◽  
Sang-Heon Lee ◽  
Phan Nguyen Ky Phuc ◽  
Luu Quoc Dat

Electronic waste (e-waste) has become one of the fastest-growing waste, leading a globe issue. Reverse supply chain (RSC) is considered a potential way for e-waste management. Over the last two decades, RSC has received significant attention from industries, governments, experts, and researchers. A large number of studies have been published in the field of e-waste RSC. Most of the existing review papers concentrated on the general RSC models for all types of returned products. However, the review papers focusing on specific products, such as e-waste, are quite limited. To fill this gap published papers in the area of RSC for a specific product, e-waste, from 1999 to 2019 have been selected for review and analysis in this study. E-waste RSC studies have been divided into four main groups, namely, factors of implementation, performance evaluation and decision making, foresting product returns, and network design. Finally, some potential directions for e-waste RSC models have been suggested for future research.


2013 ◽  
Vol 3 (3) ◽  
pp. 20-33 ◽  
Author(s):  
Xiao Zhang ◽  
WenXiong Feng ◽  
Xiao Qin

Cloud storage provides storage services to users via Internet. They provide lavish interfaces for different applications. Online backup is the most developed application based on cloud storage. Most past studies focus on functional characters and price per GB. But there is not much consideration about performance evaluation. In this paper, the authors present a method to evaluate the performance of different online backup services with clients. Because these clients do not prompt when the download/upload process starts and finishes, the authors capture the packets transferred between clients and the cloud storage provider. The authors evaluate the performance from the view of the end-user, comparing the upload and download speeds of different services. This method can help users find the best provider to accommodate their situation. The authors evaluate the performance of several cloud storage providers by analyzing the performance of different vendors in different times and different file type and size. From the performance results, the authors can expose which technologies are used in the cloud storage system to reduce the storage and network cost.


Sign in / Sign up

Export Citation Format

Share Document