Useful Additional Evaluation Measures

2008 ◽  
Vol 20 (s1) ◽  
pp. 165-173 ◽  
Author(s):  
Joel S. Demski ◽  
John C. Fellingham ◽  
Haijin H. Lin

ABSTRACT: Performance evaluation with multiple tasks and multiple measures has been explored in a variety of settings. Yet, the efficient design of a portfolio of performance measures remains opaque, largely because of the multidimensional nature of the exercise. Here we focus on the value of adding measures to an existing portfolio of measures in a multi-task LEN style agency model. We offer an algebraic decomposition that projects the gain from a set of additional performance measures into “distance” and “risk” components. The distance component comports with task balance and intensity issues and the risk component with the inevitable risk sharing or compensating wage differential issue.

2009 ◽  
Vol 21 (1) ◽  
pp. 241-248 ◽  
Author(s):  
Joel S. Demski ◽  
John C. Fellingham ◽  
Haijin H. Lin

ABSTRACT: Performance evaluation with multiple tasks and multiple measures is a favorite indoor sport, replete with coaches, clinics, and Monday morning quarterbacks. Here we tweak the familiar LEN setting to exhibit a modest reluctance to feed it an ever increasing supply of measures.


2020 ◽  
pp. 930-970
Author(s):  
Anukul Pandey ◽  
Barjinder Singh Saini ◽  
Butta Singh ◽  
Neetu Sood

In this Chapter, a MATLAB-based approach is presented for compression of Electrocardiogram (ECG) data. The methodology employs in three different domains namely direct, transformed and parameter extraction methods. The selected techniques from direct ECG compression methods are TP, AZTEC, Fan, and Cortes. Moreover selected techniques from transformed ECG compression methods are Walsh Transform, DCT, and Wavelet transform. For each of the technique, the basic implementation of the algorithm was explored, and performance measures were calculated. All 48 records of MIT-BIH arrhythmia ECG database were employed for performance evaluation of various implemented techniques. Moreover, based on requirements, any basic techniques can be selected for further innovative processing that may include the lossless encoding.


2020 ◽  
pp. 619-637
Author(s):  
Yogesh Kumar Meena ◽  
Dinesh Gopalani

Automatic Text Summarization (ATS) enables users to save their precious time to retrieve their relevant information need while searching voluminous big data. Text summaries are sensitive to scoring methods, as most of the methods requires to weight features for sentence scoring. In this chapter, various statistical features proposed by researchers for extractive automatic text summarization are explored. Features that perform well are termed as best features using ROUGE evaluation measures and used for creating feature combinations. After that, best performing feature combinations are identified. Performance evaluation of best performing feature combinations on short, medium and large size documents is also conducted using same ROUGE performance measures.


1966 ◽  
Vol 30 (3) ◽  
pp. 26-32
Author(s):  
Allan Easton

Persons responsible for evaluation of performance have found that use of single-criterion measures invariably leads to undesirable side-effects. As a remedy, designers of evaluation methods would like to use multiple in place of single criteria, but are likely to have difficulty in amalgamating their multiple measures into a meaningful whole. Here is a method for combining multiple-criterion scores into a conceptually satisfying, overall figure-of-merit which can be used to rank subjects or projects in order of their excellence.


Author(s):  
Peter Flach

This paper gives an overview of some ways in which our understanding of performance evaluation measures for machine-learned classifiers has improved over the last twenty years. I also highlight a range of areas where this understanding is still lacking, leading to ill-advised practices in classifier evaluation. This suggests that in order to make further progress we need to develop a proper measurement theory of machine learning. I then demonstrate by example what such a measurement theory might look like and what kinds of new results it would entail. Finally, I argue that key properties such as classification ability and data set difficulty are unlikely to be directly observable, suggesting the need for latent-variable models and causal inference.


Author(s):  
Saurabh Agrawal ◽  
Rajesh Kr Singh ◽  
Qasim Murtaza

Purpose The paper aims to incorporate the relationship of reverse logistics into the economic, environmental, and social sustainability, known as triple bottom line and developed a framework for reverse logistics performance evaluation. Design/methodology/approach The performance measures, based on triple bottom line approach, were selected, and fuzzy analytical hierarchy process and extent analysis approach was applied for estimating the weights, global weights of performance measures and hence, the reverse logistics performance index. Reverse logistics performance of three electronic companies were evaluated and compared for the demonstration of the methodology. Findings The results show that economic performance has highest performance index followed by environmental performance and social performance. “Recapturing value” and “return on investment” from economic, “minimum energy consumption” and “optimum use of raw material” from environmental and “community complaints” and “customer health and safety” from social perspective have higher performance indexes. Over all, “reduced packaging”, “use of recycled material” and “employee benefits” show very poor performance indexes. Research Limitations/implications The study will provide useful guidance to the academicians and practitioners for evaluating, improving and benchmarking the reverse logistics performance. Originality/value The analysis adds to the very few studies on triple bottom line aspects of reverse logistics and its performance evaluation. Also, fuzzy analytical hierarchy process and extent analysis is used first time being an efficient tool to tackle the fuzziness of the data involved in performance evaluation.


2005 ◽  
Vol 17 (1) ◽  
pp. 7-21 ◽  
Author(s):  
Anil Arya ◽  
Jonathan Glover ◽  
Brian Mittendorf ◽  
Lixin Ye

Despite the influx of measures which can be customized to the demands of each business unit (e.g., customer satisfaction surveys and quality indices), many firms have been dogged in their reliance on standardized measures (e.g., conventional financial metrics) in performance evaluation. In this paper, we consider one justification: though customized measures may more accurately target the goals of a particular unit, standardized measures may offer more meaningful opportunities for relative performance evaluation. Standardized measures have a commonality in errors which is naturally absent among measures targeted to each circumstance. This commonality allows learning about one measure from another and, thus, the construction of more efficient proxies for unobservable employee inputs. The use of comparative evaluation schemes is not without its challenges, since it may induce unwanted coordination by those being evaluated. Even with such gaming concerns, standardized measures can still be preferred, but the requirements are more stringent.


1980 ◽  
Vol 5 (4) ◽  
pp. 267-274
Author(s):  
Mirza S. Saiyadain

Several reasons have been offered for the depressed values of coefficients of correlation between performance evaluation scores and test scores for tests that otherwise seem to have high validity. Most of these studies have concerned themselves with only the first year performance measure. This study was undertaken to broadbase the validity design by including performance measures of three subsequent years. Data on the test and performance scores of a sample of executives were analysed. The results indicate that though test scores may not show significant relationship with the first year performance appraisal score, they show positive and significant relationship with subsequent performance appraisal scores. The results are explained in terms of changed performance evaluation.


Sign in / Sign up

Export Citation Format

Share Document