Rater Error

2010 ◽  
Author(s):  
Jay C. Thomas ◽  
Heidi Meeke
Keyword(s):  
Rater Error

scholarly journals Automatic Evaluation of Wheat Resistance to Fusarium Head Blight Using Dual Mask-RCNN Deep Learning Frameworks in Computer Vision

2020 ◽  
Vol 13 (1) ◽  
pp. 26
Author(s):  
Wen-Hao Su ◽  
Jiajing Zhang ◽  
Ce Yang ◽  
Rae Page ◽  
Tamas Szinyei ◽  
...  
Keyword(s):  
Fusarium Head Blight ◽  
Ground Truth ◽  
Wheat Breeding ◽  
Head Blight ◽  
Detection Rates ◽  
Ground Truth Data ◽  
Resistant Cultivars ◽  
Feature Pyramid ◽  
Rater Error ◽  
Wheat Lines

In many regions of the world, wheat is vulnerable to severe yield and quality losses from the fungus disease of Fusarium head blight (FHB). The development of resistant cultivars is one means of ameliorating the devastating effects of this disease, but the breeding process requires the evaluation of hundreds of lines each year for reaction to the disease. These field evaluations are laborious, expensive, time-consuming, and are prone to rater error. A phenotyping cart that can quickly capture images of the spikes of wheat lines and their level of FHB infection would greatly benefit wheat breeding programs. In this study, mask region convolutional neural network (Mask-RCNN) allowed for reliable identification of the symptom location and the disease severity of wheat spikes. Within a wheat line planted in the field, color images of individual wheat spikes and their corresponding diseased areas were labeled and segmented into sub-images. Images with annotated spikes and sub-images of individual spikes with labeled diseased areas were used as ground truth data to train Mask-RCNN models for automatic image segmentation of wheat spikes and FHB diseased areas, respectively. The feature pyramid network (FPN) based on ResNet-101 network was used as the backbone of Mask-RCNN for constructing the feature pyramid and extracting features. After generating mask images of wheat spikes from full-size images, Mask-RCNN was performed to predict diseased areas on each individual spike. This protocol enabled the rapid recognition of wheat spikes and diseased areas with the detection rates of 77.76% and 98.81%, respectively. The prediction accuracy of 77.19% was achieved by calculating the ratio of the wheat FHB severity value of prediction over ground truth. This study demonstrates the feasibility of rapidly determining levels of FHB in wheat spikes, which will greatly facilitate the breeding of resistant cultivars.

COMPARING THE STANDARD AND ELECTRONIC VERSIONS OF THE ALZHEIMER’S DISEASE ASSESSMENT SCALE – COGNITIVE SUBSCALE: A VALIDATION STUDY

2019 ◽  
pp. 1-5
Author(s):  
T.M. Solomon ◽  
J.M. Barbone ◽  
H.T. Feaster ◽  
D.S. Miller ◽  
G.B. deBros ◽  
...  
Keyword(s):  
Alzheimer’S Disease ◽  
Alzheimer's Disease ◽  
Adult Population ◽  
Prospective Trial ◽  
Electronic Version ◽  
Assessment Scale ◽  
Disease Assessment ◽  
Cognitive Subscale ◽  
Interclass Correlation ◽  
Rater Error

The Alzheimer’s Disease Assessment Scale (ADAS-Cog) has become the de facto gold-standard for assessing the efficacy of putative anti-dementia treatments. There has been an increasing interest in providing greater standardization, automation, and administration consistency to the scale. Recently, electronic versions of the ADAS-Cog (eADAS-Cog) have been utilized in clinical trials and demonstrated significant reductions in frequency of rater error as compared to paper. In order to establish validity of the electronic version (eADAS-Cog), 20 subjects who had received a diagnosis of probable Alzheimer’s disease (AD) at a private US Memory Clinic completed a single-center, randomized, counterbalanced, prospective trial comparing a version of the eADAS-Cog to the standard paper scale. Interclass Correlation Coefficient on total scores and Kappa analysis on domain scores yielded high agreement (0.88 – 0.99). Effects of order and mode of administration on ADAS-Cog total scores did not demonstrate a significant main effect. Overall, this study establishes adequate concurrent validity between the ADAS-Cog and eADAS-Cog among an adult population with diagnosed AD.

Training Performance Raters Through Error-based Experiential Learning

2001 ◽  
Vol 7 (1) ◽  
pp. 1-12
Author(s):  
Shelda Debowski
Keyword(s):  
Experiential Learning ◽  
Good Practice ◽  
Human Resource Managers ◽  
Training Performance ◽  
Training Strategy ◽  
Learning Platform ◽  
Resource Managers ◽  
Alternative Approach ◽  
Traditional Training ◽  
Rater Error

AbstractHuman resource managers need to understand issues relating to rater error. There are well-established ways to introduce these concepts to those training in the field. However, they require a substantial period of training to be successful. Their use in a tertiary setting can be severely constrained by time limitations. An alternative approach to these traditional training styles is that of error-based experiential learning. This training strategy immerses students in erroneous experiences that are then explored and used as a learning platform to build models of good practice. The training process used to structure the exercise is described in detail, illustrating the various errors committed by the trainees. Student feedback from the exercise and some likely risks attached to the activity are also discussed.

PERFORMANCE APPRAISAL SYSTEM IN MAJAN ELECTRICITY COMPANY (SOHAR, OMAN) AND ITS IMPACT ON EMPLOYEES’ MOTIVATION

2016 ◽  
Vol 2 (1) ◽  
pp. 13
Author(s):  
Maryam Al Fazari ◽  
Dr. M. Firdouse Rahman Khan
Keyword(s):  
Performance Appraisal ◽  
Random Sampling ◽  
Positive Impact ◽  
Strong Association ◽  
Evaluation Process ◽  
Appraisal System ◽  
Employees Satisfaction ◽  
Performance Appraisal System ◽  
Rater Error ◽  
The Impact

Purpose The objective of the study is to investigate whether the performance appraisal system used is in Majan Electricity Company, (Oman), measures the employees’ performance accurately and to ensure motivation and satisfaction of its employees.Design/methodology/approach  The study was conducted with 106 employees from all the departments of the main office of the company located at Sohar, who were selected on stratified random sampling basis and were contacted through a well-defined questionnaire. Findings The study reveals that even if there is a problem with the accuracy of performance appraisal system in measuring the performance accurately, or due to rater error in the evaluation process, the employees’ performance appraisal is not affected by them and has got positive impact on employees’ motivation and satisfaction.Practical Implications The study demonstrates that there is a strong association between the (i) performance appraisal system and (ii) motivation of the employees and the employees’ satisfaction. It is also found that there is no relationship between performance appraisal system, rater errors, and the accuracy of performance appraisal system.Social Implications Performance appraisal system is dependent on motivation of the employees and employees’ satisfaction. So, there exists necessity for the company to pay attention towards motivating the employees through concentrating on increasing the satisfaction of the employees.Originality/value No study have examined the impact of performance appraisal system of the Majan Electricity Company in Sohar ever before considering employee’s motivation and the welfare of the employees in one hand and the management on the other, and it is first hand study of its kind.Research limitations/Implications The study was restricted to the main office of the company located at Sohar, Oman. The study could be extended to know the insight of the personnel involved in the entire Majan Electricity Company, Oman. 

A test of the context dependency of three causal models of halo rater error.

1994 ◽  
Vol 79 (3) ◽  
pp. 332-340 ◽  
Author(s):  
Charles E. Lance ◽  
Julie A. LaPointe ◽  
Amy M. Stewart
Keyword(s):  
Causal Models ◽  
Context Dependency ◽  
Rater Error

Training Performance Raters Through Error-based Experiential Learning

2001 ◽  
Vol 7 (1) ◽  
pp. 1-12
Author(s):  
Shelda Debowski
Keyword(s):  
Experiential Learning ◽  
Good Practice ◽  
Human Resource Managers ◽  
Training Performance ◽  
Training Strategy ◽  
Learning Platform ◽  
Resource Managers ◽  
Alternative Approach ◽  
Traditional Training ◽  
Rater Error

AbstractHuman resource managers need to understand issues relating to rater error. There are well-established ways to introduce these concepts to those training in the field. However, they require a substantial period of training to be successful. Their use in a tertiary setting can be severely constrained by time limitations. An alternative approach to these traditional training styles is that of error-based experiential learning. This training strategy immerses students in erroneous experiences that are then explored and used as a learning platform to build models of good practice. The training process used to structure the exercise is described in detail, illustrating the various errors committed by the trainees. Student feedback from the exercise and some likely risks attached to the activity are also discussed.

scholarly journals Characteristics of the Perception of Different Severity Measures of Citrus Canker and the Relationships Between the Various Symptom Types

Plant Disease ◽  
2008 ◽  
Vol 92 (6) ◽  
pp. 927-939 ◽  
Author(s):  
C. H. Bock ◽  
P. E. Parker ◽  
A. Z. Cook ◽  
T. R. Gottwald
Keyword(s):  
Disease Severity ◽  
Extreme Values ◽  
Bacterial Pathogen ◽  
Citrus Canker ◽  
Visual Assessment ◽  
Disease Assessment ◽  
Disease Category ◽  
Normal Probability ◽  
Rater Error ◽  
Citrus Leaves

Citrus canker is a disease of citrus and is caused by the bacterial pathogen Xanthomonas citri subsp. citri. Ways of managing the disease are being sought, and accurate, precise, reproducible disease assessment is needed for monitoring epidemics. The objective of this study was to investigate the characteristics of visual assessment of citrus canker symptoms compared with actual disease measured using image analysis (IA). Images of 210 citrus leaves with a range of incidence and severity of citrus canker were assessed by three plant pathologists (VR1-3) and by IA. The number of lesions (L), % area necrotic (%AN), and % area necrotic+chlorotic (%ANC) were assessed. The best relationships were found between %AN and %ANC (r2 = 0.41 to 0.87), and the worst between L and %AN (r2 = 0.27 to 0.66). Bland-Altman plots showed various sources of rater error in assessments, including under- and over-estimation, proportional error, and heterogeneity of variation dependent on actual disease magnitude. There was a tendency to overestimate area diseased, but not lesion counts, and this tendency was pronounced at lower disease severity, with a leaf having more lesions tending to be assessed as having greater area infected compared with a leaf with fewer lesions but equal actual area infected. The rater estimations of disease were less accurate or precise with increasing actual disease severity as indicated by the fit of a normal probability density function—the incidence of extreme values increases with increasing actual disease. For example, for %ANC the kurtosis of the distribution ranged from 17.92 to 1.18, 0.51, and 0.22 in actual disease category ranges of 0 to 10, 11 to 20, 21 to 30, and 31 to 40% area infected, respectively. The log variance of the estimates plotted against log actual disease for all three raters over two assessment occasions gave a linear relationship for L, %AN, and %ANC (r2 = 0.74, 0.65, and 0.74, respectively). Training should improve the accuracy, precision, and reproducibility of raters, and knowledge of the characteristics of disease assessment should help develop and target the training more appropriately and address specific causes and sources of error.

Systematic Errors in Rating the Quality of Themes Varying in Mode of Discourse and Grade Level

1971 ◽  
Vol 28 (1) ◽  
pp. 131-136
Author(s):  
M. H. Tillman ◽  
L. Ramon Veal
Keyword(s):  
Analysis Of Variance ◽  
Grade Level ◽  
Systematic Errors ◽  
Rater Error

Theme models were developed for assessing quality of writing within four modes of discourse: argumentative, descriptive, expository, and narrative. Compositions were obtained in each of the four modes at Grades 2, 4, and 6. Using the model themes, three raters rated all themes. In order to locate sources of systematic rater error within the context of these rating procedures, the results were analyzed by analysis of variance (Guilford, 1954) which identifies three sources of rater error: halo, leniency, and rater-trait interaction. At Grade 6, z rater leniency error was found, perhaps reflecting that raters tended to equalize time actually spent in rating themes without proper regard to the time needed to rate themes. It was suggested that attention be focused on rater attitude toward models and the subsequent ratings. Finally, it was noted that the use of different mode models did not affect the variation among raters.

The Influence of Collectivism and Rater Error on Organizational Citizenship and Impression Management Behaviors

2012 ◽  
Vol 40 (4) ◽  
pp. 545-555 ◽  
Author(s):  
Philsung Kim ◽  
Ji-Hwan Lee
Keyword(s):  
Organizational Performance ◽  
Impression Management ◽  
Organizational Citizenship ◽  
Organizational Citizenship Behavior ◽  
Citizenship Behavior ◽  
Future Research ◽  
Employee Behaviors ◽  
Negative Effect ◽  
Rater Error ◽  
Selection Factors

Although the employer may not necessarily recognize this, organizational citizenship behavior (OCB) enhances organizational performance. However, most contemporary appraisal measures fail to distinguish between OCB and other types of employee behaviors such as impression management behavior (IMB) and in-role behavior (IRB), all of which employees could display in order to gain higher performance ratings. In this paper we distinguished empirically between OCB, IMB, and IRB, and examined their selection factors. Our regression results showed that an employee's collectivism was positively associated with his/her OCBs. Contrary to our prediction, however, collectivism was also positively related to IMBs. In the context of human resource management, an employee's perception of rater error had a negative effect on OCBs and IRBs. Implications for management and future research are discussed.

Sign in / Sign up

Export Citation Format

Share Document