scholarly journals Reliability and Accuracy of Visual Estimation of Phomopsis Leaf Blight of Strawberry

2003 ◽  
Vol 93 (8) ◽  
pp. 995-1005 ◽  
Author(s):  
M. Nita ◽  
M. A. Ellis ◽  
L. V. Madden
Keyword(s):  
Linear Relationship ◽  
Disease Severity ◽  
Correlation Coefficients ◽  
Leaf Blight ◽  
Visual Estimation ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Direct Estimation ◽  
Assessment Time ◽  
The Relationship

Six different individuals (raters) assessed the severity of Phomopsis leaf blight on strawberry leaflets in five experimental repetitions over 2 years by making a direct visual estimation of the percentage of diseased area of each leaflet or by using the Horsfall-Barratt (H-B) disease scale. Intra-rater and inter-rater reliability and accuracy were determined, and then the relationship between visually estimated severity values and actual severity values was evaluated. Agreement in estimated disease severity values between assessment times by the same raters (i.e., intra-rater reliability), and agreement in disease severity values among raters at a single assessment time (i.e., inter-rater reliability), were both high, with most correlation coefficients being greater than 0.85. The intra-class correlation for overall agreement among raters ranged from 0.80 to 0.96 for the five repetitions. Based on the concordance coefficient calculated for each rater in each repetition, agreement between estimated and actual severity (i.e., accuracy) was somewhat lower than reliability. The relationship between estimated and actual severity was linear, and there was a slight trend to overestimate disease severity. The H-B scale was not more reliable or accurate than direct estimation of severity, and the linear relationship between estimated and actual severity did not support the principles underling the H-B scale. Both size of leaflets and number of lesions per leaflet slightly affected the error in estimate of disease severity.

scholarly journals Guideline for Selecting Types of Reliability and Suitable Intra-class Correlation Coefficients in Clinical Research

2021 ◽  
Author(s):  
Khalil Taherzadeh Chenani ◽  
Farzan Madadizadeh
Keyword(s):  
Clinical Research ◽  
Correlation Coefficients ◽  
Reliability Test ◽  
Research Information ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Medical Researchers ◽  
Different Types ◽  
Test Retest Reliability ◽  
Cluster Correlation

Introduction: Reliability is an integral part of measuring the reproducibility of research information. Intra-cluster correlation coefficient (ICC) is one of the necessary indicators for reliability reporting, which can be misleading in terms of its diversity. The main purpose of this study was to introduce the types of reliability and appropriate ICC indices.  Methods: In this tutorial article, useful information about the types of reliability and indicators needed to report the results, as well as the types of ICC and its applications were explained for dummies. Results: Three general types of reliability include inter-rater reliability, test-retest reliability, and intra-rater reliability was presented. 10 different types of ICC were also introduced and explained. Conclusion: The research results may be misleading if any of the reliability types and calculation criteria types are chosen incorrectly. Therefore, to make the results of the study more accurate and valuable. Medical researchers must seek help from relevant guidelines such as this study before conducting reliability analysis.  

scholarly journals Temperature and Wetness-Duration Requirements for Grape Leaf and Cane Infection by Phomopsis viticola

Plant Disease ◽  
2003 ◽  
Vol 87 (7) ◽  
pp. 832-840 ◽  
Author(s):  
O. Erincik ◽  
L. V. Madden ◽  
D. C. Ferree ◽  
M. A. Ellis
Keyword(s):  
Disease Severity ◽  
Correlation Coefficients ◽  
Phomopsis Viticola ◽  
Average Temperature ◽  
Growing Seasons ◽  
Wide Range ◽  
Maximum Temperatures ◽  
Rain Events ◽  
Grape Leaf ◽  
The Relationship

In 1998 and 1999, controlled-environment studies were conducted in growth chambers to determine the temperature and wetness-duration parameters required for leaf and cane infection of grape by Phomopsis viticola. Greenhouse-grown ‘Catawba’ (Vitis labrusca) and ‘Seyval’ (French hybrid) grapes were inoculated with P. viticola and incubated at constant temperatures of 5, 10, 15, 20, 25, 30, and 35°C and at wetness durations of 5, 10, 15, and 20 h for each temperature. Data from each cultivar were analyzed by nonlinear regression analysis to determine the relationship between disease severity and temperature and wetness duration. A generalized form of the Analytis Beta model was found to provide the best fit to the data. Disease severity on leaves and canes increased with increasing wetness duration at most temperatures. Minimum and maximum temperatures for infection were around 5 and 35.5°C, respectively. Optimum temperatures for leaf and cane infection were between 16 and 20°C. In the 2000 and 2001 growing seasons, the generalized Beta model was validated in ‘Catawba’ and ‘Seyval’ vineyards by inoculating vines during natural rain events. Average temperature and hours of wetness for each event and inoculation were recorded and used in the model equation to predict disease severity on leaves and internodes. Correlation coefficients between observed disease severities following field inoculations and predicted disease severities for both cultivars were between 0.71 and 0.81 and always significant (P < 0.01). These results indicate that the model reliably predicted leaf and cane infection on both cultivars over a wide range of wetness durations and temperatures. The model may be useful in developing disease-forecasting systems for Phomopsis cane and leaf spot on grapes.

scholarly journals Disease Severity and Yield of Sweet Corn Hybrids with Resistance to Northern Leaf Blight

Plant Disease ◽  
1998 ◽  
Vol 82 (1) ◽  
pp. 57-63 ◽  
Author(s):  
J. K. Pataky ◽  
R. N. Raid ◽  
L. J. du Toit ◽  
T. J. Schueneman
Keyword(s):  
Disease Severity ◽  
Partial Resistance ◽  
Yield Loss ◽  
Sweet Corn ◽  
Correlation Coefficients ◽  
Inbred Lines ◽  
Leaf Blight ◽  
Northern Leaf Blight ◽  
Corn Hybrids ◽  
Highly Correlated

Reactions of supersweet (sh2) sweet corn to northern leaf blight (NLB) and associated yields were evaluated in Belle Glade, Florida and Urbana, Illinois in yield-loss trials, hybrid evaluations, and evaluations of breeding materials. Hybrids differed significantly for NLB in all trials. Severity of NLB ranged from 0 to 66% on 35 sh2 hybrids in yield-loss trials, and from 0 to 60% on 80 sh2 hybrids in hybrid evaluations. NLB ratings ranged from 1 to 9 (approximately 0 to 80% severity) on 375 hybrids and 186 inbred lines in evaluations of breeding materials. Various methods of rating NLB and ratings from multiple dates were highly correlated, with correlation coefficients ranging from 0.76 to 0.98. Yield, measured as weight of ears and number of marketable ears from inoculated plots as a percentage of that from control plots, decreased as disease severity increased. Linear or quadratic regression models explained 31 to 70% of the variation in percent yield as a function of disease severity at harvest. The effects of NLB on yield were limited by NLB-resistance in several hybrids, including CCO 3268, Chieftain, Crisp N Sweet 710A, Day Star, Envy, Forever, GSS 1526, Jupiter, Midship, Prime Plus, Sch 5005, and SummerSweet 7630. Although high levels of partial resistance to NLB were prevalent among 375 new experimental sh2 hybrids and 186 sh2 inbred lines evaluated in 1995, use of the gene HtN may increase in the near future as breeders are incorporating this resistance into new inbreds and hybrids. Breeders and plant pathologists would be wise to continue improving partial resistance to NLB without using the gene HtN in genotypes with adequate levels of partial resistance, because the widespread use of the gene HtN will select for virulent races of Exserohilum turcicum which occur in Florida, or for races with new combinations of virulence.

Inter-rater reliability of two depression rating scales, MADRS and DRRS, based on videotape records of structured interviews

1998 ◽  
Vol 13 (5) ◽  
pp. 264-266 ◽  
Author(s):  
E Corruble ◽  
D Purper ◽  
C Payan ◽  
JD Guelfi
Keyword(s):  
Rating Scales ◽  
Antidepressant Treatment ◽  
Correlation Coefficients ◽  
Structured Interview ◽  
Structured Interviews ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Videotape Recording

SummaryThe inter-rater reliability of the French versions of the MADRS and the DRRS was studied on the basis of 58 videotape records of structured standardised interviews of depressed inpatients under antidepressant treatment. Each patient was assessed by two trained raters, from the same videotape recording. The inter-rater reliability of total scores was high with both scales (intra-class correlation coefficients: 0.86 for MADRS and 0.77 for DRRS). However, the inter-rater reliability for individual items was higher and more homogeneous for the MADRS than for the DRRS. Finally, the structured interview in French appears to be relevant for the MADRS, but it should be improved for the DRRS.

Inter-rater reliability of case-note audit: a systematic review

2007 ◽  
Vol 12 (3) ◽  
pp. 173-180 ◽  
Author(s):  
Richard Lilford ◽  
Alex Edwards ◽  
Alan Girling ◽  
Timothy Hofer ◽  
Gian Luca Di Tanna ◽  
...  
Keyword(s):  
Systematic Review ◽  
Clinical Care ◽  
Quality Care ◽  
Correlation Coefficients ◽  
Poor Quality ◽  
Case Note ◽  
Rater Reliability ◽  
The Relationship ◽  
Retrospective Examination

Objective: The quality of clinical care is often assessed by retrospective examination of case-notes (charts, medical records). Our objective was to determine the inter-rater reliability of case-note audit. Methods: We conducted a systematic review of the inter-rater reliability of case-note audit. Analysis was restricted to 26 papers reporting comparisons of two or three raters making independent judgements about the quality of care. Results: Sixty-six separate comparisons were possible, since some papers reported more than one measurement of reliability. Mean kappa values ranged from 0.32 to 0.70. These may be inflated due to publication bias. Measured reliabilities were found to be higher for case-note reviews based on explicit, as opposed to implicit, criteria and for reviews that focused on outcome (including adverse effects) rather than process errors. We found an association between kappa and the prevalence of errors (poor quality care), suggesting alternatives such as tetrachoric and polychoric correlation coefficients be considered to assess inter-rater reliability. Conclusions: Comparative studies should take into account the relationship between kappa and the prevalence of the events being measured.

Field Inter-Rater Reliability of the Psychopathy Checklist–Revised

2016 ◽  
Vol 62 (2) ◽  
pp. 468-481 ◽  
Author(s):  
Ghena Ismail ◽  
Jan Looman
Keyword(s):  
Sex Offenders ◽  
Correlation Coefficients ◽  
Treatment Center ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Psychopathy Checklist ◽  
Federal Inmates ◽  
Psychopathy Checklist Revised ◽  
Hare Psychopathy Checklist ◽  
Absolute Agreement

Strong inter-rater reliability has been established for the Hare Psychopathy Checklist–Revised (PCL-R), specifically by examiners in research contexts. However, there is less support for inter-reliability in applied settings. This study examined archival data that included a sample of sex offenders ( n = 178) who entered federal custody between 1992 and 1998. The offenders were assessed using the PCL-R on two occasions. The first assessment occurred at Millhaven Institution, the intake unit for federally incarcerated offenders in the province of Ontario. The second assessment took place upon inmates’ transfer to the Regional Treatment Center, which admits federal inmates with intense psychological and psychiatric needs. Intra-class correlation coefficients (ICCs) were calculated for item, total, factor, and facet scores. The ICC absolute agreement for the PCL-R total and factor scores from raters across both settings was slightly better than what has been previously reported by Hare. Results of this study show that the reliability of PCL-R scores in field settings can be comparable to those in research settings. Authors conclude by highlighting the importance of training, consultation, considering different scores for a given item, following the guidelines of the manual in addition to considering measures that enhance neutrality and reliability of findings in the criminal justice system.

scholarly journals The inter-rater reliability of the Pulmonary Embolism Severity Index

2010 ◽  
Vol 104 (12) ◽  
pp. 1258-1262 ◽  
Author(s):  
Montserrat Fraga ◽  
Patrick Taffé ◽  
Marie Méan ◽  
Olivier Hugli ◽  
Stéphanie Witzig ◽  
...  
Keyword(s):  
Pulmonary Embolism ◽  
Correlation Coefficients ◽  
Severity Index ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Risk Class ◽  
Point Score ◽  
Total Point ◽  
Attending Physician

SummaryThe Pulmonary Embolism Severity Index (PESI) is a validated clinical prognostic model for patients with acute pulmonary embolism (PE). Our goal was to assess the PESI’s inter-rater reliability in patients diagnosed with PE. We prospectively identified consecutive patients diagnosed with PE in the emergency department of a Swiss teaching hospital. For all patients, resident and attending physician raters independently collected the 11 PESI variables. The raters then calculated the PESI total point score and classified patients into one of five PESI risk classes (I-V) and as low (risk classes I/II) versus higher-risk (risk classes III-V). We examined the inter-rater reliability for each of the 11 PESI variables, the PESI total point score, assignment to each of the five PESI risk classes, and classification of patients as low versus higher-risk using kappa (κ) and intra-class correlation coefficients (ICC). Among 48 consecutive patients with an objective diagnosis of PE, reliability coefficients between resident and attending physician raters were > 0.60 for 10 of the 11 variables comprising the PESI. The inter-rater reliability for the PESI total point score (ICC: 0.89, 95% CI: 0.81–0.94), PESI risk class assignment (κ: 0.81, 95% CI: 0.66–0.94), and the classification of patients as low versus higher-risk (κ: 0.92, 95% CI: 0.72–0.98) was near perfect. Our results demonstrate the high reproducibility of the PESI, supporting the use of the PESI for risk stratification of patients with PE.

scholarly journals Agreement and reliability of the Feline Grimace Scale among cat owners, veterinarians, veterinary students and nurses

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Marina C. Evangelista ◽  
Paulo V. Steagall
Keyword(s):  
Mixed Models ◽  
Correlation Coefficients ◽  
Limits Of Agreement ◽  
Veterinary Students ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Bland Altman Method ◽  
Method Effects ◽  
Good For ◽  
Good Agreement

AbstractThis study aimed to evaluate the agreement and reliability of the Feline Grimace Scale (FGS) among cat owners, veterinarians, veterinary students and nurses/technicians. Raters (n = 5/group) scored 100 images using the FGS (ear position, orbital tightening, muzzle tension, whiskers position and head position). Intra-class correlation coefficients (ICC) were used to assess inter- and intra-rater reliability. Agreement between each group and the veterinarian group (gold-standard) was calculated using the Bland–Altman method. Effects of gender, age and number of cats owned on FGS scores were assessed using linear mixed models. Inter-rater reliability was good for FGS final scores (ICC > 0.8). The muzzle and whiskers yielded lower reliability (ICC = 0.39 to 0.74). Intra-rater reliability was excellent for students and veterinarians (ICC = 0.91), and good for owners and nurses (ICC = 0.87 and 0.81, respectively). A very good agreement between all groups and veterinarians (bias < 0.1 and narrow limits of agreement) was observed. Female raters assigned higher FGS scores than males (p = 0.006); however, male raters were underrepresented in this study. Scores were not affected by age or number of cats owned. The FGS is reliable for feline acute pain assessment when used by individuals with different experience.

scholarly journals Examination of inter-rater and intra-rater reliability during retentive force measurement of different clasps using the developed small-sized retentive force measurement device

2020 ◽  
Author(s):  
Hitoshi AKIYAMA ◽  
Maiko SAKAMOTO ◽  
Ryoichi AKAMA ◽  
Jun TAKEI
Keyword(s):  
Clinical Practice ◽  
Force Measurement ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Plaster Cast ◽  
Measurement Device ◽  
Removable Partial Denture ◽  
Rater Reliability ◽  
Intra Class Correlation ◽  
Retentive Force

Abstract The purpose of the present study is to develop a small-sized retentive force measurement device that can easily measure the retentive force of a clasp used for a removable partial denture in daily clinical practice, and it is to examine the inter-rater and intra-rater reliability. A small-sized retentive force measurement device that can be easily measured in clinic has been developed. Using commercially available hard plaster cast, a skilled dental technician has made 10 types of cast clasps used in clinical practice using conventional techniques. There were 3 assessors who measured the retentive force of 10 types of cast clasps. In order to confirm the reliability, the intra-class correlation coefficients ICC (1,1) and ICC (1,3) of the 3 assessors were calculated, and the reliability within the assessor was examined. Further, the inter-class correlation coefficients ICC (3,1) and ICC (3,3) were calculated, and the reliability between the measurers was examined. The intra-class correlation coefficients of 3 assessors are as follows: assessor 1 has ICC (1,1) = 0.971, ICC (1,3) = 0.990, assessor 2 has ICC (1,1) = 0.967, ICC (1,3) = 0.989, assessor 3 has ICC (1,1) = 0.962, ICC (1,3) = 0.987. The inter-class correlation coefficients of 3 assessors are as follows: ICC (3,1) = 0.993, ICC (3,3) = 0.998. From the evaluation standard of the intraclass correlation coefficients of reliability value by ICC, it was evaluated as almost perfect and high reproducibility was confirmed. The developed small-sized retentive force measurement device has reproducibility within and between the assessors.

scholarly journals Is the Anatomy of the Inferior Mesenteric Artery Root Different in Patients with a Tortuous Abdominal Aorta?

2020 ◽  
Author(s):  
Jia-Hao Zhou ◽  
Hsu-Chao Chang
Keyword(s):  
Abdominal Aorta ◽  
Qualitative Method ◽  
Pearson Correlation ◽  
Correlation Coefficients ◽  
Root Anatomy ◽  
Convex Side ◽  
Visual Estimation ◽  
Endovascular Interventions ◽  
Abdominal Aortic ◽  
The Relationship

Abstract Background: Catheterization of the inferior mesentery artery (IMA) during angiography can sometimes be difficult due to anatomic variations. Our study aimed to evaluate the relationship between abdominal aortic tortuosity (AAT) and the anatomy of the IMA root. Methods: In this retrospective study, a total of 45 patients were selected and 3 groups were divided using a qualitative method by visual estimation of vessel tortuosity. A quantitative method was performed by recording the patient age, tortuosity index, and features of the IMA root anatomy, including orifice level, vertical diameter, clockwise angle, and angulation. Pearson correlation coefficients (p < 0.05) were calculated to analyse the strength of the linear association between tortuosity and other variables. Results: The AAT index was significantly associated with age. When the abdominal aorta was tortuous, the IMA root was more likely to be distorted toward the convex side, with a larger angulation between the IMA root and the abdominal aorta. Conclusions: Our study provides information which could help clinicians plan endovascular interventions of IMA. When cannulation of the IMA appears to be difficult, a rotation of tip of the catheter to the convex side of the abdominal aorta and a less sharp looping of the catheter may be attempted.

Sign in / Sign up

Export Citation Format

Share Document