scholarly journals Interobserver and Intraobserver Reproducibility and Reliability of the Huashan Clinical Classification System for Hirayama Disease

2021 ◽  
Vol 12 ◽  
Author(s):  
Chi Sun ◽  
Guangyu Xu ◽  
Yuxuan Zhang ◽  
Zhongyi Cui ◽  
Dayong Liu ◽  
...  
Keyword(s):  
Classification System ◽  
Weighted Kappa ◽  
Intraobserver Agreement ◽  
Clinical Environment ◽  
Clinical Classification ◽  
Percentage Agreement ◽  
Interobserver Reproducibility ◽  
Hirayama Disease ◽  
Different Order ◽  
Excellent Reproducibility

Purpose: The Huashan clinical classification system for Hirayama disease has recently been proposed and has been found useful for diagnosis and treatment. So far, however, there has been little in-depth evaluation of its reliability. Thus, this study aimed to assess the reproducibility and reliability of the system.Methods: Patients diagnosed with Hirayama disease between 2019 and 2020 were recruited. Seven spine surgeons from four different institutions, including an experienced group of three and an inexperienced group of four, were trained as observers of the Huashan clinical classification system for Hirayama disease, and these surgeons classified the recruited patients using the system. Then, 2 months later, they repeated the classification on the same patients in a different order. The interobserver and intraobserver agreement between the results was analyzed using percentage agreement and weighted kappa (κ) statistics.Results: A total of 60 patients were included in the analysis. For all the observers, experienced observers, and inexperienced observers, the agreement percentages were, respectively, 78.5% (κ = 0.76), 80.0% (κ = 0.78), and 78.9% (κ = 0.77), indicating substantial interobserver reproducibility. For distinguishing typical (Types I and II) and atypical (Type III) Hirayama disease among the different groups of observers, the percentage agreement ranged from 95.6 to 98.9% (κ = 0.74–0.92), indicating substantial to nearly perfect reproducibility. For suggesting conservative treatment (Types I and III) or surgery (Type II), the percentage agreement ranged from 93.3 to 96.4% (κ = 0.81–0.90), indicating nearly perfect reproducibility. As for intraobserver agreement, the percentage agreement ranged from 68.3 to 81.7% (κ = 0.65–0.79), indicating substantial reliability.Conclusion: The Huashan clinical classification system for Hirayama disease was easy to learn and apply in a clinical environment, showing excellent reproducibility and reliability. Therefore, it would be promising to apply and promote this system for the precise and individualized future treatment of Hirayama disease.

An independent inter- and intraobserver agreement assessment of the AOSpine sacral fracture classification system

2021 ◽  
Author(s):  
Julio Urrutia ◽  
Arturo Meissner-Haecker ◽  
Nelson Astur ◽  
Manuel Valencia ◽  
Ratko Yurac ◽  
...  
Keyword(s):  
Classification System ◽  
Sacral Fracture ◽  
Intraobserver Agreement ◽  
Fracture Classification ◽  
Agreement Assessment

scholarly journals Validity and Reliability of an Expanded Vegetable Questionnaire Among Elementary School Children

2019 ◽  
Vol 3 (8) ◽  
Author(s):  
M J Landry ◽  
N Ranjit ◽  
D M Hoelscher ◽  
F M Asigbee ◽  
S Vandyousefi ◽  
...  
Keyword(s):  
Vegetable Intake ◽  
Weighted Kappa ◽  
Fifth Grade ◽  
Kappa Statistics ◽  
Percentage Agreement ◽  
Validity And Reliability ◽  
Reliable Measure ◽  
Dietary Recall ◽  
Fifth Grade Students ◽  
Reliability Estimates

ABSTRACT Background The purpose of this study was to expand the School Physical Activity and Nutrition questionnaire to include a greater variety of vegetables and to evaluate the relative validity and reliability of these revised items. Objectives This study utilized 2 convenience samples of third to fifth graders for an analysis: validity (n = 70) and reliability (n = 76). Validity was assessed by comparing questionnaire items with vegetable intake reported from a 24-hour dietary recall covering the same reference period. Reliability estimates were assessed via same-day test-retest. Results Agreement correlations ranged from 0.35 to 0.71. Kappa statistics varied from 0.16 to 0.66. Percentage agreements ranged from 57% to 87%. Test-retest Spearman coefficients were greater than 0.50 for 6 items, weighted Kappa values were greater than 0.40 for all 7 items, and percentage agreement exceeded 75% for 5 items. Conclusions Results suggest that the questionnaire is a valid and reliable measure of the previous day's vegetable intake in third- to fifth-grade students. This trial was registered at ClinicalTrials.gov as NCT02668744.

A clinical classification system for grading platinum hypersensitivity reactions

2020 ◽  
Vol 159 (3) ◽  
pp. 794-798
Author(s):  
Monica Hagan Vetter ◽  
Antonio Castaneda ◽  
Ambar Khan ◽  
David M. O'Malley
Keyword(s):  
Classification System ◽  
Hypersensitivity Reactions ◽  
Clinical Classification

Problems With Reliability of Speech Variables for Use in Quality Registries for Cleft Lip and Palate—Experiences From the Swedish Cleft Lip and Palate Registry

2018 ◽  
Vol 55 (8) ◽  
pp. 1051-1059 ◽  
Author(s):  
Jan-Olof Malmborn ◽  
Magnus Becker ◽  
Kristina Klintö
Keyword(s):  
Cleft Lip ◽  
Cleft Lip And Palate ◽  
Intraclass Correlation ◽  
Weighted Kappa ◽  
University Hospital ◽  
Percentage Agreement ◽  
Quality Registry ◽  
Audio Recordings ◽  
Absolute Agreement ◽  
Velopharyngeal Function

Objective: To test the reliability of the speech data in the Swedish quality registry for cleft lip and palate. Design: Retrospective study. Setting: Primary care university hospital. Participants: Ninety-four children born with cleft palate with or without cleft lip between 2005 and 2009 who had been assessed and registered in the quality registry at the age of 5 years. Main Outcome Measures: Data in the registry on percent oral consonants correct, percent oral errors, percent nonoral errors, perceived velopharyngeal function (PVPF), and intelligibility were compared with results based on reassessments by 3 independent raters from audio recordings. Agreement was calculated by the intraclass correlation coefficient (ICC), quadratic weighted kappa, and percentage agreement. Results: Absolute agreement calculated by average measures ICC for percent oral consonants correct, percent oral errors, and percent nonoral errors was above >0.90. Single measures ICC for percent oral consonants correct was 0.82, for percent oral errors 0.69, and for percent nonoral errors 0.83. The kappa coefficient for PVPF was 0.5 to 0.59 and for intelligibility 0.65 to 0.77. Exact percentage agreement for PVPF was 33% and for intelligibility 47.8%. Conclusions: The data on oral consonants correct and nonoral errors in the quality registry seem to be reliable. The data on oral errors, PVPF, and intelligibility should be interpreted with caution. If differences among treatment centers are detected, one should go back and examine the collected raw data before drawing any definitive conclusions about treatment outcome.

Classification of patients with a clinically isolated syndrome based on signs and symptoms is supported by magnetic resonance imaging results

2007 ◽  
Vol 13 (6) ◽  
pp. 717-721 ◽  
Author(s):  
J.M. Nielsen ◽  
B. Moraal ◽  
C.H. Polman ◽  
P. Poppe ◽  
M. de Vos ◽  
...  
Keyword(s):  
Magnetic Resonance Imaging ◽  
Multiple Sclerosis ◽  
Magnetic Resonance ◽  
Classification System ◽  
Signs And Symptoms ◽  
First Episode ◽  
Clinical Classification ◽  
Resonance Imaging ◽  
Imaging Results ◽  
Symptoms And Signs

Background Recently, a clinical classification system was described to determine whether symptoms and signs of patients presenting with a first episode suggestive of multiple sclerosis (MS) indicate the presence of monofocal or multifocal disease. Objectives To evaluate the value of this new classification system by comparing the results with those of simultaneously obtained magnetic resonance imaging (MRI) scans. Methods The 487 patients, randomised in the BENEFIT study, were centrally assessed using the new system and classified as monofocal or multifocal, based on clinical information by two neurologists masked for the MRI results. MRI analyses were performed by expert readers masked for the clinical classification. Results Patients classified as multifocal had more T2 hyperintense (median: 21 versus 15.5) and more T1 hypo-intense lesions (median: 2 versus 1) than those classified as monofocal. Patients classified at the local site as having evidence of a single clinical lesion, but reclassified centrally as having a clinical multifocal central nervous system presentation, had more T2 lesions than monofocal patients. In addition, patients with a multifocal presentation more often fulfilled the MRI criteria for dissemination in space, as incorporated in the International Panel (IP) diagnostic criteria for MS. Conclusion These data provide justification for the recently proposed clinical classification system to be used in patients who present with a first episode suggestive of MS, in that `multifocal', based on symptoms and signs, is associated with more lesions on MRI. Multiple Sclerosis 2007; 13: 717-721. http://msj.sagepub.com

Interrater and Intrarater Reliability of the Kuntz et al New Deformity Classification System

Neurosurgery ◽  
2012 ◽  
Vol 71 (1) ◽  
pp. 47-57 ◽  
Author(s):  
Martin Thaler ◽  
Ricarda Lechner ◽  
Michaela Gstöttner ◽  
Matthias Luegmair ◽  
Michael Liebensteiner ◽  
...  
Keyword(s):  
Classification System ◽  
Interobserver Agreement ◽  
Intraobserver Agreement ◽  
Spinal Alignment ◽  
Intrarater Reliability ◽  
Surgical Interventions ◽  
Apical Vertebral Rotation ◽  
Age Dependent ◽  
The Mean

Abstract BACKGROUND: Kuntz et al recently introduced a new system for classifying spinal deformities. This classification of spinal deformity was developed from age-dependent deviations from the neutral upright spinal alignment. OBJECTIVE: To determine the interobserver and intraobserver reliabilities of the new Kuntz et al system for classifying scoliosis. METHODS: Fifty consecutive patients were evaluated. Three observers independently assigned a major structural curve, minor structural curve, curve type, apical vertebral rotation, spinal balance, and pelvic alignment to each curve following the guidelines described by Kuntz et al. Assignment of the curves was repeated 4 weeks later, with the curves presented in a different blinded order. The Kendall W and Holsti agreement coefficients were used to determine the interobserver and intraobserver agreement. RESULTS: The intraobserver value of agreement for all parameters was 0.85 (range, 0.28-1.0), and the mean Kendall W coefficient was 0.89 (range, 0.5-0.97), demonstrating perfect reliability. The interobserver agreement averaged 0.7 (range, 0.251-1.0). The mean Kendall W coefficient was 0.67 (range, 0.19-1.0), demonstrating substantial reliability. The average time for classification of 1 curve was approximately 8.4 minutes. CONCLUSION: The new Kuntz et al deformity classification system is comparable to the Lenke et al system in terms of reliability. However, the Kuntz et al classification system provides no recommendations for surgical interventions. It is more complex and time-consuming and therefore may be of limited value in daily clinical practice.

scholarly journals An Independent Inter- and Intraobserver Agreement Evaluation of the New AO Spine Thoracolumbar Spine Injury Classification System

2015 ◽  
Vol 5 (1_suppl) ◽  
pp. s-0035-1554440-s-0035-1554440
Author(s):  
Julio Urrutia ◽  
Tomas Zamora ◽  
Ratko Yurac ◽  
Mauricio Campos ◽  
Joaquin Palma ◽  
...  
Keyword(s):  
Classification System ◽  
Thoracolumbar Spine ◽  
Spine Injury ◽  
Intraobserver Agreement ◽  
Injury Classification

scholarly journals Evaluation and inter-observer analysis of retinography existing clinical classification system to categorize moderate retinopathies

2009 ◽  
Vol 87 ◽  
pp. 0-0
Author(s):  
C SANCHEZ RAMOS ◽  
M WASFI ◽  
C BONNIN-ARIAS ◽  
M VINAS-PENA ◽  
A FORLAN ◽  
...  
Keyword(s):  
Classification System ◽  
Clinical Classification

scholarly journals Intra and Inter-observer Concordance of a New Classification System for Myopic Maculopathy

2020 ◽  
Author(s):  
Rong-rong Zhang ◽  
Yan Yu ◽  
Yin-fen Hou ◽  
Chang-fan Wu
Keyword(s):  
Classification System ◽  
Clinical Decision Making ◽  
Interobserver Reliability ◽  
Type A ◽  
Clinical Decision ◽  
Intraobserver Agreement ◽  
Intraobserver Reproducibility ◽  
Fundus Photographs ◽  
Myopic Maculopathy

Abstract Background: Myopic maculopathy (MM) is one of the major causes of visual impairment and irreversible blindness in eyes with PM. However, the classification of each type of lesion associated with MM has not been determined. Recently, a new MM classification system was proposed, known as the ATN grading and classification system, which was based on the fundus photographs and OCT images, including three variable components: atrophy (A), traction (T), and neovascularization (N). Hence, this study aimed to perform an independent interobserver and intraobserver agreement evaluation of the recently developed ATN grading system for MM. Methods: This was a retrospective study. Fundus photographs and the optical coherence tomography (OCT) images of 125 patients (226 eyes) with various of MM were evaluated and classified using the ATN grading of the new MM classification system by four evaluators (2 attending ophthalmologists and 2 ophthalmic residents). All cases were repeatedly evaluated by the same evaluators after an interval of 6 weeks. The Kappa coefficient (κ) and 95% confidence interval (CI) were used to determine the interobserver and intraobserver agreement.Results: The interobserver reliability was substantial when considering the maculopathy type (A, T, and N). The weighted Fleiss κ values for each MM type (A, T, and N) were 0.651 (95% CI: 0.602–0.700), 0.734 (95% CI: 0.689–0.779), and 0.702 (95% CI: 0.649–0.755), respectively. The interobserver agreement when considering the sub-types was good or excellent, except for stages A1, A2, and N1 which weighted κ value was less than 0.6, with a moderate agreement. The intraobserver reproducibility of types or sub-types was excellent, with κ>0.8. No significant differences were observed between attending ophthalmologists and residents in the interobserver reliability and intraobserver reproducibility.Conclusions: The ATN classification allows an adequate agreement among ophthalmologists with different qualifications and by the same observer on separate occasions. Future prospective studies should further evaluate whether this classification can be better implemented at clinical decision-making and disease progression assessment.

Sign in / Sign up

Export Citation Format

Share Document