scholarly journals Intra- and interobserver concordance of a new classification system for myopic maculopathy

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Rong-rong Zhang ◽  
Yan Yu ◽  
Yin-fen Hou ◽  
Chang-fan Wu

Abstract Background Myopic maculopathy (MM) is one of the major causes of visual impairment and irreversible blindness in eyes with pathologic myopia (PM). However, the classification of each type of lesion associated with MM has not been determined. Recently, a new MM classification system, known as the ATN grading and classification system, was proposed; it is based on the fundus photographs and optical coherence tomography (OCT) images and includes three variable components: atrophy (A), traction (T), and neovascularization (N). This study aimed to perform an independent evaluation of interobserver and intraobserver agreement for the recently developed ATN grading system for MM. Methods This was a retrospective study. Fundus photographs and OCT images of 125 patients (226 eyes) with various MMs were evaluated and classified using the ATN grading of the new MM classification system by four blinded and independent evaluators (2 attending ophthalmologists and 2 ophthalmic residents). All cases were randomly re-evaluated by the same observers after an interval of 6 weeks. The kappa coefficient (κ) and 95% confidence interval (CI) were used to determine the interobserver and intraobserver agreement. Results The interobserver agreement was substantial when considering the maculopathy type (A, T, and N). The weighted Fleiss κ values for each MM type (A, T, and N) were 0.651 (95% CI: 0.602–0.700), 0.734 (95% CI: 0.689–0.779), and 0.702 (95% CI: 0.649–0.755), respectively. The interobserver agreement when considering the subtypes was good or excellent, except for stages A1, A2, and N1, in which the weighted κ value was less than 0.6, with moderate agreement. The intraobserver agreement of types and subtypes was excellent, with κ > 0.8. No significant differences were observed between the attending ophthalmologists and residents for interobserver reliability or intraobserver reproducibility. Conclusions The ATN classification allows an adequate agreement among ophthalmologists with different qualifications and by the same observer on separate occasions. Future prospective studies should further evaluate whether this classification can be better implemented in clinical decision-making and disease progression assessments.

2020 ◽  
Author(s):  
Rong-rong Zhang ◽  
Yan Yu ◽  
Yin-fen Hou ◽  
Chang-fan Wu

Abstract Background: Myopic maculopathy (MM) is one of the major causes of visual impairment and irreversible blindness in eyes with PM. However, the classification of each type of lesion associated with MM has not been determined. Recently, a new MM classification system was proposed, known as the ATN grading and classification system, which was based on the fundus photographs and OCT images, including three variable components: atrophy (A), traction (T), and neovascularization (N). Hence, this study aimed to perform an independent interobserver and intraobserver agreement evaluation of the recently developed ATN grading system for MM. Methods: This was a retrospective study. Fundus photographs and the optical coherence tomography (OCT) images of 125 patients (226 eyes) with various of MM were evaluated and classified using the ATN grading of the new MM classification system by four evaluators (2 attending ophthalmologists and 2 ophthalmic residents). All cases were repeatedly evaluated by the same evaluators after an interval of 6 weeks. The Kappa coefficient (κ) and 95% confidence interval (CI) were used to determine the interobserver and intraobserver agreement.Results: The interobserver reliability was substantial when considering the maculopathy type (A, T, and N). The weighted Fleiss κ values for each MM type (A, T, and N) were 0.651 (95% CI: 0.602–0.700), 0.734 (95% CI: 0.689–0.779), and 0.702 (95% CI: 0.649–0.755), respectively. The interobserver agreement when considering the sub-types was good or excellent, except for stages A1, A2, and N1 which weighted κ value was less than 0.6, with a moderate agreement. The intraobserver reproducibility of types or sub-types was excellent, with κ>0.8. No significant differences were observed between attending ophthalmologists and residents in the interobserver reliability and intraobserver reproducibility.Conclusions: The ATN classification allows an adequate agreement among ophthalmologists with different qualifications and by the same observer on separate occasions. Future prospective studies should further evaluate whether this classification can be better implemented at clinical decision-making and disease progression assessment.


2021 ◽  
Vol 29 (2) ◽  
pp. 92-96
Author(s):  
FELIPPI GUIZARDI CORDEIRO ◽  
PATRICIA MORENO GRANGEIRO ◽  
BRUNO SÉRGIO FERREIRA MASSA ◽  
NEI BOTTER MONTENEGRO ◽  
ROBERTO GUARNIERO

ABSTRACT Objective: The purpose of our study is to evaluate intraobserver and interobserver reliability of modified Waldenström classification system for Legg-Calvé-Perthes disease and assess the influence of the professional’s area of expertise in the assessment. Methods: Twelve evaluators assessed 40 pairs of pelvic radiographs of patients with Legg-Calvé-Perthes disease. After two weeks, a new evaluation was performed by the same evaluators. Kappa and Kendall’s W indexes were used to evaluate both intraobserver and interobserver reliability and determine the influence of the evaluators’ experience and area of expertise. Results: The average intraobserver kappa value was 0.394, with a reasonable agreement level. The interobserver Kappa value was 0.243 in the first evaluation (95% CI, 0.227-0.259 and p < 0.0001) and 0.245 in the second evaluation (95% CI, 0.229-0.260 and p < 0.0001). The Kendall’s W values obtained for pediatric orthopedists, radiologists and resident physicians were 0.686, 0.630 and 0.529 (p < 0.0001), respectively. Conclusion: The modified Waldenström classification presented both moderate and reasonable levels of intraobserver agreement, and reasonable level of interobserver agreement. The evaluators’ degree of experience and area of expertise influenced the concordance level found. Level of Evidence II, Diagnostic Studies - Investigating a Diagnostic Test.


2016 ◽  
Vol 37 (5) ◽  
pp. 1857-1870 ◽  
Author(s):  
Jed A Hartings ◽  
Chunyan Li ◽  
Jason M Hinzman ◽  
C William Shuttleworth ◽  
Griffin L Ernst ◽  
...  

Spreading depolarizations cause cortical electrical potential changes over a wide spectral range that includes slow potentials approaching the direct current (or 0 Hz) level. The negative direct current shift (<0.05 Hz) is an important identifier of cortical depolarization and its duration is a measure of potential tissue injury associated with longer lasting depolarizations. To determine the feasibility of monitoring the full signal bandwidth of spreading depolarizations in patients, we performed subdural electrocorticography using platinum electrode strips and direct current-coupled amplifiers in 27 patients with acute brain injury at two neurosurgical centers. While large baseline direct current offsets developed, loss of data due to amplifier saturation was minimal and rates of baseline drift throughout recordings were generally low. Transient negative direct current shifts of spreading depolarizations were easily recognized and in 306/551 (56%) cases had stereotyped, measurable characteristics. Following a standardized training session, novice scorers achieved a high degree of accuracy and interobserver reliability in identifying depolarizations, suggesting that direct current-coupled recordings can facilitate bedside diagnosis for future trials or clinical decision-making. We conclude that intracranial monitoring of slow potentials can be achieved with platinum electrodes and that unfiltered, direct current-coupled recordings are advantageous for identifying and assessing the impact of spreading depolarizations.


Neurosurgery ◽  
2012 ◽  
Vol 71 (1) ◽  
pp. 47-57 ◽  
Author(s):  
Martin Thaler ◽  
Ricarda Lechner ◽  
Michaela Gstöttner ◽  
Matthias Luegmair ◽  
Michael Liebensteiner ◽  
...  

Abstract BACKGROUND: Kuntz et al recently introduced a new system for classifying spinal deformities. This classification of spinal deformity was developed from age-dependent deviations from the neutral upright spinal alignment. OBJECTIVE: To determine the interobserver and intraobserver reliabilities of the new Kuntz et al system for classifying scoliosis. METHODS: Fifty consecutive patients were evaluated. Three observers independently assigned a major structural curve, minor structural curve, curve type, apical vertebral rotation, spinal balance, and pelvic alignment to each curve following the guidelines described by Kuntz et al. Assignment of the curves was repeated 4 weeks later, with the curves presented in a different blinded order. The Kendall W and Holsti agreement coefficients were used to determine the interobserver and intraobserver agreement. RESULTS: The intraobserver value of agreement for all parameters was 0.85 (range, 0.28-1.0), and the mean Kendall W coefficient was 0.89 (range, 0.5-0.97), demonstrating perfect reliability. The interobserver agreement averaged 0.7 (range, 0.251-1.0). The mean Kendall W coefficient was 0.67 (range, 0.19-1.0), demonstrating substantial reliability. The average time for classification of 1 curve was approximately 8.4 minutes. CONCLUSION: The new Kuntz et al deformity classification system is comparable to the Lenke et al system in terms of reliability. However, the Kuntz et al classification system provides no recommendations for surgical interventions. It is more complex and time-consuming and therefore may be of limited value in daily clinical practice.


Author(s):  
Mustafa Akkaya ◽  
Mehmet Emin Simsek ◽  
Serhat Akcaalan ◽  
Ceyhun Caglar ◽  
Safa Gursoy ◽  
...  

Abstract Objective Aseptic loosening (AL) is among the most important causes of failure after total knee arthroplasty (TKA). However, while there are numerous underlying causes of AL, the morphometry of the distal femur and intramedullary canal has not been sufficiently demonstrated. This study aimed to show the interobserver and intraobserver reliability and validity of the Citak classification, which has been recently defined according to the morphometry of the distal femur and provides a risk factor definition for AL. Materials and Methods A total of 200 patients whose standardized anteroposterior (AP) and lateral images of the knee joint were obtained between October 2019 and April 2020 were retrospectively evaluated in this study. Patients with a history of extra-articular deformity and knee surgery were excluded from the study. For AL, morphologies of the distal femur were identified by two observers using the new radiological classification system of the distal femur. Mean pairwise Cronbach’s alpha coefficient was used to assess the intra- and interobserver agreement of the classification. Results There was excellent interobserver agreement for the 20 cm proximal and 2 cm proximal to the lateral joint line (PLJL) and adductor tubercle (PAD), respectively. The mean Cronbach’s alpha coefficient was 0.96 (range 0.764–0.944) for the PAD and 0.98 (range 0.734–0.929) for the PLJL. There was also an excellent intraobserver agreement, with 93% average pairwise percent agreement for the index group and 95.5% average pairwise percent agreement for the anatomical classification group. Conclusions The level of inter- and intraobserver agreement for the morphology of the distal femur was excellent in the new radiological classification system, which was shown to be beneficial in the planning of revision knee arthroplasty for AL. However, there is a need for further studies in order to make a correlation of the classification with specific intraoperative findings.


2017 ◽  
Vol 42 (1) ◽  
pp. 103-113 ◽  
Author(s):  
Jagannathan Madhanagopal ◽  
Om Prakash Singh ◽  
Vikram Mohan ◽  
Kathiresan V. Sathasivam ◽  
Abdul Hafidz Omar ◽  
...  

An accurate measurement of intrinsic hand muscle strength (IHMS) is required by clinicians for effective clinical decision-making, diagnosis of certain diseases, and evaluation of the outcome of treatment. In practice, the clinicians use Intrins-o-meter and Rotterdam Intrinsic Hand Myometer for IHMS measurement. These are quite bulky, expensive, and possess poor interobserver reliability (37–52%) and sensitivity. The purpose of this study was to develop an alternative lightweight, accurate, cost-effective force measurement device with a simple electronic circuit and test its suitability for IHMS measurement. The device was constructed with ketjenblack/deproteinized natural rubber sensor, 1-MΩ potential divider, and Arduino Uno through the custom-written software. Then, the device was calibrated and tested for accuracy and repeatability within the force range of finger muscles (100 N). The 95% limit of agreement in accuracy from −1.95 N to 2.06 N for 10 to 100 N applied load and repeatability coefficient of ±1.91 N or 6.2% was achieved. Furthermore, the expenditure for the device construction was around US$ 53. For a practical demonstration, the device was tested among 16 participants for isometric strength measurement of the ulnar abductor and dorsal interossei. The results revealed that the performance of the device was suitable for IHMS measurement.


2011 ◽  
Vol 21 (6) ◽  
pp. 732-739 ◽  
Author(s):  
Ingmar Ipach ◽  
Eva-Maria Arlt ◽  
Falk Mittag ◽  
Beate Kunze ◽  
Petra Wolf ◽  
...  

Early detection of pistol-grip-deformity may be beneficial in optimising the outcome and the cost effectiveness of surgery. It is important to identify reliable radiographic parameters in assessing femoro-acetabular impingement (FAI) to develop a treatment algorithm. Radiographs of 47 patients ranging from “pistol grip deformity” to a normal head-neck-junction were measured for alpha angle and head ratio, and then classified by two different observers. The Bland-Altman plot was used for inter- and intraobserver agreement of alpha angle and head ratio. Inter- and intraobserver agreement for classification of “pistol grip deformity” was determined using weighted Cohen's kappa coefficient. Observer I achieved a kappa coefficient of 0.97. Observer II achieved a kappa coefficient of 0.92. An interobserver kappa coefficient between 0.87 and 0.92 was achieved by using a classification system. By testing for interobserver agreement, a bias of –0.004 with an upper limit of 0.461 and a lower limit of –0.47 was seen for the ratio and a bias of –3.7 with an upper limit of 17.2 and a lower limit of –24.6 for the alpha angle. Therefore, poor results were seen for intra- and interobserver reliability by using only a single plane for classification of “pistol grip deformity”. The strength of agreement could be improved by using a classification system (based on two planes).


Sign in / Sign up

Export Citation Format

Share Document