Observer Reliability in Ankle Radiographic Measurements

1997 ◽  
Vol 18 (6) ◽  
pp. 324-329 ◽  
Author(s):  
Michael E. Brage ◽  
Craig R. Bennett ◽  
Jon B. Whitehurst ◽  
Patrick J. Getty ◽  
Alicia Toledano
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Intraobserver Reliability ◽  
Medial Malleolus ◽  
Observer Reliability ◽  
Clear Space ◽  
Posterior Malleolus ◽  
Radiographic Measurements ◽  
Angular Measurements

We analyzed 50 sets of ankle radiographs to determine the interobserver and intraobserver reliability when obtaining common linear and angular measurements. The radiographs were divided into two groups: one group included 25 normal ankles, and the second group included 25 fractured ankles. Each set of radiographs was evaluated independently by four different observers on two separate occasions under controlled conditions. Six radiographic parameters were measured on all 50 sets of films: syndesmosis A, syndesmosis B, syndesmosis C, the medial clear space, and the talocrural and bimalleolar angles. On the 25 sets of fracture films, four additional measurements of fracture displacement were included: displacement of the medial malleolus (mortise), displacement of the lateral malleolus (AP and lateral), and displacement of the posterior malleolus. Reliability was evaluated with an analysis of variance intraclass correlation coefficient. Among the examiners, 9 of the 10 parameters could be measured reliably. Intraobserver reliability was found to increase with the experience of the examiner.

scholarly journals Biomechanical Measurement of Rabbit Cornea by a Modified Scheimpflug Device

2016 ◽  
Vol 2016 ◽  
pp. 1-6
Author(s):  
Bo Zhang ◽  
Jianjun Gu ◽  
Xiaoxiao Zhang ◽  
Bin Yang ◽  
Zheng Wang ◽  
...  
Keyword(s):  
Bulk Modulus ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Anterior Segment ◽  
Intraobserver Reliability ◽  
Rabbit Cornea ◽  
Deformation Response ◽  
Biomechanical Measurements ◽  
Biomechanical Measurement

Purpose. To explore the probability and variation in biomechanical measurements of rabbit cornea by a modified Scheimpflug device.Methods. A modified Scheimpflug device was developed by imaging anterior segment of the model imitating the intact eye at various posterior pressures. The eight isolated rabbit corneas were mounted on the Barron artificial chamber and images of the anterior segment were taken at posterior pressures of 15, 30, 45, 60, and 75 mmHg by the device. The repeatability and reliability of the parameters including CCT, ACD, ACV, and CV were evaluated at each posterior pressure. All the variations of the parameters at the different posterior pressures were calculated.Results. All parameters showed good intraobserver reliability (Cronbach’s alpha; intraclass correlation coefficient,α, ICC > 0.96) and repeatability in the modified Scheimpflug device. With the increase of posterior pressures, the ratio of CCT decreased linearly and the bulk modulus gradually reduced to a platform. The increase of ACD was almost linear with the posterior pressures elevated.Conclusions. The modified Scheimpflug device was a valuable tool to investigate the biomechanics of the cornea. The posterior pressure 15–75 mmHg range produced small viscoelastic deformations and nearly linear pressure-deformation response in the rabbit cornea.

scholarly journals Comparison of Reliability of Norberg Angle and Distraction Index as Measurements for Hip Laxity in Dogs

2020 ◽  
Vol 33 (04) ◽  
pp. 274-278
Author(s):  
Julius Klever ◽  
Andreas Brühschwein ◽  
Silvia Wagner ◽  
Sven Reese ◽  
Andrea Meyer-Lindenberg
Keyword(s):  
Correlation Coefficient ◽  
Clinical Significance ◽  
Intraclass Correlation Coefficient ◽  
Hip Joint ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Joint Laxity ◽  
Intraobserver Reliability ◽  
Level Of Experience ◽  
Norberg Angle

Abstract Objective The main purpose of the study was to compare reliability of measurements for the evaluation of hip joint laxity in 59 dogs. Materials and Methods Measurement of the distraction index (DI) of the PennHIP method and the Norberg angle (NA) of the Fédération Cynologique Internationale (FCI) scoring scheme as well as scoring according to the FCI scheme and the Swiss scoring scheme were performed by three observers at different level of experience. For each dog, two radiographs were acquired with each method by the same operator to evaluate intraoperator-reliability. Results Intraoperator-reliability was slightly better for the NA compared with the DI with an intraclass correlation coefficient (ICC) of 0.962 and 0.892 respectively. The ICC showed excellent results in intraobserver-reliability and interobserver-reliability for both the NA (ICC 0.975; 0.969) and the DI (ICC 0.986; 0.972). Thus, the NA as well as the DI can be considered as reliable measurements. The FCI scheme and the Swiss scoring scheme provide similar reliability. While the FCI scheme seems to be slightly more reliable in experienced observers (Kappa FCI 0.687; Kappa Swiss 0.681), the Swiss scoring scheme had a noticeable better reliability for the unexperienced observer (Kappa FCI 0.465; Kappa Swiss 0.514). Clinical Significance The Swiss scoring scheme provides a structured guideline for the interpretation of hip radiographs and can thus be recommended to unexperienced observers.

scholarly journals Visual versus automatic ultrasound scoring of lung B-lines: reliability and consistency between systems

2019 ◽  
Vol 21 (1) ◽  
pp. 45 ◽  
Author(s):  
Jorge Short ◽  
Carlos Acebes ◽  
Guido Rodriguez-de-Lema ◽  
Giuliana Maria Concetta La Paglia ◽  
Maria Pavón ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Automatic System ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Counting System ◽  
Observer Reliability ◽  
Automatic Counting ◽  
B Lines

Aims. To evaluate the agreement between a visual and an automatic counting system of lung B-lines by ultrasound (US) as well as to test the inter- and intra-observer reliability of both systems in patients with lung diseases.Material and methods. We included four patients with different lung conditions. Four ultrasonographers expert in lung US blindly, independently and consecutively performed, in two rounds, a US B-mode assessment of 8 lung intercostal spaces of each patient. Each US assessment consisted of a visual and an automatic counting of B-lines.Results. Agreement between visual and automatic counting of B-lines was good to excellent [intraclass correlation coefficient (ICC) 0.79-0.84, p<0.001]. Intra-observer reliability was good to excellent [ICC 0.62-0.99, p<0.001] except for one investigator in whom it was close to moderate for the automatic system [ICC 0.49, p<0.05]. Inter-observer reliability was excellent for both systems in both rounds [ICC 0.86-0.90, p<0.001].Conclusions. US automatic counting was consistent with US visual counting of lung B-lines, as performed by experts in the field. Both systems showed a high intra- and interobserver reliability.

scholarly journals ISAKOS Classification of Meniscal Tears. Intra and Interobserver Reliability.

2014 ◽  
Vol 2 (12_suppl4) ◽  
pp. 2325967114S0023
Author(s):  
Mariano J. Fresneda ◽  
Juan J. Dere ◽  
Carlos H. Yacuzzi ◽  
Matías Costa Paz
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Intraobserver Reliability ◽  
Knee Surgery ◽  
Meniscal Tears ◽  
Meniscal Lesions ◽  
Good Agreement

Objectives: To analyze the intra and interobserverreliability of the International Society of Arthroscopy, Knee Surgery and Orthopaedic Sports Medicine (ISAKOS) classification of meniscal tears. Methods: Thearthroscopic classification of meniscal lesions created by the ISAKOS was used. Thirty one arthroscopic videos, made between June and December 2013,with different meniscal tear characteristics were analyzedby three orthopedic surgeons (two specialists in knee surgery and a fellowship), twice at an interval of 30 days. The Kappa Coefficients (k) was used to assess the intraobserver reliability and intraclass correlation coefficient (ICC) for interobserverreliability. Results: The averageintraobserver reliability was for the first observer 51%, the second 65% and the third 58%, reaching moderate agreement according to the Kappa coefficient used by Landis and Koch. Regarding interobserver reliability, good agreement (ICC = 0.71) was obtained as the intraclass correlation coefficient. The whole results were significantlystatical (p <0.05). Conclusion: While this classification provides a detailed description of meniscal lesions, the intraobserver reliability did not reach the optimum values obtained despite having on average a moderate agreement. However interobserver reliability results showed on average 70% of agreement (good agreement), which can affirm that the agreement and interobserver reliability is acceptable.

scholarly journals Three-dimensional Acetabular Bone Defect Classification System Aided with Rapid Prototyping Model and Reliability and Validity Test

2021 ◽  
Author(s):  
Jingwei Zhang ◽  
Yi Hu ◽  
Hua Ying ◽  
Yuanqing Mao ◽  
Zhenan Zhu ◽  
...  
Keyword(s):  
Rapid Prototyping ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Bone Defect ◽  
Intraclass Correlation ◽  
Three Dimensional ◽  
Revision Arthroplasty ◽  
Reliability And Validity ◽  
Defect Classification ◽  
Observer Reliability

Abstract Background: Accurately assessing acetabular defects and designing precise and feasible surgical plans are important before hip revision arthroplasty. With the development of three-dimensional printing, rapid prototyping is a novel technique used to print isometric physical object models. We aimed to propose a three-dimensional acetabular bone defect classification system aided with rapid prototyping and evaluated its reliability and validity.Methods: We reviewed 104 consecutive patients who underwent hip revision arthroplasty in our department between January 2014 and December 2019. Forty five of them had rapid prototyping and were included for reliability and validity test. Three doctors retrospectively evaluated bone defects of these 45 patients with this classification and made surgical plans, and repeated it after 2 weeks. The intra- and inter-observer reliability and the validity to surgical records were assessed using intraclass correlation coefficient or Kappa correlation coefficient.Results: The reliability and validity for classification results were high. The mean initial intraclass correlation coefficient for inter-observer reliability was 0.947, which increased to 0.972 when texted second time. As for inter-observer reliability, it ranged from 0.958 to 0.980. The validity showed high Kappa correlation coefficient of 0.951 to 0.967. When considering detailed surgical plans, the reliability and validity were also high with intraclass correlation coefficient and Kappa correlation coefficient all over 0.9.Conclusions: This three-dimensional acetabulum defect classification was of high reliability and convincing validity. With this classification and objective rapid prototyping models, accurate bone defect assessment and reliable surgical plans were achieved. This classification aided with rapid prototyping could serve as a promising tool for surgeons for preoperative evaluation.

scholarly journals A preliminary study of intensivist-performed DVT ultrasound screening in trauma ICU patients (APSIT Study)

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Lloyd Roberts ◽  
Tom Rozen ◽  
Deirdre Murphy ◽  
Adam Lawler ◽  
Mark Fitzgerald ◽  
...  
Keyword(s):  
Intensive Care ◽  
Deep Vein Thrombosis ◽  
High Risk ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Major Trauma ◽  
Intraclass Correlation ◽  
Trauma Patients ◽  
Vein Thrombosis ◽  
Deep Vein

Abstract Background Multiple screening Duplex ultrasound scans (DUS) are performed in trauma patients at high risk of deep vein thrombosis (DVT) in the intensive care unit (ICU). Intensive care physician performed compression ultrasound (IP-CUS) has shown promise as a diagnostic test for DVT in a non-trauma setting. Whether IP-CUS can be used as a screening test in trauma patients is unknown. Our study aimed to assess the agreement between IP-CUS and vascular sonographer performed DUS for proximal lower extremity deep vein thrombosis (PLEDVT) screening in high-risk trauma patients in ICU. Methods A prospective observational study was conducted at the ICU of Alfred Hospital, a major trauma center in Melbourne, Australia, between Feb and Nov 2015. All adult major trauma patients admitted with high risk for DVT were eligible for inclusion. IP-CUS was performed immediately before or after DUS for PLEDVT screening. The paired studies were repeated twice weekly until the DVT diagnosis, death or ICU discharge. Written informed consent from the patient, or person responsible, or procedural authorisation, was obtained. The individuals performing the scans were blinded to the others’ results. The agreement analysis was performed using Cohen’s Kappa statistics and intraclass correlation coefficient for repeated binary measurements. Results During the study period, 117 patients had 193 pairs of scans, and 45 (39%) patients had more than one pair of scans. The median age (IQR) was 47 (28–68) years with 77% males, mean (SD) injury severity score 27.5 (9.53), and a median (IQR) ICU length of stay 7 (3.2–11.6) days. There were 16 cases (13.6%) of PLEDVT with an incidence rate of 2.6 (1.6–4.2) cases per 100 patient-days in ICU. The overall agreement was 96.7% (95% CI 94.15–99.33). The Cohen’s Kappa between the IP-CUS and DUS was 0.77 (95% CI 0.59–0.95), and the intraclass correlation coefficient for repeated binary measures was 0.75 (95% CI 0.67–0.81). Conclusions There is a substantial agreement between IP-CUS and DUS for PLEDVT screening in trauma patients in ICU with high risk for DVT. Large multicentre studies are needed to confirm this finding.

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

Sign in / Sign up

Export Citation Format

Share Document