Interobserver Reliability
Recently Published Documents





2022 ◽  
Vol 9 (1) ◽  
Grégoire Thürig ◽  
Raùl Panadero-Morales ◽  
Luca Giovannelli ◽  
Franziska Kocher ◽  
José Luis Peris ◽  

Abstract Purpose This study's main objective is to assess the feasibility of processing the MRI information with identified ACL-footprints into 2D-images similar to a conventional anteroposterior and lateral X-Ray image of the knee. The secondary aim is to conduct specific measurements to assess the reliability and reproducibility. This study is a proof of concept of this technique. Methods Five anonymised MRIs of a right knee were analysed. A orthopaedic knee surgeon performed the footprints identification. An ad-hoc software allowed a volumetric 3D image projection on a 2D anteroposterior and lateral view. The previously defined anatomical femoral and tibial footprints were precisely identified on these views. Several parameters were measured (e.g. coronal and sagittal ratio of tibial footprint, sagittal ratio of femoral footprint, femoral intercondylar notch roof angle, proximal tibial slope and others). The intraclass correlation coefficient (ICCs), including 95% confidence intervals (CIs), has been calculated to assess intraobserver reproducibility and interobserver reliability. Results Five MRI scans of a right knee have been assessed (three females, two males, mean age of 30.8 years old). Five 2D-"CLASS" have been created. The measured parameters showed a "substantial" to "almost perfect" reproducibility and an "almost perfect" reliability. Conclusion This study confirmed the possibility of generating "CLASS" with the localised centroid of the femoral and tibial ACL footprints from a 3D volumetric model. "CLASS" also showed that these footprints were easily identified on standard anteroposterior and lateral X-Ray views of the same patient, thus allowing an individual identification of the anatomical femoral and tibial ACL's footprints. Level of evidence Level IV diagnostic study

2022 ◽  
Patrizia Piotti ◽  
Andrea Piseddu ◽  
Enrica Aguzzoli ◽  
Andrea Sommese ◽  
Eniko Kubinyi

Abstract The prolonged lifespan of companion dogs has resulted in an increased occurrence of behavioural and physical challenges linked to old age. The development of behavioural tests for identifying and monitoring age-related differences has begun. However, standardised testing requires validation. The present study aimed to assess external validity, interobserver reliability, and test-retest reliability of an indoor test battery for the rapid assessment of age-related behavioural differences in dogs. Two experimenters tested young and old dogs on a first occasion and after two weeks. Our results found external validity for two subtests out of six. On both test occasions, old dogs committed more errors than young dogs in a memory test and showed more object avoidance when encountering a novel object. Interobserver reliability and test-retest reliability was high. We conclude that the Memory and Novel object tests are valid and reliable for monitoring age-related memory performance and object neophobic differences in dogs.

2022 ◽  
pp. 219256822110684
Brian A. Karamian ◽  
Gregory D. Schroeder ◽  
Mark J. Lambrechts ◽  
Jose A. Canseco ◽  
Emiliano N. Vialle ◽  

Study Design Global cross-sectional survey. Objective To explore the influence of geographic region on the AO Spine Sacral Classification System. Methods A total of 158 AO Spine and AO Trauma members from 6 AO world regions (Africa, Asia, Europe, Latin and South America, Middle East, and North America) participated in a live webinar to assess the reliability, reproducibility, and accuracy of classifying sacral fractures using the AO Spine Sacral Classification System. This evaluation was performed with 26 cases presented in randomized order on 2 occasions 3 weeks apart. Results A total of 8320 case assessments were performed. All regions demonstrated excellent intraobserver reproducibility for fracture morphology. Respondents from Europe (k = .80) and North America (k = .86) achieved excellent reproducibility for fracture subtype while respondents from all other regions displayed substantial reproducibility. All regions demonstrated at minimum substantial interobserver reliability for fracture morphology and subtype. Each region demonstrated >90% accuracy in classifying fracture morphology and >80% accuracy in fracture subtype compared to the gold standard. Type C morphology (p2 = .0000) and A3 (p1 = .0280), B2 (p1 = .0015), C0 (p1 = .0085), and C2 (p1 =.0016, p2 =.0000) subtypes showed significant regional disparity in classification accuracy (p1 = Assessment 1, p2 = Assessment 2). Respondents from Asia (except in A3) and the combined group of North, Latin, and South America had accuracy percentages below the combined mean, whereas respondents from Europe consistently scored above the mean. Conclusions In a global validation study of the AO Spine Sacral Classification System, substantial reliability of both fracture morphology and subtype classification was found across all geographic regions.

2022 ◽  
Vol 75 (3) ◽  
Andréa Costa de Oliveira ◽  
Shirley Verônica Melo Almeida Lima ◽  
Álvaro Francisco Lopes-Sousa ◽  
Jader Pereira de Farias Neto ◽  
Karina Conceição Gomes Machado de Araújo

ABSTRACT Objectives: to construct and validate an instrument for assessing the functionality of individuals with schistosomiasis. Methods: methodological study, developed in three stages: 1) construction of the instrument and its association with categories of the International Classification of Functionality, which the study used to elaborate the questions; 2) validation of content, performed by judges experts in the subject; 3) application of the instrument by the test-retest technique in the population with schistosomiasis in 14 days. The study used the correlation coefficient kappa to calculate the degree of agreement between the judges kappa. Results: in its final version, the instrument consists of 27 items, 9 of which are from the Body functions component, 6 from Body structures, 4 from Activity and participation, and 8 from Environmental factors. Conclusions: the constructed instrument has a biopsychosocial approach, considering four components of the ICF, besides presenting good validity and interobserver reliability.

2021 ◽  
Vol 8 ◽  
Jane A. Hoel ◽  
Ginger B. Templeton ◽  
Gilad Fefer ◽  
Beth C. Case ◽  
Anshu Shah ◽  

Canine Cognitive Dysfunction Syndrome (CCDS) is a syndrome of progressive cognitive decline comparable to Alzheimer's Disease. The sustained gaze test captures attention loss associated with CCDS in laboratory settings, and adapting the sustained gaze test for use by owners at home could greatly increase the data generated on CCDS. We hypothesized that it would be feasible for owners to perform the sustained gaze test at home, and that results would be reliable over repeated trials. Training materials were developed and dog owners underwent training and performed the test in triplicate at weekly intervals for 3 weeks. Gaze videos and a CAnine DEmentia Scale (CADES) questionnaire were submitted each week. Videos were examined for inclusion and duration of gaze was recorded. One observer repeated video assessments twice, 1 week apart; five different observers assessed videos once. Outcome measures included the relationship between CADES and gaze duration, test-retest reliability of owner-performed sustained gaze testing, and intra- and inter-rater reliability. Twenty dogs aged 7–15.5 years completed testing. The majority of videos were acceptable (162/183). Within dog test-retest reliability was excellent (ICC = 0.96). Intra- and interobserver reliability for determining video validity for inclusion were substantial (k = 0.76 and 0.78, respectively); for duration of gaze these were excellent (ICC = 0.99 and 0.96, respectively). Gaze duration was significantly associated with CADES (p = 0.0026). We conclude that owners can perform the sustained gaze test at home and that data generated are reliable and correlate to CADES, a validated measure of dementia.

2021 ◽  
Vol 15 (3) ◽  
pp. 252-258
Kevin Dibbern ◽  
Hunter Briggs ◽  
Andrew Behrens ◽  
Lily McGettigan ◽  
Kepler Alencar Mendes de Carvalho ◽  

Objective: To assess interobserver reliability of previously described coronal plane rotation measurements of medial column bones and to assess their ability to accurately quantify changes in rotational profile. Methods: Two cadaveric below-knee specimens were implanted with pins in each bone of the medial column. Weight-bearing computed tomography (CT) scans were acquired in a simulated standing position under neutral, supinated, and pronated conditions. For each specimen and condition, 2 observers measured the coronal plane rotation of the navicular, medial cuneiform, first metatarsal base, shaft, and head, and proximal phalanx of the hallux as previously described. The rotation of each pin was measured relative to the ground in the coronal plane for each condition. These measurements were defined as benchmarks for the rotational profile of each bone. The correlation between these benchmarks and direct bone measurements was then assessed. Intraclass correlation coeficiente was used to assess interobserver reliability. Pearson’s coefficient was used to evaluate correlations. Results: The interobserver reliability of direct bone measurements ranged from 0.98 to 0.99. Correlations between pin rotation and direct measurements ranged from ρ=0.87 to 0.99 across the neutral, supinated, and pronated conditions. Conclusion: Coronal plane rotation measurements of medial column bones described in this study are reliable tools. Level of Evidence III; Case-Control Study.

2021 ◽  
pp. rapm-2021-103174
Bart Liebrand ◽  
Koen Brakel ◽  
Arthur Boon ◽  
Walter van der Weegen ◽  
Selina van der Wal ◽  

BackgroundLumbosacral transitional vertebra can result in an anomalous number of lumbar vertebrae associated with wrong level treatment. The primary aim of this study was to characterize discrepancies between reported referring levels and levels from MRI reports with treated levels. The secondary aim was to analyze interobserver variability between a pain physician and a radiologist when determining levels and classifying lumbosacral transitional vertebrae.MethodsBetween February 2016 and October 2019, a retrospective case series of prospectively collected data of the affected levels mentioned in referrals, MRI reports and treated levels was performed. The counting process, level determination, classification of lumbosacral transitional vertebrae and a secondary control were carried out by independent researchers using a standard methodology.ResultsOf the 2443 referrals, 143 patients had an anomalous number of lumbar vertebrae; of these, 114 were included for analysis. The vertebral level noted in the patient’s file, in the referral, and the reported level of treatment differed in 40% of these cases. The vertebral level between the MRI reports and treatment differed in 46% of cases. The interobserver reliability (radiologist vs pain physician) for classifying a transitional vertebra was fair ((κ=0.40) and was substantial (κ=0.70) when counting the vertebrae.ConclusionIn the presence of lumbar spine anomalies, we report a high prevalence of discrepancies between referral levels and MRI pathological findings with treatment levels. Further research is needed to better understand clinical implications.

Medicina ◽  
2021 ◽  
Vol 57 (12) ◽  
pp. 1363
Radomir Dimovski ◽  
Robert Teitge ◽  
Nicholas Bolz ◽  
Patrick Schafer ◽  
Vamsy Bobba ◽  

Background and Objectives: Producing consistent measures of femoral version amongst observers are necessary to allow for an assessment of version for possible corrective procedures. The purpose of this study was to compare two computed tomography (CT)-based techniques for the reliability of measuring femoral version amongst observers. Materials and Methods: Review was performed for 15 patients post-femoral nailing for comminuted (Winquist III and IV) femoral shaft fractures where CT scanograms were obtained. Two CT-based techniques were utilized to measure femoral version by five observers. Results: The mean femoral version, when utilizing a proximal line drawn down the center of the femoral head-neck through CT, was 9.50 ± 4.82°, while the method utilizing the head and shaft at lesser trochanter centers produced a mean version of 18.73 ± 2.69°. A significant difference was noted between these two (p ≤ 0.001). The method of measuring in the center of the femoral head and neck produced an intraclass correlation coefficient (ICC) of 0.960 with a 95% confidence interval lower bound of 0.909 and upper bound of 0.982. For the method assessing version via the center of the head and shaft at the lesser trochanter region, the ICC was 0.993 with a 95% confidence interval lower bound of 0.987 and an upper bound of 0.996. Conclusions: The method of measuring version proximally through a CT image of the femoral head–neck versus overlaying the femoral head with the femoral shaft at the most prominent aspect of the lesser trochanter produces differing version measurements by roughly 10° while yielding an almost perfect interobserver reliability in the new technique. Both techniques result in significantly high interobserver reliability.

2021 ◽  
Ruimin Ma ◽  
Shuang Li ◽  
Yuanying Wang ◽  
Shuqiao Yang ◽  
Na Bao ◽  

Abstract BackgroundAsbestosis and fibrotic hypersensitivity pneumonitis (FHP) are fibrotic interstitial lung diseases that develop secondary to inhalation exposure. The differential diagnosis is based on clinical evaluation of imaging findings, particularly in developing countries. We compared the imaging features between asbestosis and FHP to gain a better understanding of the differential diagnostic value of these conditions.MethodsThis comparative study included 204 patients with asbestosis and 74 patients with FHP. We compared patients’ clinical data and chest high-resolution computed tomography (HRCT) images obtained from a predesigned chart. The International Classification of HRCT for Occupational and Environmental Respiratory Diseases was used to categorize chest imaging findings in patients. Diagnostic tests were used to compare the imaging features of asbestosis and FHP.ResultsPatients with asbestosis were older and had a longer latent period until disease manifestation than those with FHP. Asbestosis was characterized by irregular and/or linear opacities, with lower lung preponderance, accompanied by ground-glass opacities and mosaic attenuation. Notably, 98.5% of patients with asbestosis showed benign pleural abnormalities, and >33% of these patients had diffuse pleural thickening with parenchymal bands and/or rounded atelectasis. Abnormalities of the mediastinal and diaphragmatic pleura were observed only in cases of asbestosis, and this finding showed high specificity for the diagnosis for asbestosis compared with that for FHP. Subpleural dots or diaphragmatic pleural abnormalities showed moderate sensitivity and high specificity for diagnosis of asbestosis compared with that for FHP. Interobserver reliability was good for evaluation of imaging findings including honeycombing, pleural calcification, lymphadenectasis, and lymph node calcification.ConclusionsHRCT-based imaging findings can distinguish between asbestosis and FHP to a certain extent, particularly with regard to subpleural dots and diaphragmatic pleural abnormalities that characterize the former.

2021 ◽  
Vol 22 (23) ◽  
pp. 13108
Pantea Pour Farid ◽  
Markus Eckstein ◽  
Susanne Merkel ◽  
Robert Grützmann ◽  
Arndt Hartmann ◽  

Peritumoral budding and intratumoral budding (ITB) are important prognostic factors for colorectal cancer patients. Scientists worldwide have investigated the role of budding in tumor progression and its prognosis, but guidelines for reliably identifying tumor buds based on morphology are lacking. In this study, next-generation tissue microarray (ngTMA®) construction was used for tumor bud evaluation, and highly detailed rule-out annotation was used for tumor definition in pancytokeratin-stained tissue sections. Initially, tissues of 245 colon cancer patients were evaluated with high interobserver reliability, and a concordance of 96% was achieved. It was shown that high ITB scores were associated with poor distant metastasis-free survival (p = 0.006 with a cut-off of ≥10 buds). This cut-off was defined as the best maximum value from one of two/three ngTMA® cores (0.6 mm diameter). ITB in 30 cases of mucinous, medullary, and signet ring cell carcinoma was analyzed for the subsequent determination of differences in tumor bud analyses between those subtypes. In conclusion, blinded randomized punched cores in the tumor center can be useful for ITB detection. It can be assumed that this method is suitable for its adoption in clinical routines.

Sign in / Sign up

Export Citation Format

Share Document