Interobserver Agreement in the Diagnosis of Anal Dysplasia: Comparison Between Gastrointestinal and Gynaecologic Pathologists and Utility of Consensus Conferences

2021 ◽  
Author(s):  
Sohaib Abu‐Farsakh ◽  
Michael G. Drage ◽  
Aaron R. Huber ◽  
Bradley M. Turner ◽  
Sharlin Varghese ◽  
...  
Keyword(s):  
Interobserver Agreement ◽  
Anal Dysplasia ◽  
Consensus Conferences

INTEROBSERVER AGREEMENT BETWEEN TUTOR AND FELLOW AFTER 6 MONTHS OF TRAINING IN ENDOSCOPIC ULTRASOUND

2020 ◽  
Author(s):  
E Dabizzi ◽  
S Landi ◽  
M Bassi ◽  
S Ghersi ◽  
M Riccò ◽  
...  
Keyword(s):  
Endoscopic Ultrasound ◽  
Interobserver Agreement

Evaluation of Accuracy and Interobserver Agreement of MR Cholangiography for Diagnosis of Cholelithiasis

2001 ◽  
Vol 44 (5) ◽  
pp. 577
Author(s):  
Sung Won Park ◽  
Seung Yon Baek ◽  
Byung Chul Kang ◽  
Chung Sik Rhee
Keyword(s):  
Interobserver Agreement ◽  
Mr Cholangiography

The 32-Item Multilingual Naming Test: Cultural and Linguistic Biases in Monolingual Chinese-Speaking Older Adults

2021 ◽  
pp. 1-9
Author(s):  
Clara Li ◽  
Xiaoyi Zeng ◽  
Judith Neugroschl ◽  
Amy Aloysi ◽  
Carolyn W. Zhu ◽  
...  
Keyword(s):  
Older Adults ◽  
New York ◽  
Test Performance ◽  
Item Difficulty ◽  
Chinese Older Adults ◽  
Chinese Speakers ◽  
School Of Medicine ◽  
Consensus Conferences ◽  
Linguistic Groups ◽  
Naming Test

ABSTRACT Objectives: This study describes the performance of the Multilingual Naming Test (MINT) by Chinese American older adults who are monolingual Chinese speakers. An attempt was also made to identify items that could introduce bias and warrant attention in future investigation. Methods: The MINT was administered to 67 monolingual Chinese older adults as part of the standard dementia evaluation at the Alzheimer’s Disease Research Center (ADRC) at the Icahn School of Medicine at Mount Sinai (ISMMS), New York, USA. A diagnosis of normal cognition (n = 38), mild cognitive impairment (n = 12), and dementia (n = 17) was assigned to all participants at clinical consensus conferences using criterion sheets developed at the ADRC at ISMMS. Results: MINT scores were negatively correlated with age and positively correlated with education, showing sensitivity to demographic factors. One item, butterfly, showed no variations in responses across diagnostic groups. Inclusion of responses from different regions of China changed the answers from “incorrect” to “correct” on 20 items. The last five items, porthole, anvil, mortar, pestle, and axle, yielded a high nonresponse rate, with more than 70% of participants responding with “I don’t know.” Four items, funnel, witch, seesaw, and wig, were not ordered with respect to item difficulty in the Chinese language. Two items, gauge and witch, were identified as culturally biased for the monolingual group. Conclusions: Our study highlights the cultural and linguistic differences that might influence the test performance. Future studies are needed to revise the MINT using more universally recognized items of similar word frequency across different cultural and linguistic groups.

scholarly journals Interobserver agreement of the Paris and simplified classifications of superficial colonic lesions: a Western study

2021 ◽  
Vol 09 (03) ◽  
pp. E388-E394
Author(s):  
Francesco Cocomazzi ◽  
Marco Gentile ◽  
Francesco Perri ◽  
Antonio Merla ◽  
Fabrizio Bossa ◽  
...  
Keyword(s):  
Interobserver Agreement ◽  
Classification Systems ◽  
Sensitivity Analyses ◽  
Size Estimation ◽  
Rater Agreement ◽  
Staff Members ◽  
Video Clips ◽  
Paris Classification ◽  
Level Of Agreement

Abstract Background and study aims The Paris classification of superficial colonic lesions has been widely adopted, but a simplified description that subgroups the shape into pedunculated, sessile/flat and depressed lesions has been proposed recently. The aim of this study was to evaluate the accuracy and inter-rater agreement among 13 Western endoscopists for the two classification systems. Methods Seventy video clips of superficial colonic lesions were classified according to the two classifications, and their size estimated. The interobserver agreement for each classification was assessed using both Cohen k and AC1 statistics. Accuracy was taken as the concordance between the standard morphology definition and that made by participants. Sensitivity analyses investigated agreement between trainees (T) and staff members (SM), simple or mixed lesions, distinct lesion phenotypes, and for laterally spreading tumors (LSTs). Results Overall, the interobserver agreement for the Paris classification was substantial (κ = 0.61; AC1 = 0.66), with 79.3 % accuracy. Between SM and T, the values were superimposable. For size estimation, the agreement was 0.48 by the κ-value, and 0.50 by AC1. For single or mixed lesions, κ-values were 0.60 and 0.43, respectively; corresponding AC1 values were 0.68 and 0.57. Evaluating the several different polyp subtypes separately, agreement differed significantly when analyzed by the k-statistics (0.08–0.12) or the AC1 statistics (0.59–0.71). Analyses of LSTs provided a κ-value of 0.50 and an AC1 score of 0.62, with 77.6 % accuracy. The simplified classification outperformed the Paris classification: κ = 0.68, AC1 = 0.82, accuracy = 91.6 %. Conclusions Agreement is often measured with Cohen’s κ, but we documented higher levels of agreement when analyzed with the AC1 statistic. The level of agreement was substantial for the Paris classification, and almost perfect for the simplified system.

scholarly journals Diagnostic and prognostic implications of 2018 guideline for the diagnosis of idiopathic pulmonary fibrosis in clinical practice

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Jooae Choe ◽  
Byoung Soo Kwon ◽  
Kyung-Hyun Do ◽  
Hee Sang Hwang ◽  
Jin Woo Song ◽  
...  
Keyword(s):  
Clinical Practice ◽  
Idiopathic Pulmonary Fibrosis ◽  
Pulmonary Fibrosis ◽  
Interobserver Agreement ◽  
Usual Interstitial Pneumonia ◽  
High Specificity ◽  
Fluid Analysis ◽  
Diagnostic Certainty ◽  
Prognostic Stratification ◽  
Prognostic Implications

AbstractThe purpose of this study was to evaluate the implications of the 2018 updated guideline for the diagnosis of idiopathic pulmonary fibrosis (IPF) in clinical practice compared to 2011 guideline. This study involved 535 patients including 339 IPF and 196 non-IPF, and we retrospectively evaluated CT classifications of usual interstitial pneumonia (UIP) by two guidelines. Interobserver agreement of 2018 criteria showed moderate reliability (κ = 0.53) comparable to 2011 (κ = 0.56) but interobserver agreement for probable UIP was fair (κ = 0.40). CT pattern of indeterminate for UIP was associated with better prognosis compared with the other groups (adjusted hazard ratio [HR] = 0.36, p < 0.001). Compared to possible UIP, probable UIP demonstrated a lower positive predictive value (PPV, 62.9% vs 65.8%). In analysis of patients with CT patterns of non-definite UIP, diagnosing IPF when CT pattern showed probable UIP with lymphocyte count ≤ 15% in BAL fluid, and either male sex or age ≥ 60 years showed a high specificity of 90.6% and a PPV of 80.8% in the validation cohort. The 2018 criteria provide better prognostic stratification than the 2011 in patients with possible UIP. BAL fluid analysis can improve the diagnostic certainty for IPF diagnosis in patients with probable UIP CT pattern.

scholarly journals AB1093 INTEROBSERVER AGREEMENT IN MAGNETIC RESONANCE OF SACROILIAC JOINTS ABOUT ACTIVE SACROILIITIS

2020 ◽  
Vol 79 (Suppl 1) ◽  
pp. 1835.1-1836
Author(s):  
A. C. Genç ◽  
F. Turkoglu Genc ◽  
A. B. Kara ◽  
Z. Ozturk ◽  
D. Karatas ◽  
...  
Keyword(s):  
Magnetic Resonance ◽  
Interobserver Agreement ◽  
Corporate Strategy ◽  
Axial Spondyloarthritis ◽  
Musculoskeletal Diseases ◽  
P Value ◽  
Mri Findings ◽  
Expert Radiologist ◽  
Significant Difference ◽  
Active Sacroiliitis

Background:Axial spondyloarthritis has characteristic clinical features such as enthesitis, sacroiliitis and spondylitis, and extra-articular manifestations(1). Magnetic resonance imaging (MRI) of sacroiliac (SI) joints is used to detect early sacroiliitis(2). Health institutions in our country carry out some of the radiology reporting services by outsourcing for reasons such as high cost and insufficient number of radiologists(3).Objectives:We decided to evaluate the interobserver agreement in active MRI findings of SI between radiologist of outsourcing radiology services and local/expert radiologist in musculoskeletal diseases.Methods:Between the years of 2015 and 2019, 8100 sacroiliac MRIs were taken at our center. The MRI of 1150 patients who were reported as active or chronic sacroiliitis from these sacroiliac MRIs or whose MRI was considered by the primary physician in favor of sacroiliitis was included in the study. Concordance between Evaluation and Service Procurement was examined using Kappa (k) coefficients. Mc Nemar test was used to compare the evaluation result between two observers. A p-value <0.05 was considered significant. Analyses were performed using commercial software (IBM SPSS Statistics, Version 23.0. Armonk, NY: IBM Corp.)Results:Of the 1150 patients examined in the study, 526 (45.7%) were male and 624 (54.3%) were female. The general average age is 37.20 ± 11.65 and the average age of men and women is 34.98 ± 11.19 and 39.07 ± 11.71 respectively. A statistically significant difference was found between the expert radiologists and outsourcing radiologist reports. In other words, a high level of compatibility was not found among the evaluators (p <0.001). When the consistency between expert radiologist and outsourced radiologist reports was examined, it was observed that there was a medium level of concordance (k = 0.589).Conclusion:The diagnosis of a spondyloarthropathy may be delayed for some reasons. In addition to the insidious course of the disease, being contented with an outsourced radiologist report may delay diagnosis. If the patient’s clinic and MRI report are not consistent, the patient should not be removed from follow-up.References:[1]Braun J. ‘Axial spondyloarthritis including ankylosing spondylitis’ Rheumatology (Oxford). 2018 1;57(suppl_6):vi1-vi3[2]Jans L, Egund N, Eshed I, Sudoł-Szopińska I, Jurik AG. Sacroiliitis in Axial Spondyloarthritis: Assessing Morphology and Activity. Semin Musculoskelet Radiol. 2018;22: 180–188.[3]Quélin B, Duhamel F. Bringing Together Strategic Outsourcing and Corporate Strategy: European Management Journal. 2003. pp. 647–661. doi:10.1016/s0263-2373(03)00113-0OUTSOURCING RADIOLOGIST REPORTSTOTALpNOT ACTIVE SACROILIITISACTIVE SACROILIITISEXPERT RADIOLOGIST REPORTSNOT ACTIVE SACROILIITIS508178686<0.0010.589ACTIVE SACROILIITIS59405464TOTAL5675831150Disclosure of Interests:None declared

scholarly journals Interobserver agreement of Prostate Imaging–Reporting and Data System (PI-RADS–v2)

2021 ◽  
Vol 52 (1) ◽  
Author(s):  
Hala Maher Ahmed ◽  
Ahmed Ebrahim Ebeed ◽  
Ahmed Hamdy ◽  
Mohamed Abou El-Ghar ◽  
Ahmed Abdel Khalek Abdel Razek
Keyword(s):  
Interobserver Agreement ◽  
Imaging Modality ◽  
Peripheral Zone ◽  
Transitional Zone ◽  
Data System ◽  
3 Tesla ◽  
Prostate Imaging ◽  
Percent Agreement ◽  
3 Tesla Mri

Abstract Background A retrospective study was conducted on 71 consecutive patients with suspected prostate cancer (PCa) with a mean age of 56 years and underwent mp-MRI of the prostate at 3 Tesla MRI. Two readers recognized all prostatic lesions, and each lesion had a score according to Prostate Imaging–Reporting and Data System version 2 (PI-RADS-v2). Purpose of the study To evaluate the interobserver agreement of PI-RADS-v2 in characterization of prostatic lesions using multiparametric MRI (mp-MRI) at 3 Tesla MRI. Results The overall interobserver agreement of PI-RADS-v2 for both zones was excellent (k = 0.81, percent agreement = 94.9%). In the peripheral zone (PZ) lesions are the interobserver agreement for PI-RADS II (k = 0.78, percent agreement = 83.9%), PI-RADS III (k = 0.66, percent agreement = 91.3 %), PI-RADS IV (k = 0.69, percent agreement = 93.5%), and PI-RADS V (k = 0.91, percent agreement = 95.7 %). In the transitional zone (TZ) lesions are the interobserver agreement for PI-RADS I (k = 0.98, percent of agreement = 96%), PI-RADS II (k = 0.65, percent agreement = 96%), PI-RADS III (k = 0.65, percent agreement = 88%), PI-RADS IV (k = 0.83, percent agreement = 96%), and PI-RADS V (k = 0.82, percent agreement = 92%). Conclusion We concluded that PI-RADS-v2 is a reliable and a reproducible imaging modality for the characterization of prostatic lesions and detection of PCa.

Sign in / Sign up

Export Citation Format

Share Document