interreader agreement
Recently Published Documents


TOTAL DOCUMENTS

50
(FIVE YEARS 28)

H-INDEX

11
(FIVE YEARS 3)

Author(s):  
I. Barnaure ◽  
J. Galley ◽  
B. Fritz ◽  
R. Sutter

Abstract Objective The oblique orientation of the cervical neural foramina challenges the implementation of a short MRI protocol with concurrent excellent visualization of the spine. While sagittal oblique T2-weighted sequences permit good evaluation of the cervical neuroforamina, all segments may not be equally well depicted on a single sequence and conspicuity of foraminal stenosis may be limited. 3D T2-weighted sequences can be reformatted in arbitrary planes, including the sagittal oblique. We set out to compare 3D T2w SPACE sequences with sagittal oblique reformations and sagittal oblique 2D T2w TSE sequences for the evaluation of cervical foraminal visibility and stenosis. Materials and methods Sixty consecutive patients who underwent MRI of the cervical spine with sagittal oblique 2D T2w TSE and 3D T2w SPACE sequences were included. Image homogeneity of the sequences was evaluated. Imaging sets were assessed for structure visibility and foraminal stenosis by two independent readers. Results of the sequences were compared by Wilcoxon matched-pairs tests. Interreader agreement was evaluated by weighted κ. Results Visibility of most structures was rated good to excellent on both sequences (mean visibility scores ≥ 4.5 of 5), though neuroforaminal contents were better seen on sagittal oblique T2w TSE (mean scores 4.1–4.6 vs. 3.1–4.1 on 3D T2w SPACE, p < 0.01). Stenosis grades were comparable between sequences (mean 1.1–2.6 of 4), with slightly higher values for 3D T2w SPACE at some levels (difference ≤ 0.3 points). Conclusion 3D T2w SPACE is comparable with sagittal oblique 2D T2w TSE in the evaluation of cervical neural foramina.


Diagnostics ◽  
2021 ◽  
Vol 11 (10) ◽  
pp. 1849
Author(s):  
Julia A. Mueller ◽  
Katharina Martini ◽  
Matthias Eberhard ◽  
Mathias A. Mueller ◽  
Alessandra A. De Silvestro ◽  
...  

Purpose/Objectives: To compare the diagnostic performance of dual-energy subtraction (DE) and conventional radiography (CR) for detecting pulmonary emphysema using computed tomography (CT) as a reference standard. Methods and Materials: Sixty-six patients (24 female, median age 73) were retrospectively included after obtaining lateral and posteroanterior chest X-rays with a dual-shot DE technique and chest CT within ±3 months. Two experienced radiologists first evaluated the standard CR images and, second, the bone-/soft tissue weighted DE images for the presence (yes/no), degree (1–4), and quadrant-based distribution of emphysema. CT was used as a reference standard. Inter-reader agreement was calculated. Sensitivity and specificity for the correct detection and localization of emphysema was calculated. Further degree of emphysema on CR and DE was correlated with results from CT. A p-value < 0.05 was considered as statistically significant. Results: The mean interreader agreement was substantial for CR and moderate for DE (kCR = 0.611 vs. kDE = 0.433; respectively). Sensitivity, as well as specificity for the detection of emphysema, was comparable between CR and DE (sensitivityCR 96% and specificityCR 75% vs. sensitivityDE 91% and specificityDE 83%; p = 0.157). Similarly, there was no significant difference in the sensitivity or specificity for emphysema localization between CR and DE (sensitivityCR 50% and specificityCR 100% vs. sensitivityDE 57% and specificityDE 100%; p = 0.157). There was a slightly better correlation with CT of emphysema grading in DE compared to CR (rDE = 0.75 vs. rCR = 0.68; p = 0.108); these differences were not statistically significant, however. Conclusion: Diagnostic accuracy for the detection, quantification, and localization of emphysema between CR and DE is comparable. Interreader agreement, however, is better with CR compared to DE


2021 ◽  
Vol Publish Ahead of Print ◽  
Author(s):  
Nazli Pinar Karahan Şen ◽  
Ayşegül Aksu ◽  
Ozan Bozkurt ◽  
Emine Burçin Tuna ◽  
Gamze Çapa Kaya

Author(s):  
Nesrin Gündüz ◽  
Mahmut Bilal Doğan ◽  
Mine Alacagöz ◽  
Merve Yağbasan ◽  
Umut Perçem Orhan Söylemez ◽  
...  

Abstract Background The frequency of insertion variations of cystic duct (CD) is inconsistent between studies caused to some extent by the way they give the relative frequency of the variations. Moreover, certain insertion variations have been reported to be associated with choledocholithiasis. This study aimed to assess the frequency of CD insertion variations with a comprehensive way of classification in an unselected population in whom MRCP was performed. Moreover, the relationship between the types of variant insertions and choledocholithiasis using MRCP was also assessed. Patients undergoing magnetic resonance cholangiopancreatography (MRCP) were reviewed retrospectively by two radiologists who were blinded to the clinical data. The normal insertion was defined as the union through middle one third of the lateral border of the extrahepatic bile duct. The transverse site (lateral, medial, anterior, and posterior) and the craniocaudal level (high, mid and low) of insertions and their intersections were assessed using axial and coronal slices, respectively. In addition, the frequencies of the CD insertion variations were compared between choledocholithiasis and control (no-choledocholithiasis) groups. Results A total of 307 patients (124 with choledocholithiasis and 183 controls) were analyzed. A true variant insertion was found in 149 (48.5%) cases. The insertion variations were less frequent in the choledocholithiasis group [50 (40.3%) vs. 99 (54.1%), respectively, p = 0.018]. The frequencies of craniocaudal level of insertion differed significantly between groups (p = 0.014) that was driven by a lower rate of low medial insertion (1.6% vs. 9.8%, respectively) in the choledocholithiasis group. The frequencies of transverse site of insertion were similar between groups (p = 0.314). The low medial insertion was 80.7% less likely associated with choledocholithiasis even after adjustment for age (Odds ratio: 0.193, 95% Confidence interval: 0.039–0.954, p = 0.044). The interreader agreement for insertion assessment was good (Cohen’s Kappa: 0.748, p < 0.001). Conclusions The prevalence of CD insertion variations in an unselected population undergoing MRCP is quite high and a mid-posterior insertion is the most common variant type. Insertion variations of CD, the low medial insertion in particular, are less common in patients with choledocholithiasis than controls.


Author(s):  
Kai Higashigaito ◽  
Christian W. A. Pfirrmann ◽  
Sarah Koch ◽  
Dimitri Graf ◽  
Andreas Schweizer ◽  
...  

Abstract Purpose To evaluate the MRI anatomy of the scapho-trapezial-trapezoidal (STT) ligament complex in asymptomatic and symptomatic individuals. Material and methods In this retrospective study, STT ligament complex of 42 (male 69%, median age 37.5 years) asymptomatic (n = 25) and symptomatic (n = 17) (defined as pain described over the STT joint) individuals was examined using a high-resolution 3D proton density-weighted isovoxel sequence (MR arthrogram) with multiplanar reconstructions. Two musculoskeletal radiologists independently assessed visibility, signal intensity (SI), morphology, and thickness of the radiopalmar scapho-trapezial ligament (rpSTL), palmar scapho-capitate capsular ligament (pSCL), palmar STT capsule (pSTTC), and dorsal STT capsule (dSTTC). Results Interreader agreement ranged from fair to good and intraclass correlations were good. The rpSTL was almost always visible (85.7%/80.1%; reader 1/reader 2). The pSCL and dSTTC were visible in all cases. The pSTTC was visible in only 52.4%/42.9%. Mean thickness of the rpSTL, pSCL, pSTTC, and dSTTC was 1.4 ± 0.5 mm/1.3 ± 0.5 mm, 2.8 ± 0.7 mm/2.7 ± 0.6 mm, 0.5 ± 0.5 mm/0.4 ± 0.4 mm, and 0.5 ± 0.3 mm/0.3 ± 0.3 mm. Both readers rated SI of the rpSTL significantly more often as increased in the symptomatic group (increased SI in asymptomatic group: 20%/15%; symptomatic group: 56%/50%) (p-values < 0.005). For all other ligaments, no significant difference was observed for SI between symptomatic and asymptomatic group (p-values ranging between 0.188 and 0.890). For all other ligaments, no significant differences were observed regarding ligament visibility, morphology, and thickness (p-values ranging between 0.274 and 1.000). Conclusion The anatomy of the STT ligament complex can consistently be visualized on high-resolution 3D MRI. Increased signal intensity of rpSTL is significantly more frequent in patients with radial-sided wrist pain.


2021 ◽  
pp. 109884
Author(s):  
Aristeidis Grigoriadis ◽  
Kristina I. Ringe ◽  
Mats Andersson ◽  
Nikolaos Kartalis ◽  
Annika Bergquist

2021 ◽  
Vol 94 (1123) ◽  
pp. 20210435
Author(s):  
Gavin E Duggan ◽  
Joshua J Reicher ◽  
Yun Liu ◽  
Daniel Tse ◽  
Shravya Shetty

Objective: Demonstrate the importance of combining multiple readers' opinions, in a context-aware manner, when establishing the reference standard for validation of artificial intelligence (AI) applications for, e.g. chest radiographs. By comparing individual readers, majority vote of a panel, and panel-based discussion, we identify methods which maximize interobserver agreement and label reproducibility. Methods: 1100 frontal chest radiographs were evaluated for 6 findings: airspace opacity, cardiomegaly, pulmonary edema, fracture, nodules, and pneumothorax. Each image was reviewed by six radiologists, first individually and then via asynchronous adjudication (web-based discussion) in two panels of three readers to resolve disagreements within each panel. We quantified the reproducibility of each method by measuring interreader agreement. Results: Panel-based majority vote improved agreement relative to individual readers for all findings. Most disagreements were resolved with two rounds of adjudication, which further improved reproducibility for some findings, particularly reducing misses. Improvements varied across finding categories, with adjudication improving agreement for cardiomegaly, fractures, and pneumothorax. Conclusion: The likelihood of interreader agreement, even within panels of US board-certified radiologists, must be considered before reads can be used as a reference standard for validation of proposed AI tools. Agreement and, by extension, reproducibility can be improved by applying majority vote, maximum sensitivity, or asynchronous adjudication for different findings, which supports the development of higher quality clinical research. Advances in knowledge: A panel of three experts is a common technique for establishing reference standards when ground truth is not available for use in AI validation. The manner in which differing opinions are resolved is shown to be important, and has not been previously explored.


Diagnostics ◽  
2021 ◽  
Vol 11 (6) ◽  
pp. 953
Author(s):  
Florian T. Gassert ◽  
Johannes Hammel ◽  
Felix C. Hofmann ◽  
Jan Neumann ◽  
Claudio E. von Schacky ◽  
...  

The aim of this study is to assess whether perifocal bone marrow edema (BME) in patients with osteoid osteoma (OO) can be accurately detected on dual-layer spectral CT (DLCT) with three-material decomposition. To that end, 18 patients with OO (25.33 ± 12.44 years; 7 females) were pairwise-matched with 18 patients (26.72 ± 9.65 years; 9 females) admitted for suspected pathologies other than OO in the same anatomic location but negative imaging findings. All patients were examined with DLCT and MRI. DLCT data was decomposed into hydroxyapatite and water- and fat-equivalent volume fraction maps. Two radiologists assessed DLCT-based volume fraction maps for the presence of perifocal BME, using a Likert scale (1 = no edema; 2 = likely no edema; 3 = likely edema; 4 = edema). Accuracy, sensitivity, and specificity for the detection of BME on DLCT were analyzed using MR findings as standard of reference. For the detection of BME in patients with OO, DLCT showed a sensitivity of 0.92, a specificity of 0.94, and an accuracy of 0.92 for both radiologists. Interreader agreement for the assessment of BME with DLCT was substantial (weighted κ = 0.78; 95% CI, 0.59, 0.94). DLCT with material-specific volume fraction maps allowed accurate detection of BME in patients with OO. This may spare patients additional examinations and facilitate the diagnosis of OO.


2021 ◽  
pp. 20201434
Author(s):  
Yasuyo Urase ◽  
Yoshiko Ueno ◽  
Tsutomu Tamada ◽  
Keitaro Sofue ◽  
Satoru Takahashi ◽  
...  

Objectives: To evaluate the interreader agreement and diagnostic performance of the Prostate Imaging Reporting and Data System (PI-RADS) v2.1, in comparison with v2. Methods: Institutional review board approval was obtained for this retrospective study. Seventy-seven consecutive patients who underwent a prostate multiparametric magnetic resonance imaging at 3.0 T before radical prostatectomy were included. Four radiologists (two experienced uroradiologists and two inexperienced radiologists) independently scored eight regions [six peripheral zones (PZ) and two transition zones (TZ)] using v2.1 and v2. Interreader agreement was assessed using κ statistics. To evaluate diagnostic performance for clinically significant prostate cancer (csPC), area under the curve (AUC) was estimated. Results 228 regions were pathologically diagnosed as positive for csPC. With a cutoff ≥3, the agreement among all readers was better with v2.1 than v2 in TZ, PZ, or both zones combined (κ-value: TZ, 0.509 vs 0.414; PZ, 0.686 vs 0.568; both zones combined, 0.644 vs 0.531). With a cutoff ≥4, the agreement among all readers was also better with v2.1 than v2 in the PZ or both zones combined (κ-value: PZ, 0.761 vs 0.701; both zones combined, 0.756 vs 0.709). For all readers, AUC with v2.1 was higher than with v2 (TZ, 0.826–0.907 vs 0.788–0.856; PZ, 0.857–0.919 vs 0.853–0.902). Conclusions: Our study suggests that the PI-RADS v2.1 could improve the interreader agreement and might contribute to improved diagnostic performance compared with v2. Advances in knowledge: PI-RADS v2.1 has a potential to improve interreader variability and diagnostic performance among radiologists with different levels of expertise.


Sign in / Sign up

Export Citation Format

Share Document