Reproducibility of MRI Features of Uterine Leiomyomas: A Study on Interobserver Agreement and Inter-Method Agreement With Surgery

2021 ◽  
pp. 084653712110385
Author(s):  
Guilherme Castilho Sorensen de Lima ◽  
Ulysses S. Torres ◽  
Leticia Ferreira Bueno ◽  
Gustavo Pedreira Rodi ◽  
Larissa Rossini Favaro ◽  
...  
Keyword(s):  
Interobserver Agreement ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Uterine Leiomyomas ◽  
Categorical Variables ◽  
Imaging Features ◽  
Gynecology And Obstetrics ◽  
Mri Features ◽  
Method Agreement ◽  
Figo Classification

Purpose: To evaluate interobserver agreement in the interpretation of different MRI features of uterine leiomyomas (UL) according to observers’ experience, and to assess the inter-method reproducibility (MRI versus surgery) regarding the International Federation of Gynecology and Obstetrics (FIGO) classification. Methods: Retrospective study including UL patients who underwent MRI and surgical treatment. Four blinded observers (2 vs >10 years of experience) assessed UL regarding dimensions and volume; inner and outer mantles; FIGO classification; vascularization; degeneration; and diffusion-weighted imaging features. Uterine dimensions and volume were calculated. FIGO classification as ascertained by observers was compared to surgical findings. Intraclass correlation coefficient (ICC) estimates were used for interobserver comparison of numerical variables, and kappa statistic for categorical variables. Results: Thirty-five patients (26y-73y) with 61 UL were included in the interobserver analyses, and 31 patients (54 UL) had available data allowing retrospective surgical FIGO classification for assessment of inter-method reproducibility. Both groups of observers had good to excellent agreement in assessing UL (ICC = 0.980-0.994) and uterine volumes (ICC = 0.857-0.914), mantles measurement (ICC = 0.797-0.920), and apparent diffusion coefficient calculation (ICC = 0.787-0.883). There was substantial agreement for both groups regarding FIGO classification (κ = 0.645-0.767). Vascularization, degeneration and restricted diffusion had lower agreement, varying from reasonable to moderate. Inter-method agreement was reasonable (κ = 0.341-0.395). Conclusions: Interobserver agreement of MRI for UL was higher for quantitative than qualitative features, with a little impact of observers’ experience for most features. MRI agreement with surgery was reasonable. Further efforts should be taken to improve interobserver and inter-method reproducibility for MRI in this scenario.

Region-specific agreement in ASPECTS estimation between neuroradiologists and e-ASPECTS software

2019 ◽  
Vol 12 (7) ◽  
pp. 720-723
Author(s):  
Ain Neuhaus ◽  
Seyed Mohammad Seyedsaadat ◽  
David Mihal ◽  
John Benson ◽  
Ian Mark ◽  
...  
Keyword(s):  
Machine Learning ◽  
Learning Strategies ◽  
Interobserver Agreement ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Kappa Statistic ◽  
Term Outcome ◽  
Long Term Outcome ◽  
Ischemic Change ◽  
Contrast Ct

Background and purposeThe Alberta Stroke Program Early CT Score (ASPECTS) is a widely used measure of ischemic change on non-contrast CT. Although predictive of long-term outcome, ASPECTS is limited by its modest interobserver agreement. One potential solution to this is the use of machine learning strategies, such as e-ASPECTS, to detect ischemia. Here, we compared e-ASPECTS with manual scoring by experienced neuroradiologists for all 10 individual ASPECTS regions.Materials and methodsWe retrospectively reviewed 178 baseline non-contrast CT scans from patients with acute ischemic stroke undergoing endovascular thrombectomy. All scans were reviewed by two independent neuroradiologists with a third reader arbitrating disagreements for a consensus read. Each ASPECTS region was scored individually. All scans were then evaluated using a machine learning-based software package (e-ASPECTS, Brainomix). Interobserver agreement between readers and the software for each region was calculated with a kappa statistic.ResultsThe median ASPECTS was 9 for manual scoring and 8.5 for e-ASPECTS, with an overall agreement of κ=0.248. Regional agreement varied from κ=0.094 (M1) to κ=0.555 (lentiform), with better performance in subcortical regions. When corrected for the low number of infarcts in any given region, prevalence-adjusted bias-adjusted kappa ranged from 0.483 (insula) to 0.888 (M3), with greater agreement for cortical areas. Intraclass correlation coefficients were between 0.09 (M1) and 0.556 (lentiform).ConclusionManual scoring and e-ASPECTS had fair agreement in our dataset on a per-region basis. This warrants further investigation using follow-up scans or MRI as the gold standard measure of true ASPECTS.

Myxofibrosarcoma: clinical and prognostic value of MRI features

2020 ◽  
Vol 16 ◽  
Author(s):  
Paolo Spinnato ◽  
Andrea Sambri ◽  
Tomohiro Fujiwara ◽  
Luca Ceccarelli ◽  
Roberta Clinca ◽  
...  
Keyword(s):  
Soft Tissue ◽  
Local Recurrence ◽  
Contrast Enhancement ◽  
Imaging Modality ◽  
Soft Tissue Sarcomas ◽  
The Elderly ◽  
High Rate ◽  
Imaging Features ◽  
High Grade ◽  
Mri Features

: Myxofibrosarcoma is one of the most common soft tissue sarcomas in the elderly. It is characterized by an extremely high rate of local recurrence, higher than other soft tissue tumors, and a relatively low risk of distant metastases.Magnetic resonance imaging (MRI) is the imaging modality of choice for the assessment of myxofibrosarcoma and plays a key role in the preoperative setting of these patients.MRI features associated with high risk of local recurrence are: high myxoid matrix content (water-like appearance of the lesions), high grade of contrast enhancement, presence of an infiltrative pattern (“tail sign”). On the other hand, MRI features associated with worse sarcoma specific survival are: large size of the lesion, deep location, high grade of contrast enhancement. Recognizing the above-mentioned imaging features of myxofibrosarcoma may be helpful to stratify the risk for local recurrence and disease-specific survival. Moreover, the surgical planning should be adjusted according to the MRI features

scholarly journals Head and neck osteosarcoma: CT and MR imaging features

2020 ◽  
Vol 49 (2) ◽  
pp. 20190202
Author(s):  
Zhendong Luo ◽  
Weiguo Chen ◽  
Xinping Shen ◽  
Genggeng Qin ◽  
Jianxiang Yuan ◽  
...  
Keyword(s):  
Soft Tissue ◽  
Head And Neck ◽  
Giant Cell ◽  
High Signal ◽  
Imaging Features ◽  
Matrix Mineralization ◽  
Imaging Characteristics ◽  
Mri Features ◽  
Signal Intensities ◽  
Ct And Mri

Objective: This study aims to assess the CT and MRI features of head and neck osteosarcoma (HNO). Methods: 37 HNOs were identified, and the following imaging characteristics were reviewed on CT and MRI. Results: A total of 37 patients(age 41.5 ± 15.0 years old; 16 males, 21 females) were included in the study. Tumours occurred in the maxilla (16, 43.2%), mandible (8, 21.6%), skull base (6, 16.2%), calvarium (5, 13.5%), paranasal sinuses (1, 2.7%) and cervical soft tissue (1, 2.7%). 16 patients received radiotherapy for nasopharyngeal carcinoma. Three patients (8.1%) developed osteosarcomas related to a primary bone disease. 16 of the (43.2%) tumours demonstrated lytic density on CT scans, followed by 13 (35.1%) showing mixed density and 7 (18.9%) with sclerotic density. Matrix mineralization was present in 32 (86.5%). 3 out of 24 (12.5%) tumours showed lamellar periosteal reactions, 21 out of 24 (87.5%) showed spiculated periosteal reactions. 12 tumours showed low signal intensities on T1WI, with 16 having heterogeneous signal intensities. 10 tumours showed high signal intensities on T2WI, and 18 showed heterogeneous signal intensities. With contrast-enhanced images, 3 tumours showed homogeneous enhancement (2 osteoblastic and 1 giant cell-rich), 18 tumours showed heterogeneous enhancement (13 osteoblastic, 4 fibroblastic and 1 giant cell-rich), and 7 tumours showed peripheral enhancement (6 chondroblastic and 1 osteoblastic). These tumours were characterized by soft tissue masses with a diameter of 5.6 ± 1.8 cm. Conclusions: HNO is a rare condition and is commonly associated with previous radiation exposure. This study provides age, sex distribution, location, CT and MRI features of HNO.

Development of the Teaching Interpersonal Skills for Telehealth Checklist

2021 ◽  
pp. 016327872199283
Author(s):  
Beverly W. Henry ◽  
Danica Billingsly ◽  
Derryl E. Block ◽  
Joseph Ehrmann
Keyword(s):  
Interpersonal Skills ◽  
Intraclass Correlation ◽  
Test Validity ◽  
Kappa Statistic ◽  
Order Effects ◽  
Response Patterns ◽  
Validity And Reliability ◽  
Communication Behaviors ◽  
Multi Stage ◽  
Test Retest Reliability

While interpersonal skills in telehealth may positively impact clinical practice, patient engagement and outcomes, assessment strategies are lacking. We conducted a multi-stage iterative approach to develop and test validity and reliability of the Teaching Interpersonal Skills in Telehealth checklist (TIPS-TC). First, we identified observable communication behaviors from the literature. Second, we surveyed telehealth managers and researchers (N = 11) to rate appropriateness of potential checklist items. Level of agreement (35%–91%) and Kappa statistic (0.18–0.89) confirmed items to be retained and identified items to modify. Based on response patterns and comments, we reduced 44 items to 12 critical checklist behaviors. Third, student clinicians used the checklist with video telehealth consultations and provided feedback. Fourth, we conducted reliability testing with practitioners and administrators (N = 68) who completed the TIPS-TC for two versions of a telehealth scenario. Strong interrater reliability intraclass correlation coefficient (ICC) and test-retest reliability ICC (both p < .001), along with non-significant findings of order effects supported the checklist as an acceptable instrument to differentiate high skill from low skill telehealth sessions. The TIPS-TC offers an evidence-based approach to assessing interpersonal skills in telehealth to help evaluate clinician competence and tailor learning activities across disciplinary roles.

scholarly journals CTNI-03. IMAGING FEATURES OF LEPTOMENINGEAL METASTASES OF NON-SMALL CELL LUNG CANCER: A SINGLE-CENTER REAL-WORLD STUDY

2020 ◽  
Vol 22 (Supplement_2) ◽  
pp. ii41-ii41
Author(s):  
Junjie Zhen ◽  
Lei Wen ◽  
Shaoqun Li ◽  
Mingyao Lai ◽  
Changguo Shan ◽  
...  
Keyword(s):  
Spinal Cord ◽  
Type A ◽  
Brain Parenchyma ◽  
Imaging Features ◽  
Type B ◽  
Type D ◽  
Mri Examination ◽  
Mri Features ◽  
Brain And Spinal Cord ◽  
The Brain

Abstract BACKGROUND According to EANO-ESMO clinical practice guidelines, the MRI findings of LM are divided into 4 types, namely linear enhancement (type A), nodular enhancement (type B), linear combined with nodular enhancement (type C), and sign of hydrocephalus (type D). METHODS The MRI features of brain and spinal cord in patients diagnosed with NSCLC-LM in Guangdong Sanjiu Brain Hospital from 2010 until 2019 were investigated, and then were classified into 4 types. The imaging features were analyzed. RESULTS A total of 80 patients were enrolled in the study. The median age of the patients was 53.5 years old, and the median time from the initial diagnosis to the confirmed diagnosis of LM was 11.6 months. The results of enhanced MRI examination of the brain in 79 cases showed that the number of cases with enhancements of type A, B, C and D were 50 (63.3%), 0, 26 (32.9%) and 3 (3.8%), respectively, and that LM with metastases to the brain parenchyma was found in 42 cases (53.2%). The results of enhanced MRI examination of spinal cord in 59 cases showed that there were only enhancements of type A and C in 40 cases (67.8%) and 3 cases (5.0%), and no enhancement sign in the other 16 cases (27.2%). CONCLUSION MRI examination of brain and spinal cord will improve the detection rate of LM. The MRI features of NSCLC-LM in real world are mainly characterized by the linear enhancements of brain and spinal cord, followed by linear combined with nodular enhancement. The enhancements of type B and type D are rare in clinic. Almost half of the patients have LM and metastases to the brain parenchyma. Therefore, the differentiation of tumor metastases is needed to be paid attention to for the early diagnosis and the formulation of reasonable treatment plans.

scholarly journals Testing telediagnostic obstetric ultrasound in Peru: a new horizon in expanding access to prenatal ultrasound

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Marika Toscano ◽  
Thomas J. Marini ◽  
Kathryn Drennan ◽  
Timothy M. Baran ◽  
Jonah Kan ◽  
...  
Keyword(s):  
Excellent Agreement ◽  
Rural Areas ◽  
Intraclass Correlation ◽  
Standard Of Care ◽  
The United States ◽  
Categorical Variables ◽  
Continuous Variables ◽  
Second Trimester ◽  
Obstetric Ultrasound ◽  
Biometric Measurements

Abstract Background Ninety-four percent of all maternal deaths occur in low- and middle-income countries, and the majority are preventable. Access to quality Obstetric ultrasound can identify some complications leading to maternal and neonatal/perinatal mortality or morbidity and may allow timely referral to higher-resource centers. However, there are significant global inequalities in access to imaging and many challenges to deploying ultrasound to rural areas. In this study, we tested a novel, innovative Obstetric telediagnostic ultrasound system in which the imaging acquisitions are obtained by an operator without prior ultrasound experience using simple scan protocols based only on external body landmarks and uploaded using low-bandwidth internet for asynchronous remote interpretation by an off-site specialist. Methods This is a single-center pilot study. A nurse and care technician underwent 8 h of training on the telediagnostic system. Subsequently, 126 patients (68 second trimester and 58 third trimester) were recruited at a health center in Lima, Peru and scanned by these ultrasound-naïve operators. The imaging acquisitions were uploaded by the telemedicine platform and interpreted remotely in the United States. Comparison of telediagnostic imaging was made to a concurrently performed standard of care ultrasound obtained and interpreted by an experienced attending radiologist. Cohen’s Kappa was used to test agreement between categorical variables. Intraclass correlation and Bland-Altman plots were used to test agreement between continuous variables. Results Obstetric ultrasound telediagnosis showed excellent agreement with standard of care ultrasound allowing the identification of number of fetuses (100% agreement), fetal presentation (95.8% agreement, κ =0.78 (p < 0.0001)), placental location (85.6% agreement, κ =0.74 (p < 0.0001)), and assessment of normal/abnormal amniotic fluid volume (99.2% agreement) with sensitivity and specificity > 95% for all variables. Intraclass correlation was good or excellent for all fetal biometric measurements (0.81–0.95). The majority (88.5%) of second trimester ultrasound exam biometry measurements produced dating within 14 days of standard of care ultrasound. Conclusion This Obstetric ultrasound telediagnostic system is a promising means to increase access to diagnostic Obstetric ultrasound in low-resource settings. The telediagnostic system demonstrated excellent agreement with standard of care ultrasound. Fetal biometric measurements were acceptable for use in the detection of gross discrepancies in fetal size requiring further follow up.

scholarly journals Using Differential Item Functioning to Test for Interrater Reliability in Constructed Response Items

2020 ◽  
Vol 80 (4) ◽  
pp. 808-820
Author(s):  
Cindy M. Walker ◽  
Sakine Göçer Şahin
Keyword(s):  
Differential Item Functioning ◽  
Interrater Reliability ◽  
Rating Scales ◽  
Rating Scale ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Promising Alternative ◽  
Constructed Response ◽  
Polytomous Item ◽  
Item Functioning

The purpose of this study was to investigate a new way of evaluating interrater reliability that can allow one to determine if two raters differ with respect to their rating on a polytomous rating scale or constructed response item. Specifically, differential item functioning (DIF) analyses were used to assess interrater reliability and compared with traditional interrater reliability measures. Three different procedures that can be used as measures of interrater reliability were compared: (1) intraclass correlation coefficient (ICC), (2) Cohen’s kappa statistic, and (3) DIF statistic obtained from Poly-SIBTEST. The results of this investigation indicated that DIF procedures appear to be a promising alternative to assess the interrater reliability of constructed response items, or other polytomous types of items, such as rating scales. Furthermore, using DIF to assess interrater reliability does not require a fully crossed design and allows one to determine if a rater is either more severe, or more lenient, in their scoring of each individual polytomous item on a test or rating scale.

scholarly journals Reliability Assessment of Scores From Video-Recorded TGMD-3 Performances

2017 ◽  
Vol 5 (1) ◽  
pp. 59-68 ◽  
Author(s):  
Pauli Olavi Rintala ◽  
Arja Kaarina Sääkslahti ◽  
Susanna Iivonen
Keyword(s):  
Motor Development ◽  
Interrater Reliability ◽  
Intraclass Correlation ◽  
Kappa Statistic ◽  
Intrarater Reliability ◽  
Gross Motor ◽  
Gross Motor Development ◽  
Percent Agreement ◽  
Two Samples ◽  
Ball Skills

This study examined the intrarater and interrater reliability of the Test of Gross Motor Development—3rd Edition (TGMD-3). Participants were 60 Finnish children aged between 3 and 9 years, divided into three separate samples of 20. Two samples of 20 were used to examine the intrarater reliability of two different assessors, and the third sample of 20 was used to establish interrater reliability. Children’s TGMD-3 performances were video-recorded and later assessed using an intraclass correlation coefficient, a kappa statistic, and a percent agreement calculation. The intrarater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.69 to 0.77, and percent agreement ranged from 87 to 91%. The interrater reliability of the locomotor subtest, ball skills subtest, and gross motor total score ranged from 0.56 to 0.64. Percent agreement of 83% was observed for locomotor skills, ball skills, and total skills, respectively. Hop, horizontal jump, and two-hand strike assessments showed the most difference between the assessors. These results show acceptable reliability for the TGMD-3 to analyze children’s gross motor skills.

scholarly journals Multimodal imaging patterns predict survival in recurrent glioblastoma patients treated with bevacizumab

2016 ◽  
Vol 18 (12) ◽  
pp. 1680-1687 ◽  
Author(s):  
Ken Chang ◽  
Biqi Zhang ◽  
Xiaotao Guo ◽  
Min Zong ◽  
Rifaquat Rahman ◽  
...  
Keyword(s):  
Clinical Decision Making ◽  
Progression Free Survival ◽  
Clinical Decision ◽  
Recurrent Glioblastoma ◽  
Machine Learning Techniques ◽  
Imaging Biomarkers ◽  
Imaging Features ◽  
Mri Features ◽  
Fluid Attenuated Inversion Recovery ◽  
Multimodal Mri

Abstract Background Bevacizumab is a humanized antibody against vascular endothelial growth factor approved for treatment of recurrent glioblastoma. There is a need to discover imaging biomarkers that can aid in the selection of patients who will likely derive the most survival benefit from bevacizumab. Methods The aim of the study was to examine if pre- and posttherapy multimodal MRI features could predict progression-free survival and overall survival (OS) for patients with recurrent glioblastoma treated with bevacizumab. The patient population included 84 patients in a training cohort and 42 patients in a testing cohort, separated based on pretherapy imaging date. Tumor volumes of interest were segmented from contrast-enhanced T1-weighted and fluid attenuated inversion recovery images and were used to derive volumetric, shape, texture, parametric, and histogram features. A total of 2293 pretherapy and 9811 posttherapy features were used to generate the model. Results Using standard radiographic assessment criteria, the hazard ratio for predicting OS was 3.38 (P < .001). The hazard ratios for pre- and posttherapy features predicting OS were 5.10 (P < .001) and 3.64 (P < .005) for the training and testing cohorts, respectively. Conclusion With the use of machine learning techniques to analyze imaging features derived from pre- and posttherapy multimodal MRI, we were able to develop a predictive model for patient OS that could potentially assist clinical decision making.

Sign in / Sign up

Export Citation Format

Share Document