interrater agreement
Recently Published Documents


TOTAL DOCUMENTS

450
(FIVE YEARS 123)

H-INDEX

41
(FIVE YEARS 3)

Dermatology ◽  
2021 ◽  
pp. 1-4
Author(s):  
Simon Bossart ◽  
Simone Cazzaniga ◽  
Torsten Willenberg ◽  
Albert-Adrien Ramelet ◽  
Kristine Heidemeyer ◽  
...  

<b><i>Background:</i></b> The skin hyperpigmentation index (SHI), a new objective method for measuring skin hyperpigmentation, needs validation. <b><i>Objective:</i></b> To gain evidence of the reliability and validity of the SHI. <b><i>Methods:</i></b> Fifteen raters were divided into 3 groups (5 dermatologists, 5 nondermatologist physicians, and 5 nonphysician clinicians). Each rated 5 pigmented mole lesions with mild-to-severe hyperpigmentation to determine intra- and interrater reliability. All raters photographed the lesions and rated them using the subjective Physician Global Assessment (PGA) score. The same photographs were then assessed based on automatic computer measurement software using the online SHI tool (https://shi.skinimageanalysis.com). <b><i>Results:</i></b> The SHI reliability was excellent for all intra- and interrater assessments, while most PGA assessments showed good intra- and interrater agreement. Between-group reliability was excellent for SHI, while moderate-to-good for PGA evaluations. Concordance between the SHI and PGA assessments was strong across all groups of assessors. <b><i>Conclusion:</i></b> There is evidence that the SHI is a reliable instrument for measuring skin hyperpigmentation, and can be used by nonexperienced clinicians.


2021 ◽  
pp. 084653712110565
Author(s):  
Ibrahim M. Nadeem ◽  
Sohaib Munir ◽  
Vincent Leung ◽  
Euan Stubbs

Purpose To determine if CT can improve the diagnostic confidence for the detection of sacroiliac joint (SIJ) erosions in patients with equivocal MRI findings. Methods A retrospective analysis of adult patients who had an SIJ MRI and a subsequent SIJ CT within 12 months was conducted. Using a 5-point Likert scale, two reviewers evaluated the de-identified MRI and CT images in randomized order and in separate sessions to answer the question: “Does the patient have SIJ erosions?”. A Fisher’s exact test was used to analyze the difference in diagnostic confidence, and intraclass correlation coefficient (ICC) was used to determine interrater reliability. Results 54 patients were included in the analysis (average age, 43.9 years). The average time interval between initial SIJ MRI and subsequent CT was 14.4 weeks (range, 5.6–50.3 weeks). CT resulted in significantly more cases with definitive diagnostic confidence than cases with probable or equivocal confidence compared to MRI ( P < .001). Amongst cases with equivocal findings on MRI, 73.2% of cases had definitive diagnoses on CT. There was moderate interrater agreement for MRI, with an ICC of .490 [95% CI, .258–.669], and excellent agreement for CT, with an ICC of .832 [95% CI, .728–.899]. Conclusion Overall, CT led to significantly increased diagnostic confidence and higher interrater reliability for the detection of SIJ erosions compared to MRI. Judicious use of CT may be useful in detecting SIJ erosions in patients with equivocal MRI findings.


Author(s):  
Lukas Baumanns ◽  
Benjamin Rott

AbstractThe aim of this study is to develop a descriptive phase model for problem-posing activities based on structured situations. For this purpose, 36 task-based interviews with pre-service primary and secondary mathematics teachers working in pairs who were given two structured problem-posing situations were conducted. Through an inductive-deductive category development, five types of activities (situation analysis, variation, generation, problem-solving, evaluation) were identified. These activities were coded in so-called episodes, allowing time-covering analyses of the observed processes. Recurring transitions between these episodes were observed, through which a descriptive phase model was derived. In addition, coding of the developed episode types was validated for its interrater agreement.


2021 ◽  
pp. 014556132110624
Author(s):  
Amy B. De La Torre ◽  
Stephanie Joe ◽  
Victoria S. Lee

Objectives Online surgical videos are an increasingly popular resource for surgical trainees, especially in the context of the COVID-19 pandemic. Our objective was to assess the instructional quality of the YouTube videos of the transsphenoidal surgical approach (TSA), using LAParoscopic surgery Video Educational Guidelines (LAP-VEGaS). Methods YouTube TSA videos were searched using 5 keywords. Video characteristics were recorded. Two fellowship-trained rhinologists evaluated videos using LAP-VEGaS (scale 0 [worst] to 18 [best]). Results The searches produced 43 unique, unduplicated videos for analysis. Mean video length 7 minutes (standard deviation [SD] = 13), mean viewership was 16 017 views (SD = 29 415), and mean total LAP-VEGaS score was 9 (SD = 3). The LAP-VEGaS criteria with the lowest mean scores were presentation of the positioning of the patient/surgical team (mean = 0.2; SD = 0.6) and the procedure outcomes (mean = 0.4; SD = 0.6). There was substantial interrater agreement (κ = 0.71). Conclusions LAP-VEGaS, initially developed for laparoscopic procedures, is useful for evaluating TSA instructional videos. There is an opportunity to improve the quality of these videos.


2021 ◽  
Vol 9 ◽  
Author(s):  
Edwar Pinzón-Casas ◽  
Maira Soto-Trujillo ◽  
Laura Camargo-Agón ◽  
Ángela Henao-Castaño ◽  
Nathalie Gualdrón ◽  
...  

Objective: The goal of the present study was to perform a cross-cultural adaptation and clinical validation of the Preschool Confusion Assessment Method for the Intensive Care Unit–Spanish (psCAM-ICU-S) for its clinical use in the Colombian Population.Methods: We designed a Cross-cultural adaptation study followed by a cross-sectional validation study at a Single-center Pediatric Intensive Care Unit (PICU) at a University Hospital in Bogotá, Colombia. The study population was children aged from 6 months to 5 years and 11 months who had been treated in the PICU with a Richmond sedation-agitation scale score of−3 or higher. A three-phase study was carried out. The first phase comprised the application of psychometric tests on the tool. In the second phase, the psCAM-ICU-S was applied to the target population. Patients were evaluated by a nurse and a pediatric intensivist using the psCAM-ICU-S; additionally, a child psychiatrist evaluated each patient using the DSM-V criteria; the psychiatrist evaluation was chosen as the gold standard for the diagnosis of delirium. In the third phase, an evaluation of the tool's effectiveness was carried out by using sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and likelihood ratios. Interrater agreement was also assessed by using the Fleiss' kappa.Results: Psychometric tests established the instrument's reliability and consistency as well as the clarity of its items. A total of 31 patients were evaluated. On average, the instrument presented a sensitivity of 93.3%, specificity of 94.8%, PPV 78%, NPV 99%, a positive likelihood ratio of 19.93, and a negative ratio of 0.07. The prevalence of delirium was 16.1% by the child psychiatrist and 25.8% using de psCAM-ICU-S. We confirmed high Interrater agreement, Kappa index (0.672–0.902).Conclusions: The psCAM-ICU-S was a valid and reliable instrument for the diagnosis of delirium in critically ill pediatric patients.


Radiology ◽  
2021 ◽  
Author(s):  
Kimberly L. Shampain ◽  
Prasad R. Shankar ◽  
Jonathan P. Troost ◽  
Maarten L. Galantowicz ◽  
Rudra A. Pampati ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document