Reliability Assessment and Validation of the Skin Hyperpigmentation Index Compared to the Physician Global Assessment Score

Dermatology ◽  
2021 ◽  
pp. 1-4
Author(s):  
Simon Bossart ◽  
Simone Cazzaniga ◽  
Torsten Willenberg ◽  
Albert-Adrien Ramelet ◽  
Kristine Heidemeyer ◽  
...  

<b><i>Background:</i></b> The skin hyperpigmentation index (SHI), a new objective method for measuring skin hyperpigmentation, needs validation. <b><i>Objective:</i></b> To gain evidence of the reliability and validity of the SHI. <b><i>Methods:</i></b> Fifteen raters were divided into 3 groups (5 dermatologists, 5 nondermatologist physicians, and 5 nonphysician clinicians). Each rated 5 pigmented mole lesions with mild-to-severe hyperpigmentation to determine intra- and interrater reliability. All raters photographed the lesions and rated them using the subjective Physician Global Assessment (PGA) score. The same photographs were then assessed based on automatic computer measurement software using the online SHI tool (https://shi.skinimageanalysis.com). <b><i>Results:</i></b> The SHI reliability was excellent for all intra- and interrater assessments, while most PGA assessments showed good intra- and interrater agreement. Between-group reliability was excellent for SHI, while moderate-to-good for PGA evaluations. Concordance between the SHI and PGA assessments was strong across all groups of assessors. <b><i>Conclusion:</i></b> There is evidence that the SHI is a reliable instrument for measuring skin hyperpigmentation, and can be used by nonexperienced clinicians.

Stroke ◽  
2012 ◽  
Vol 43 (suppl_1) ◽  
Author(s):  
Koto Ishida ◽  
Jonathan M Raser ◽  
Christina A Wilson ◽  
Scott E Kasner ◽  
Michael T Mullen ◽  
...  

Background and Purpose: The ABCD 2 score is increasingly used for risk stratification of TIA patients. Many of the studies assessing the utility of the ABCD 2 score have retrospectively extracted the score from medical records, but the reliability of estimation based on chart review has not been reported. We sought to determine whether the ABCD 2 score can be estimated retrospectively from medical records. Methods: We compared ABCD 2 scores that were prospectively determined by a board certified vascular neurologist to scores determined retrospectively from medical record review. All ED records and initial neurology consult resident notes were abstracted with explicit ABCD 2 scoring redacted. ABCD 2 scores were then estimated by two independent blinded trained raters using these records. Estimated component, total scores, and ABCD 2 risk category (0-3, 4-5, 6-7), were compared both between raters and with the prospectively obtained scores. Reliability was assessed using unweighted kappa statistics. Results: Records were analyzed for 55 consecutive TIA patients. For the two raters of retrospective ABCD 2 scores, interrater reliability was good with 75% exact agreement in total score between raters (κ=0.68) and 84% agreement for ABCD 2 category (κ=0.74). Interrater agreement on individual items was greatest for age and diabetes, and poorest for clinical features and duration. Retrospectively estimated total ABCD 2 scores were identical to prospective scores in 52% of patients. Agreement between raters and the prospectively obtained score was >90% for age, blood pressure, and diabetes, but was only ∼70% for clinical features and duration. Retrospectively estimated ABCD 2 category was identical to the prospective category in 64% of patients ( Table ). Dichotomizing at an ABCD 2 score ≥4, retrospective assessment had a sensitivity of 83% (CI 70-95%) and specificity of 67% (CI 40-95%) compared to the prospective score. Conclusions: The ABCD 2 score can be abstracted from medical records with good interrater reliability but limited validity, which may lead to misclassification of risk category in over one-third of patients.


2021 ◽  
Vol 80 (Suppl 1) ◽  
pp. 98.1-98
Author(s):  
G. Horneff ◽  
D. Windschall ◽  
T. Hospach ◽  
S. Mrusek ◽  
M. Rühlmann ◽  
...  

Background:In 2017, 2 Etanercept biosimilars became approved. Comparative studies performed in adult patients with rheumatoid arthritis, ankylosing spondylitis or psoriasis by extrapolation led to approval for juvenile idiopathic arthritis (JIA).Objectives:So far there is limited experience with Etanercept biosimilars in JIA: The large national data base of the BIKER-registry was used to describe experience with Etanercept biosimilars in clinical practice.Methods:In this retrospective analysis patients exposed to ETA were identified in the German BIKER-registry and grouped into cohorts according to initiation of treatment after 2017, use of the originator and of biosimilars. The course of JADAS10, Physician global assessment VAS 0–100-mm, Parent/patient global assessment VAS 0–100-cm, Active joint count 0-71, truncated at 10, ESR and CHAQ-DI was analyzed. Descriptive statistics was used for demographic, clinical data, drug exposure, adverse events (AEs) and events of special interest (ESI).Results:Until 31.10.2020, 2917 JIA patients were reported to have received Etanercept. Since January 1 2017, in 39 centres treatment with Etanercept was started in 439 patients (377 (85.9%) started with the originator and 62 (14.1%) started a Biosimilar). Biosimilars were prescribed n 17 centres (44%). In 12 centres (31%), Etanercept biosimilars were used first line in 62 patients. In 17 centres (44%), 63 patients switched for the originator to a biosimilar. 3 patients reswitched from the biosimilar to the originator. 4 patient switched from a biosimilar to the originator). 22 centres (56%) had not prescribed a biosimilars so far.In not a single centre, initiation of a biosimilar was more frequent than of the originator.The patients’ characteristics and disease activity parameters were widely comparanble. Patients receiving biosimilar first line were slightly older at disease onset and had a longer disease duration. Patients receiving biosimilar first line had more often rheumatoid factor (RF) negative polyarthritis while extended oligoarthritis was more frequent in the originator cohort. In the switching cohort, more patients had extended oligoarthritis and fewer had RF negative polyarthritis and ERA JIA.No difference in disease activity parameters was noted, neither at baseline, during the course of treatment nor at last observation upon treatment. A decrease of the JADAS10 indicates improvement in both groups (Figure 1). At the time of switching, 68% had JADAS minimal disease activity (MDA) and 43% were in JASDAS remission. At month 6 and 12 these numbers increased to 74%/65% and 62%/50%.In total, 66 adverse events (AE) were reported in 45 patients upon biosimilar treatment.33 patients had 1, 5 patients 2, 5 patients had 3 and 2 reported 4 events. Adverse event of special interest were hypersensitivity n=1, injection site reaction n=1, new onset of psoriasis n=1, celiac disease n=1, Crohn‘s diesease n=1, elevated transaminases n=2, depression n=1 and disease deterioration (arthritis flare) in n=21. In 20 patients, the etanercept biosimilar was discontinued.Conclusion:This analysis is the first attempt to present a large data sample on JIA patients exposed to Etanercept biosimilars. Biosimilar were used in a minority of patients and by a minority of centers although no difference in efficacy or safety was noted from our analysis. Until today, the use of the originator is by far exceeding the use of biosimilars. The prescription of a biosimilar either first line or by switching from the originator is limited to a part of centres. Differences in efficacy between first line biosimilar users and originator users could not be observed. Also, after switching, no loss of efficacy was observed.Disclosure of Interests:Gerd Horneff Speakers bureau: Pfizer, Daniel Windschall: None declared, Toni Hospach: None declared, Sonja Mrusek: None declared, Michael Rühlmann: None declared, Ariane Klein: None declared


2021 ◽  
Vol 80 (Suppl 1) ◽  
pp. 767.1-767
Author(s):  
P. Fischer ◽  
A. Zbinden ◽  
F. Foerger

Background:Disease activity in patients with axial spondyloarthritis (axSpA) can be measured by BASDAI and ASDAS. Both instruments were validated in non-pregnant patients with cutoff values for active diseases. In pregnant women with axSpA, however, BASDAI and ASDAS scores might be biased by signs and symptoms of pregnancy itself.Objectives:To compare the performance of ASDAS and BASDAI during pregnancyMethods:Patients with axSpA were prospectively followed before pregnancy, at each trimester and 6 to 12 weeks postpartum. Disease activity was assessed by BASDAI, ASDAS, patient global assessment (PGA) and physician global assessment (PhGA). We analysed the disease course throughout pregnancy and postpartum, the correlation between BASDAI and ASDAS and the agreement in the classification of active disease. We applied receiver operating curves (ROC) to evaluate the cut-off points in pregnant patients.Results:The study involved 40 women with axSpA. Disease activity scores were higher during pregnancy (median ASDAS score: 2.5, median BASDAI score 3.1) than during a non-pregnant state (median ASDAS score 2.3, median BASDAI score 2.1). Median BASDAI scores were highest at the first trimester, median ASDAS scores were highest at the second trimester. ASDAS strongly correlated with BASDAI, both in the pregnant and in the non-pregnant state (r=0.796, r=0.727). However, there was a discordance when analysing the proportion of patients with high disease activity using the common cut-off values (ASDAS >2.1, BASDAS >4). More patients had high disease activity when measured by ASDAS (1st trimester (T): 63%, 2nd T: 76%, 3rd T: 61%) compared to those measured by BASDAI (1st T 43%, 2nd T: 39%, 3rd T: 34%). The κ coefficient showed only fair agreement (κ=0.39). ROC analysis among pregnant patients showed that the cut-off point estimation for high disease activity using ASDAS >2.75 corresponded to a BASDAI >4. The ASDAS >2.75 cut-off for high disease activity had a good agreement with BASDAI >4 (κ=0.657). When ASDAS >2.75 was applied in pregnant women with axSpA, about 40% experienced high disease activity.Conclusion:During pregnancy, the majority of women with axSpA experience ongoing disease activity. However, the cut-off values defining low and high disease activity might differ between pregnant and non-pregnant individuals since BASDAI and ASDAS are biased by pregnancy related symptoms like fatigue and mechanical back pain.Disclosure of Interests:None declared.


2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.


1984 ◽  
Vol 13 (1) ◽  
pp. 15-20 ◽  
Author(s):  
C Wagner ◽  
D Drescher

An electronic gravity goniometer was developed for determining the passive range of movement of the MCP joints II, III, IV, and V in the dorso-volar plane by the use of preset torques. Test–retest measurements on 23 healthy subjects between the ages of 18 and 57 demonstrated high intrarater and interrater agreement for determining the total range. In the determination of the amounts of flexion and extension the measurement of the flexion was less reliable. There was overall evidence of a declining tendency of reliability from MCP joint II to MCP joint V, probably caused by different reactions of the joints to repeated measurements. The higher total range of the MCP joints in women was principally caused by a higher range of extension. In the case of men and women the range of MCP joint V was noticeably greater than that of the other three joints. The mobility of the four MCP joints correlates relatively closely as a whole, however, in the case of the non-adjacent joints less closely than with the adjacent joints. Reliability and validity of the examination method were balanced against one another with regard to testing of the biomechanical pre-conditions for manual dexterity.


2005 ◽  
Vol 32 (3) ◽  
pp. 329-344 ◽  
Author(s):  
Fred Schmidt ◽  
Robert D. Hoge ◽  
Lezlie Gomes

The Youth Level of Service/Case Management Inventory (YLS/CMI) is a structured assessment tool designed to facilitate the effective intervention and rehabilitation of juvenile offenders by assessing each youth’s risk level and criminogenic needs. The present study examined the YLS/CMI’s reliability and validity in a sample of 107 juvenile offenders who were court-referred for mental health assessments. Results demonstrated the YLS/CMI’s internal consistency and interrater reliability. Moreover, the instrument’s predictive validity was substantiated on a number of recidivism measures for both males and females. Limitations of the current findings are discussed.


2014 ◽  
Vol 66 (2) ◽  
pp. 153-159 ◽  
Author(s):  
Jamil Lati ◽  
Vanessa Pellow ◽  
Jeannine Sproule ◽  
Dina Brooks ◽  
Cindy Ellerton

Sign in / Sign up

Export Citation Format

Share Document