INTERRATER RELIABILITY AND VALIDITY OF THE GLOBAL ASSESSMENT OF RELATIONAL FUNCTIONING (GARF) SCALE IN A CLINICAL SETTING: A PRELIMINARY STUDY

1997 ◽  
Vol 25 (4) ◽  
pp. 357-360 ◽  
Author(s):  
Karen H. Rosen ◽  
Eric E. Mccollum ◽  
Kimberly Middleton ◽  
Lisa Locke ◽  
Kim Bird
Keyword(s):  
Clinical Setting ◽  
Interrater Reliability ◽  
Global Assessment ◽  
Reliability And Validity ◽  
Relational Functioning ◽  
Preliminary Study

Reliability Assessment and Validation of the Skin Hyperpigmentation Index Compared to the Physician Global Assessment Score

Dermatology ◽  
2021 ◽  
pp. 1-4
Author(s):  
Simon Bossart ◽  
Simone Cazzaniga ◽  
Torsten Willenberg ◽  
Albert-Adrien Ramelet ◽  
Kristine Heidemeyer ◽  
...  
Keyword(s):  
Interrater Reliability ◽  
Global Assessment ◽  
Reliability Assessment ◽  
Reliability And Validity ◽  
Interrater Agreement ◽  
Physician Global Assessment ◽  
Skin Hyperpigmentation ◽  
Computer Measurement ◽  
Reliable Instrument ◽  
Nonphysician Clinicians

<b><i>Background:</i></b> The skin hyperpigmentation index (SHI), a new objective method for measuring skin hyperpigmentation, needs validation. <b><i>Objective:</i></b> To gain evidence of the reliability and validity of the SHI. <b><i>Methods:</i></b> Fifteen raters were divided into 3 groups (5 dermatologists, 5 nondermatologist physicians, and 5 nonphysician clinicians). Each rated 5 pigmented mole lesions with mild-to-severe hyperpigmentation to determine intra- and interrater reliability. All raters photographed the lesions and rated them using the subjective Physician Global Assessment (PGA) score. The same photographs were then assessed based on automatic computer measurement software using the online SHI tool (https://shi.skinimageanalysis.com). <b><i>Results:</i></b> The SHI reliability was excellent for all intra- and interrater assessments, while most PGA assessments showed good intra- and interrater agreement. Between-group reliability was excellent for SHI, while moderate-to-good for PGA evaluations. Concordance between the SHI and PGA assessments was strong across all groups of assessors. <b><i>Conclusion:</i></b> There is evidence that the SHI is a reliable instrument for measuring skin hyperpigmentation, and can be used by nonexperienced clinicians.

Development and Initial Validation of a Project-Based Rubric to Assess the Systems-Based Practice Competency of Residents in the Clinical Chemistry Rotation of a Pathology Residency

2014 ◽  
Vol 138 (6) ◽  
pp. 809-813
Author(s):  
Carolyn R. Vitek ◽  
Jane C. Dale ◽  
Henry A. Homburger ◽  
Sandra C. Bryant ◽  
Amy K. Saenger ◽  
...  
Keyword(s):  
Critical Thinking ◽  
Interrater Reliability ◽  
Clinical Chemistry ◽  
Core Competencies ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Thinking Skills ◽  
Project Evaluation ◽  
Critical Thinking Skills

Context.— Systems-based practice (SBP) is 1 of 6 core competencies required in all resident training programs accredited by the Accreditation Council for Graduate Medical Education. Reliable methods of assessing resident competency in SBP have not been described in the medical literature. Objective.— To develop and validate an analytic grading rubric to assess pathology residents' analyses of SBP problems in clinical chemistry. Design.— Residents were assigned an SBP project based upon unmet clinical needs in the clinical chemistry laboratories. Using an iterative method, we created an analytic grading rubric based on critical thinking principles. Four faculty raters used the SBP project evaluation rubric to independently grade 11 residents' projects during their clinical chemistry rotations. Interrater reliability and Cronbach α were calculated to determine the reliability and validity of the rubric. Project mean scores and range were also assessed to determine whether the rubric differentiated resident critical thinking skills related to the SBP projects. Results.— Overall project scores ranged from 6.56 to 16.50 out of a possible 20 points. Cronbach α ranged from 0.91 to 0.96, indicating that the 4 rubric categories were internally consistent without significant overlap. Intraclass correlation coefficients ranged from 0.63 to 0.81, indicating moderate to strong interrater reliability. Conclusions.— We report development and statistical analysis of a novel SBP project evaluation rubric. The results indicate the rubric can be used to reliably assess pathology residents' critical thinking skills in SBP.

Reliability and Validity Analyses of the Youth Level of Service/Case Management Inventory

2005 ◽  
Vol 32 (3) ◽  
pp. 329-344 ◽  
Author(s):  
Fred Schmidt ◽  
Robert D. Hoge ◽  
Lezlie Gomes
Keyword(s):  
Juvenile Offenders ◽  
Case Management ◽  
Interrater Reliability ◽  
Assessment Tool ◽  
Reliability And Validity ◽  
Level Of Service ◽  
Risk Level ◽  
Criminogenic Needs ◽  
Health Assessments ◽  
Males And Females

The Youth Level of Service/Case Management Inventory (YLS/CMI) is a structured assessment tool designed to facilitate the effective intervention and rehabilitation of juvenile offenders by assessing each youth’s risk level and criminogenic needs. The present study examined the YLS/CMI’s reliability and validity in a sample of 107 juvenile offenders who were court-referred for mental health assessments. Results demonstrated the YLS/CMI’s internal consistency and interrater reliability. Moreover, the instrument’s predictive validity was substantiated on a number of recidivism measures for both males and females. Limitations of the current findings are discussed.

scholarly journals Examining Interrater Reliability and Validity of a Paediatric Cardiopulmonary Physiotherapy Discharge Tool

2014 ◽  
Vol 66 (2) ◽  
pp. 153-159 ◽  
Author(s):  
Jamil Lati ◽  
Vanessa Pellow ◽  
Jeannine Sproule ◽  
Dina Brooks ◽  
Cindy Ellerton
Keyword(s):  
Interrater Reliability ◽  
Reliability And Validity

“You Say Severe, I Say Mild”: Toward an Empirical Classification of Dysarthria Severity

2021 ◽  
pp. 1-18
Author(s):  
Kaila L. Stipancic ◽  
Kira M. Palmer ◽  
Hannah P. Rowe ◽  
Yana Yunusova ◽  
James D. Berry ◽  
...  
Keyword(s):  
Speech Intelligibility ◽  
Interrater Reliability ◽  
Reliability And Validity ◽  
Roc Curves ◽  
Speaking Rate ◽  
Response Options ◽  
Cutoff Points ◽  
Healthy Control ◽  
Dysarthric Speech ◽  
Surrogate Measures

Purpose: The main purpose of this study was to create an empirical classification system for speech severity in patients with dysarthria secondary to amyotrophic lateral sclerosis (ALS) by exploring the reliability and validity of speech-language pathologists' (SLPs') ratings of dysarthric speech. Method: Ten SLPs listened to speech samples from 52 speakers with ALS and 20 healthy control speakers. SLPs were asked to rate the speech severity of the speakers using five response options: normal, mild, moderate, severe, and profound. Four severity-surrogate measures were also calculated: SLPs transcribed the speech samples for the calculation of speech intelligibility and rated the effort it took to understand the speakers on a visual analog scale. In addition, speaking rate and intelligible speaking rate were calculated for each speaker. Intrarater and interrater reliability were calculated for each measure. We explored the validity of clinician-based severity ratings by comparing them to the severity-surrogate measures. Receiver operating characteristic (ROC) curves were conducted to create optimal cutoff points for defining dysarthria severity categories. Results: Intrarater and interrater reliability for the clinician-based severity ratings were excellent and were comparable to reliability for the severity-surrogate measures explored. Clinician severity ratings were strongly associated with all severity-surrogate measures, suggesting strong construct validity. We also provided a range of values for each severity-surrogate measure within each severity category based on the cutoff points obtained from the ROC analyses. Conclusions: Clinician severity ratings of dysarthric speech are reliable and valid. We discuss the underlying challenges that arise when selecting a stratification measure and offer recommendations for a classification scheme when stratifying patients and research participants into speech severity categories.

scholarly journals Ajuste social em pacientes com transtorno afetivo bipolar, unipolar, distimia e depressão dupla

2001 ◽  
Vol 23 (2) ◽  
pp. 79-87 ◽  
Author(s):  
Adriana M Tucci ◽  
Florence Kerr-Corrêa ◽  
Ivete Dalben
Keyword(s):  
Global Assessment ◽  
Relational Functioning ◽  
De Medicina

OBJETIVOS: Dados internacionais mostram que os transtornos afetivos têm uma prevalência de, aproximadamente, 11,3% da população. Além disso, são uma das doenças que mais geram perdas sociais e nos relacionamentos familiares. O objetivo deste trabalho foi avaliar o ajuste social e familiar de pacientes com transtornos afetivos (bipolar, unipolar, distimia e com depressão dupla), comparando o resultado entre as categorias diagnósticas, além de verificar quais variáveis estão associadas e conduzem ao pior ajuste. MÉTODOS: Foram feitos a caracterização socioeconômica e demográfica e um levantamento dos dados de evolução e de história da doença por meio de um questionário elaborado para essa finalidade. Para a avaliação de ajuste social, utilizou-se a Escala de Avaliação da Incapacitação Psiquiátrica (DAS/OMS, 1998). O relacionamento familiar foi avaliado pelo Global Assessment of Relational Functioning Scale (GARF/APA, 1994). Foram estudados 100 pacientes em tratamento, por pelo menos seis meses, no Ambulatório de Psiquiatria da Faculdade de Medicina Unesp, Botucatu, SP. RESULTADOS/CONCLUSÕES: Com predomínio de mulheres, a maioria dos pacientes tinha no mínimo dois anos de seguimento, idade acima de 50 anos, baixa escolaridade e nível socioeconômico baixo. Não houve diferença estatística significativa quanto aos dados socioeconômicos e demográficos. Na análise de regressão logística, o diagnóstico e o relacionamento familiar tiveram papel significativo no resultado de ajustamento social. Os pacientes unipolares e os distímicos tiveram melhores resultados no ajustamento social e no relacionamento familiar do que os bipolares e aqueles com depressão dupla.

Sign in / Sign up

Export Citation Format

Share Document