scholarly journals Education Research: The Narrative Evaluation Quality Instrument

Neurology ◽  
2020 ◽  
Vol 94 (2) ◽  
pp. 91-95
Author(s):  
Michael S. Kelly ◽  
Christopher J. Mooney ◽  
Justin F. Rosati ◽  
Melanie K. Braun ◽  
Robert Thompson Stone
Keyword(s):  
Correlation Coefficients ◽  
Good Reliability ◽  
Interclass Correlation ◽  
Performance Domains ◽  
Assess Quality ◽  
Reliability Performance ◽  
Quality Instrument ◽  
Narrative Evaluation ◽  
Neurology Clerkship

ObjectiveDetermining the quality of narrative evaluations to assess medical student neurology clerkship performance remains a challenge. This study sought to develop a tool to comprehensively and systematically assess quality of student narrative evaluations.MethodsThe Narrative Evaluation Quality Instrument (NEQI) was created to assess several components within clerkship narrative evaluations: performance domains, specificity, and usefulness to learner. In this retrospective study, 5 investigators scored 123 narrative evaluations using the NEQI. Inter-rater reliability was estimated by calculating interclass correlation coefficients (ICC) across 615 NEQI scores.ResultsThe average overall NEQI score was 6.4 (SD 2.9), with mean component arm scores of 2.6 for performance domains (SD 0.9), 1.8 for specificity (SD 1.1), and 2.0 for usefulness (SD 1.4). Each component arm exhibited moderate reliability: performance domains ICC 0.65 (95% confidence interval [CI] 0.58–0.72), specificity ICC 0.69 (95% CI 0.61–0.77), and usefulness ICC 0.73 (95% CI 0.66–0.80). Overall NEQI score exhibited good reliability (0.81; 95% CI 0.77–0.86).ConclusionThe NEQI is a novel, reliable tool to comprehensively assess the quality of narrative evaluation of neurology clerks and will enhance the study of interventions seeking to improve clerkship evaluation.

Quantitative testing in spinal cord injury: overview of reliability and predictive validity

2012 ◽  
Vol 17 (Suppl1) ◽  
pp. 141-150 ◽  
Author(s):  
Maxwell Boakye ◽  
Susan Harkema ◽  
Peter H. Ellaway ◽  
Andrea C. Skelly
Keyword(s):  
Spinal Cord ◽  
Spinal Cord Injury ◽  
Evoked Potentials ◽  
Predictive Validity ◽  
Correlation Coefficients ◽  
Sensory Level ◽  
Intrarater Reliability ◽  
Interclass Correlation ◽  
Cord Injury

Object The objective of this study was to identify commonly used physiological outcome measures and summarize evidence on the reliability and predictive validity of quantitative measures used in monitoring persons with spinal cord injury (SCI). Methods A systematic search of PubMed through January 5, 2012, was conducted to identify publications using common outcome measures in persons with SCI and for studies that were specifically designed to evaluate the reliability and predictive validity of selected quantitative measures. Quantitative measures were defined as tests that quantify sensory and motor function, such as amount of force or torque, as well as thresholds, amplitudes, and latencies of evoked potentials that might be useful in studies and monitoring of patients with SCI. Reliability studies reporting interclass correlation coefficients (ICCs) or weighted κ coefficients were considered for inclusion. Studies explicitly evaluating correlation between measures and specific functional outcomes were considered for predictive validity. Results From a total of 121 potentially relevant citations, 6 studies of reliability and 4 studies of predictive validity for quantitative tests met the inclusion criteria. In persons with incomplete SCI, ICCs for both interrater and intrarater reliability of electrical perceptual threshold (EPT) were ≥ 0.7 above the sensory level of SCI but were less reliable below the sensory level. Interclass correlation coefficients for interrater and intrarater reliability of the Graded Redefined Assessment of Strength, Sensibility, and Prehension (GRASSP) components ranged from 0.84 to 0.98. For electromyography, the ICC was consistently high for within-day tests. The overall quality of reliability of the majority of studies was poor, due to the potential for selection bias and small sample sizes. No classic validation studies were found for the selected measures, and evidence regarding the predictive validity of the measures was limited. Somatosensory evoked potentials (SSEPs) may be correlated with ambulatory capacity, as well as the Barthel Index and motor index scores, but this correlation was limited for evaluation of bladder function recovery in 3 studies that assessed the correlation between baseline or initial SSEPs and a specific clinical outcome at a later follow-up time. All studies used convenience samples and the overall sample quality was low. Conclusions Evidence on the reliability and validity of the quantitative measures selected for this review is limited, and the overall quality of existing studies is poor. There is some evidence for the reliability of the EPT, dermatomal SSEPs, and the GRASSP to suggest that they may be useful in longitudinal studies of patients with SCI. There is a need for high quality studies of reliability, responsiveness, and validity for quantitative measures to monitor the level and degree of SCI.

Addressing Quality of Life of Children With Autism Spectrum Disorder and Intellectual Disability

2020 ◽  
Vol 58 (5) ◽  
pp. 393-408
Author(s):  
Laura E. Gómez ◽  
M. Lucía Morán ◽  
M. Ángeles Alcedo ◽  
Víctor B. Arias ◽  
Miguel-Ángel Verdugo
Keyword(s):  
Quality Of Life ◽  
Autism Spectrum Disorder ◽  
Intellectual Disability ◽  
Children With Autism ◽  
Autism Spectrum ◽  
Spectrum Disorder ◽  
Good Reliability ◽  
Assess Quality ◽  
Study Participants

Abstract Despite the advances on the assessment of quality of life, this concept is barely studied and is riddled with important limitations for those with autism spectrum disorder (ASD). This article is aimed at validating a questionnaire to assess quality of life of children with ASD and intellectual disability (ID). Based on the KidsLife Scale, geared toward people with ID, the most reliable items for those with ASD were selected. Study participants were 420 persons, from 4 to 21 years old. Results indicated that the KidsLife-ASD Scale measured eight intercorrelated domains, had good reliability, and exhibited adequate evidences of validity. KidsLife-ASD emerges as a helpful tool to guide person-centered planning addressed at improving quality of life.

scholarly journals Test-retest reliability for HAQ-DI and SF-36 PF for the measurement of physical function in psoriatic arthritis

2021 ◽  
pp. jrheum.210175
Author(s):  
Ying Ying Leung ◽  
William Tillett ◽  
Pil Hojgaard ◽  
Ana-Maria Orbai ◽  
Richard Holland ◽  
...  
Keyword(s):  
Psoriatic Arthritis ◽  
Short Form ◽  
Health Assessment ◽  
Correlation Coefficients ◽  
Intra Class Correlation ◽  
Retest Reliability ◽  
Sf 36 ◽  
Reliability Performance ◽  
Test Retest Reliability

Objective Due to no existing data, we aimed to derive evidence to support test-retest reliability for the Health Assessment Questionnaire-Disability Index (HAQ-DI) and Medical Outcome Survey Short-Form-36 item physical functioning domain (SF-36 PF) in psoriatic arthritis (PsA). Methods We identified datasets that collected relevant data for test-retest reliability for HAQ-DI and SF-36 PF; and evaluated them using OMERACT Filter 2.1 methodology. We calculated intra-class correlation coefficients (ICC) as a measure of test-retest reliability. We then conducted a quality assessment and evaluated the adequacy of test-retest reliability performance. Results Two datasets were identified for HAQ-DI and one for SF-36 PF in PsA. The quality of the datasets was good. The ICCs for HAQ-DI were excellent in both datasets: 0.94 (95% CI: 0.88 to 0.97) and 0.94 (95% CI: 0.89 to 0.97). The ICC of SF-36 PF was good (0.89, 95% CI: 0.76 to 0.95). The performance of test-retest reliability for both instruments was judged to be adequate. Conclusion The new data derived support good and reasonable test-retest reliability for HAQ-DI and SF-36 PF in PsA.

scholarly journals Non-infectious uveitis burden on quality of life and work impairment assessed through different psychometric questionnaires

2021 ◽  
pp. 112067212110346
Author(s):  
Luca Cimino ◽  
Piergiorgio Neri ◽  
Elisabetta Miserocchi ◽  
Maria Pia Paroli ◽  
Lorenzo Vannozzi ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Short Form ◽  
Activity Impairment ◽  
Good Reliability ◽  
Work Impairment ◽  
Validated Questionnaires ◽  
Infectious Uveitis ◽  
Visual Function Questionnaire ◽  
Assess Quality

Background: The purpose of this study was to evaluate the association between a novel psychometric 12-item questionnaire (U-qest) and other validated questionnaires to assess quality of life and work impairment in patients with non-infectious uveitis. Methods: Data were collected at baseline and 3 months postbaseline using U-qest and two other validated questionnaires: The National Eye Institute 25-Item Visual Function Questionnaire (VFQ-25) and the 12-Item Short-Form Health Survey (SF-12). Results: A total of 136 patients (52.2% female) aged 47.9 ± 14.8 years (mean ± SD) were enrolled in 14 uveitis referral centres. U-qest correlated moderately with VFQ-25 and SF-12 at baseline and at 3 months. Both U-qest and VFQ-25 scores improved as disease improved; however, U-qest also detected improvement in patients for whom VFQ-25 scores did not improve. Disease activity was shown to significantly affect activity impairment. Patients and physicians expressed positive perceptions regarding the use and benefit of this instrument. U-qest showed very good reliability in terms of internal consistency (Cronbach’s alpha = 0.91). Conclusions: U-qest can be considered a useful tool to assess the burden of uveitis on quality of life.

Evaluation of an instrument to assess the needs of cancer patients in an ambulatory chemotherapy unit

2007 ◽  
Vol 25 (18_suppl) ◽  
pp. 19593-19593
Author(s):  
L. Bernal ◽  
A. Casas ◽  
A. Cayuela ◽  
J. Corral ◽  
M. Flor ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Principal Components ◽  
Service Management ◽  
Ad Hoc ◽  
Intraclass Correlation ◽  
Information Access ◽  
Correlation Coefficients ◽  
Good Reliability

19593 Background: The physical deterioration, suffering and proximity of death associated with cancer dramatically affect the patient. Knowing about their perception of the circumstances that influence quality of life and adaptation to the disease, allows us to take appropriate medical action to satisfy their needs and improve the quality of patient care. Patients and Methods: The aim of this study was to evaluate treatment-related symptoms, information access, patient-doctor relationships, health service management, confidence, waiting time and financial needs of patients receiving ambulatory chemotherapy, through an “ad hoc” questionnaire. Different samples of patients were used to design the questionnaire: 141 patients for item identification, and completeness and acceptability evaluation; 47 patients for construct validity and prevalence of needs. The construct validity of the questionnaire was tested via analysis of the principal components, while reliability was evaluated in terms of the internal consistency of dimensions and test-retest scores. Results: The principal components found through factor analysis with Varimax rotation identified seven dimensions with Cronbrach′s a coefficients >0.70, which accounted for 64.3% of the variance. Internal consistency was high: Cronbrach′s a coefficients were 0.82. Test-retest reliability was acceptable with intraclass correlation coefficients ranging from 0.60 to 0.83. The most common needs were more information about diagnosis and prognosis (63%); over 50% of patients perceived shortcomings in communication with their doctors; 85% perceived sufficient intimacy in doctors‘ offices; 76% perceived that they had waited too long before being seen by doctors and given treatment. Conclusions: The validation analysis showed rather good reliability, structure validity and internal consistency. The needs expressed by patients are related to objective aspects of the disease, to time spent in contact with the service, to disease duration and to treatment lines. More vulnerable patients (elderly, low education level, more advanced treatment lines) express less needs, which is why they need an individualized analysis of their circumstances and greater attention from the professionals who take care of them. No significant financial relationships to disclose.

Quality of life in depression scale (QLDS). Development, reliability, validity, responsiveness and application

1997 ◽  
Vol 12 (4) ◽  
pp. 199-202 ◽  
Author(s):  
H Tuynman-Qua ◽  
F de Jonghe ◽  
S.P. McKenna
Keyword(s):  
Quality Of Life ◽  
Internal Consistency ◽  
Rating Scale ◽  
Depression Scale ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Well Being ◽  
The United States ◽  
Good Reliability

SummaryThe joint development of the Dutch and English versions of the Quality of Life in Depression Scale (QLDS) is described. The QLDS is based on the needs model of quality of life developed by Hunt and McKenna. The scale has good reliability and internal consistency. Test-retest correlation coefficients were 0.94 and 0.87 in the United Kingdom and the Netherlands, respectively. Internal consistency alpha-coefficients were 0.95 and 0.92, respectively. The validity of the scale is highly acceptable. The QLDS was shown to correlate relatively highly with established measures of well-being, and scores obtained with the measure were related to severity of depression as assessed by the Hamilton Rating Scale for Depression. The QLDS was shown to be responsive to change in an open study with fluoxetine in 540 patients with major depression. The scale has wide applicability and has been shown to be user-friendly, both for respondents and administrators. It has been, or is in the process of being, tested for reliability and validity in the following additional countries: Australia, Austria, Belgium, Canada, Denmark, France, Germany, Italy, Morocco, Spain and the United States.

scholarly journals Validation of the Functional Assessment of Anorexia/Cachexia Therapy Instrument to Assess Quality of Life in Maintenance Hemodialysis-Treated Patients with Cachexia

2020 ◽  
Author(s):  
Yang Zhen ◽  
Huang Yanlin ◽  
Lu Haizhen ◽  
Zhao Ping ◽  
Wang Han ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Functional Assessment ◽  
Discriminant Validity ◽  
Short Form ◽  
Demographic Data ◽  
Reliability And Validity ◽  
Maintenance Hemodialysis ◽  
Good Reliability ◽  
Assess Quality

Abstract Background Cachexia is the ultimate state of many maintenance hemodialysis (MHD)-treated patients. Functional Assessment of Anorexia/Cachexia Therapy (FAACT) is a tool used to evaluate the quality of life of patients with cachexia related to various diseases, but its effectiveness in MHD-treated patients has yet to be verified. This study aims to explore the applicability of FAACT in MHD-treated patients.Methods Qualified MHD-treated patients were selected for FAACT and The Kidney Disease Quality of Life Short Form 36 (KDQOL-36) questionnaire survey, and their demographic data and biochemical test results were collected from electronic medical records. Then, data were analyzed using statistical methods.Results This study enrolled 299 effective patients. The reliability of FAACT and its anorexia-cachexia subscale (ACS) were 0.904 and 0.842, respectively, and their retest exceeded 0.85. A reasonable correlation was found between FAACT and its items, and a reasonable calibration validity was identified between FAACT and KDQOL-36 subscale. FAACT and its subscale ACS showed good discriminant validity in the comparison of patients with different cachexia states and inflammatory states.Conclusions FAACT and ACS have good reliability and validity in MHD-treated patients and are suitable to measure the quality of life of MHD-treated patients with cachexia.

scholarly journals Development and Evaluation of Quality of Life Instruments for Chronic Diseases–Chronic Pulmonary Heart Disease (QLICD-CPHD) (V2.0)

2020 ◽  
Author(s):  
Haiyan Pan ◽  
Zheng Yang ◽  
Chonghua Wan ◽  
Jinghao Ruan ◽  
Bin Wu ◽  
...  
Keyword(s):  
Quality Of Life ◽  
Heart Disease ◽  
Chronic Diseases ◽  
Correlation Coefficients ◽  
Good Reliability ◽  
Pulmonary Heart Disease ◽  
Chronic Pulmonary Heart Disease ◽  
Quality Of Life Instruments ◽  
General Module

Abstract Objective: To develop a quality of life (QOL) instrument specific to chronic pulmonary heart disease (CPHD) and to evaluate its reliability, validity, and responsiveness. Methods: Under the Quality of Life Instruments for Chronic Diseases (QLICD) system, the QLICD-CPHD (V2.0) was developed and used to measure the QOL of 184 patients with CPHD. Data were analyzed by statistical description, linear correlation analysis, exploratory factor analysis, and paired t-test. Results: The QLICD-CPHD (V2.0) consisted of 44 items, including 28 in the general module and 16 in the specific module. The Cronbach’s α coefficients of four domains in the general module and the specific module were greater than 0.7, and the split-half reliability coefficients were between 0.6 and 0.8, indicating that the instrument has good reliability. The instrument showed good validity as the correlation coefficients among items of the same domain were significantly higher than those among items of different domains. Correlation coefficients r between the corresponding domains of SF-36 and QLICD-CPHD were between 0.26 and 0.60, which suggests that QLICD-CPHD has moderate criterion validity. Paired t-tests of scores of patients before and after treatment showed significant differences in the overall score, scores of general module domains except social role, and scores of the specific module. Standardized response means were greater than 0.2, suggesting that the instrument had moderate responsiveness and was sensitive to changes in the patients’ QOL. Conclusion: The QLICD-CPHD (V2.0) has good reliability, validity, and responsiveness. The instrument can be used to evaluate the QOL of CPHD patients.

Sign in / Sign up

Export Citation Format

Share Document