scholarly journals Measurement of Harm Outcomes in Older Adults after Hospital Discharge: Reliability and Validity

2012 ◽  
Vol 2012 ◽  
pp. 1-7 ◽  
Author(s):  
Alison Douglas ◽  
Lori Letts ◽  
Kevin Eva ◽  
Julie Richardson

Objectives. Defining and validating a measure of safety contributes to further validation of clinical measures. The objective was to define and examine the psychometric properties of the outcome “incidents of harm.”Methods. The Incident of Harm Caregiver Questionnaire was administered to caregivers of older adults discharged from hospital by telephone. Caregivers completed daily logs for one month and medical charts were examined.Results. Test-retest reliability (n=38) was high for the occurrence of an incident of harm (yes/no; kappa = 1.0) and the type of incident (agreement = 100%). Validation against daily logs found no disagreement regarding occurrence or types of incidents. Validation with medical charts found no disagreement regarding incident occurrence and disagreement in half regarding incident type.Discussion. The data support the Incident of Harm Caregiver Questionnaire as a reliable and valid estimation of incidents for this sample and are important to researchers as a method to measure safety when validating clinical measures.


2019 ◽  
Vol 25 (08) ◽  
pp. 857-867 ◽  
Author(s):  
Emmi P. Scott ◽  
Anne Sorrell ◽  
Andreana Benitez

AbstractObjective:Few independent studies have examined the psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) in older adults, despite growing interest in its use for clinical purposes. In this paper we report the test–retest reliability and construct validity of the NIHTB-CB, as well as its agreement or concordance with traditional neuropsychological tests of the same construct to determine whether tests could be used interchangeably.Methods:Sixty-one cognitively healthy adults ages 60–80 completed “gold standard” (GS) neuropsychological tests, NIHTB-CB, and brain MRI. Test–retest reliability, convergent/discriminant validity, and agreement statistics were calculated using Pearson’s correlations, concordance correlation coefficients (CCC), and root mean square deviations.Results:Test–retest reliability was acceptable (CCC = .73 Fluid; CCC = .85 Crystallized). The NIHTB-CB Fluid Composite correlated significantly with cerebral volumes (r’s = |.35−.41|), and both composites correlated highly with their respective GS composites (r’s = .58−.84), although this was more variable for individual tests. Absolute agreement was generally lower (CCC = .55 Fluid; CCC = .70 Crystallized) due to lower precision in fluid scores and systematic overestimation of crystallized composite scores on the NIHTB-CB.Conclusions:These results support the reliability and validity of the NIHTB-CB in healthy older adults and suggest that the fluid composite tests are at least as sensitive as standard neuropsychological tests to medial temporal atrophy and ventricular expansion. However, the NIHTB-CB may generate different estimates of performance and should not be treated as interchangeable with established neuropsychological tests.



2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Amin Kordi Yoosefinejad ◽  
Fatemeh Karjalian ◽  
Marzieh Momennasab ◽  
Shahrokh Ezzatzadegan Jahromi

Abstract Background Hemodialysis is considered a major therapeutic method for patients with chronic kidney disease. Pruritus is a common complaint of hemodialysis patients. The 5-D pruritus scale is amongst the most common tools to evaluate several dimensions of itch. Psychometric properties of the 5-D scale have not been evaluated in Persian speaking population with hemodialysis; hence, the objective of this study was to assess reliability and validity of the Persian version of the scale. Methods Ninety hemodialysis patients (men: 50, women: 40, mean age: 54.4 years) participated in this cross-sectional study. The final Persian version of 5-D scale was given to the participants. Tests Compared: One-third of the participants completed the scale twice within 3–7 days apart to evaluate test- retest reliability. Other psychometric properties including internal consistency, absolute reliability, convergent, discriminative and construct validity, floor/ceiling effects were also evaluated. Results The Persian 5-D scale has strong test-retest reliability (ICC= 0.98) and internal consistency (Cronbach’s alpha= 0.99). Standard error of measurement and minimal detectable change were 0.33 and 0.91, respectively. Regarding convergent validity, the scale had moderate correlation with numeric rating scale (r =0.67) and quality of life questionnaire related to itch (r = 0.59). Exploratory factor analysis revealed two factors within the scale. No floor or ceiling effect was found for the scale. Conclusion The Persian version of 5-D the itching scale is a brief instrument with acceptable reliability and validity. Therefore, the scale could be used by experts, nurses, and other health service providers to evaluate pruritus among Persian speaking hemodialysis patients.



2008 ◽  
Vol 16 (3) ◽  
pp. 292-315 ◽  
Author(s):  
Dawn P. Gill ◽  
Gareth R. Jones ◽  
GuangYong Zou ◽  
Mark Speechley

The purpose of this study was to develop a brief physical activity interview for older adults (Phone-FITT) and evaluate its test–retest reliability and validity. Summary scores were derived for household, recreational, and total PA. Reliability was evaluated in a convenience sample from a fall-prevention study (N= 43, 79.4 ± 2.9 years, 51% male), and validity, in a random sample of individuals in older adult exercise programs (N= 48, 77.4 ± 4.7 years, 25% male). Mean time to complete the Phone-FITT was 10 min for participants sampled from exercise programs. Evaluation of test–retest reliability indicated substantial to almost perfect agreement for all scores, with intraclass correlation coefficients (95% confidence intervals) ranging from .74 (.58–.85) to .88 (.8–.94). For validity, Spearman’s rho correlations of Phone-FITT scores with accelerometer counts ranged from .29 (.01–.53) to .57 (.34–.73). Correlations of Phone-FITT recreational scores with age and seconds to complete a self-paced step test ranged from –.29 (–.53 to –.01) to –.45 (–.68 to –.14). This study contributes preliminary evidence of the reliability and validity of the Phone-FITT.



2015 ◽  
Vol 12 (5) ◽  
pp. 727-732 ◽  
Author(s):  
Keith P. Gennuso ◽  
Charles E. Matthews ◽  
Lisa H. Colbert

Background:The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults.Methods:Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity.Results:Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = −0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r = .005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53).Conclusions:Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.



2007 ◽  
Vol 15 (2) ◽  
pp. 184-194 ◽  
Author(s):  
Marissa E. Mendelsohn ◽  
Denise M. Connelly ◽  
Tom J. Overend ◽  
Robert J. Petrella

Although popular in clinical settings, little is known about the utility of all-extremity semirecumbent exercise machines for research. Twenty-one community-dwelling older adults performed two exercise trials (three 4-min stages at increasing workloads) to evaluate the reliability and validity of exercise responses to submaximal all-extremity semirecumbent exercise (BioStep). Exercise responses were measured directly (Cosmed K4b2) and indirectly through software on the BioStep. Test–retest reliability (ICC2,1) was moderate to high across all three stages for directly measured METs (.92, .87, and .88) and HR (.91, .83, and .86). Concurrent criterion validity between the K4b2and BioStep MET values was moderate to very good across the three stages on both Day 1 (r= .86, .71, and .83) and Day 2 (r= .73, .87, and .72). All-extremity semirecumbent submaximal exercise elicited reliable and valid responses in our sample of older adults and thus can be considered a viable exercise mode.



2019 ◽  
Vol 32 ◽  
Author(s):  
Larissa Alamino Pereira de Viveiro ◽  
André Finotti Lagos Ferreira ◽  
José Eduardo Pompeu

Abstract Introduction: Falls are an important adverse event among older adults. The St. Thomas’s Falls Risk Assessment Tool in Older Adults (STRATIFY) is a tool to assess the risk of falls; however, it is not translated and adapted to Portuguese. Objective: To translate and perform a cross-cultural adaptation of STRATIFY in Brazilian Portuguese, as well as to test the reliability and validity of the instrument. Method: The cross-cultural adaptation process was carried out in six stages: A) T1 and T2 translations; B) synthesis of translations (T12); C) T12 back translations (RT1 and RT2); D) expert committee review; E) pretesting of the version approved by the committee; F) adapted version of STRATIFY for Brazilian Portuguese. Inter-rater and test-retest reliability were performed using the intraclass correlation coefficient (ICC) and 95% confidence interval (CI). Validity was assessed by the Spearman’s correlation coefficient of the STRATIFY with the Morse Fall Scale (MFS). Data analysis was performed by the Microsoft Office Excel 2016 (translation and adaptation) and by the IBM SPSS Statistics 20.0 (reliability and validity). We used a level of significance of p<0.05. Results: Data were presented about the perception of 33 health professionals on the adapted version of STRATIFY. The following ICC and CI were found for inter-rater and test-retest reliability, respectively: ICC=0.729; CI=0.525-0.845 and ICC=0.876; CI=0.781-0.929. STRATIFY and MFS showed a moderate but significant correlation (ρ=0.50, p<0.001). Conclusion: The translated and adapted version of the STRATIFY presented moderate inter-rater reliability and good test-retest reliability, in addition to a moderate correlation to the MFS.



2014 ◽  
Vol 27 (7) ◽  
pp. 1121-1133 ◽  
Author(s):  
Emily S. Bower ◽  
Julie Loebach Wetherell ◽  
C. Caroline Merz ◽  
Andrew J. Petkus ◽  
Vanessa L. Malcarne ◽  
...  

ABSTRACTBackground:Although fear of falling is prevalent among older adults recovering from hip fracture, current instruments are inadequate due to focus on specific situations and measurement of self-efficacy rather than fear.Methods:The authors revised and tested a form of the Fear of Falling Questionnaire with three groups of older adults: 405 recovering from hip fracture, 89 healthy community dwelling, and 42 with severe fear of falling. Test-retest reliability was evaluated in a subsample of 16 hip fracture patients. Internal consistency was compared across all groups. Construct validity was established through factor analysis, convergent validity with a measure of fall-related self-efficacy, and discriminant validity with measures of depression and affect.Results:A revised two-factor, six-item scale appears to have adequate psychometric properties. Scores were lower in the healthy comparison group relative to the hip fracture and fear of falling groups. Cronbach's α ranged from 0.72–0.83, with test-retest reliability of 0.82. Correlations with a measure of fall-related self-efficacy were moderate for the hip fracture group (0.42) and high with the healthy comparison (0.68) and fear of falling (0.70) groups. Correlations with depression and negative and positive affect were low to moderate.Conclusions:The Fear of Falling Questionnaire – Revised shows promise as a self-report measure of fear of falling, and is one of the first to be tested in older adults recovering from hip fracture. Advantages are that it is global rather than situation-specific and measures fear rather than self-efficacy. Future research on this scale is recommended in other older adult samples for whom fear of falling is relevant.



2015 ◽  
Vol 95 (9) ◽  
pp. 1274-1286 ◽  
Author(s):  
Deborah Antcliff ◽  
Malcolm Campbell ◽  
Steve Woby ◽  
Philip Keeley

Background Therapists frequently advise the use of activity pacing as a coping strategy to manage long-term conditions (eg, chronic low back pain, chronic widespread pain, chronic fatigue syndrome/myalgic encephalomyelitis). However, activity pacing has not been clearly operationalized, and there is a paucity of empirical evidence regarding pacing. This paucity of evidence may be partly due to the absence of a widely used pacing scale. To address the limitations of existing pacing scales, the 38-item Activity Pacing Questionnaire (APQ-38) was previously developed using the Delphi technique. Objective The aims of this study were: (1) to explore the psychometric properties of the APQ-38, (2) to identify underlying pacing themes, and (3) to assess the reliability and validity of the scale. Design This was a cross-sectional questionnaire study. Methods Three hundred eleven adult patients with chronic pain or fatigue participated, of whom 69 completed the test-retest analysis. Data obtained for the APQ-38 were analyzed using exploratory factor analysis, internal and test-retest reliability, and validity against 2 existing pacing subscales and validated measures of pain, fatigue, anxiety, depression, avoidance, and mental and physical function. Results Following factor analysis, 12 items were removed from the APQ-38, and 5 themes of pacing were identified in the resulting 26-item Activity Pacing Questionnaire (APQ-26): activity adjustment, activity consistency, activity progression, activity planning, and activity acceptance. These themes demonstrated satisfactory internal consistency (Cronbach α=.72–.92), test-retest reliability (intraclass correlation coefficient=.50–.78, P≤.001), and construct validity. Activity adjustment, activity progression, and activity acceptance correlated with worsened symptoms; activity consistency correlated with improved symptoms; and activity planning correlated with both improved and worsened symptoms. Limitations Data were collected from self-report questionnaires only. Conclusions Developed to be widely used across a heterogeneous group of patients with chronic pain or fatigue, the APQ-26 is multifaceted and demonstrates reliability and validity. Further study will explore the effects of pacing on patients' symptoms to guide therapists toward advising pacing themes with empirical benefits.



2004 ◽  
Vol 84 (1) ◽  
pp. 62-74 ◽  
Author(s):  
Earllaine Croarkin ◽  
Jerome Danoff ◽  
Candice Barnes

AbstractIntroduction. Tests of upper-extremity motor function used for people following a stroke have been described, but reliability and validity (psychometric properties) of measurements obtained with these tests have not been consistently established. This investigation was performed: (1) to review literature relative to upper-extremity motor function testing during rehabilitation following a stroke, (2) to develop selection criteria for identifying these tests in the literature, and (3) to rate the tests relative to their psychometric properties. Method. Literature searches were done using 2 databases. Reports of 4 psychometric properties were sought: interrater reliability, test-retest reliability, convergent validity or concurrent validity, and predictive validity. Results. Nine tests met the inclusion criteria of having psychometric properties reported in the literature. No test had evidence for all 4 psychometric properties. Only the Nine-Hole Peg Test was supported by 3 out of 4 properties. Most tests had 2 properties supported. Concurrent validity or convergent validity was most frequently described; test-retest reliability was least frequently described. Conclusions. More complete psychometric support is needed for upper-extremity motor function tests applied following a stroke. The absence of psychometric support, however, does not mean that a test has no value. Clinicians are cautioned not to generalize psychometric evidence.



Author(s):  
Xu Tian ◽  
Yanfei Jin ◽  
Hui Chen ◽  
María F. Jiménez-Herrera

Moral distress (MD) has become a seriously negative problem experienced by healthcare professionals, especially clinical nurses. Early and accurate detection of MD by the validated and reliable instrument is critically important to further develop an effective intervention strategy. We performed the current systematic review to comprehensively summarize the evidence of instruments for the detection of MD in clinical nurses. The research design was a systematic literature review. We assigned 2 investigators to independently search potential studies in PubMed, EMBASE, and China National Knowledge Infrastructure (CNKI) from their inception to June 2020. We used data extraction table extracting essential information, and the modified critical appraisal tool evaluating the reliability and validity of eligible instruments. Finally, we qualitatively summarized results of all included instruments. No ethical approval was required because this systematic review was performed based on published studies. We included 16 eligible studies covering 10 original and 6 revised or modified instruments for the final analysis. The overall quality of all instruments was moderate because test-retest reliability was inadequately examined in most instruments. Of 16 instruments, MDS-revised (MDS-R) was broadly validated and employed in different working or cultural settings. Meanwhile, it also extensively expands to specifically detect MD. Moreover, other instruments including moral distress risk scale (MDSR) and moral distress thermometer (MDT) should be further validated and utilized because it covered the gap missed by most instruments. Although several instruments have been made available for clinical nurses, some of them have inadequate psychometric properties test, especially test-retest reliability evaluation. Meanwhile, most of them have not be validated and employed in other working or cultural settings. We therefore suggested further studies to validate the psychometric properties of existing instruments and then employed instruments with high reliability and validity to detect MD in clinical nurses.



Sign in / Sign up

Export Citation Format

Share Document