scholarly journals Long-Term Test–Retest Reliability of the UPSIT in Cognitively Intact Older Adults

2019 ◽  
Vol 44 (6) ◽  
pp. 365-369
Author(s):  
Davangere P Devanand ◽  
Xinhua Liu ◽  
Hannah Cohen ◽  
John Budrow ◽  
Nicole Schupf ◽  
...  

Abstract The objective of this study was to determine the long-term test–retest reliability of the University of Pennsylvania Smell Identification Test (UPSIT), and its individual items, in cognitively intact older adults. A community sample of older adults received a neuropsychological test battery, including the 12-item, 6-trial Selective Reminding Test (SRT). The UPSIT was administered at baseline and follow-up that occurred between 1 and 4 years after baseline. UPSIT scores of participants who were cognitively intact and did not decline cognitively were examined for test–retest reliability. In 92 older adults with mean age 77.6 years followed for 2.79 (standard deviation [SD] 0.69) years, mean UPSIT score declined from 30.29 (SD 5.83) to 27.80 (SD 5.50). In linear mixed models that adjusted for time, age, sex, and education, intraclass correlation coefficients for UPSIT were 0.65, SRT delayed recall 0.59, and SRT total immediate recall 0.49. Among 4 possible response combinations, the largest proportion of participants had correct responses at both visits for 35 out of 40 items. Consistency of item responses ranged from 50% to 90% across the 2 time points. The long-term test–retest reliability of the UPSIT was moderately strong without practice effects over long periods of time in older adults. These results provide indirect support to prior findings on odor identification impairment predicting cognitive decline and dementia, and suggest potential use of olfactory testing as a biomarker in prevention and treatment trials of cognitive enhancers.

1997 ◽  
Vol 64 (5) ◽  
pp. 270-276 ◽  
Author(s):  
Johanne Desrosiers ◽  
Annie Rochette ◽  
Réjean Hébert ◽  
Gina Bravo

Several dexterity tests have been developed, including the Minnesota Rate of Manipulation Test (MRMT) and a new version, the Minnesota Manual Dexterity Test (MMDT). The objectives of the study were: a) to verify the test-retest reliability of the MMDT; b) to compare the MRMT and the MMDT; c) to study the concurrent validity of the MMDT; and d) to establish reference values for elderly people with the MMDT. Two hundred and forty-seven community-living healthy elderly were evaluated with the MMDT, and two other dexterity tests, the Box and Block Test (BBT) and the Purdue Pegboard (PP). Thirty-five of them were evaluated twice with the MMDT and 44 were evaluated with both the MMDT and MRMT. The results show that the test-retest reliability of the MMDT is acceptable to high (intraclass correlation coefficients of 0.79 to 0.87, depending on the subtest) and the validity of the test is demonstrated by significant correlations between the MMDT, the BBT and the PP (0.63 to 0.67). There is a high correlation (0.85 to 0.95) between the MMDT and the MMRT in spite of different results. The reference values will help occupational therapists to differentiate better between real dexterity difficulties and those that may be attributed to normal aging.


2008 ◽  
Vol 22 (6) ◽  
pp. 737-744 ◽  
Author(s):  
I-Ping Hsueh ◽  
Miao-Ju Hsu ◽  
Ching-Fan Sheu ◽  
Su Lee ◽  
Ching-Lin Hsieh ◽  
...  

Objective. To provide empirical justification for selecting motor scales for stroke patients, the authors compared the psychometric properties (validity, responsiveness, test-retest reliability, and smallest real difference [SRD]) of the Fugl-Meyer Motor Scale (FM), the simplified FM (S-FM), the Stroke Rehabilitation Assessment of Movement instrument (STREAM), and the simplified STREAM (S-STREAM). Methods. For the validity and responsiveness study, 50 inpatients were assessed with the FM and the STREAM at admission and discharge to a rehabilitation department. The scores of the S-FM and the S-STREAM were retrieved from their corresponding scales. For the test-retest reliability study, a therapist administered both scales on a different sample of 60 chronic patients on 2 occasions. Results. Only the S-STREAM had no notable floor or ceiling effects at admission and discharge. The 4 motor scales had good concurrent validity (rho ≥ .91) and satisfactory predictive validity (rho = .72-.77). The scales showed responsiveness (effect size d ≥ 0.34; standardized response mean ≥ 0.95; P < .0001), with the S-STREAM most responsive. The test-retest agreements of the scales were excellent (intraclass correlation coefficients ≥ .96). The SRD of the 4 scales was 10% of their corresponding highest score, indicating acceptable level of measurement error. The upper extremity and the lower extremity subscales of the 4 showed similar results. Conclusions. The 4 motor scales showed acceptable levels of reliability, validity, and responsiveness in stroke patients. The S-STREAM is recommended because it is short, responsive to change, and able to discriminate patients with severe or mild stroke.


2021 ◽  
Vol 12 ◽  
Author(s):  
Wei Xia ◽  
William Ho Cheung Li ◽  
Tingna Liang ◽  
Yuanhui Luo ◽  
Laurie Long Kwan Ho ◽  
...  

Objectives: This study conducted a linguistic and psychometric evaluation of the Chinese Counseling Competencies Scale-Revised (CCS-R).Methods: The Chinese CCS-R was created from the original English version using a standard forward-backward translation process. The psychometric properties of the Chinese CCS-R were examined in a cohort of 208 counselors-in-training by two independent raters. Fifty-three counselors-in-training were asked to undergo another counseling performance evaluation for the test-retest. The confirmatory factor analysis (CFA) was conducted for the Chinese CCS-R, followed by internal consistency, test-retest reliability, inter-rater reliability, convergent validity, and concurrent validity.Results: The results of the CFA supported the factorial validity of the Chinese CCS-R, with adequate construct replicability. The scale had a McDonald's omega of 0.876, and intraclass correlation coefficients of 0.63 and 0.90 for test-retest reliability and inter-rater reliability, respectively. Significantly positive correlations were observed between the Chinese CCS-R score and scores of performance checklist (Pearson's γ = 0.781), indicating a large convergent validity, and knowledge on drug abuse (Pearson's γ = 0.833), indicating a moderate concurrent validity.Conclusion: The results support that the Chinese CCS-R is a valid and reliable measure of the counseling competencies.Practice implication: The CCS-R provides trainers with a reliable tool to evaluate counseling students' competencies and to facilitate discussions with trainees about their areas for growth.


2002 ◽  
Vol 82 (4) ◽  
pp. 364-371 ◽  
Author(s):  
Douglas P Gross ◽  
Michele C Battié

Abstract Background and Purpose. Functional capacity evaluations (FCEs) are measurement tools used in predicting readiness to return to work following injury. The interrater and test-retest reliability of determinations of maximal safe lifting during kinesiophysical FCEs were examined in a sample of people who were off work and receiving workers' compensation. Subjects. Twenty-eight subjects with low back pain who had plateaued with treatment were enrolled. Five occupational therapists, trained and experienced in kinesiophysical methods, conducted testing. Methods. A repeated-measures design was used, with raters testing subjects simultaneously, yet independently. Subjects were rated on 2 occasions, separated by 2 to 4 days. Analyses included intraclass correlation coefficients (ICCs) and 95% confidence intervals. Results. The ICC values for interrater reliability ranged from .95 to .98. Test-retest values ranged from .78 to .94. Discussion and Conclusion. Inconsistencies in subjects' performance across sessions were the greatest source of FCE measurement variability. Overall, however, test-retest reliability was good and interrater reliability was excellent.


2015 ◽  
Vol 35 (7) ◽  
pp. 1199-1205 ◽  
Author(s):  
Kati Alakurtti ◽  
Jarkko J Johansson ◽  
Juho Joutsa ◽  
Matti Laine ◽  
Lars Bäckman ◽  
...  

We measured the long-term test–retest reliability of [11C]raclopride binding in striatal subregions, the thalamus and the cortex using the bolus-plus-infusion method and a high-resolution positron emission scanner. Seven healthy male volunteers underwent two positron emission tomography (PET) [11C]raclopride assessments, with a 5-week retest interval. D2/3 receptor availability was quantified as binding potential using the simplified reference tissue model. Absolute variability (VAR) and intraclass correlation coefficient (ICC) values indicated very good reproducibility for the striatum and were 4.5%/0.82, 3.9%/0.83, and 3.9%/0.82, for the caudate nucleus, putamen, and ventral striatum, respectively. Thalamic reliability was also very good, with VAR of 3.7% and ICC of 0.92. Test-retest data for cortical areas showed good to moderate reproducibility (6.1% to 13.1%). Our results are in line with previous test–retest studies of [11C]raclopride binding in the striatum. A novel finding is the relatively low variability of [11C]raclopride binding, providing suggestive evidence that extrastriatal D2/3 binding can be studied in vivo with [11C]raclopride PET to be verified in future studies.


2020 ◽  
Vol 47 (4) ◽  
pp. 479-486
Author(s):  
Yuki Kondo ◽  
Kyota Bando ◽  
Yosuke Ariake ◽  
Wakana Katsuta ◽  
Kyoko Todoroki ◽  
...  

BACKGROUND: The reliability of the evaluation of the Balance Evaluation Systems Test (BESTest) and its two abbreviated versions are confirmed for balance characteristics and reliability. However, they are not utilized in cases of spinocerebellar ataxia (SCA). OBJECTIVE: We aimed to examine the test-retest reliability and minimal detectable change (MDC) of the BESTest and its abbreviated versions in persons with mild to moderate spinocerebellar ataxia. METHODS: The BESTest was performed in 20 persons with SCA at baseline and one month later. The scores of the abbreviated version of the BESTest were determined from the BESTest scores. The interclass correlation coefficient (1,1) was used as a measure of relative reliability. Furthermore, we calculated the MDC in the BESTest and its abbreviated versions. RESULTS: The intraclass correlation coefficients (1,1) and MDC at 95% confidence intervals were 0.92, 8.7(8.1%), 0.91, 4.1(14.5%), and 0.81, 5.2(21.6%) for the Balance, Mini-Balance, and Brief-Balance Evaluation Systems Tests, respectively. CONCLUSIONS: The BESTest and its abbreviated versions had high test-retest reliability. The MDC values of the BESTest could enable clinicians and researchers to interpret changes in the balance of patients with SCA more precisely.


2012 ◽  
Vol 92 (2) ◽  
pp. 318-328 ◽  
Author(s):  
Alaina M. Newell ◽  
Jessie M. VanSwearingen ◽  
Elizabeth Hile ◽  
Jennifer S. Brach

BackgroundPerceived ability or confidence plays an important role in determining function and behavior. The modified Gait Efficacy Scale (mGES) is a 10-item self-report measure used to assess walking confidence under challenging everyday circumstances.ObjectiveThe purpose of this study was to determine the reliability, internal consistency, and validity of the mGES as a measure of gait in older adults.DesignThis was a cross-sectional study.MethodsParticipants were 102 community-dwelling older adults (mean [±SD] age=78.6±6.1 years) who were independent in ambulation with or without an assistive device. Participants were assessed using the mGES and measures of confidence and fear, measures of function and disability, and performance-based measures of mobility. In a subsample (n=26), the mGES was administered twice within a 1-month period to establish test-retest reliability through the intraclass correlation coefficient (ICC [2,1]). The standard error of measure (SEM) was determined from the ICC and standard deviation. The Cronbach α value was calculated to determine internal consistency. To establish the validity of the mGES, the Spearman rank order correlation coefficient was used to examine the association with measures of confidence, fear, gait, and physical function and disability.ResultsThe mGES demonstrated test-retest reliability within the 1-month period (ICC=.93, 95% confidence interval=.85, .97). The SEM of the mGES was 5.23. The mGES was internally consistent across the 10 items (Cronbach α=.94). The mGES was related to measures of confidence and fear (r=.54–.88), function and disability (Late-Life Function and Disability Instrument, r=.32–.88), and performance-based mobility (r=.38–.64).LimitationsThis study examined only community-dwelling older adults. The results, therefore, should not be generalized to other patient populations.ConclusionThe mGES is a reliable and valid measure of confidence in walking among community-dwelling older adults.


Cephalalgia ◽  
2015 ◽  
Vol 36 (9) ◽  
pp. 831-839 ◽  
Author(s):  
Veronika Rauschel ◽  
Ruth Ruscheweyh ◽  
Siegbert Krafczyk ◽  
Andreas Straube

Objective Habituation of visual-evoked potentials (VEPs) is typically described as deficient interictally in migraine patients, supposedly indicating altered cortical excitability. Use of this parameter for monitoring changes over time, e.g. under treatment, requires demonstration of test-retest reliability. Methods VEPs were recorded interictally in 41 episodic migraine patients and 40 controls. N75–P100 amplitudes were measured over six consecutive blocks of 75 VEPs each. Amplitude regression slopes and block ratios were used to quantify VEP habituation. Test-retest reliability was assessed over 15 minutes and two to three weeks. Results Controls showed significantly more negative VEP habituation slopes than migraine patients (−0.21 ± 0.40 vs. 0.04 ± 0.46 µV/block, p < 0.05). Results were similar for block ratios, though, in the migraine group, VEP habituation significantly increased from test to two- to three-week retest ( p < 0.05). In addition, VEP habituation test-retest correlations were mostly poor both in migraine patients and controls (intraclass correlation coefficients, 15 minutes: −0.13 to 0.30, two to three weeks: 0.07 to 0.59). Conclusions Deficient VEP habituation in migraine was confirmed. However, the test-retest reliability of VEP habituation was rather weak. Therefore, we suggest that VEP habituation should be used for evaluation of cortical excitability under treatment only at the group level and only when a control group with sham treatment is included.


2016 ◽  
Vol 2016 ◽  
pp. 1-8 ◽  
Author(s):  
Taher I. Omari ◽  
Johanna Savilampi ◽  
Karmen Kokkinn ◽  
Mistyka Schar ◽  
Kristin Lamvik ◽  
...  

Purpose. We evaluated the intra- and interrater agreement and test-retest reliability of analyst derivation of swallow function variables based on repeated high resolution manometry with impedance measurements.Methods. Five subjects swallowed10×10 mL saline on two occasions one week apart producing a database of 100 swallows. Swallows were repeat-analysed by six observers using software. Swallow variables were indicative of contractility, intrabolus pressure, and flow timing.Results. The average intraclass correlation coefficients (ICC) for intra- and interrater comparisons of all variable means showedsubstantialtoexcellentagreement (intrarater ICC 0.85–1.00; mean interrater ICC 0.77–1.00). Test-retest results were less reliable. ICC for test-retest comparisons ranged fromslighttoexcellentdepending on the class of variable. Contractility variables differed most in terms of test-retest reliability. Amongst contractility variables, UES basal pressure showedexcellenttest-retest agreement (mean ICC 0.94), measures of UES postrelaxation contractile pressure showedmoderatetosubstantialtest-retest agreement (mean Interrater ICC 0.47–0.67), and test-retest agreement of pharyngeal contractile pressure ranged fromslighttosubstantial(mean Interrater ICC 0.15–0.61).Conclusions. Test-retest reliability of HRIM measures depends on the class of variable. Measures of bolus distension pressure and flow timing appear to be more test-retest reliable than measures of contractility.


Sign in / Sign up

Export Citation Format

Share Document