A comparison of test-retest reliability of four cognitive screening tools in people with dementia

BackgroundCurrent dynamic walking tests, used in studies with older adults with dementia, rely strongly on healthy cognitive and physical function. Therefore, the Groningen Meander Walking Test (GMWT) was developed specifically for people with dementia. The aim of the GMWT is to measure dynamic walking ability by walking over a meandering curved line, with an emphasis on walking speed and stepping accuracy, while changing direction.ObjectiveThe purpose of this study was to investigate the feasibility, test-retest reliability, and minimal detectable change (MDC) of the GMWT.DesignA repeated-measures design was used.MethodsForty-two people with dementia participated in the study. Adherence rate, adverse events, repetition of instructions during test performance, test duration, and number of oversteps were assessed.ResultsThe adherence rate was excellent, with no adverse events. No repetitive instructions were given during test performance, and test duration was short (mean=17.16 seconds) with few oversteps (mean=1.94 oversteps). Test-retest reliability for participants without a walking device was excellent for the GMWT time score (intraclass correlation coefficient [ICC]=.942), with an MDC of 2.96 seconds. Test-retest reliability for participants with a 4-wheeled walker (4WW) was moderate (ICC=.837), with an MDC of 10.35 seconds. For the overstep score, a marginal ICC of .630 was found, with an MDC of 4.38 oversteps.LimitationsNo fall data were available, and there was a volunteer bias.ConclusionsThe GMWT is a feasible test for people with dementia. With the GMWT time score, a reliable and sensitive field test to measure walking abilities in older adults with dementia is available. The GMWT overstep score can be used to give information about the execution according to protocol and should be emphasized during the instructions. Future studies need to investigate the validity of the GMWT.

Download Full-text

Development, reliability and validity of the Safe Use of Mobility Aids Checklist (SUMAC) for 4-wheeled walker use in people living with dementia

10.21203/rs.2.22127/v2 ◽

2020 ◽

Author(s):

Susan Hunter ◽

Alison Divine ◽

Humberto Omana ◽

Edward Madou ◽

Jeffrey Holmes

Keyword(s):

Focus Groups ◽

Physical Function ◽

Assessment Tool ◽

Rank Order ◽

Criterion Validity ◽

Minimal Detectable Change ◽

Retest Reliability ◽

People With Dementia ◽

Mobility Aid ◽

Test Retest Reliability

Abstract Background: Balance and gait problems are common and progressive in dementia. Mobility aid use in people with dementia increases the likelihood of falls three-fold. An assessment tool to quantify mobility aid safety in people with dementia does not currently exist. The objectives of this study were: 1) to develop a tool for the evaluation of physical function and safety with use of a 4-wheeled walker in people with dementia, and 2) to evaluate its construct and criterion validity, inter-rater and test-retest reliability and minimal detectable change.Methods: Healthcare professionals (HCP) experienced in care and rehabilitation of people with dementia participated in focus groups for item generation of the new tool, entitled The Safe Use of Mobility Aid Checklist (SUMAC). The SUMAC evaluates physical function (PF) and safe use of the equipment (EQ) on nine tasks of daily life. Ten individuals with dementia using a 4-wheeled walker were recorded performing the tasks within the SUMAC. Reliability was evaluated by having five HCP score participant videos on two occasions. Inter-rater and test-retest reliability was assessed using intra-class correlation coefficients (ICC). Construct validity was evaluated using scores determined by a consensus panel compared to the individual HCP scores using Spearman’s rank-order correlations. Criterion validity was assessed between SUMAC-PF and the Performance-Oriented Mobility Assessment (POMA) gait subscale using Spearman’s rank-order correlations. Results: Three focus groups (n=17) were completed and these generated a tool comprised of nine tasks and the components within each task that the clinicians would observe for physical function and safe use. Inter-rater reliability was statistically significant for the SUMAC-PF (ICC=0.92, 95%CI (0.81, 0.98), p<0.001) and SUMAC-EQ (ICC=0.82, 95%CI (0.54, 0.95), p<0.001). Test-retest reliability was also statistically significant for the SUMAC-PF (ICC=0.89, 95%CI (0.81, 0.94), p<0.001) and SUMAC-EQ (ICC=0.88, 95%CI (0.79, 0.93), p<0.001). The POMA gait subscale correlated strongly with the SUMAC-PF (r=0.84), but not EQ (r=0.39).Conclusions: Each of the scores of the SUMAC, physical function and safe use of the equipment, demonstrated content validity, strong inter-rater and test-retest reliability and strong criterion and concurrent validity for the assessment of mobility aid safety in people with dementia.

Download Full-text

The Swedish translation of Perceptions of Restraint Use Questionnaire (PRUQ): A test-retest reliability study in two dementia nursing homes

BMC Geriatrics ◽

10.1186/s12877-021-02486-2 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Charlotta Thunborg ◽

Martin Salzman-Erikson ◽

Annakarin Olsson

Keyword(s):

Nursing Homes ◽

Internal Consistency ◽

Health Care Professionals ◽

Intraclass Correlation ◽

Systematic Change ◽

Swedish Version ◽

Retest Reliability ◽

Restraint Use ◽

People With Dementia ◽

Test Retest Reliability

Abstract Background The Perceptions of Restraint Use Questionnaire measures perception of restraint in a 17-item questionnaire. The aim of this study was to assess the test-retest reliability of the PRUQ as a measure of staff attitudes to restraint in elderly older persons care for people with dementia from two different nursing homes, and its ability to produce reliable results. Methods Twenty-six staff members from two different nursing homes completed the 17-item PRUQ twice with 14–21 days between time points. As the questionnaire has already been translated in another study, the current study evaluated total item scores, mean, internal consistency, and intraclass correlation for reliability purposes. Results The internal consistency Cronbach’s Alpha were ˃ ≥0.726. The Intraclass correlation (ICC) between test and retest was moderate to good for the three subscales, with ICC (A,1) and ICC (C,1) values approximately equal and in the range 0.480–0.962. A Bland-Altman plot of the PRUQ total mean scores illustrates no systematic change in the mean. Conclusions The Swedish version of the PRUQ shows mainly good reliability. Therefore, we suggest that researchers continue to develop the PRUQ to be an even higher reliable questionnaire of health care professionals’ perceptions of measure for restraint use in nursing homes for persons with dementia.

Download Full-text

Development, reliability and validity of the Safe Use of Mobility Aids Checklist (SUMAC) for 4-wheeled walker use in people living with dementia

10.21203/rs.2.22127/v1 ◽

2020 ◽

Author(s):

Susan Hunter ◽

Alison Divine ◽

Humberto Omana ◽

Edward Madou ◽

Jeffrey Holmes

Keyword(s):

Focus Groups ◽

Physical Function ◽

Assessment Tool ◽

Rank Order ◽

Criterion Validity ◽

Minimal Detectable Change ◽

Retest Reliability ◽

People With Dementia ◽

Mobility Aid ◽

Test Retest Reliability

Abstract Background Balance and gait problems are common and progressive in dementia. Mobility aid use in people with dementia increases the likelihood of falls three-fold. An assessment tool to quantify mobility aid safety in people with dementia does not currently exist. The objectives of this study were: 1) to develop a tool for the evaluation of physical function and safety with use of a 4-wheeled walker in people with dementia, and 2) to evaluate its construct and criterion validity, inter-rater and test-retest reliability and minimal detectable change. Methods Healthcare professionals (HCP) experienced in care and rehabilitation of people with dementia participated in focus groups for item generation of the new tool, entitled The Safe Use of Mobility Aid Checklist (SUMAC). The SUMAC evaluates physical function (PF) and safe use of the equipment (EQ) on nine tasks of daily life. Ten individuals with dementia using a 4-wheeled walker were recorded performing the tasks within the SUMAC. Reliability was evaluated by having five HCP score participant videos on two occasions. Inter-rater and test-retest reliability was assessed using intra-class correlation coefficients (ICC). Construct validity was evaluated using scores determined by a consensus panel compared to the individual HCP scores using Spearman’s rank-order correlations. Criterion validity was assessed between SUMAC-PF and the Performance-Oriented Mobility Assessment (POMA) using Spearman’s rank-order correlations. Results Three focus groups (n=17) were completed and these generated a tool comprised of nine tasks and the components within each task that the clinicians would observe for physical function and safe use. Inter-rater reliability was statistically significant for the SUMC-PF (ICC=0.72, 95%CI (0.33-0.92), p<0.001) and SUMAC-EQ (ICC=0.40, 95%CI (0.03-0.78), p=0.020). Test-retest reliability was also statistically significant for the SUMAC-PF (ICC=0.69, 95%CI (0.45-0.83), p<0.001) and SUMAC-EQ (ICC=0.73, 95%CI (0.53,0.85), p<0.001). The POMA correlated strongly with the SUMAC-PF (r=0.84), but not EQ (r=0.39). Conclusions Each of the scores of the SUMAC, physical function and safe use of the equipment, demonstrated content validity, strong inter-rater and test-retest reliability and strong criterion and concurrent validity for the assessment of mobility aid safety in people with dementia.

Download Full-text

A-03 SCAT5 Cognitive Screening Normative Data and Reliable Change Indices

Archives of Clinical Neuropsychology ◽

10.1093/arclin/acaa036.03 ◽

2020 ◽

Vol 35 (5) ◽

pp. 599-599

Author(s):

C Bailey ◽

J Meyer ◽

C Tangen ◽

R Deane ◽

S Briskin ◽

...

Keyword(s):

Normative Data ◽

Recall Score ◽

Descriptive Statistics ◽

Cognitive Screening ◽

Delayed Recall ◽

Retest Reliability ◽

Cut Points ◽

Immediate Recall ◽

Low Performance ◽

Test Retest Reliability

Abstract Objective This study provides normative data on the SCAT5 Cognitive Screening, establishes test-retest reliability, and creates clinically relevant cut points for low performance. Method The multisport baseline sample was composed of 727 uninjured college athletes (52% female) at a Division I university who were administered the SCAT5 before the 2017–2018 season. Descriptive statistics, including base rates of low performance, were calculated for SCAT5 indices. Repeat baseline testing was completed by 325 athletes (48% female) at 1 year (days M = 352.56;SD = 56.03) who were included in the test-retest reliability and practice effect analyses. Reliable change indices were calculated. Results Descriptive statistics for SCAT5 were computed for both baselines (Baseline 1: SAC total M = 35.15,SD = 4.93; immediate recall total M = 20.01,SD = 3.46; delayed recall total M = 6.43,SD = 1.75). A difference in descriptive statistics and practice effects by sex on the SCAT5 Cognitive Screening has been demonstrated (Bailey, Meyer, Tangen et al., under review). For female athletes, the 1st administration cutoff scores for abnormal performance (<10th%ile) included SAC total score = 33, immediate recall score = 18, and delayed recall score = 6. For male athletes, the 1st administration cutoff scores for abnormal performance (<10th%ile) included SAC total score = 30, immediate recall score = 17, and delayed recall score = 5. Test-retest reliability of the SAC was similar to previous versions but varied by sex. Reliable change indices (RCI) were created with cut points for significant change. Conclusions The present study provides clinically relevant normative data for the SCAT5 Cognitive Screening. Cut points for low performance on both reliable chance indices (RCIs) and normative performance reflected meaningful sex differences that could influence clinical interpretation.

Download Full-text

Psychometric Properties of the Family Stigma in Alzheimer's Disease Scale in Greek Professional Caregivers

Journal of Nursing Measurement ◽

10.1891/jnm-d-18-00113 ◽

2020 ◽

Vol 28 (2) ◽

pp. 259-282

Author(s):

Marianna Mantzorou ◽

Sofia Zyga ◽

Dimos Mastrogiannis ◽

Evmorfia Koukia

Keyword(s):

Alzheimer’S Disease ◽

Alzheimer's Disease ◽

Principal Component ◽

Maslach Burnout Inventory ◽

Validity And Reliability ◽

Retest Reliability ◽

People With Dementia ◽

The Family ◽

High Internal Consistency ◽

Test Retest Reliability

Background and PurposesThe present study was undertaken in order to evaluate the validity and reliability of the Family Stigma in Alzheimer's Disease Scale (FS-ADS) in the Greek population.MethodsThe Greek version of the FS-ADS as well as the Maslach Burnout Inventory (MBI) was administered to 171 healthcare professional caring for people with dementia. Exploratory factor analysis was performed to examine the factor structure of the FS-ADS. Test–retest reliability was measured by administration of the FS-ADS in 20 individuals.ResultsPrincipal component analysis revealed 5, 8 and 3 factors (subscales) for each dimension of the original questionnaire, respectively, similar to other previously reported results in the literature. The overall Cronbach's α was .899, yielding a high internal consistency. Test–retest reliability was very high (r = 0.903, p < .001). Statistically significant relationships were found between most of the FS-ADS dimensions and Maslach subscales.ConclusionThe findings favor the use of FS-ADS in nurses and professional caregivers in general, for measuring stigma in dementia in Greece.

Download Full-text

A Reliable Tool for Assessing MCI and Dementia: Validation Study of DemTect for Turkish Population

American Journal of Alzheimer s Disease & Other Dementias® ◽

10.1177/1533317520949805 ◽

2020 ◽

Vol 35 ◽

pp. 153331752094980

Author(s):

Gozde Sengul Aycicek ◽

Hatice Çalıskan ◽

Cemile Ozsurekci ◽

Pelin Unsal ◽

Josef Kessler ◽

...

Keyword(s):

Cognitive Impairment ◽

Mild Cognitive Impairment ◽

Interrater Reliability ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Screening Tools ◽

Turkish Version ◽

Retest Reliability ◽

Reliable Tool ◽

Test Retest Reliability

Background and Aim: Mild cognitive impairment (MCI) and dementia prevalence are expected to increase with aging. The DemTect is a very quick and easy tool to administer and recognize the early stages of dementia and MCI. In this study we aimed to evaluate the reliability and validity of a Turkish version of the DemTect and define cut off values for different age and educational levels. One of our aims is also to compare the sensitivity and specifity of the DemTect to other common screening tools. Patients and Methods: Fifty-four patients with MCI, 55 patients with dementia and 91 patients with subjective memory complaints (SMC) were enrolled in the study. The DemTect was translated into Turkish by forward-backward translation and compared with the Mini Mental State Examination (MMSE), the Quick Mild Cognitive Impairment Turkish version (QMCI-TR) and the Montreal Cognitive Assessment (MoCA). In order to test interrater reliability, the DemTect was administered to 11 patients, on the same day, by 2 trained raters. To establish test–retest reliability, the same rater scored the tool a second time on 11 patients within 2 weeks. Results: The median age of the patients was 73 (min-max: 65–90) years, 54.5% were female. We found a strong correlation between DemTect scores and the MMSE, the QMCI, and the MoCA (r = 0.725, r = 0.816, r = 0.821, respectively; p < 0.001). In ROC analysis, the cut-off point of the DemTect to differentiate MCI from SMC was 11.5 with 92.6% sensitivity, 91.2% specificity, AUC 0.973 and the cut-off point of the DemTect to differentiate dementia from SMC was 9.5 with 96.4% sensitivity, 100% specificity, AUC 0.916. Cronbach α was 0.823. Intraclass correlation coefficient was 0.873 (95% CI: 0.598–0.964) for interrater reliability and 0.966 (95% 0.777–0.982) for test-retest reliability (Cronbach α = 0.932, 0.966 respectively). Conclusion: The DemTect is a very reliable tool to assess Turkish patients with MCI and dementia.

Download Full-text

The Cognitive Telephone Screening Instrument (COGTEL): A Brief, Reliable, and Valid Tool for Capturing Interindividual Differences in Cognitive Functioning in Epidemiological and Aging Studies

Dementia and Geriatric Cognitive Disorders Extra ◽

10.1159/000479680 ◽

2017 ◽

Vol 7 (3) ◽

pp. 339-345 ◽

Cited By ~ 4

Author(s):

Andreas Ihle ◽

Élvio R. Gouveia ◽

Bruna R. Gouveia ◽

Matthias Kliegel

Keyword(s):

Older Adults ◽

Cognitive Functioning ◽

Convergent Validity ◽

Screening Instrument ◽

Screening Tools ◽

Interindividual Differences ◽

Retest Reliability ◽

Aging Studies ◽

Test Retest Reliability ◽

Telephone Screening

Aims: The present study set out to evaluate the psychometric properties of the Cognitive Telephone Screening Instrument (COGTEL) in 2 different samples of older adults. Methods: We assessed COGTEL in 116 older adults, with retest after 7 days to evaluate the test-retest reliability. Moreover, we assessed COGTEL in 868 older adults to evaluate convergent validity to the Mini-Mental State Examination (MMSE). Results: Test-retest reliability of the COGTEL total score was good at 0.85 (p < 0.001). Latent variable analyses revealed that COGTEL and MMSE correlated by 0.93 (p < 0.001), indicating convergent validity of the COGTEL. Conclusion: The present analyses suggest COGTEL as a brief, reliable, and valid instrument for capturing interindividual differences in cognitive functioning in epidemiological and aging studies, with the advantage of covering more cognitive domains than traditional screening tools such as the MMSE, as well as differentiating between individual performance levels, in healthy older adults.

Download Full-text

Development, reliability and validity of the Safe Use of Mobility Aids Checklist (SUMAC) for 4-wheeled walker use in people living with dementia

BMC Geriatrics ◽

10.1186/s12877-020-01865-5 ◽

2020 ◽

Vol 20 (1) ◽

Author(s):

Susan W. Hunter ◽

Alison Divine ◽

Humberto Omana ◽

Ed Madou ◽

Jeffrey Holmes

Keyword(s):

Focus Groups ◽

Physical Function ◽

Assessment Tool ◽

Rank Order ◽

Criterion Validity ◽

Minimal Detectable Change ◽

Retest Reliability ◽

People With Dementia ◽

Mobility Aid ◽

Test Retest Reliability

Abstract Background Balance and gait problems are common and progressive in dementia. Use of a mobility aid provides physical support and confidence. Yet, mobility aid use in people with dementia increases falls three-fold. An assessment tool of mobility aid safety in people with dementia does not currently exist. The objectives of this study were: 1) to develop a tool for the evaluation of physical function and safe use of a 4-wheeled walker in people with dementia, and 2) to evaluate its construct and criterion validity, inter-rater and test-retest reliability and minimal detectable change. Methods Healthcare professionals (HCP) experienced in rehabilitation of people with dementia participated in focus groups for item generation of the new tool, The Safe Use of Mobility Aid Checklist (SUMAC). The SUMAC evaluates physical function (PF) and safe use of the equipment (EQ) on nine tasks of daily life. Reliability was evaluated by HCP (n = 5) scored participant videos of people with dementia (n = 10) using a 4-wheeled walker performing the SUMAC. Inter-rater and test-retest reliability was assessed using intra-class correlation coefficients (ICC). Construct validity evaluated scores of the HCPs to a consensus HCP panel using Spearman’s rank-order correlations. Criterion validity evaluated SUMAC-PF to the Performance-Oriented Mobility Assessment (POMA) gait subscale using Spearman’s rank-order correlations. Results Three focus groups (n = 17) generated a tool comprised of nine tasks and the components within each task for physical function and safe use. Inter-rater reliability was statistically significant for SUMAC-PF (ICC = 0.92, 95%CI (0.81, 0.98), p < 0.001) and SUMAC-EQ. (ICC = 0.82, 95%CI (0.54, 0.95), p < 0.001). Test-retest reliability was statistically significant for SUMAC-PF (ICC = 0.89, 95%CI (0.81, 0.94), p < 0.001) and SUMAC-EQ. (ICC = 0.88, 95%CI (0.79, 0.93), p < 0.001). As hypothesized, the POMA gait subscale correlated strongly with the SUMAC-PF (rs = 0.84), but not EQ (rs = 0.39). Conclusions The focus groups and research team developed a tool of nine tasks with evaluation on physical function and safe use of a 4-wheeled walker for people with dementia. The SUMAC tool has demonstrated content validity for the whole scale and good construct and criterion validity for the SUMAC-PF and SUMAC-EQ. The subscores of the SUMAC demonstrated excellent to good inter-rater and test-retest reliability.

Download Full-text