scholarly journals Test–Retest Reliability and Reliable Change Estimates for Four Mobile Cognitive Tests Administered Virtually in Community-Dwelling Adults

2021 ◽  
Vol 12 ◽  
Author(s):  
Ryan Van Patten ◽  
Grant L. Iverson ◽  
Mélissa A. Muzeau ◽  
Heidi A. VanRavenhorst-Bell
Keyword(s):  
Working Memory ◽  
Reaction Time ◽  
Impulse Control ◽  
Community Dwelling ◽  
Cognitive Test ◽  
Inspection Time ◽  
Reliable Change ◽  
Retest Reliability ◽  
Intraclass Correlations ◽  
Test Retest Reliability

Objective: Remote mobile cognitive testing (MCT) is an expanding area of research, but psychometric data supporting these measures are limited. We provide preliminary data on test–retest reliability and reliable change estimates in four MCTs from SWAY Medical, Inc.Methods: Fifty-five adults from the U.S. Midwest completed the MCTs remotely on their personal mobile devices once per week for 3 consecutive weeks, while being supervised with a video-based virtual connection. The cognitive assessment measured simple reaction time (“Reaction Time”), go/no-go response inhibition (“Impulse Control”), timed visual processing (“Inspection Time”), and working memory (“Working Memory”). For each cognitive test except Working Memory, we analyzed both millisecond (ms) responses and an overall SWAY composite score.Results: The mean age of the sample was 26.69years (SD=9.89; range=18–58). Of the 55 adults, 38 (69.1%) were women and 49 (89.1%) used an iPhone. Friedman’s ANOVAs examining differences across testing sessions were nonsignificant (ps>0.31). Intraclass correlations for Weeks 1–3 were: Reaction Time (ms): 0.83, Reaction Time (SWAY): 0.83, Impulse Control (ms): 0.68, Impulse Control (SWAY): 0.80, Inspection Time (ms): 0.75, Inspection Time (SWAY): 0.75, and Working Memory (SWAY): 0.88. Intraclass correlations for Weeks 1–2 were: Reaction Time (ms): 0.75, Reaction Time (SWAY): 0.74, Impulse Control (ms): 0.60, Impulse Control (SWAY): 0.76, Inspection Time (ms): 0.79, Inspection Time (SWAY): 0.79, and Working Memory (SWAY): 0.83. Natural distributions of difference scores were calculated and reliable change estimates are presented for 70, 80, and 90% CIs.Conclusion: Test–retest reliability was adequate or better for the MCTs in this virtual remote testing study. Reliable change estimates allow for the determination of whether a particular level of improvement or decline in performance is within the range of probable measurement error. Additional reliability and validity data are needed in other age groups.

scholarly journals Reaction time, inhibition, working memory and ‘delay aversion’ performance: genetic influences and their interpretation

2006 ◽  
Vol 36 (11) ◽  
pp. 1613-1624 ◽  
Author(s):  
JONNA KUNTSI ◽  
HANNAH ROGERS ◽  
GREER SWINARD ◽  
NORBERT BÖRGER ◽  
JAAP van der MEERE ◽  
...  
Keyword(s):  
Working Memory ◽  
Reaction Time ◽  
Performance Test ◽  
Genetic Influences ◽  
Moderate Degree ◽  
Delay Aversion ◽  
Retest Reliability ◽  
Combining Data ◽  
Heritability Estimates ◽  
Test Retest Reliability

Background. For candidate endophenotypes to be useful for psychiatric genetic research, they first of all need to show significant genetic influences. To address the relative lack of previous data, we set to investigate the extent of genetic and environmental influences on performance in a set of theoretically driven cognitive-experimental tasks in a large twin sample. We further aimed to illustrate how test–retest reliability of the measures affects the estimates.Method. Four-hundred 7- to 9-year-old twin pairs were assessed individually on tasks measuring reaction time, inhibition, working memory and ‘delay aversion’ performance. Test–retest reliability data on some of the key measures were available from a previous study.Results. Several key measures of reaction time, inhibition and working-memory performance indicated a moderate degree of genetic influence. Combining data across theoretically related tasks increased the heritability estimates, as illustrated by the heritability estimates of 60% for mean reaction time and 50% for reaction-time variability. Psychometric properties (reliability or ceiling effects) had a substantial influence on the estimates for some measures.Conclusions. The data support the usefulness of several of the variables for endophenotype studies that aim to link genes to cognitive and motivational processes. Importantly, the data also illustrate specific conditions under which the true extent of genetic influences may be underestimated and hence the usefulness for genetic mapping studies compromised, and suggest ways to address this.

Cognitive-motor interference in walking after stroke: test–retest reliability and validity of dual-task walking assessments

2019 ◽  
Vol 33 (6) ◽  
pp. 1066-1078 ◽  
Author(s):  
Charlotte Sau Lan Tsang ◽  
Doris Yin Kei Chong ◽  
Marco Yiu Chung Pang
Keyword(s):  
Reaction Time ◽  
Dual Task ◽  
Reliability And Validity ◽  
Community Dwelling ◽  
Walking Distance ◽  
Cognitive Tasks ◽  
Retest Reliability ◽  
Cognitive Domains ◽  
Post Stroke ◽  
Test Retest Reliability

Objective: To explore the reliability and validity of a series of dual-task mobility assessments among individuals post-stroke. Design: Observational study with repeated measures. Setting: University laboratory. Participants: Thirty community-dwelling individuals with chronic stroke. Interventions: Not applicable. Main Measures: Each of the two mobility tasks (1-minute level-ground walking with and without obstacle-negotiation) was performed concurrently with each of the eight cognitive tasks (auditory Stroop test, serial subtraction, shopping list recall and category naming at two difficulty levels). Walking distance and obstacle hitting rate (OHR) indicated dual-task mobility performance. Number of correct responses (NCR) indicated cognitive performance. Reaction time was additionally measured for the auditory Stroop test. Construct validity was examined by correlations between the dual-task assessments. The dual-task assessments were repeated within 7–14 days for test–retest reliability. Results: Excellent test–retest reliability in walking distance and OHR was found (intraclass correlation coefficient, ICC(3,1) = 0.891–0.984, P < 0.05). Moderate to excellent reliability was found in NCR and reaction time (ICC(3,1) = 0.480–0.911, P < 0.01). Correlations between walking distance were excellent ( rs = 0.840–0.985, P < 0.01). Correlations of NCR and reaction time between low- and high-level cognitive tasks were mostly moderate to excellent ( rs  = 0.515–0.793, P < 0.01). Generally no significant correlations were found in NCR between the dual-task assessments with different cognitive domains. Conclusion: The dual-task walking assessments are reliable and valid for evaluating cognitive-motor interference in community-dwelling individuals post-stroke. The lack of correlations between the tasks of different cognitive domains indicates the need of using different cognitive domains in dual-task walking assessment post-stroke.

Test–Retest Reliability, Training, and Detraining Effects Associated With the Dynavision D2™ Mode A Visuomotor Reaction Time Test

2021 ◽  
pp. 1-9
Author(s):  
Adam J. Wells ◽  
Bri-ana D.I. Johnson
Keyword(s):  
Reaction Time ◽  
Repeated Measures ◽  
Intraclass Correlation ◽  
Analysis Of Covariance ◽  
Repeated Testing ◽  
Retest Reliability ◽  
Sports Science ◽  
Test Retest Reliability ◽  
Mode A ◽  
Training And Detraining

Context: The Dynavision D2™ Mode A test (ModeA) is a 1-minute reaction time (RT) test commonly used in sports science research and clinical rehabilitation. However, there is limited data regarding the effect of repeated testing (ie, training) or subsequent periods of no testing (ie, detraining) on test–retest reliability and RT performance. Therefore, the purpose of this study was to examine the test–retest reliability, training, and detraining effects associated with the D2™ ModeA test. Design: Repeated measures/reliability. Methods: Twenty-four recreationally active men and women completed 15 training sessions consisting of 2 ModeA tests per session (30 tests). The participants were then randomized to either 1 or 2 weeks of detraining prior to completing 15 retraining sessions (30 tests). The training and retraining periods were separated into 10 blocks for analysis (3 tests per block). The number of hits (hits) and the average RT per hit (AvgRT) within each block were used to determine RT performance. Intraclass correlation coefficients, SEM, and minimum difference were used to determine reliability. Repeated-measures analysis of variance/analysis of covariance were used to determine training and detraining effects, respectively. Results: The ModeA variables demonstrated excellent test–retest reliability (intraclass correlation coefficient2,3 > .93). Significant improvements in hits and AvgRT were noted within training blocks 1 to 5 (P < .05). No further improvements in RT performance were noted between training blocks 6 through 10. There was no effect of detraining period on RT. The RT performance was not different between blocks during retraining. Conclusions: It appears that 15 tests are necessary to overcome the training effect and establish reliable baseline performance for the ModeA test. Detraining for 1 to 2 weeks did not impact RT performance. The authors recommend that investigators and clinicians utilize the average of 3 tests when assessing RT performance using the D2 ModeA test.

Test–Retest Reliability and Internal Consistency of the Activity Card Sort–Australia (18-64)

2016 ◽  
Vol 37 (1) ◽  
pp. 50-56 ◽  
Author(s):  
Louise Gustafsson ◽  
Inez Hui Min Hung ◽  
Jacki Liddle
Keyword(s):  
Internal Consistency ◽  
Descriptive Study ◽  
Community Dwelling ◽  
Lower Percentage ◽  
Card Sort ◽  
Retest Reliability ◽  
Activity Engagement ◽  
Maintenance Activities ◽  
Test Retest Reliability ◽  
Acceptable Internal Consistency

The Activity Card Sort (ACS) measures activity engagement levels. The Activity Card Sort–Australian version for adults aged 18 to 64 (ACS-Aus (18-64)) was recently developed, and psychometric properties have not yet been determined. This study was established to determine the test–retest reliability and internal consistency of the ACS-Aus (18-64) and describe activity engagement trends for healthy adults. Fifty-four adults aged 18 to 64 participated in this descriptive study. The ACS-Aus (18-64) demonstrated excellent test–retest reliability ( r = .92, p < .001) and acceptable internal consistency (α = .83). Adults aged 18 to 40 retained a lower percentage of activities than adults aged 41 to 64 for personal care, daily life, home maintenance activities ( t = −2.22, p = .03), and recreation and relaxation activities ( t = −2.38, p = .02). The ACS-Aus (18-64) may be used to explore the activity engagement patterns of community-dwelling Australian adults aged 18 to 64. Further research will determine validity for clinical populations.

scholarly journals Reliability and validity of a Mediterranean diet and culinary index (MediCul) tool in an older population with mild cognitive impairment

2018 ◽  
Vol 120 (10) ◽  
pp. 1189-1200 ◽  
Author(s):  
Sue Radd-Vagenas ◽  
Maria A. Fiatarone Singh ◽  
Michael Inskip ◽  
Yorgi Mavros ◽  
Nicola Gates ◽  
...  
Keyword(s):  
Cognitive Impairment ◽  
Mild Cognitive Impairment ◽  
Mediterranean Diet ◽  
Reliability And Validity ◽  
Community Dwelling ◽  
Systematic Bias ◽  
Older Individuals ◽  
Retest Reliability ◽  
The Mean ◽  
Test Retest Reliability

AbstractDementia is a leading cause of morbidity and mortality without pharmacologic prevention or cure. Mounting evidence suggests that adherence to a Mediterranean dietary pattern may slow cognitive decline, and is important to characterise in at-risk cohorts. Thus, we determined the reliability and validity of the Mediterranean Diet and Culinary Index (MediCul), a new tool, among community-dwelling individuals with mild cognitive impairment (MCI). A total of sixty-eight participants (66 % female) aged 75·9 (sd 6·6) years, from the Study of Mental and Resistance Training study MCI cohort, completed the fifty-item MediCul at two time points, followed by a 3-d food record (FR). MediCul test–retest reliability was assessed using intra-class correlation coefficients (ICC), Bland–Altman plots and κ agreement within seventeen dietary element categories. Validity was assessed against the FR using the Bland–Altman method and nutrient trends across MediCul score tertiles. The mean MediCul score was 54·6/100·0, with few participants reaching thresholds for key Mediterranean foods. MediCul had very good test–retest reliability (ICC=0·93, 95 % CI 0·884, 0·954, P<0·0001) with fair-to-almost-perfect agreement for classifying elements within the same category. Validity was moderate with no systematic bias between methods of measurement, according to the regression coefficient (y=−2·30+0·17x) (95 % CI −0·027, 0·358; P=0·091). MediCul over-estimated the mean FR score by 6 %, with limits of agreement being under- and over-estimated by 11 and 23 %, respectively. Nutrient trends were significantly associated with increased MediCul scoring, consistent with a Mediterranean pattern. MediCul provides reliable and moderately valid information about Mediterranean diet adherence among older individuals with MCI, with potential application in future studies assessing relationships between diet and cognitive function.

ERRATUM

2002 ◽  
Vol 8 (3) ◽  
pp. 481-481
Author(s):  
WILLIAM B. BARR ◽  
MICHAEL McCREA
Keyword(s):  
Confidence Interval ◽  
Sensitivity And Specificity ◽  
Neurocognitive Testing ◽  
Reliable Change ◽  
Retest Reliability ◽  
Sports Concussion ◽  
The Third ◽  
Test Retest Reliability

The following is a correction for an error that occurred in the Journal of the International Neuropsychological Society, Vol. 7, No. 6. The error occurred in the article titled “Sensitivity and specificity of standardized neurocognitive testing immediately following sports concussion,” pp. 693–702, by Barr and McCrea. On page 696, under the subheading “Test-Retest Reliability and Reliable Change Cut-off Scores”, the confidence interval in the third sentence should read “−2.21, +2.59”, rather than “±2.59”.

Test–Retest Reliability and the Effects of Walking Speed on Stride Time Variability During Continuous, Overground Walking in Healthy Young Adults

2020 ◽  
pp. 1-7
Author(s):  
Nicholas S. Ryan ◽  
Paul A. Bruno ◽  
John M. Barden
Keyword(s):  
Young Adults ◽  
Walking Speed ◽  
Time Variability ◽  
Clinical Settings ◽  
Stride Time ◽  
Real Difference ◽  
Overground Walking ◽  
Retest Reliability ◽  
Intraclass Correlations ◽  
Test Retest Reliability

Studies have investigated the reliability and effect of walking speed on stride time variability during walking trials performed on a treadmill. The objective of this study was to investigate the reliability of stride time variability and the effect of walking speed on stride time variability, during continuous, overground walking in healthy young adults. Participants completed: (1) 2 walking trials at their preferred walking speed on 1 day and another trial 2 to 4 days later and (2) 1 trial at their preferred walking speed, 1 trial approximately 20% to 25% faster than their preferred walking speed, and 1 trial approximately 20% to 25% slower than their preferred walking speed on a separate day. Data from a waist-mounted accelerometer were used to determine the consecutive stride times for each trial. The reliability of stride time variability outcomes was generally poor (intraclass correlations: .167–.487). Although some significant differences in stride time variability were found between the preferred walking speed, fast, and slow trials, individual between-trial differences were generally below the estimated minimum difference considered to be a real difference. The development of a protocol to improve the reliability of stride time variability outcomes during continuous, overground walking would be beneficial to improve their application in research and clinical settings.

scholarly journals The Development and Psychometric Properties of the Visuospatial Working Memory Assessment (VWMA) for Children

2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Thitiya Wangkawan ◽  
Cynthia Lai ◽  
Peeraya Munkhetvit ◽  
Trevor Yung ◽  
Supaporn Chinchai
Keyword(s):  
Working Memory ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Adhd Group ◽  
Visuospatial Working Memory ◽  
Normal Children ◽  
Retest Reliability ◽  
Memory Assessment ◽  
Significant Difference ◽  
Test Retest Reliability

The visuospatial working memory plays a crucial role in the occupational performance of children including daily living and academic achievement. Unfortunately, relevant visuospatial working memory tests in the occupational therapy setting are lacking. Therefore, it is of clinical interest to develop new assessment tools in this area. The present study is aimed at summarizing the development of the visuospatial working memory assessment (VWMA) and assessing its psychometric properties. The results revealed that the score of item-objective congruence index (IOC) was 1.0 in overall items of assessment. The Cronbach alpha test confirmed that the internal consistency of VWMA showed good reliability in both types of the assessment, with the total score of computerized tests being .88 and the tabletop tests being .81. The computerized test was found to have excellent test-retest reliability with intraclass correlation coefficient (ICC) values ranging from .88 to .99. The tabletop test was found to have a fair to good test-retest reliability with the ICC values ranging from .51 to .63. As regards construct validity, the results revealed that the tasks in the computerized test identified a significant difference between the control group, normal children, and children with attention deficit/hyperactivity disorder (ADHD) group. The exception to this was the N-back task in which the independent sample t-test of computerized test ranged from 1.61 to 6.23. The results of the tabletop test revealed a significant difference between normal children and the children in the ADHD group over all tasks in which the independent sample t-test ranged from 3.05 to 8.40. In conclusion, good psychometric properties established as regards content validity, internal consistency, test-retest reliability, and construct validity provide evidence to support the position that the new VWMA is appropriate for children.

scholarly journals The Modified Gait Efficacy Scale: Establishing the Psychometric Properties in Older Adults

2012 ◽  
Vol 92 (2) ◽  
pp. 318-328 ◽  
Author(s):  
Alaina M. Newell ◽  
Jessie M. VanSwearingen ◽  
Elizabeth Hile ◽  
Jennifer S. Brach
Keyword(s):  
Older Adults ◽  
Correlation Coefficient ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Self Report ◽  
Retest Reliability ◽  
And Performance ◽  
Test Retest Reliability ◽  
Community Dwelling Older Adults

BackgroundPerceived ability or confidence plays an important role in determining function and behavior. The modified Gait Efficacy Scale (mGES) is a 10-item self-report measure used to assess walking confidence under challenging everyday circumstances.ObjectiveThe purpose of this study was to determine the reliability, internal consistency, and validity of the mGES as a measure of gait in older adults.DesignThis was a cross-sectional study.MethodsParticipants were 102 community-dwelling older adults (mean [±SD] age=78.6±6.1 years) who were independent in ambulation with or without an assistive device. Participants were assessed using the mGES and measures of confidence and fear, measures of function and disability, and performance-based measures of mobility. In a subsample (n=26), the mGES was administered twice within a 1-month period to establish test-retest reliability through the intraclass correlation coefficient (ICC [2,1]). The standard error of measure (SEM) was determined from the ICC and standard deviation. The Cronbach α value was calculated to determine internal consistency. To establish the validity of the mGES, the Spearman rank order correlation coefficient was used to examine the association with measures of confidence, fear, gait, and physical function and disability.ResultsThe mGES demonstrated test-retest reliability within the 1-month period (ICC=.93, 95% confidence interval=.85, .97). The SEM of the mGES was 5.23. The mGES was internally consistent across the 10 items (Cronbach α=.94). The mGES was related to measures of confidence and fear (r=.54–.88), function and disability (Late-Life Function and Disability Instrument, r=.32–.88), and performance-based mobility (r=.38–.64).LimitationsThis study examined only community-dwelling older adults. The results, therefore, should not be generalized to other patient populations.ConclusionThe mGES is a reliable and valid measure of confidence in walking among community-dwelling older adults.

Sign in / Sign up

Export Citation Format

Share Document