scholarly journals 1119 Superior Test-Retest Reliability of a Computerized Cognitive Assessment vs SLUMS During an 18-Month Longitudinal Study

SLEEP ◽  
2020 ◽  
Vol 43 (Supplement_1) ◽  
pp. A426-A426
Author(s):  
J C Andrefsky ◽  
D Cahn-Hidalgo ◽  
R Benabou
Keyword(s):  
Longitudinal Study ◽  
Linear Regression ◽  
Sleep Disorders ◽  
Test Session ◽  
Test Reliability ◽  
Computerized Testing ◽  
Retest Reliability ◽  
Long Term Treatment ◽  
Test Retest Reliability ◽  
Clearance Study

Abstract Introduction Chronic sleep deprivation has been associated with cognitive impairment (CI) in multiple studies. Cognivue is an FDA-cleared computerized testing tool that provides adaptive psychophysic evaluation of cognitive functions (CF). A reliable objective method to evaluate CF in patients with sleep disorders could be helpful to optimize long-term treatment. In an FDA clearance study, Cognivue demonstrated good agreement with St. Louis University Mental Status (SLUMS) and other neuropsychological tests, and superior test re-test reliability compared to SLUMS across 2 sessions, 1 to 2 weeks apart (Cognivue regression fit: R2= 0.81, r= 0.90); SLUMS regression fit: R2 = 0.67, r= 0.82). Methods 238 subjects from the FDA clearance study enrolled in the longitudinal study. They underwent Cognivue test and SLUMS at 3 sessions over 18 months (6, 12, 18 months post-FDA study). An analysis of rank linear regression test-retest reliability was performed for both tests. Results Among these 238 patients, Cognivue demonstrated similar linear regression scores across comparisons (test session 1&2: regression fit: R2= 0.76; r = 0.87; test session 1&3: regression fit: R2= 0.72; r = 0.85; test session 1&4: regression fit: R2= 0.73; r = 0.86). The SLUMS test demonstrated greater variability in regression scores across test sessions (test session 1&2: regression fit: R2= 0.63; r = 0.79; test session 1&3: regression fit: R2= 0.43 r = 0.65; test session 1&4: regression fit: R2= 0.64; r = 0.80). Conclusion Cognivue demonstrated maintained superior test re-test reliability compared to SLUMS over a period of 18 months after the FDA clearance study. With that, Cognivue could be beneficial in detecting early stages of multi-domain CI in patients with sleep disorders, providing an opportunity for early intervention strategies and follow-up over time to improve patient outcomes. Support Cognivue, Inc.

The Minnesota Manual Dexterity Test: Reliability, Validity and Reference Values Studies with Healthy Elderly People

1997 ◽  
Vol 64 (5) ◽  
pp. 270-276 ◽  
Author(s):  
Johanne Desrosiers ◽  
Annie Rochette ◽  
Réjean Hébert ◽  
Gina Bravo
Keyword(s):  
Elderly People ◽  
Reference Values ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Manual Dexterity ◽  
Test Reliability ◽  
Retest Reliability ◽  
Healthy Elderly ◽  
Block Test ◽  
Test Retest Reliability

Several dexterity tests have been developed, including the Minnesota Rate of Manipulation Test (MRMT) and a new version, the Minnesota Manual Dexterity Test (MMDT). The objectives of the study were: a) to verify the test-retest reliability of the MMDT; b) to compare the MRMT and the MMDT; c) to study the concurrent validity of the MMDT; and d) to establish reference values for elderly people with the MMDT. Two hundred and forty-seven community-living healthy elderly were evaluated with the MMDT, and two other dexterity tests, the Box and Block Test (BBT) and the Purdue Pegboard (PP). Thirty-five of them were evaluated twice with the MMDT and 44 were evaluated with both the MMDT and MRMT. The results show that the test-retest reliability of the MMDT is acceptable to high (intraclass correlation coefficients of 0.79 to 0.87, depending on the subtest) and the validity of the test is demonstrated by significant correlations between the MMDT, the BBT and the PP (0.63 to 0.67). There is a high correlation (0.85 to 0.95) between the MMDT and the MMRT in spite of different results. The reference values will help occupational therapists to differentiate better between real dexterity difficulties and those that may be attributed to normal aging.

scholarly journals A-058 Test–Retest Reliability of the Grooved Pegboard Test in a Pediatric Medical Population

2020 ◽  
Vol 35 (6) ◽  
pp. 848-848
Author(s):  
David C ◽  
Vasserman M ◽  
Brooks B ◽  
Macallister W
Keyword(s):  
Children And Adolescents ◽  
Test Reliability ◽  
Practice Effects ◽  
Fine Motor ◽  
Limited Data ◽  
Motor Tasks ◽  
Retest Reliability ◽  
Medical Population ◽  
Test Retest Reliability ◽  
Grooved Pegboard Test

Abstract Objective The Grooved Pegboard Test (GPT) is among the most commonly used fine motor tasks, though there is limited data on its basic psychometric properties in children and adolescents with medical conditions. The purpose of this study was to establish test reliability for the GPT within this group. Method Participants (N = 44; 22 males, 22 females) were children and adolescents clinically referred for neuropsychological evaluation. Diagnoses included epilepsy (n = 24), cardiac conditions (n = 13), other (n = 5). Each completed the GPT twice: once in the morning and once in the afternoon, ranging from 64-390 minutes apart (x-=263 min., SD = 60 min.). Spearman correlations assessed test–retest reliability for speed of completion for both dominant (DH) and non-dominant hands (NDH) trials and number of peg drops. Paired sample t-test assessed for practice effects between administrations. Results Ages ranged between 6.11 to 18.10 years (x-=12.52 yrs., SD = 3.19 yrs.). GPT raw scores for first presentation ranged from 25-296 seconds (DH x-=80.91, SD = 25.1; NDH x-=95.34, SD = 49.42). The GPT showed high test–retest reliability for DH (ρ = 0.80, p < 0.001) and NDH (ρ = 0.83, p < 0.001). Number of drops showed non-significant correlations across trials (DH ρ = −0.03, p = 0.87; NDH ρ = 0.11, p = 0.49). Practice effects were identified for the DH (t = −3.25, p = 0.002) but not NDH (t = −1.83, p = 0.074). Conclusion Strong test–retest reliability of the GPT speed of completion in this population supports stability of test results over time, though practice effects are seen at short intervals. Number of pegs dropped, however, lacks sufficient retest reliability and may be of lesser clinical utility. Overall, this study provides increased confidence for continued use of the GPT.

scholarly journals The Dutch Technical-Tactical Tennis Test (D4T) for Talent Identification and Development: Psychometric Characteristics

2017 ◽  
Vol 55 (1) ◽  
pp. 127-138 ◽  
Author(s):  
Nikki Kolman ◽  
Barbara Huijgen ◽  
Tamara Kramer ◽  
Marije Elferink-Gemser ◽  
Chris Visscher
Keyword(s):  
Intraclass Correlation ◽  
Test Session ◽  
Psychometric Characteristics ◽  
Talent Identification ◽  
Ranking List ◽  
Retest Reliability ◽  
Tennis Players ◽  
P 75 ◽  
Ball Velocity ◽  
Test Retest Reliability

AbstractThis study examined the test-retest reliability, validity and feasibility of the newly developed Dutch Technical-Tactical Tennis Test (D4T). This new test is relevant for talent identification and development in tennis. Thirty-two youth male tennis players (age 13.4 ± 0.5) were classified as elite (n = 15) or sub-elite (n = 17) according to their position on the national youth ranking list under 15 years (cut-off rank 50) in the Netherlands. Games, rallies and different tactical situations (i.e. offensive, neutral and defensive) were simulated with a ball machine. Players had to return 72 balls to predetermined target areas. Stroke quality was recorded based on ball velocity and accuracy (VA-index), as well as percentage errors. Test-retest reliability was assessed by comparing differences between the first and second test-session (n = 10). An intraclass-correlation coefficient of .78 for the VA-index was found (p < .05), indicating excellent test-retest reliability. Independent t-tests revealed that elite players outscored sub-elite players for the VA-index, ball velocity, accuracy and percentage errors (p < .05), supporting good validity. Furthermore, a high correlation was found between the VA-index and individual positions on the youth ranking list (p = -.75; p < .001). The assessment of feasibility indicated that the D4T was applicable for instructors and coaches. In conclusion, the D4T was shown to be a reliable, valid and feasible test to measure technical-tactical characteristics of tennis performance in youth players.

Longitudinal Study of Reading Scores of the Stanford Achievement Test

1982 ◽  
Vol 54 (2) ◽  
pp. 369-370 ◽  
Author(s):  
David E. Suddick ◽  
Charles L. Bowen
Keyword(s):  
Longitudinal Study ◽  
Achievement Test ◽  
Reading Scores ◽  
Retest Reliability ◽  
Stanford Achievement Test ◽  
Test Retest Reliability ◽  
Reliability Coefficients

A 2. 5-yr. longitudinal study of the reading scales of the Stanford Achievement Test confirmed the redundancy in its subtests. Strong and stable test-retest reliability coefficients were evident and supported the use of the Stanford total reading scale for longitudinal evaluations.

scholarly journals Measuring Food-Related Attentional Bias

2021 ◽  
Vol 12 ◽  
Author(s):  
Stefania Franja ◽  
Anna E. McCrae ◽  
Tina Jahnel ◽  
Ashley N. Gearhardt ◽  
Stuart G. Ferguson
Keyword(s):  
Reaction Time ◽  
Attentional Bias ◽  
Reaction Times ◽  
Test Reliability ◽  
Future Research ◽  
Retest Reliability ◽  
Probe Task ◽  
Visual Probe ◽  
The Stability ◽  
Test Retest Reliability

Objective: Food-related attentional bias has been defined as the tendency to give preferential attention to food-related stimuli. Attentional bias is of interest as studies have found that increased attentional bias is associated with obesity; others, however, have not. A possible reason for mixed results may be that there is no agreed upon measure of attentional bias: studies differ in both measurement and scoring of attentional bias. Additionally, little is known about the stability of attentional bias over time. The present study aims to compare attentional bias measures generated from commonly used attentional bias tasks and scoring protocols, and to test re-test reliability.Methods: As part of a larger study, 69 participants (67% female) completed two food-related visual probe tasks at baseline: lexical (words as stimuli), and pictorial (pictures as stimuli). Reaction time bias scores (attentional bias scores) for each task were calculated in three different ways: by subtracting the reaction times for the trials where probes replaced (1) neutral stimuli from the trials where the probes replaced all food stimuli, (2) neutral stimuli from the trials where probes replaced high caloric food stimuli, and (3) neutral stimuli from low caloric food stimuli. This resulted in three separate attentional bias scores for each task. These reaction time results were then correlated. The pictorial visual probe task was administered a second time 14-days later to assess test-retest reliability.Results: Regardless of the scoring use, lexical attentional bias scores were minimal, suggesting minimal attentional bias. Pictorial task attentional bias scores were larger, suggesting greater attentional bias. The correlation between the various scores was relatively small (r = 0.13–0.20). Similarly, test-retest reliability for the pictorial task was poor regardless of how the test was scored (r = 0.20–0.41).Conclusion: These results suggest that at least some of the variation in findings across attentional bias studies could be due to differences in the way that attentional bias is measured. Future research may benefit from either combining eye-tracking measurements in addition to reaction times.

Testing the Reliability of Neighborhood-Specific Measures of Physical Activity Among Canadian Adults

2009 ◽  
Vol 6 (3) ◽  
pp. 367-373 ◽  
Author(s):  
Gavin R. McCormack ◽  
Alan Shiell ◽  
Patricia K. Doyle-Baker ◽  
Christine Friedenreich ◽  
Bev Sandalack ◽  
...  
Keyword(s):  
Physical Activity ◽  
Test Reliability ◽  
Moderate Intensity ◽  
Activity Levels ◽  
Retest Reliability ◽  
Walk Ability ◽  
Intensity Physical Activity ◽  
Recreational Walking ◽  
Vigorous Intensity ◽  
Test Retest Reliability

Background:Capturing neighborhood-specific physical activity is necessary to advance understanding of the relations between neighborhood walkability and physical activity. This study examined the test–retest reliability of previously developed items (from the Neighborhood Physical Activity Questionnaire) for capturing setting-specific physical activity among Canadian adults.Methods:Randomly sampled adults (N = 117) participated in 2 telephone interviews 2 to 5 days apart. Respondents were asked a series of items capturing frequency and duration of transportation-related walking, recreational walking, and moderate- and vigorous-intensity physical activity undertaken inside and outside the neighborhood in a usual week. The test–test reliability of reported physical activity levels were then examined using intraclass and Spearman’s rank correlations, kappa coefficients, and overall agreement.Results:Participation, frequency, and the duration of transportation-related and recreational walking and vigorous-intensity physical activity inside and outside the neighborhood showed moderate to excellent test–retest reliability. Moderate reliability was found for moderate-intensity physical activity undertaken inside (k = .48; ICC frequency = .38; ICC duration = .39) and outside (k = .51; ICC frequency = .79; ICC duration = .31) the neighborhood.Conclusions:Neighborhood-specific physical activity items administered by telephone interview are reliable and are therefore appropriate for use in future studies examining neighborhood walk-ability and physical activity.

scholarly journals Reliability and repeatability of a smartphone-based 6-min walk test as a patient-centred outcome measure

2021 ◽  
Author(s):  
Jonathan Mak ◽  
Neil Rens ◽  
Dasha Savage ◽  
Helle Nielsen-Bowles ◽  
Doran Triggs ◽  
...  
Keyword(s):  
Cardiovascular Disease ◽  
High Reliability ◽  
Ground Truth ◽  
Test Reliability ◽  
Reliability Test ◽  
Walk Test ◽  
Retest Reliability ◽  
Implementation Challenges ◽  
Test Retest Reliability ◽  
At Home

Abstract Aims  The 6-min-walk test (6MWT) is a validated proxy for frailty and a predictor of clinical outcomes, yet is not widely used due to implementation challenges. This comparative effectiveness study assesses the reliability and repeatability of a home-based 6MWT compared to in-clinic 6MWTs in patients with cardiovascular disease. Methods and results  One hundred and ten (110) patients scheduled for cardiac or vascular surgery were enrolled during a study period from June 2018 to December 2019 at the Palo Alto VA Hospital. Subjects were provided with an Apple iPhone 7 and Apple Watch Series 3 loaded with the VascTrac research study application and performed a supervised in-clinic 6MWT during enrolment, at 2 weeks, 1, 3, and 6 months post-operatively. Subjects also received notifications to perform at-home smartphone-based 6MWTs once a week for a duration of 6 months. Test–retest reliability of in-clinic measurements and at-home measurements was assessed with an industry standard Cronbach’s alpha reliability test. Test–retest reliability for in-clinic ground truth 6MWT steps vs. in-clinic iPhone 6MWT steps was 0·99, showing high reliability between the two tested measurements. When comparing for in-clinic ground truth 6MWT steps vs. neighbouring at-home iPhone 6MWT steps, reliability was 0·74. Conclusion  Running the test–reliability test on both measurements shows that an iPhone 6MWT test is reliable compared to an in-clinic ground truth measurement in patients with cardiovascular disease.

Validity and reliability of smartphone-based pelvic rotation evaluations of children with cerebral palsy while sitting, standing, and standing on one leg

2021 ◽  
pp. 1-5
Author(s):  
Do Hyun Kim
Keyword(s):  
Cerebral Palsy ◽  
Linear Regression ◽  
Intraclass Correlation ◽  
Smartphone Application ◽  
Simple Linear Regression ◽  
Validity And Reliability ◽  
Retest Reliability ◽  
Pelvic Rotation ◽  
Children With Cerebral Palsy ◽  
Test Retest Reliability

PURPOSE: We explored the test-retest reliability of pelvic rotation measured using a smartphone and established criterion-related validity by analyzing simple linear regression between pelvic rotation data obtained using the smartphone and those measured by a palpation meter. METHODS: We recruited 12 children with cerebral palsy (CP) (7 boys and 5 girls) and measured pelvic rotation using a smartphone application and a palpation meter in the sitting, standing, and one-leg standing positions. Test-retest reliability was evaluated by calculating intraclass correlation coefficients (ICCs); simple linear regression was analyzed to explore the relationships between smartphone and palpation meter data. RESULTS: In terms of the test-retest reliability of pelvic rotation measured by the smartphone, the ICCs ranged from 0.85 to 0.95. A positive linear correlation was found between smartphone and palpation meter data. CONCLUSIONS: We confirmed that measurement of pelvic rotation using a smartphone was reliable when children with CP were in the sitting, standing, and one-leg standing positions. In addition, pelvic rotation measured using the smartphone correlated significantly with that measured using a palpation meter.

Sign in / Sign up

Export Citation Format

Share Document