scholarly journals A-38 A Different Approach for Examining Gender Differences on Computerized Neurocognitive Testing: Percentile Ranks Versus Composite Scores

2020 ◽  
Vol 35 (5) ◽  
pp. 634-634
Author(s):  
P Schatz ◽  
K Slicer ◽  
R J Elbin
Keyword(s):  
Gender Differences ◽  
Reaction Time ◽  
Verbal Memory ◽  
Visual Memory ◽  
Motor Speed ◽  
Age And Gender ◽  
Visual Motor ◽  
Gender Based ◽  
And Gender ◽  
Composite Scores

Abstract Objective ImPACT is a popular tool used to assess neurocognitive function after concussion. Age- and gender-based percentile ranks are provided as part of the ImPACT clinical report, but only raw composite scores are provided for research. Percentile ranks may provide an alternate look at gender differences on neurocognitive testing. We sought to compare the use of percentile ranks versus composite scores when comparing neurocognitive performance between male and females. Method Pre-season baseline data from 3,238 collegiate athletes were exported from a larger multi-site database, 1,714 male (53%) and 1,524 female (47%), ages 18–22 (Mean = 19.3, SD = 1.2). ImPACT composite scores were extracted (Verbal Memory, Visual Memory, Visual Motor Speed, Reaction Time) and Percentile Ranks were calculated using age- and gender-based reference tables in the ImPACT 2017–2012 Technical Manual. One-way analyses of variance (ANOVA) were conducted with gender as the IV and the four composite scores and their associated percentile ranks as the DVs. Bonferroni correction for 8 comparisons set the alpha level to p < .006. Results ANOVAs revealed a significant effect of gender on ImPACT Verbal Memory [F(1,3236) = 16.32, p < .001], Visual Memory [F(1,3236) = 66.06, p < .001], Visual Motor Speed [F(1,3236) = 15.61,p < .001] but not Reaction Time [F(1,3236) = 2.59, p = .11]. When using percentile ranks, ANOVAs revealed a significant effect of gender on only Visual Motor Speed [F(1,3236) = 31.07, p < .001], but not Verbal Memory [F(1,3236) = 2.43, p = .12], Visual Memory [F(1,3236) = 0.48, p = .49], or Reaction Time [F(1,3236) = 0.61, p = .44]. Conclusions Use of ImPACT Composite Scores in concussion research may exaggerate or inappropriately promote gender differences on computerized neurocognitive testing. Given that age- and gender-based normative data are available, use of percentile ranks is recommended.

scholarly journals A-28 Updated Baselines Show Improvement, Even When Athletes Sustain A Concussion Between Assessments

2020 ◽  
Vol 35 (5) ◽  
pp. 624-624
Author(s):  
S O'Connor ◽  
T Dean ◽  
P Schatz
Keyword(s):  
Verbal Memory ◽  
Visual Memory ◽  
Motor Speed ◽  
Change Scores ◽  
Visual Motor ◽  
Gender Based ◽  
And Gender ◽  
Percentile Scores ◽  
Composite Scores

Abstract Objective To explore change across repeated baseline assessments using raw scores and percentile scores, for athletes sustaining and not sustaining a concussion between baselines. Method Athletes (12–23 years) completed two valid, baseline neurocognitive test sessions using ImPACT. Participants were divided into independent groups based on having sustained a concussion between annual baselines (CONCUSSION; N = 269) or no concussion (NO CONCUSSION; N = 270) between baselines. Raw change scores were calculated between the first and follow-up baseline for both groups by subtracting the first baseline score from the updated baseline score on the four ImPACT composite scores. Age- and gender-based percentile scores were then applied for all participants, and percentile change scores were calculated in the same manner. Raw change scores and percentile change scores between groups were compared using 4 ANOVAs with a Bonferroni-corrected p-value of (p < .0125). Results Using raw scores ANOVAs revealed that athletes in the CONCUSSION group showed significantly greater improvement on follow-up testing than athletes in the NO CONCUSSION group on Verbal Memory (p < .001) and Visual Motor Speed (p = .001), but not on Visual Memory (p = .41) and Reaction Time (p = .04). Using percentile ranks, ANOVAs revealed significantly greater improvement in CONCUSSION group on Verbal Memory (p < .001), but not on Visual Memory (p = .34), Visual Motor Speed (p = .03), or Reaction Time (p = .014). Conclusions Athletes sustaining a concussion between annual baseline assessments show increases on Verbal Memory and Visual Motor Speed follow-up testing when using raw composite scores, but only on Verbal Memory when using age- and gender-based percentile ranks.

scholarly journals B-44 An Examination of Balance Measurements in Predicting Post-Concussion Neurocognitive Dysfunction

2019 ◽  
Vol 34 (6) ◽  
pp. 990-990
Author(s):  
A DaCosta ◽  
A Crane ◽  
M Fasciana ◽  
A LoGalbo
Keyword(s):  
Reaction Time ◽  
Verbal Memory ◽  
Visual Memory ◽  
Clinical Utility ◽  
Collegiate Athletes ◽  
Motor Speed ◽  
Balance Performance ◽  
Neurocognitive Dysfunction ◽  
Balance Deficits ◽  
Visual Motor

Abstract Objective Previous research indicates that athletes experiencing concussions demonstrate acute balance deficits (Guskiewicz, 2011). Although it is hypothesized that balance performance is related to neurocognitive function in athletes experiencing a concussion (Guskiewicz, Ross, & Marshall, 2001; Broglio, Sosnoff, Ferrara, 2009), limited research exists regarding the clinical utility of baseline measures. Method 68 collegiate athletes (ages 18-23; M = 19.62, SD = 1.44) were evaluated using the Balance error scoring system (BESS) and ImPACT at baseline and post-concussion. Multiple linear regressions were used to determine how BESS performance change across evaluations predicted post-concussion neurocognitive dysfunction compared to post-concussion performance alone. Results BESS performance changes from baseline to post-concussion significantly predicted post-concussion Verbal Memory (R² = .06, p = .05), Visual Memory (R² = .135, p = .002), Visual-Motor Speed (R² = .146, p = .001), Reaction Time (R² = .156, p = .001), and Total Symptom Scores (R² = .112, p = .005); while post-concussion BESS scores predicted Visual Memory (R² = .138, p = .002), Visual-Motor Speed (R² = .137, p = .002), and Reaction Time (R² = .145, p = .001). Therefore, assessing change in BESS performance is a more comprehensive predictor of neurocognitive dysfunction than solely post-concussion BESS performance. Conclusions Changes in BESS performance from baseline to post-concussion was found to be a more comprehensive predictor of neurocognitive dysfunction than post-concussion BESS scores alone. Therefore, our results support the clinical utility of evaluating balance at pre-participation to better understand neurocognitive risk factors.

scholarly journals THE RELATIONSHIP BETWEEN ACUTE MOOD, SLEEP, AND SEX ON NEUROCOGNITIVE PERFORMANCE POST-CONCUSSION IN ADOLESCENTS

2020 ◽  
Vol 8 (4_suppl3) ◽  
pp. 2325967120S0019
Author(s):  
Sara Stremlau ◽  
Richard Cameron Allred ◽  
Richard Gerkin ◽  
Steven Erickson ◽  
Jamie Pardini
Keyword(s):  
Reaction Time ◽  
Verbal Memory ◽  
Visual Memory ◽  
Cognitive Testing ◽  
Motor Speed ◽  
Neurocognitive Performance ◽  
Symptom Report ◽  
Mood Symptoms ◽  
Visual Motor ◽  
And Performance

Background: Both sleep disturbance and mood changes are common symptoms post-concussion (Sell & Rubeor, 2017). Studies have found these symptoms are correlated with poorer performance on neurocognitive testing (Kontos et al., 2012 and Kostyun et al., 2015). In addition, Brown et al., (2015) showed that females report more symptoms at both baseline and post-concussion compared to males on the Post-Concussion Scale and the Sport Concussion Assessment Tool 2. Hypothesis/Purpose: The purpose of this study is to investigate how a patient’s sex, as well as self-reported acute mood and sleep symptoms are related to neurocognitive performance in individuals with concussion. Methods: Data were acquired through IRB-approved retrospective chart review. Composite scores from the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) computerized evaluation and self-reported symptom scores on the Post-Concussion Symptom Scale were gathered for 1619 adolescents age 12-18 (49.3% female) who presented to a large metropolitan outpatient clinic for treatment of concussion. Results: Females endorsed higher overall symptoms (x=19.52, SD 19.37, median 13.0 for females; x=12.88, SD 15.89, median 7.0 for males; Mann-Whitney U Test p<0.001). This same pattern emerged for the mood and sleep symptom clusters (female mood mean=2.92, SD 4.51; male mood mean=1.64, SD 3.34; female sleep mean=1.59, SD 2.0; male sleep mean=1.11, SD 1.84; both Independent Samples Mann-Whitney U Tests ps<0.001). There were significant but modest negative correlations between mood symptoms and performance on verbal memory (r=-0.174), visual memory (r=-0.213), and visual motor speed (r=-0.146) composites (all ps<0.01). There was positive correlation between reaction time composite and mood symptoms (r=0.191). There were significant but modest negative correlations between sleep symptoms and performance on verbal memory (r=-0.171), visual memory (r=-0.184), and visual motor speed (r=-0.161) composites (all ps<0.01). There was a positive correlation between reaction time composite and sleep symptoms (r=0.196, p<0.01). Conclusion: Consistent with prior research, adolescent females reported more symptoms post-concussion, including total symptom score, mood symptoms, and sleep symptoms. Adolescents presenting with more mood and sleep symptoms demonstrated poorer performance on neurocognitive testing. However, given the modest nature of the correlation, a significant amount of variation in test performance is not explained by symptom report. Results from this study underscore the importance of a multidimensional concussion assessment that includes both symptom report and cognitive testing when working with pediatric athletes. This study also reinforces the importance of understanding potential effects of sleep, mood, and sex on concussion.

scholarly journals A Cohort Study of the Temporal Stability of ImPACT Scores Among NCAA Division I Collegiate Athletes: Clinical Implications of Test–Retest Reliability for Enhancing Student Athlete Safety

2020 ◽  
Vol 35 (7) ◽  
pp. 1131-1144
Author(s):  
Sara J Mason ◽  
Bradley S Davidson ◽  
Marybeth Lehto ◽  
Aurélie Ledreux ◽  
Ann-Charlotte Granholm ◽  
...  
Keyword(s):  
Reaction Time ◽  
Ncaa Division I ◽  
Verbal Memory ◽  
Temporal Stability ◽  
Division I ◽  
Cognitive Test ◽  
Motor Speed ◽  
Visual Motor ◽  
Composite Scores ◽  
The Impact

Abstract Objective In this study we examined the temporal stability of the Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) within NCAA Division I athletes across various timepoints using an exhaustive series of statistical models. Methods Within a cohort design, 48 athletes completed repeated baseline ImPACT assessments at various timepoints. Intraclass correlation coefficients (ICC) were calculated using a two-way mixed effects model with absolute agreement. Results Four ImPACT composite scores (Verbal Memory, Visual Memory, Visual Motor Speed, and Reaction Time) demonstrated moderate reliability (ICC = 0.51–0.66) across the span of a typical Division I athlete’s career, which is below previous reliability recommendations (0.90) for measures used in individual decision-making. No evidence of fixed bias was detected within Verbal Memory, Visual Motor Speed, or Reaction Time composite scores, and minimal detectable change values exceeded the limits of agreement. Conclusions The demonstrated temporal stability of the ImPACT falls below the published recommendations, and as such, fails to provide robust support for the NCAA’s recommendation to obtain a single preparticipation cognitive baseline for use in sports-related concussion management throughout an athlete’s career. Clinical interpretation guidelines are provided for clinicians who utilize baseline ImPACT scores for later performance comparisons.

scholarly journals Test-Retest Reliability of ImPACT Across a Two-Year Interval in Collegiate Athletes

2019 ◽  
Vol 34 (5) ◽  
pp. 778-778
Author(s):  
C Burley ◽  
A Datoc ◽  
R Bennett ◽  
L Lashley
Keyword(s):  
Verbal Memory ◽  
Visual Memory ◽  
Intraclass Correlation ◽  
Collegiate Athletes ◽  
Motor Speed ◽  
Retest Reliability ◽  
Symptom Scores ◽  
Visual Motor ◽  
Composite Scores ◽  
Test Retest Reliability

Abstract Purpose To examine the two-year test-retest reliability of Immediate Post-concussion Assessment and Cognitive Testing (ImPACT) in a sample of collegiate athletes. Methods A total of 163 college athletes (63.8% female) completed two pre-season baseline assessments two years apart as mandated by their athletic programs. Participants completed the first baseline prior to their first year of competition (M age=18.38, M edu=12.13). Individuals with baselines flagged as invalid by ImPACT were excluded. No diagnosed concussions occurred between baseline assessments. Results Pearson r correlations for ImPACT composite scores between assessments ranged from .32 to .70. Paired samples t-tests indicated significant differences between verbal memory (t(162)=-4.61, p<.001, MD=-3.6) and visual-motor speed (t(162)=-4.10, p<.001, MD=-1.5) at time 1 and time 2. Intraclass correlation coefficients (ICCs) with a “two-way mixed” model and “consistency” type indicated higher reliability for all composite scores. Visual-motor speed (mean ICC=.83; .76–.87 95% confidence interval [CI]) was the most reliable composite score, followed by visual memory (.66; 95% CI .53-.75), impulse control (.62; 95% CI .48–.72), verbal memory (.58; 95% CI .43–.69), and reaction time (.49; 95% CI .30-.62). The total symptom score showed moderate reliability (.63; 95% CI .50–.73). Conclusion Overall, ImPACT composite and total symptom scores appear to maintain relative long-term stability in a collegiate sample across a two-year period. ImPACT composite scores showed moderate to good reliability, and total symptom scores showed moderate reliability. Results of this study corroborate previous research indicating moderately stable ImPACT scores across a 2-year test-retest period in collegiate athletes (Schatz, 2010).

Signs of cognitive dysfunction in adult players of club level rugby

2019 ◽  
Vol 50 (1) ◽  
pp. 128-140 ◽  
Author(s):  
Diana Zoccola ◽  
Ann B Shuttleworth-Edwards ◽  
Sarah E Radloff
Keyword(s):  
Reaction Time ◽  
Cognitive Dysfunction ◽  
Verbal Memory ◽  
Visual Memory ◽  
Rugby Union ◽  
Motor Speed ◽  
Visual Motor ◽  
The Impact ◽  
Rugby Players

The objective of this study was to investigate players of club level Rugby Union (hereafter rugby) over one rugby season, for signs of residual cognitive dysfunction due to repeated concussive events incurred during long-term participation in the sport. Adult male players of club level rugby, without a diagnosis of a concussion during the season ( n = 20), were compared with non-contact club level sports participants ( n = 22) of equivalent sex, age, education, and estimated IQ at pre-, mid-, and post-season intervals. Measures included the ImPACT Verbal Memory, Visual Memory, Visual Motor Speed and Reaction Time composites, and the Purdue Pegboard test. Statistical group comparisons revealed consistently poorer performance for rugby players compared with controls for ImPACT Visual Motor Speed and Reaction Time composites at all test intervals, and for the Purdue Pegboard tasks at the first two test intervals. Repeat measures comparisons across the three test intervals demonstrated differential learning patterns between groups on ImPACT Visual Memory, ImPACT Reaction Time, and Purdue Both tasks, suggestive of cognitive vulnerability in the rugby group. Overall, the results reveal deleterious cognitive performance in adult club level rugby players relative to equivalent non-contact sports controls. The finding serves to endorse indications from other studies that demonstrate persistent brain injury effects in association with long-term participation in a contact sport. Recommendations for further research and management of concussion in rugby players are discussed.

The Effect of Test Setting Upon Test-Retest Reliability of ImPACT Baseline Tests in High School Athletes

Neurology ◽  
2021 ◽  
Vol 98 (1 Supplement 1) ◽  
pp. S23.2-S23
Author(s):  
Mark Thomas William Roberts ◽  
Jonathan Danield Lichtenstein
Keyword(s):  
High School ◽  
Reaction Time ◽  
Verbal Memory ◽  
Visual Memory ◽  
Motor Speed ◽  
High School Athletes ◽  
Retest Reliability ◽  
Concussion Management ◽  
Visual Motor ◽  
Test Retest Reliability

ObjectiveTo determine the test-retest reliability of ImPACT baseline tests across different schools within the same larger concussion management program.BackgroundImPACT is the most widely used concussion management cognitive testing tool. Baseline testing is often required for high school sports participation. Typically, testing occurs every 2 years based on test-retest reliability statistics in previous studies. Demographic and environmental factors, such as age, sex, number of participants, and supervision, all impact baseline performance. Studies to date have not examined test-retest differences across testing sites, such as between school differences.Design/MethodsCross-sectional retrospective design. Valid baseline tests from high school athletes over a 2-year interval were included. Participants who experienced concussions prior to or between tests were excluded. A total of 979 student athletes from 5 schools were included. The Intra-class correlations were determined over a 2-year period for each ImPACT composite score and school.ResultsICC estimates averaged between schools reflected good reliability for visual-motor speed (0.833), visual memory (0.673) and reaction time (0.615) over the two-year period. Verbal memory (0.586) and impulse control (0.556) were less reliable. Between schools a greater range of composite reliability was observed for reaction time (0.484–0.730) and impulse control (0.461–0.655) compared to verbal memory (0.534–0.637), visual memory (0.61–0.719), and visual-motor speed (0.769–914).ConclusionsAs previously established, reliability of ImPACT baselines vary by composite. This study revealed that reliability also varies by setting, as different schools yielded different ICCs. Consistent with the literature, the most reliable measure was visual-motor speed. The greatest difference in reliability between schools was for reaction time. These results suggest that test setting and environment affect reliability of ImPACT baseline scores, with varying effects per composite. Attention must be paid to environmental setting to improve reliability of baseline cognitive test performance to maximize athlete safety.

A-120 Comparison of Baseline and Post-Concussion ImPACT Performance in Spanish-English Bilingual and English Monolingual Athletes

2021 ◽  
Vol 36 (6) ◽  
pp. 1170-1170
Author(s):  
Erick Rogers ◽  
Hana Kuwabara ◽  
Grace Goodwin ◽  
Sara Moore ◽  
Nia Hopkins ◽  
...  
Keyword(s):  
Reaction Time ◽  
Visual Memory ◽  
Cognitive Testing ◽  
English Speakers ◽  
Future Research ◽  
Motor Speed ◽  
Linear Modeling ◽  
Impact Performance ◽  
Sport Type ◽  
Visual Motor

Abstract Objective Research comparing English and Spanish administrations of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) have consistently found differences in performance on various cognitive composites. Few studies have examined the effect of bilingualism on baseline and post-concussion assessments. This study examined whether monolingual English-speakers (MO) and bilingual Spanish/English speakers (BI) differed in cognitive performance at baseline (BL) and post-concussion (PC). Methods Participants were selected from a larger database of high school athletes administered ImPACT in English at BL and PC. Participants included 86 BI athletes (Mage = 14.53; 65.10% male) and 86 MO athletes matched on age, gender, sport type, and probable concussion as defined by number of PC follow-up assessments (PCF; 0 vs. ≥1). To examine group differences and changes over time in cognitive composites, a general linear modeling approach was used with language and PCF as between-subjects factors and time as a within-subjects factor. Results There was a significant Language x Time x PCF interaction for Visual Memory (VM), Visual Motor Speed (VMS), and Reaction Time (RT). On VM and RT, MO with multiple PCF performed the worst at PC, while MO with 0 PCF performed the best at PC. On VMS, BI with 0 PCF performed the worst at BL. Conclusion Visual memory and reaction time were less affected in bilingual compared to monolingual athletes with probable concussion. However, at baseline, bilingual athletes had slower visual motor speed compared to monolingual athletes. Future research should focus on how bilingualism may serve as both a protective and risk factor for cognitive functioning after probable concussion.

scholarly journals Addressing the ``Replication Crisis'' in Sports Neuropsychology: Validation of the Two-Factor Theory of ImPACT

2019 ◽  
Vol 34 (5) ◽  
pp. 758-758 ◽  
Author(s):  
P Schatz ◽  
K Bogar ◽  
R J Elbin
Keyword(s):  
High School ◽  
Reaction Time ◽  
Factor Structure ◽  
Verbal Memory ◽  
Visual Memory ◽  
Impact Testing ◽  
Memory Factor ◽  
Speed Factor ◽  
Replication Crisis ◽  
Visual Motor

Abstract Purpose The "replication crisis" in psychology and across the broader field of social sciences raises criticism due to a lack of data to show that esoteric research findings can be replicated. The present study replicated and validated the two-factor “memory” and “speed” structure of ImPACT (Schatz & Maerlender, 2013). Methods High school aged athletes (N=18,918, Mean age=15.4, SD=1.2) who completed pre-season baseline ImPACT testing were randomly assigned to one of 5 independent samples of approximately 3,780 athletes. Exploratory factor analyses (FA) for a two-factor solution were conducted with ImPACT composite scores within each of the five groups. Post-Concussion Symptom Scale (PCSS) scores were included, with the expectation they would load on a third, unique factor. Results All five samples met assumptions for FA (KMO Measure of Sampling Adequacy above .600), and all five analyses yielded the same “memory” and “speed” two-factor structure. Visual Motor Speed and Reaction Time loaded on the first "Speed" factor and Verbal and Visual Memory loaded on a second "Memory" factor. The PCSS scores loaded on a third, unique “symptom” factor. Conclusion Replication of the two-factor structure for ImPACT in a five large high school sample further validates the model. Given that both visual and verbal memory involve encoding of information presented visually, use of a “memory” factor may improve interpretation of ImPACT scores. Similarly, similarities between constructs measuring speed of responding (Reaction Time) and speed of processing (Visual Motor Processing Speed) may be best explained using a “speed” factor.

scholarly journals The Relation Between Cognitive Performance and Symptom Factors Following Concussion

2019 ◽  
Vol 34 (5) ◽  
pp. 764-764
Author(s):  
E Whitley ◽  
R Gerkin ◽  
A Kontos ◽  
C Quintana ◽  
B Nalepa ◽  
...  
Keyword(s):  
Cognitive Performance ◽  
Verbal Memory ◽  
Visual Memory ◽  
Injury Severity ◽  
Clinical Importance ◽  
Retrospective Chart Review ◽  
Symptom Assessment ◽  
Cognitive Outcomes ◽  
Motor Speed ◽  
And Gender

Abstract Purpose The purpose of this study was to explore if symptom factors are related to cognitive outcomes. Prior studies have examined the relationship of individual symptoms to cognition. However, the relation between empirically-derived symptom factors and cognitive outcomes has yet to be explored. Methods Data were extracted via retrospective chart review of 691 patients (aged 10–24, mean: 14.99±2.63). Participants completed ImPACT and the PCSS within 14 days of injury (mean: 9.27±3.37). Predictors were PCSS factor scores of Cognitive-Fatigue-Migraine (CFM), Affective (AFF), Somatic (SOM), and Sleep (SLP) (Kontos et al., 2012). Outcomes examined were ImPACT composite scores. Univariate analyses were performed and values with p < 0.10 were entered into stepwise linear regression (LR) models. Retained predictors in each LR model had p values <.05. Results Verbal memory was predicted by CFM, SOM, age, and gender. Visual memory was predicted by CFM and SOM. Visual motor speed was predicted by age, gender, CFM, SOM, and AFF. Reaction time was best predicted by SOM, CFM, and age. The variance explained was fairly small (0.08 to 0.21). SLP was not a significant predictor in any LR. Conclusion CFM and SOM factors were most predictive of lower cognitive performance, similar to prior studies linking dizziness to longer recovery and post-traumatic migraine to worse cognitive performance. These findings underscore the clinical importance of diverse symptom assessment and injury education. Higher CFM and SOM scores may also serve as proxy for injury severity, which we would expect to be associated with worse cognitive performance.

Sign in / Sign up

Export Citation Format

Share Document