Diagnostic accuracy and reliability of sideline concussion evaluation: a prospective, case-controlled study in college athletes comparing newer tools and established tests

2021 ◽  
pp. bjsports-2020-103840
Author(s):  
Kimberly G Harmon ◽  
Bridget M Whelan ◽  
Douglas F Aukerman ◽  
Adam D Bohr ◽  
J Matthew Nerrie ◽  
...  
Keyword(s):  
Diagnostic Accuracy ◽  
Symptom Score ◽  
Smooth Pursuit ◽  
Symptom Severity ◽  
College Athletes ◽  
Controlled Study ◽  
Symptom Scale ◽  
Retest Reliability ◽  
Point Increase ◽  
Test Retest Reliability

ObjectiveTo assess diagnostic accuracy and reliability of sideline concussion tests in college athletes.MethodsAthletes completed baseline concussion tests including Post-Concussion Symptom Scale, Standardised Assessment of Concussion (SAC), modified Balance Error Scoring System (m-BESS), King-Devick test and EYE-SYNC Smooth Pursuits. Testing was repeated in athletes diagnosed acutely with concussion and compared to a matched teammate without concussion.ResultsData were collected on 41 concussed athletes and 41 matched controls. Test–retest reliability for symptom score and symptom severity assessed using control athletes was 0.09 (−0.70 to 0.88) and 0.08 (−1.00 to 1.00) (unweighted kappa). Intraclass correlations were SAC 0.33 (−0.02 to 0.61), m-BESS 0.33 (−0.2 to 0.60), EYE-SYNC Smooth Pursuit tangential variability 0.70 (0.50 to 0.83), radial variability 0.47 (0.19 to 0.69) and King-Devick test 0.71 (0.49 to 0.84). The maximum identified sensitivity/specificity of each test for predicting clinical concussion diagnosis was: symptom score 81%/94% (3-point increase), symptom severity score 91%/81% (3-point increase), SAC 44%/72% (2-point decline), m-BESS 40%/92% (5-point increase), King-Devick 85%/76% (any increase in time) and EYE-SYNC Smooth Pursuit tangential variability 48%/58% and radial variability 52%/61% (any increase). Adjusted area under the curve was: symptom score 0.95 (0.89, 0.99), symptom severity 0.95 (95% CI 0.88 to 0.99), SAC 0.66 (95% CI 0.54 to 0.79), m-BESS 0.71 (0.60, 0.83), King-Devick 0.78 (0.69, 0.87), radial variability 0.47 (0.34, 0.59), tangential variability 0.41 (0.30, 0.54)ConclusionTest–retest reliability of most sideline concussion tests was poor in uninjured athletes, raising concern about the accuracy of these tests to detect new concussion. Symptom score/severity had the greatest sensitivity and specificity, and of the objective tests, the King-Devick test performed best.

scholarly journals AB0882 RELIABILITY OF THE 3-M BACKWARDS WALK TEST IN PATIENTS WITH REVISION TOTAL KNEE ARTHROPLASTY

2020 ◽  
Vol 79 (Suppl 1) ◽  
pp. 1746.2-1746
Author(s):  
B. Unver ◽  
K. Sevik ◽  
V. Karatosun
Keyword(s):  
Total Knee Arthroplasty ◽  
Diagnostic Accuracy ◽  
Knee Arthroplasty ◽  
Fall Risk ◽  
Dynamic Balance ◽  
Fracture Dislocation ◽  
Walk Test ◽  
Retest Reliability ◽  
Total Knee ◽  
Test Retest Reliability

Background:Total knee arthroplasty (TKA) is an effective treatment for patients suffering from end-stage osteoarthritis with 10- to 15-year implant survivorship rates exceeding 90%. Infection, osteolysis due to polyethylene wear, loosening, stiffness and instability may cause to implant failure and revision of the TKA (rTKA). However, up to 20% of patients continue to have postoperative pain, functional limitations and low treatment satisfaction and 24% of patients were not able to walk unaided with no limp or a slight limp after TKA [1].Falls and related traumas can produce “fracture, dislocation, crushing, and other injuries” [2]. Falls often occur due to impaired physical function which includes changes in lower knee joint angle, weakened lower limb muscles, peripheral nerve blockade, deformity of the foot limited balance and gait.Several measures of fall risk have been previously developed however, recent research has demonstrated that backwards walking is more sensitive at identifying changes in mobility and balance compared to forward walking. Backwards walking is necessary to perform such tasks as backing up to a chair, opening up a door or getting out of the way of a sudden obstacle.3-M Backwards Walk Test (3MBWT) is used to evaluate walking skills, fall risk and dynamic balance. The 3MBWT demonstrated similar or better diagnostic accuracy for falls in the past year than the most commonly used measures and found to be reliable in healthy subjects. [3] However, its reliability in rTKA has not been investigated.Objectives:The purposes of this study were to determine the test-retest reliability and the minimal clinically important difference (MCID) of the 3MBWT in patients with rTKAMethods:Twenty-two patients with rTKA, operated on by the same surgeon, were included. For the 3MBWT, a distance of 3 meters was marked with tape and participants were asked to align their heels with the black tape. They were instructed to walk backwards as quickly. Patients performed trials for 3MBWT twice on the same day. Between the trials, patients waited for an hour on sitting position to prevent fatigue.Results:The 3MBWT showed an excellent test-retest reliability. Intraclass correlation coefficient ICC for 3MBWT was 0.97. The standard error of measurement and MCID at the 95% confidence level for 3MBWT were 1,08 and 2,99 respectively.Conclusion:The 3MBWT has an excellent test-retest reliability in patients with rTKA. It is an effective and reliable tool for measuring fall risk, dynamic balance and walking skills. As a clinical test, the 3MBWT is easy to score, has no cost, needs no special equipment and can be applied in a short time as part of the routine medical examination.References:[1]Shan L, Shan B, Suzuki A et al. Intermediate and long-term quality of life after total knee replacement: a systematic review and meta-analysis. JBJS 2015; 97: 156-168.[2]Johnson RL, Duncan CM, Ahn KS et al. Fall-Prevention Strategies and Patient Characteristics That Impact Fall Rates After Total Knee Arthroplasty. Anesthesia & Analgesia 2014; 119: 1113-1118.[3]Carter V, Jain T, James J et al. The 3-m Backwards Walk and Retrospective Falls: Diagnostic Accuracy of a Novel Clinical Measure. J Geriatr Phys Ther 2017.Disclosure of Interests:None declared

scholarly journals Evaluating the effectiveness of a single-day simulation-based program in psychiatry for medical students: a controlled study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Nadia Younes ◽  
Anne Laure Delaunay ◽  
M. Roger ◽  
Pierre Serra ◽  
France Hirot ◽  
...  
Keyword(s):  
Medical Students ◽  
Factor Structure ◽  
Internal Consistency ◽  
Controlled Study ◽  
Simulated Patients ◽  
Control Group ◽  
Retest Reliability ◽  
Knowledge And Attitudes ◽  
Simulation Group ◽  
Test Retest Reliability

Abstract Background Training in psychiatry requires specific knowledge, attitudes, and skills that are obtainable by simulation, of which the use is only recent and still needs further development. Evidence is accumulating on its effectiveness but requires further validation for medical students. We aimed to evaluate the effectiveness of a single-day optional teaching program in psychiatry by simulation for medical students and validate a scale measuring Confidence in Psychiatric Clinical Skills (CPCQ), as part of the assessment. Methods This was a controlled study in a French University that compared (using paired-sample Student t-tests) knowledge and attitudes (university grades and CPCQ scores) before, just after teaching with simulated patients, and 2 months later. Satisfaction with the program (including the quality of the debriefing) was also investigated. The CPCQ scale was validated by assessing the factor structure, internal consistency, and test-retest reliability. Finally, a comparison was run with a control group who received the usual psychiatric instruction using covariance analyses. Results Twenty-four medical students were included in the simulation group and 76 in the control group. Just after the simulation, knowledge and attitudes increased significantly in the simulation group. Satisfaction with the training and debriefing was very high. The CPCQ scale showed good psychometric properties: a single-factor structure, acceptable internal consistency (α = 0.73 [0.65–0.85]), and good test-retest reliability (ICC = 0.71 [0.35–0.88]). Two months after the simulation, knowledge and attitudes were significantly higher in the simulation group than the control group, despite a lack of difference in knowledge before the simulation. Conclusions Adding a simulation program in psychiatry to the usual teaching improved the knowledge and confidence of medical students. The CPCQ scale could be used for the evaluation of educational programs.

scholarly journals Measuring Symptoms of Psychopathology in Zambian Orphans and Vulnerable Children: Scale Validation and Psychometric Evaluation

Assessment ◽  
2018 ◽  
Vol 27 (6) ◽  
pp. 1335-1348 ◽  
Author(s):  
Sarah McIvor Murray ◽  
Paul Bolton ◽  
Jeremy C. Kane ◽  
Daniel P. Lakin ◽  
Stephanie Skavenski Van Wyk ◽  
...  
Keyword(s):  
Psychosocial Problems ◽  
Well Being ◽  
Self Report ◽  
Computer Assisted ◽  
Symptom Scale ◽  
Vulnerable Children ◽  
Internal Reliability ◽  
Retest Reliability ◽  
Orphans And Vulnerable Children ◽  
Test Retest Reliability

There is a paucity of validated mental health measures for assessing psychological well-being among HIV-affected youth. We sought to explore the psychometric properties and validity of the Achenbach Youth Self-Report and Child Posttraumatic Stress Disorder Symptom Scale among orphans and vulnerable children (OVC) living in Lusaka, Zambia. These scales were administered to 210 OVC aged 13 to 17 years via audio computer-assisted self-interview. Confirmatory factor analysis was used to assess scale structure, Cronbach’s alpha for internal consistency, and correlations between scales related to mental or psychosocial health for construct validity. A known-groups validation was conducted using local identifications of youth with and without significant psychosocial problems, and test–retest reliability was assessed. Scales exhibited good internal reliability (α > .80), adequate criterion validity (area under the curve > .70), and moderate test–retest reliability (.62-.68). Findings support the utility of these symptom scales for identifying OVC experiencing significant psychosocial problems in Zambia.

scholarly journals Comparison of two different optical coherence tomography angiography devices in detecting healthy versus glaucomatous eyes – an observational cross-sectional study

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
A. R. Kee ◽  
V. C. H. Yip ◽  
E. L. T. Tay ◽  
C. W. Lim ◽  
J. Cheng ◽  
...  
Keyword(s):  
Optical Coherence Tomography ◽  
Diagnostic Accuracy ◽  
Optic Disc ◽  
Optical Coherence Tomography Angiography ◽  
Optical Coherence ◽  
Cross Sectional ◽  
Swept Source ◽  
Retest Reliability ◽  
Significant Difference ◽  
Test Retest Reliability

Abstract Background To understand the differences between two different optical coherence tomography angiography (OCTA) devices in detecting glaucomatous from healthy eyes by comparing their vascular parameters, diagnostic accuracy and test-retest reliability. Methods A cross-sectional observational study was performed on healthy and glaucoma subjects, on whom two sets of OCTA images of optic disc and macula were acquired using both AngioVue (Optovue, USA) and Swept Source (Topcon, Japan) OCTA devices during one visit. A novel in-house software was used to calculate the vessel densities. Diagnostic accuracy of the machines in differentiating healthy versus glaucomatous eyes was determined using area under the receiver operating characteristic curve (AUROC) and test-retest repeatability of the machines was also evaluated. Results A total of 80 healthy and 38 glaucomatous eyes were evaluated. Glaucomatous eyes had reduced mean vessel density compared to healthy controls in all segmented layers of the optic disc and macula using AngioVue (p ≤ 0.001). However, glaucomatous eyes had higher mean vessel density on optic disc scans using Swept Source, with lack of statistically significant difference between healthy and glaucomatous eyes. The AUROC showed better diagnostic accuracy of AngioVue (0.761–1.000) compared to Swept Source (0.113–0.644). The test-retest reliability indices were generally better using AngioVue than Swept Source. Conclusions AngioVue showed better diagnostic capability and test-retest reliability compared to Swept Source. Further studies need to be undertaken to evaluate if there is any significant difference between the various machines in diagnosing and monitoring glaucoma.

scholarly journals Expressive language sampling as a source of outcome measures for treatment studies in fragile X syndrome: feasibility, practice effects, test-retest reliability, and construct validity

2020 ◽  
Vol 12 (1) ◽  
Author(s):  
Leonard Abbeduto ◽  
Elizabeth Berry-Kravis ◽  
Audra Sterling ◽  
Stephanie Sherman ◽  
Jamie O. Edgin ◽  
...  
Keyword(s):  
Construct Validity ◽  
Outcome Measures ◽  
Symptom Severity ◽  
Fragile X ◽  
Expressive Language ◽  
Practice Effects ◽  
Full Sample ◽  
Retest Reliability ◽  
Language Sampling ◽  
Test Retest Reliability

Abstract Background The evaluation of treatment efficacy for individuals with fragile X syndrome (FXS) or intellectual disability (ID) more generally has been hampered by the lack of adequate outcome measures. We evaluated expressive language sampling (ELS) as a procedure for generating outcome measures for treatment research in FXS. We addressed: (a) feasibility, (b) practice effects over two administrations, (c) test-retest reliability over the repeated administrations, and (d) construct validity. We addressed these issues for the full sample as well as for subgroups defined by age, IQ, and ASD status. Methods Participants were 106 individuals with FXS between ages 6 and 23 years who had IQs within the range of intellectual disability (IQ < 70). ELS procedures for collecting samples in conversation and narration were followed and analyzed separately. Five measures were derived from transcripts segmented into C-units (i.e., an independent clause and its modifiers): number of C-units per minute (talkativeness), number of different word roots (vocabulary), C-unit length in morphemes (syntax), percentage of C-units containing dysfluency (utterance planning), and percentage of C-units that were fully or partly unintelligible (articulatory quality). ELS procedures were administered twice at 4-week intervals for each participant. Standardized tests and informant reports were administered and provided measures for evaluating construct validity of ELS measures. Results We found low rates of noncompliance, suggesting the task can be completed meaningfully by most individuals with FXS, although noncompliance was higher for younger, lower IQ, and more autistic participants. Minimal practice effects and strong test-retest reliability over the 4-week interval were observed for the full sample and across the range of ages, IQs, and autism symptom severity. Evidence of convergent construct validity was observed for the measures of vocabulary, syntax, and unintelligibility for the full sample and across the range of IQ and autism symptom severity, but not for participants under age 12. Conversation and narration yielded largely similar results in all analyses. Conclusions The findings suggest that the ELS procedures are feasible and yield measures with adequate psychometric properties for a majority of 6 to 23 years with FXS who have ID. The procedures work equally well regardless of level of ID or degree of ASD severity. The procedures, however, are more challenging and have somewhat less adequate psychometric properties for individuals with FXS under age 12.

scholarly journals Validation of Serbian Version of Dysfunctional Voiding Symptom Score (DVSS) Questionnaire

2018 ◽  
Vol 7 (8) ◽  
pp. 217 ◽  
Author(s):  
Dragana Cirovic ◽  
Ivana Petronic ◽  
Dejan Nikolic ◽  
Tatjana Knezevic ◽  
Vojkan Vukadinovic ◽  
...  
Keyword(s):  
Symptom Score ◽  
Internal Consistency ◽  
Educational Level ◽  
Intraclass Correlation ◽  
Demographic Parameters ◽  
Divergent Validity ◽  
Dysfunctional Voiding ◽  
Retest Reliability ◽  
Gender And Education ◽  
Test Retest Reliability

Objective: The aims of our study were to translate the dysfunctional voiding symptom score (DVSS) from English to Serbian; culturally adopt the items; assess the internal consistency and the test–retest reliability of DVSSSR in patients with dysfunctional voiding (DV); evaluate and test the construct and divergent validity of DVSSSR against demographic parameters (gender and education); and examine the level of explained variability for each item of DVSSSR against demographic parameters (gender and education). Methods: The cross-sectional observational study included 50 patients with dysfunctional voiding aged 5 years and above. The DVSS questionnaire was translated from English into Serbian by the forward–backward method. Internal consistency was assessed with Cronbach α and test–retest reliability with intraclass correlation coefficient (ICC). For validity testing we performed construct and divergent validity analyses. Results: There was excellent internal consistency for every item except for Item 6 (0.787) and Item 3 (0.864), where internal consistency was good. The observed test/retest ICC for average measures was more than 0.75 (excellent) for all DVSSSR items. Gender and educational level does not correlate significantly with each item of DVSSSR (p > 0.05). For divergent validity, there were no significant differences in mean values of each item of DVSSSR between genders and different levels of education (p > 0.05). Variability that can be explained for gender and educational level was below 10%. Conclusion: Translated DVSSSR is of adequate validity and reliability for assessing DV in children.

scholarly journals Development and cross-cultural testing of the International Depression Symptom Scale (IDSS): a measurement instrument designed to represent global presentations of depression

2017 ◽  
Vol 4 ◽  
Author(s):  
E. E. Haroz ◽  
J. Bass ◽  
C. Lee ◽  
S. S. Oo ◽  
K. Lin ◽  
...  
Keyword(s):  
Suicidal Ideation ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
Self Report ◽  
Depression Symptom ◽  
Symptom Scale ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundSelf-report measurement instruments are commonly used to screen for mental health disorders in Low and Middle-Income Countries (LMIC). The Western origins of most depression instruments may constitute a bias when used globally. Western measures based on the DSM, do not fully capture the expression of depression globally. We developed a self-report scale design to address this limitation, the International Depression Symptom Scale-General version (IDSS-G), based on empirical evidence of the signs and symptoms of depression reported across cultures. This paper describes the rationale and process of its development and the results of an initial test among a non-Western population.MethodsWe evaluated internal consistency reliability, test–retest reliability and inter-rater reliability of the IDSS-G in a sample N = 147 male and female attendees of primary health clinics in Yangon, Myanmar. For criterion validity, IDSS-G scores were compared with diagnosis by local psychiatrists using the Structured Clinical Interview for DSM (SCID). Construct validity was evaluated by investigating associations between the IDSS-G and the Patient Health Questionnaire (PHQ), impaired function, and suicidal ideation.ResultsThe IDSS-G showed high internal consistency reliability (α = 0.92), test–retest reliability (r = 0.87), and inter-rater reliability (ICC = 0.90). Strong correlations between the IDSS-G and PHQ-9, functioning, and suicidal ideation supported construct validity. Criterion validity was supported for use of the IDSS-G to identify people with a SCID diagnosed depressive disorder (major depression/dysthymia). The IDSS-G also demonstrated incremental validity by predicting functional impairment beyond that predicted by the PHQ-9. Results suggest that the IDSS-G accurately assesses depression in this population. Future testing in other populations will follow.

scholarly journals Predictive Validity, Diagnostic Accuracy and Test-Retest Reliability of the Strength of Urges to Drink (SUTD) Scale

2019 ◽  
Vol 16 (19) ◽  
pp. 3714 ◽  
Author(s):  
Emma Beard ◽  
Jamie Brown ◽  
Robert West ◽  
Colin Drummond ◽  
Eileen Kaner ◽  
...  
Keyword(s):  
Diagnostic Accuracy ◽  
Predictive Validity ◽  
Retest Reliability ◽  
Identification Test ◽  
Test Retest Reliability ◽  
The Impact ◽  
Accuracy Data ◽  
Alcohol Reduction ◽  
Alcohol Toolkit Study

This study compared the 1-item Strength of Urges to Drink (SUTD) scale with the 10-item Alcohol Use Disorders Identification Test (AUDIT) on (i) test-retest reliability, (ii) predictive validity, and (iii) diagnostic accuracy. Data come from 2960 participants taking part in the Alcohol Toolkit Study (ATS), a monthly population survey of adults in England. The long-term test-retest reliability of the SUTD was ‘fair’, but lower than that for the AUDIT (Kappaweighted 0.24 versus 0.49). Individuals with “slight/moderate” urges to drink had higher odds of reporting an attempt to cut down relative to those not experiencing urges (adjusted odds ratios (AdjORs) 1.78 95% confidence interval (CI) 1.43–2.22 and 1.54 95% CI 1.20–1.96). Drinkers reporting “moderate/slight/strong” urges to drink had mean change in consumption scores which were 0.16 (95% CI −0.31 to −0.02), 0.40 (95% CI −0.56 to −0.24) and 0.37 (95% CI −0.69 to −0.05) units lower than those reporting no urges. For all outcomes, strong associations were found with AUDIT scores. The accuracy of the SUTD for discriminating between drinkers who did and did not reduce their consumption was ‘acceptable’, and similar to that for the AUDIT (ROCAUC 0.6). The AUDIT had better diagnostic accuracy in predicting change in alcohol consumption. The SUTD may be an efficient dynamic measure of urges to drink for population surveys and studies assessing the impact of alcohol-reduction interventions.

Sign in / Sign up

Export Citation Format

Share Document