scholarly journals Reliability of Computerized Neurocognitive Tests for Concussion Assessment: A Meta-Analysis

2017 ◽  
Vol 52 (9) ◽  
pp. 826-833 ◽  
Author(s):  
James L. Farnsworth ◽  
Lucas Dargo ◽  
Brian G. Ragan ◽  
Minsoo Kang
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Effect Size ◽  
Sampling Error ◽  
Meta Analysis ◽  
Intraclass Correlation ◽  
Cognitive Testing ◽  
Test Duration ◽  
Neurocognitive Tests ◽  
The Impact

Objective:  Although widely used, computerized neurocognitive tests (CNTs) have been criticized because of low reliability and poor sensitivity. A systematic review was published summarizing the reliability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) scores; however, this was limited to a single CNT. Expansion of the previous review to include additional CNTs and a meta-analysis is needed. Therefore, our purpose was to analyze reliability data for CNTs using meta-analysis and examine moderating factors that may influence reliability. Data Sources:  A systematic literature search (key terms: reliability, computerized neurocognitive test, concussion) of electronic databases (MEDLINE, PubMed, Google Scholar, and SPORTDiscus) was conducted to identify relevant studies. Study Selection:  Studies were included if they met all of the following criteria: used a test-retest design, involved at least 1 CNT, provided sufficient statistical data to allow for effect-size calculation, and were published in English. Data Extraction:  Two independent reviewers investigated each article to assess inclusion criteria. Eighteen studies involving 2674 participants were retained. Intraclass correlation coefficients were extracted to calculate effect sizes and determine overall reliability. The Fisher Z transformation adjusted for sampling error associated with averaging correlations. Moderator analyses were conducted to evaluate the effects of the length of the test-retest interval, intraclass correlation coefficient model selection, participant demographics, and study design on reliability. Heterogeneity was evaluated using the Cochran Q statistic. Data Synthesis:  The proportion of acceptable outcomes was greatest for the Axon Sports CogState Test (75%) and lowest for the ImPACT (25%). Moderator analyses indicated that the type of intraclass correlation coefficient model used significantly influenced effect-size estimates, accounting for 17% of the variation in reliability. Conclusions:  The Axon Sports CogState Test, which has a higher proportion of acceptable outcomes and shorter test duration relative to other CNTs, may be a reliable option; however, future studies are needed to compare the diagnostic accuracy of these instruments.

scholarly journals The reliability and validity of goniometric elbow measurements in adults: A systematic review of the literature

2018 ◽  
Vol 10 (4) ◽  
pp. 274-284 ◽  
Author(s):  
Suzanne F van Rijn ◽  
Elisa L Zwerus ◽  
Koen LM Koenraadt ◽  
Wilco CH Jacobs ◽  
Michel PJ van den Bekerom ◽  
...  
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Interrater Reliability ◽  
Literature Search ◽  
Meta Analysis ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Diagnostic Reliability ◽  
Measuring Tool ◽  
Simple Measuring

Background The universal goniometer is a simple measuring tool. With this review we aimed to investigate the reliability and validity of the universal goniometer in measurements of the adults' elbow. Methods Preferred Reporting Items for Systematic reviews and Meta-Analysis guidelines were followed and our study protocol was published online at PROSPERO. A literature search was conducted on relevant studies. Methodological quality was assessed using the Quality Appraisal of Diagnostic Reliability (QAREL) scoring system. Results Out of 697 studies yielded from our literature search, 12 were included. Six studies were rated as high quality. The intrarater reliability intraclass correlation coefficient ranged from 0.45 to 0.99, the interrater reliability ranged from intraclass correlation coefficient 0.53–0.97. One study providing instructions on goniometric alignment did not find a difference in expert versus non-expert examiners. Another study in which examiners were not instructed found a higher interrater reliability in expert examiners. One study investigating the validity of the goniometer in elbow measurements found a maximum standard error of the mean of 11.5° for total range of motion. Discussion Overall, the studies showed high intra- and interrater reliability of the universal goniometer. The reliability of the universal goniometer in non-expert examiners can be increased by clear instructions on goniometric alignment.

scholarly journals Biomechanical Measurement of Rabbit Cornea by a Modified Scheimpflug Device

2016 ◽  
Vol 2016 ◽  
pp. 1-6
Author(s):  
Bo Zhang ◽  
Jianjun Gu ◽  
Xiaoxiao Zhang ◽  
Bin Yang ◽  
Zheng Wang ◽  
...  
Keyword(s):  
Bulk Modulus ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Anterior Segment ◽  
Intraobserver Reliability ◽  
Rabbit Cornea ◽  
Deformation Response ◽  
Biomechanical Measurements ◽  
Biomechanical Measurement

Purpose. To explore the probability and variation in biomechanical measurements of rabbit cornea by a modified Scheimpflug device.Methods. A modified Scheimpflug device was developed by imaging anterior segment of the model imitating the intact eye at various posterior pressures. The eight isolated rabbit corneas were mounted on the Barron artificial chamber and images of the anterior segment were taken at posterior pressures of 15, 30, 45, 60, and 75 mmHg by the device. The repeatability and reliability of the parameters including CCT, ACD, ACV, and CV were evaluated at each posterior pressure. All the variations of the parameters at the different posterior pressures were calculated.Results. All parameters showed good intraobserver reliability (Cronbach’s alpha; intraclass correlation coefficient,α, ICC > 0.96) and repeatability in the modified Scheimpflug device. With the increase of posterior pressures, the ratio of CCT decreased linearly and the bulk modulus gradually reduced to a platform. The increase of ACD was almost linear with the posterior pressures elevated.Conclusions. The modified Scheimpflug device was a valuable tool to investigate the biomechanics of the cornea. The posterior pressure 15–75 mmHg range produced small viscoelastic deformations and nearly linear pressure-deformation response in the rabbit cornea.

scholarly journals A preliminary study of intensivist-performed DVT ultrasound screening in trauma ICU patients (APSIT Study)

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Lloyd Roberts ◽  
Tom Rozen ◽  
Deirdre Murphy ◽  
Adam Lawler ◽  
Mark Fitzgerald ◽  
...  
Keyword(s):  
Intensive Care ◽  
Deep Vein Thrombosis ◽  
High Risk ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Major Trauma ◽  
Intraclass Correlation ◽  
Trauma Patients ◽  
Vein Thrombosis ◽  
Deep Vein

Abstract Background Multiple screening Duplex ultrasound scans (DUS) are performed in trauma patients at high risk of deep vein thrombosis (DVT) in the intensive care unit (ICU). Intensive care physician performed compression ultrasound (IP-CUS) has shown promise as a diagnostic test for DVT in a non-trauma setting. Whether IP-CUS can be used as a screening test in trauma patients is unknown. Our study aimed to assess the agreement between IP-CUS and vascular sonographer performed DUS for proximal lower extremity deep vein thrombosis (PLEDVT) screening in high-risk trauma patients in ICU. Methods A prospective observational study was conducted at the ICU of Alfred Hospital, a major trauma center in Melbourne, Australia, between Feb and Nov 2015. All adult major trauma patients admitted with high risk for DVT were eligible for inclusion. IP-CUS was performed immediately before or after DUS for PLEDVT screening. The paired studies were repeated twice weekly until the DVT diagnosis, death or ICU discharge. Written informed consent from the patient, or person responsible, or procedural authorisation, was obtained. The individuals performing the scans were blinded to the others’ results. The agreement analysis was performed using Cohen’s Kappa statistics and intraclass correlation coefficient for repeated binary measurements. Results During the study period, 117 patients had 193 pairs of scans, and 45 (39%) patients had more than one pair of scans. The median age (IQR) was 47 (28–68) years with 77% males, mean (SD) injury severity score 27.5 (9.53), and a median (IQR) ICU length of stay 7 (3.2–11.6) days. There were 16 cases (13.6%) of PLEDVT with an incidence rate of 2.6 (1.6–4.2) cases per 100 patient-days in ICU. The overall agreement was 96.7% (95% CI 94.15–99.33). The Cohen’s Kappa between the IP-CUS and DUS was 0.77 (95% CI 0.59–0.95), and the intraclass correlation coefficient for repeated binary measures was 0.75 (95% CI 0.67–0.81). Conclusions There is a substantial agreement between IP-CUS and DUS for PLEDVT screening in trauma patients in ICU with high risk for DVT. Large multicentre studies are needed to confirm this finding.

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

Sign in / Sign up

Export Citation Format

Share Document