Quantifying Test-Retest Reliability Using the Intraclass Correlation Coefficient and the SEM

2005 ◽  
Vol 19 (1) ◽  
pp. 231 ◽  
Author(s):  
Joseph P. Weir
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Retest Reliability ◽  
Test Retest Reliability

Test-Retest-Reliability of Computer-Based Metamorphopsia Measurement in Macular Diseases

2020 ◽  
Author(s):  
Daniela Claessens ◽  
Alexander K. Schuster ◽  
Ronald V. Krüger ◽  
Marian Liegl ◽  
Laila Singh ◽  
...  
Keyword(s):  
Macular Edema ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Measuring Method ◽  
Repeated Measurements ◽  
Retest Reliability ◽  
Macular Diseases ◽  
Computer Based ◽  
Test Retest Reliability

AbstractIn this study, the test-retest-reliability as one aspect of reliability of metamorphopsia measurements using a computer-based measuring method was determined in patients with macular diseases. Metamorphopsia amplitude, position, and area were quantified using AMD – A Metamorphopsia Detector software (app4eyes GmbH & Co. KG, Germany) in patients with diabetic, myopic, or uveitic macular edema, intermediate or neovascular age-associated macular degeneration, epiretinal membrane, vitelliform maculopathy, Irvine-Gass syndrome, or macular edema due to venous retinal occlusion. The intraclass correlation coefficient (ICC) was calculated in order to determine the repeatability of two repeated measurements and was used as an indicator of the reliability of the measurements. In this study, metamorphopsia measurements were conducted on 36 eyes with macular diseases. Metamorphopsia measurements made using AMD – A Metamorphopsia Detector software were highly reliable and repeatable in patients with maculopathies. The intraclass correlation coefficient of all indices was excellent (0.95 – 0.97). For diseases of the vitreoretinal interface or macular diseases with intra- or subretinal edema, this metamorphopsia measurement represents a supplement for visual function testing in the clinic, as well as in clinical studies.

Reliability and Validity of the Thai Version of the Carolinas Comfort Scale

2021 ◽  
Vol 104 (11) ◽  
pp. 1784-1787
Keyword(s):  
Inguinal Hernia ◽  
Hernia Repair ◽  
Inguinal Hernia Repair ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Internal Consistency Reliability ◽  
Retest Reliability ◽  
Test Retest Reliability

Objective: To evaluate the reliability and validity of the Thai version of the Carolinas Comfort Scale (CCS) to measure health-related quality of life (HRQoL) in post-hernia repaired patients. Materials and Methods: Three hundred twenty-eight patients that underwent the inguinal hernia repair procedure in Vajira Hospital were recruited in the present study. The Thai version of CCS (TCCS) was performed entirely by the patient, and the test-retest reliability was conducted at a 2-week interval. Results: The TCCS’s internal consistency reliability was excellent (Cronbach’s alpha 0.89). The inter-rater reliability was found to agree with the intraclass correlation coefficient of 0.90. The test-retest reliability over two weeks was high, with an intraclass correlation coefficient of 0.92. Conclusion: The Thai version of CCS was found to have adequate reliability and validity and could be used to measure HRQoL in Thai patients that undergo inguinal hernia repair. Keywords: Reliability; Validity; Carolinas Comfort Scale; Thai version

scholarly journals The Inventory of Physical Activity Barriers for Adults 50 Years and Older: Refinement and Validation

2021 ◽  
Vol 5 (Supplement_1) ◽  
pp. 789-789
Author(s):  
Mariana Wingood ◽  
Salene Jones ◽  
Nancy Gell ◽  
Denise Peters ◽  
Jennifer Brach
Keyword(s):  
Physical Activity ◽  
Factor Analysis ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Assessment Tool ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Cross Sectional ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Addressing physical activity (PA) barriers is an essential component of increasing PA among the 56-73% of community-dwelling adults 50 years and older who are not performing the recommended 150 minutes of moderate-to-vigorous PA. As there is no feasible, multi-factorial tool to assess PA barriers among this population, we developed and validated a PA barrier assessment tool called the Inventory of Physical Activity Barriers (IPAB). We collected cross-sectional data on 503 adults (mean age 70.1), with 79 participants completing the scale twice for test-retest reliability and 64 completing a cross-over design examining the ability to use two administration formats interchangeably. Our analyses consisted of exploratory and confirmatory factor analysis, Cronbach alpha, intraclass correlation coefficient, Bland-Altman Plot, and t-tests. Using factor analysis, we identified and confirmed an eight-factor solution consisting of 27 items. The 27-item IPAB is internally consistent (alpha= 0.91), has a high test-retest reliability (intraclass correlation coefficient=0.99), and can differentiate between individuals who meet the recommended levels of PA and those who do not (p < 0.001). The IPAB scores ranged between 1.00-3.11 for the paper format (mean=1.78) and 1.07-3.48 for the electronic format (mean=1.78), with no statistical difference between the paper and electronic administration formats (p=0.94), resulting in the conclusion that the two administration formats can be used interchangeably. Participant feedback illustrates that the IPAB is easy to use, has clear instruction, and is an appropriate length. The newly validated IPAB scale can be used to develop individualized PA interventions that address PA barriers among patients 50 years and older.

scholarly journals How reproducible is self-reported information on exposure to smoking, drinking, and dietary patterns? Evidence among Brazilian adults in the Pró-Saúde Study

2003 ◽  
Vol 121 (2) ◽  
pp. 63-66 ◽  
Author(s):  
Dóra Chor ◽  
Eduardo Faerstein ◽  
Márcia Guimarães Mello Alves ◽  
Claudia de Souza Lopes
Keyword(s):  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Dietary Patterns ◽  
Rio De Janeiro ◽  
Alcohol Intake ◽  
Dietary Habits ◽  
Intraclass Correlation ◽  
Kappa Statistics ◽  
Retest Reliability ◽  
Test Retest Reliability

CONTEXT: Epidemiological studies of the validity and reliability of self-reported information on important risk factors for non-communicable chronic diseases are scarce in Brazil. OBJECTIVE: We evaluated the test-retest reliability of information overall and stratified by gender, age and education on active and passive smoking, alcohol intake and aspects of dietary habits. TYPE OF STUDY: Test-retest reliability. SETTING: Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil. PARTICIPANTS: 192 University employees. PROCEDURES: Self-administered questionnaires were completed on two occasions, two weeks apart. MAIN MEASUREMENTS: Kappa Statistics; Intraclass Correlation Coefficient. RESULTS: Information on smoking status and pack-years smoked had almost perfect levels of agreement, respectively, kappa = 0.97 (95% CI, 0.92-1.00), and intraclass correlation coefficient = 0.93 (CI 95%, 0.89-0.96). Characteristics of alcohol intake yielded substantial levels of agreement (kappa ranging from 0.62 to 0.69). The reproducibility of the information on dietary habits varied from 0.67 to 0.79 (kappa). No clear-cut patterns could be identified comparing information by age or gender. There was a slight tendency towards greater reliability among people with higher levels of education. CONCLUSION: The reproducibility of information on smoking, drinking, and dietary patterns ranged from substantial to excellent, as investigated in the Pró-Saúde Study, a longitudinal investigation recently launched in Rio de Janeiro.

Test-retest Reliability of Navigated Transcranial Magnetic Stimulation of the Motor Cortex

2013 ◽  
Vol 10 (1) ◽  
pp. 51-56 ◽  
Author(s):  
Marie-Thérèse Forster ◽  
Moritz Limbart ◽  
Volker Seifert ◽  
Christian Senft
Keyword(s):  
Transcranial Magnetic Stimulation ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Magnetic Stimulation ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Navigated Transcranial Magnetic Stimulation ◽  
Abductor Hallucis ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract BACKGROUND: Because navigated transcranial magnetic stimulation (nTMS) is increasingly used in neurosurgical research, interpretation of its results is of utmost importance. OBJECTIVE: To evaluate the test-retest reliability of nTMS. METHODS: Twelve healthy participants underwent nTMS at 2 different sessions separated by 10.3 ± 9.6 days. Investigated parameters included resting motor thresholds, hotspots, and centers of gravity calculated for the first dorsal interosseous, abductor pollicis brevis, extensor digitorum, tibial anterior, and abductor hallucis muscles. RESULTS: Excellent reliability of resting motor thresholds was observed. Hotspots and centers of gravity showed moderate to excellent repeatability along the anteroposterior axis (intraclass correlation coefficient, 0.54-0.89), whereas the x coordinate presented mainly poor to moderate stability (intraclass correlation coefficient, 0.11-0.89). Movement of centers of gravity over sessions was 0.57 ± 0.32 cm, and hotspots laid 0.79 ± 0.47 cm apart. Calculation of coefficient of variation revealed high reliability of investigated parameters in upper extremities; in lower extremity muscles, high variation across sessions was observed. CONCLUSION: nTMS can be considered a reliable tool, thus opening new fields of noninvasive investigations in neurosurgery. The results presented here should be considered in the interpretation of individual nTMS results.

Two-Week Test-Retest Reliability of the Duke Religion Index

2004 ◽  
Vol 94 (3) ◽  
pp. 993-994 ◽  
Author(s):  
Eric A. Storch ◽  
Melissa S. Strawser ◽  
Jason B. Storch
Keyword(s):  
College Students ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Self Report ◽  
Intrinsic Religiosity ◽  
Retest Reliability ◽  
Undergraduate College Students ◽  
Test Retest Reliability

The present study investigated 2-wk. test-retest reliability of the Duke Religion Index, a 5-item self-report questionnaire that assesses organizational, nonorganizational, and intrinsic religiosity. The sample consisted of 20 undergraduate college students (11 women) whose mean age was 24.7 yr. ( SD = 5.0 yr.). Findings supported the 2-wk. test-retest reliability of the Duke Religion Index with an intraclass correlation coefficient of .91.

scholarly journals Reliability of Measures of N1 Peak Amplitude of the Compound Action Potential in Younger and Older Adults

2018 ◽  
Vol 61 (9) ◽  
pp. 2422-2430 ◽  
Author(s):  
Carolyn M. McClaskey ◽  
James W. Dias ◽  
Judy R. Dubno ◽  
Kelly C. Harris
Keyword(s):  
Older Adults ◽  
Action Potential ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Measurement Techniques ◽  
Intraclass Correlation ◽  
Compound Action Potential ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Compound Action

Purpose Human auditory nerve (AN) activity estimated from the amplitude of the first prominent negative peak (N1) of the compound action potential (CAP) is typically quantified using either a peak-to-peak measurement or a baseline-corrected measurement. However, the reliability of these 2 common measurement techniques has not been evaluated but is often assumed to be relatively poor, especially for older adults. To address this question, the current study (a) compared test–retest reliability of these 2 methods and (b) tested the extent to which measurement type affected the relationship between N1 amplitude and experimental factors related to the stimulus (higher and lower intensity levels) and participants (younger and older adults). Method Click-evoked CAPs were recorded in 24 younger (aged 18–30 years) and 20 older (aged 55–85 years) adults with clinically normal audiograms up to 3000 Hz. N1 peak amplitudes were estimated from peak-to-peak measurements (from N1 to P1) and baseline-corrected measurements for 2 stimulus levels (80 and 110 dB pSPL). Baseline-corrected measurements were made with 4 baseline windows. Each stimulus level was presented twice, and test–retest reliability of these 2 measures was assessed using the intraclass correlation coefficient. Linear mixed models were used to evaluate the extent to which age group and click level uniquely predicted N1 amplitude and whether the predictive relationships differed between N1 measurement techniques. Results Both peak-to-peak and baseline-corrected measurements of N1 amplitude were found to have good-to-excellent reliability, with intraclass correlation coefficient values > 0.60. As expected, N1 amplitudes were significantly larger for younger participants compared with older participants for both measurement types and were significantly larger in response to clicks presented at 110 dB pSPL than at 80 dB pSPL for both measurement types. Furthermore, the choice of baseline window had no significant effect on N1 amplitudes using the baseline-corrected method. Conclusions Our results suggest that measurements of AN activity can be robustly and reliably recorded in both younger and older adults using either peak-to-peak or baseline-corrected measurements of the N1 of the CAP. Peak-to-peak measurements yield larger N1 response amplitudes and are the default measurement type for many clinical systems, whereas baseline-corrected measurements are computationally simpler. Furthermore, the relationships between AN activity and stimulus- and participant-related variables were not affected by measurement technique, which suggests that these relationships can be compared across studies using different techniques for measuring the CAP N1.

scholarly journals Spatial working memory performance following acute sport-related concussion

2018 ◽  
Vol 2 ◽  
pp. 205970021879781 ◽  
Author(s):  
Tara A Whitten ◽  
Cameron S Mang ◽  
Madeline S Cosh ◽  
Stephen H Scott ◽  
Sean P Dukelow ◽  
...  
Keyword(s):  
Working Memory ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Spatial Working Memory ◽  
Intraclass Correlation ◽  
Response Duration ◽  
Reliable Change Index ◽  
Retest Reliability ◽  
Spatial Span ◽  
Test Retest Reliability

Introduction An important problem in the field of sport-related concussion is the lack of a ‘gold-standard’ clinical assessment tool. Currently, the diagnosis relies heavily on self-reporting of symptoms and observation of clinical signs by medical professionals. To address this, our group has been motivated to develop objective measures of neurological impairment following concussion. Spatial working memory is an important aspect of cognitive function that might be impaired following concussion. In the present study, we measured spatial working memory using a robotic spatial span task. We first assessed test–retest reliability in 82 healthy athletes who underwent baseline testing across two athletic seasons using intraclass correlation coefficients. We then assessed spatial span performance relative to baseline in 47 athletes acutely following sport-related concussion using a reliable change index with 80% confidence limits to define impairment on an individual basis. Results We found good test–retest reliability for the mean span (a measure of spatial working memory span length; intraclass correlation coefficient = 0.79), and moderate reliability for the response duration (time taken per spatial target; intraclass correlation coefficient = 0.64) in healthy athletes. However, only 19% of acutely concussed athletes showed evidence of impairment relative to baseline in mean span, and even fewer (9%) showed evidence of impairment in response duration. Analysis of serial position curves revealed primacy and recency effects for this task, but no group-level differences between concussed and healthy athletes. Analysis of specific types of errors showed a higher rate of substitution errors in the concussed group at baseline, suggesting possible malingering in a small number of athletes. Conclusion Overall, few athletes showed evidence of impaired spatial working memory acutely following concussion, suggesting either that spatial working memory is not commonly impaired acutely post-concussion, or that the present task is not sufficiently demanding.

The Reliability and Validity of the Turkish Kaiser Physical Activity Survey for Pregnant Women

2019 ◽  
Vol 16 (11) ◽  
pp. 962-967
Author(s):  
Esra Uzelpasaci ◽  
Türkan Akbayrak ◽  
Serap Özgül ◽  
Ceren Orhan ◽  
Emine Baran ◽  
...  
Keyword(s):  
Physical Activity ◽  
Pregnant Women ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Activity Survey ◽  
Activity Questionnaire

Background: Evaluation of physical activity by condition-specific surveys provides more accurate results than generic physical activity questionnaires. The aim of this study was to investigate the reliability and validity of the Kaiser Physical Activity Survey (KPAS) in Turkish pregnant women. Methods: In the translation and cultural adaptation of the KPAS, the 6-phase guidelines recommended in the literature were followed. The study included a total of 151 pregnant women who were assessed using the Turkish version of KPAS, the Pregnancy Physical Activity Questionnaire, and the SenseWear Pro3 Armband. To determine the test–retest reliability, the KPAS was reapplied after 7 days. The psychometric properties of KPAS were analyzed with respect to internal consistency, test–retest reliability, and concurrent validity. Results: Cronbach α coefficient indicating the internal consistency of the Turkish KPAS was found to be .60 to .80, showing moderate reliability. The intraclass correlation coefficient for test–retest reliability was very strong (intraclass correlation coefficient: .96–.98). The total KPAS scores were found to be moderately correlated with the total Pregnancy Physical Activity Questionnaire score and the total energy expenditure value on the SenseWear Pro3 Armband. Conclusions: This study showed that KPAS is a valid and reliable instrument for evaluating physical activity in Turkish pregnant women in different aspects.

Sign in / Sign up

Export Citation Format

Share Document