Identifying reliable change in tactile temporal thresholds in multiple sclerosis: test-retest reliability

2006 ◽  
Vol 12 (5) ◽  
pp. 573-577 ◽  
Author(s):  
L N Brown ◽  
L M Metz ◽  
M Eliasziw
Keyword(s):  
Multiple Sclerosis ◽  
Measurement Error ◽  
Corpus Callosum ◽  
Validation Study ◽  
Outcome Measure ◽  
Retest Reliability ◽  
Real Change ◽  
Test Retest Reliability ◽  
Standard Error Of Measurement ◽  
Error Of Measurement

Background Tactile temporal thresholds are typically significantly higher (ie, prolonged) in multiple sclerosis (MS) patients when compared to controls and increase significantly during relapses, probably reflecting integrity of conduction across a portion of the corpus callosum. As part of an ongoing validation study of tactile temporal thresholds, the test-retest reliability of these thresholds was examined in patients with MS. Methods Tactile temporal thresholds were measured in 61 MS patients during two separate test sessions within three weeks. Test-retest reliability and the standard error of measurement were calculated. The threshold of change in tactile temporal thresholds in MS patients that would correspond to real change beyond measurement error with 95% certainty was also calculated. Results The test-retest reliability of this measure of tactile temporal thresholds was 0.93. The threshold indicating change beyond chance or measurement error with 95% certainty was 19 ms. Conclusions This measure of tactile temporal thresholds has excellent test - retest reliability and a change of greater than 19 ms is highly likely to represent real change. This measure is promising as a precise, reliable outcome measure in MS.

scholarly journals Reliability of Visual Temporal Thresholds

2007 ◽  
Vol 34 (4) ◽  
pp. 433-437
Author(s):  
L N Brown ◽  
M Eliasziw ◽  
L M Metz
Keyword(s):  
Multiple Sclerosis ◽  
Measurement Error ◽  
Visual Processing ◽  
Control Group ◽  
Retest Reliability ◽  
Functional Changes ◽  
Disability Status ◽  
Temporal Aspects ◽  
Real Change ◽  
Test Retest Reliability

Background:Visual processing deficits involving temporal characteristics are typically not captured by the widely used outcome measures (i.e., Expanded Disability Status Scale, Multiple Sclerosis Functional Composite) in multiple sclerosis (MS). Visual temporal thresholds (i.e., measurements of the temporal aspects in visual processing) are typically significantly higher (i.e., prolonged) in MS patients when compared to controls. The test-retest reliability of these thresholds was examined in patients with MS.Methods:Visual temporal thresholds were measured in 21 stable MS patients during two separate test sessions. Test-retest reliability and the standard error of measurement were calculated. The threshold of change in visual temporal thresholds in MS patients that would correspond to real change beyond measurement error with 95% certainty was also calculated. For comparisons, a control group (n = 10) was included.Results:The test-retest reliability of this measure of visual temporal thresholds was 0.97. The threshold indicating change beyond chance or measurement error with 95% certainty was 11 ms. Higher thresholds were significantly correlated with longer durations of disease.Conclusions:This measure of visual temporal thresholds has excellent test-retest reliability and a change of greater than 11 ms is highly likely to represent real change in MS patients. The findings indicate that these measurements may provide useful clinical information about functional changes regarding the temporal aspects of the visual system, which is currently not captured by the Extended Disability Status Scale.

scholarly journals Symbol Digit Modalities Test Variant in a Smartphone App for Persons With Multiple Sclerosis: Validation Study (Preprint)

2020 ◽  
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Marijn B Martens ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Construct Validity ◽  
Validation Study ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Smartphone App ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

BACKGROUND The decline of cognitive processing speed (CPS) is a common dysfunction in persons with multiple sclerosis (MS). The Symbol Digit Modalities Test (SDMT) is widely used to formally quantify CPS. We implemented a variant of the SDMT in MS sherpa, a smartphone app for persons with MS. OBJECTIVE The aim of this study was to investigate the construct validity and test-retest reliability of the MS sherpa smartphone variant of the SDMT (sSDMT). METHODS We performed a validation study with 25 persons with relapsing-remitting MS and 79 healthy control (HC) subjects. In the HC group, 21 subjects were matched to the persons with MS with regard to age, gender, and education and they followed the same assessment schedule as the persons with MS (the “HC matched” group) and 58 subjects had a less intense assessment schedule to determine reference values (the “HC normative” group). Intraclass correlation coefficients (ICCs) were determined between the paper-and-pencil SDMT and its smartphone variant (sSDMT) on 2 occasions, 4 weeks apart. Other ICCs were determined for test-retest reliability, which were derived from 10 smartphone tests per study participant, with 3 days in between each test. Seven study participants with MS were interviewed regarding their experiences with the sSDMT. RESULTS The SDMT scores were on average 12.06% higher than the sSDMT scores, with a standard deviation of 10.68%. An ICC of 0.838 was found for the construct validity of the sSDMT in the combined analysis of persons with MS and HC subjects. Average ICCs for test-retest reliability of the sSDMT for persons with MS, the HC matched group, and the HC normative group were 0.874, 0.857, and 0.867, respectively. The practice effect was significant between the first and the second test of the persons with MS and the HC matched group and trivial for all other test-retests. The interviewed study participants expressed a positive attitude toward the sSDMT, but they also discussed the importance of adapting a smartphone cognition test in accordance with the needs of the individual persons with MS. CONCLUSIONS The high correlation between sSDMT and the conventional SDMT scores indicates a very good construct validity. Similarly, high correlations underpin a very good test-retest reliability of the sSDMT. We conclude that the sSDMT has the potential to be used as a tool to monitor CPS in persons with MS, both in clinical studies and in clinical practice.

Test–Retest Reliability of Skill Tests in the F-MARC Battery for Youth Soccer Players

2019 ◽  
Vol 126 (5) ◽  
pp. 1006-1023 ◽  
Author(s):  
Alexis Padrón-Cabo ◽  
Ezequiel Rey ◽  
Alexandra Pérez-Ferreirós ◽  
Anton Kalén
Keyword(s):  
Intraclass Correlation ◽  
Young Male ◽  
Soccer Players ◽  
Limits Of Agreement ◽  
Retest Reliability ◽  
Youth Soccer ◽  
Test Retest Reliability ◽  
Standard Error Of Measurement ◽  
Absolute Reliability ◽  
Error Of Measurement

This study aimed to evaluate the test–retest reliability of soccer skill tests belonging to the F-MARC test battery. To avoid bias during talent identification and development, coaches and scouts should be using reliable tests for assessing soccer-specific skills in young male players. Fifty-two U-14 outfield male soccer players performed F-MARC soccer skill tests on two occasions, separated by 7 days. After familiarization, we administered two trial sessions of five skill tests: speed dribbling, juggling, shooting, passing, and heading. We assessed absolute reliability by expressing the standard error of measurement as a coefficient of variation with 95% limits of agreement, and we assessed relative reliability with the intraclass correlation coefficient and with Pearson’s correlation ( r). The results demonstrated satisfactory relative and absolute reliability for speed dribbling, right foot juggling, short passing, shooting a dead ball right, shooting from a pass, heading in front, and heading right. However, reliability values for left foot juggling, chest-head-foot juggling, head-left-foot-right foot-chest-head juggling, long pass, and shooting a dead ball left tests were not strong enough to suggest their usage by coaches in training or sport scientists in research.

Manchester and Oxford Universities Scale for the Psychopathological Assessment of Dementia (MOUSEPAD)

1996 ◽  
Vol 169 (3) ◽  
pp. 293-307 ◽  
Author(s):  
N. H. P. Allen ◽  
Sheila Gordon ◽  
Tony Hope ◽  
Alistair Burns
Keyword(s):  
Validation Study ◽  
Outcome Measure ◽  
Post Mortem ◽  
Drug Trials ◽  
Retest Reliability ◽  
Behavioural Changes ◽  
Epidemiological Surveys ◽  
Reliability Sensitivity ◽  
Post Mortem Findings ◽  
Test Retest Reliability

BackgroundThere is increasing awareness of the importance of psychopathological and behavioural changes in dementia and a need for an instrument to measure these features which achieves an appropriate compromise between brevity and breadth. We describe a newly developed 59-item instrument: the MOUSEPAD.MethodReliability, sensitivity and validity were examined with 30 carers, each of whom was interviewed four times over six weeks.ResultsFor different symptom groups, kappa ranged from 0.43 to 0.93 for test–retest reliability, from 0.56 to 1.0 for inter-rater reliability, and from 0.43 to 0.67 for the validation study.ConclusionsThe scale may be useful as an outcome measure in drug trials, for correlating psychopathological and behavioural changes with post-mortem findings, and in epidemiological surveys.

scholarly journals A Reliability of Electromyographic Normalization Methods for the Infraspinatus Muscle in Healthy Subjects

2013 ◽  
Vol 36 (1) ◽  
pp. 69-76 ◽  
Author(s):  
Sung-min Ha ◽  
Heon-seock Cynn ◽  
Oh-yun Kwon ◽  
Kyue-nam Park ◽  
Gyoung-mo Kim
Keyword(s):  
Healthy Subjects ◽  
Emg Activity ◽  
Maximal Voluntary Isometric Contraction ◽  
Retest Reliability ◽  
Normalization Methods ◽  
Infraspinatus Muscle ◽  
Detectable Difference ◽  
Test Retest Reliability ◽  
Standard Error Of Measurement ◽  
Error Of Measurement

The purpose of this study was to examine the test-retest reliability of normalization methods for the infraspinatus muscle in a group of healthy subjects. Twelve healthy subjects (male=8, female=4) performed the maximal voluntary isometric contraction (MVIC) with examiner`s resistance, MVIC with a digital tension-meter (MVIC-DT), and sub-MVIC methods. Surface electromyography (EMG) signals were recorded from the infraspinatus muscles according to normalization methods. Reliability was analyzed using the intra-class coefficient (ICC), standard error of measurement (SEM), and minimal detectable difference (MDD). The results of the present study demonstrated that the sub-MVIC method has excellent test-retest reliability (ICC=0.92) with a relatively small SEM (5.9 mV) and MDD95 (16.4 mV), compared to MVIC-DT (ICC=0.73; SEM=11.2 mV; MDD95: 31 mV) and MVIC-E (ICC=0.5; SEM=15.7 mV; MDD95: 43.6 mV). These findings provide evidence that sub-MVIC is more appropriate for comparing the EMG activity for the infraspinatus muscle as a normalization method. If MVIC for normalization is needed, MVIC-DT is more appropriate than MVIC-E.

scholarly journals A Two-Minute Walking Test With a Smartphone App for Persons With Multiple Sclerosis: Validation Study (Preprint)

2021 ◽  
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Frank Dorssers ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Validation Study ◽  
Concurrent Validity ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Walking Test ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

BACKGROUND Walking disturbances are a common dysfunction in persons with multiple sclerosis (MS). The 2-Minute Walking Test (2MWT) is widely used to quantify walking speed. We implemented a smartphone-based 2MWT (s2MWT) in MS sherpa, an app for persons with MS. When performing the s2MWT, users of the app are instructed to walk as fast as safely possible for 2 minutes in the open air, while the app records their movement and calculates the distance walked. OBJECTIVE The aim of this study is to investigate the concurrent validity and test-retest reliability of the MS sherpa s2MWT. METHODS We performed a validation study on 25 persons with relapsing-remitting MS and 79 healthy control (HC) participants. In the HC group, 21 participants were matched to the persons with MS based on age, gender, and education and these followed the same assessment schedule as the persons with MS (the <i>HC-matched</i> group), whereas 58 participants had a less intense assessment schedule to determine reference values (the <i>HC-normative</i> group). Intraclass correlation coefficients (ICCs) were determined between the distance measured by the s2MWT and the distance measured using distance markers on the pavement during these s2MWT assessments. ICCs were also determined for test-retest reliability and derived from 10 smartphone tests per study participant, with 3 days in between each test. We interviewed 7 study participants with MS regarding their experiences with the s2MWT. RESULTS In total, 755 s2MWTs were completed. The adherence rate for the persons with MS and the participants in the HC-matched group was 92.4% (425/460). The calculated distance walked on the s2MWT was, on average, 8.43 m or 5% (SD 18.9 m or 11%) higher than the distance measured using distance markers (n=43). An ICC of 0.817 was found for the concurrent validity of the s2MWT in the combined analysis of persons with MS and HC participants. Average ICCs of 9 test-retest reliability analyses of the s2MWT for persons with MS and the participants in the HC-matched group were 0.648 (SD 0.150) and 0.600 (SD 0.090), respectively, whereas the average ICC of 2 test-retest reliability analyses of the s2MWT for the participants in the HC-normative group was 0.700 (SD 0.029). The interviewed study participants found the s2MWT easy to perform, but they also expressed that the test results can be confronting and that a pressure to reach a certain distance can be experienced. CONCLUSIONS The high correlation between s2MWT distance and the conventional 2MWT distance indicates a good concurrent validity. Similarly, high correlations underpin a good test-retest reliability of the s2MWT. We conclude that the s2MWT can be used to measure the distance that the persons with MS walk in 2 minutes outdoors near their home, from which both clinical studies and clinical practice can benefit.

scholarly journals The Isometric Horizontal Push Test: Test–Retest Reliability and Validation Study

2020 ◽  
Vol 15 (4) ◽  
pp. 581-584 ◽  
Author(s):  
Antonio Dello Iacono ◽  
Stephanie Valentin ◽  
Mark Sanderson ◽  
Israel Halperin
Keyword(s):  
Strain Gauge ◽  
Standard Error ◽  
Intraclass Correlation ◽  
Force Plate ◽  
Ease Of Use ◽  
Peak Force ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Standard Error Of Measurement ◽  
Error Of Measurement

Purpose: To investigate the test–retest reliability and criterion validity of the isometric horizontal push test (IHPT), a newly designed test that selectively measures the horizontal component of maximal isometric force. Methods: Twenty-four active males with ≥3 years of resistance training experience performed 2 testing sessions of the IHPT, separated by 3 to 4 days of rest. In each session, subjects performed 3 maximal trials of the IHPT with 3 minutes of rest between them. The peak force outputs were collected simultaneously using a strain gauge and the criterion equipment consisting of a floor-embedded force plate. Results: The test–retest reliability of peak force values was nearly perfect (intraclass correlation coefficient = ∼.99). Bland–Altman analysis showed excellent agreement between days with nearly no bias for strain gauge 1.2 N (95% confidence interval [CI], −3 to 6 N) and force plate 0.8 N (95% CI, −4 to 6 N). A nearly perfect correlation was observed between the strain gauge and force plate (r = .98, P < .001), with a small bias of 8 N (95% CI, 1.2 to 15 N) in favor of the force plate. The sensitivity of the IHPT was also good, with smallest worthwhile change greater than standard error of measurement for both the strain gauge (smallest worthwhile change: 29 N; standard error of measurement: 17 N; 95% CI, 14 to 20 N) and the force plate (smallest worthwhile change: 29 N; standard error of measurement: 18 N; 95% CI, 14 to 19 N) devices. Conclusions: The high degree of validity, reliability, and sensitivity of the IHPT, coupled with its affordability, portability, ease of use, and time efficacy, point to the potential of the test for assessment and monitoring purposes.

scholarly journals A Two-Minute Walking Test With a Smartphone App for Persons With Multiple Sclerosis: Validation Study

10.2196/29128 ◽  
2021 ◽  
Vol 5 (11) ◽  
pp. e29128
Author(s):  
Pim van Oirschot ◽  
Marco Heerings ◽  
Karine Wendrich ◽  
Bram den Teuling ◽  
Frank Dorssers ◽  
...  
Keyword(s):  
Multiple Sclerosis ◽  
Validation Study ◽  
Concurrent Validity ◽  
Intraclass Correlation ◽  
Study Participant ◽  
Walking Test ◽  
Retest Reliability ◽  
Matched Group ◽  
Test Retest Reliability ◽  
Study Participants

Background Walking disturbances are a common dysfunction in persons with multiple sclerosis (MS). The 2-Minute Walking Test (2MWT) is widely used to quantify walking speed. We implemented a smartphone-based 2MWT (s2MWT) in MS sherpa, an app for persons with MS. When performing the s2MWT, users of the app are instructed to walk as fast as safely possible for 2 minutes in the open air, while the app records their movement and calculates the distance walked. Objective The aim of this study is to investigate the concurrent validity and test-retest reliability of the MS sherpa s2MWT. Methods We performed a validation study on 25 persons with relapsing-remitting MS and 79 healthy control (HC) participants. In the HC group, 21 participants were matched to the persons with MS based on age, gender, and education and these followed the same assessment schedule as the persons with MS (the HC-matched group), whereas 58 participants had a less intense assessment schedule to determine reference values (the HC-normative group). Intraclass correlation coefficients (ICCs) were determined between the distance measured by the s2MWT and the distance measured using distance markers on the pavement during these s2MWT assessments. ICCs were also determined for test-retest reliability and derived from 10 smartphone tests per study participant, with 3 days in between each test. We interviewed 7 study participants with MS regarding their experiences with the s2MWT. Results In total, 755 s2MWTs were completed. The adherence rate for the persons with MS and the participants in the HC-matched group was 92.4% (425/460). The calculated distance walked on the s2MWT was, on average, 8.43 m or 5% (SD 18.9 m or 11%) higher than the distance measured using distance markers (n=43). An ICC of 0.817 was found for the concurrent validity of the s2MWT in the combined analysis of persons with MS and HC participants. Average ICCs of 9 test-retest reliability analyses of the s2MWT for persons with MS and the participants in the HC-matched group were 0.648 (SD 0.150) and 0.600 (SD 0.090), respectively, whereas the average ICC of 2 test-retest reliability analyses of the s2MWT for the participants in the HC-normative group was 0.700 (SD 0.029). The interviewed study participants found the s2MWT easy to perform, but they also expressed that the test results can be confronting and that a pressure to reach a certain distance can be experienced. Conclusions The high correlation between s2MWT distance and the conventional 2MWT distance indicates a good concurrent validity. Similarly, high correlations underpin a good test-retest reliability of the s2MWT. We conclude that the s2MWT can be used to measure the distance that the persons with MS walk in 2 minutes outdoors near their home, from which both clinical studies and clinical practice can benefit.

scholarly journals Test–Retest Reliability of the Total Motion Release® Scale

2020 ◽  
pp. 1-4
Author(s):  
Emilie N. Miley ◽  
Ashley J. Reeves ◽  
Madeline P. Casanova ◽  
Nickolai J.P. Martonick ◽  
Jayme Baker ◽  
...  
Keyword(s):  
Clinical Practice ◽  
Correlation Coefficient ◽  
Intraclass Correlation Coefficient ◽  
Standard Error ◽  
Intraclass Correlation ◽  
The Body ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Standard Error Of Measurement ◽  
Error Of Measurement

Context: Total Motion Release® (TMR®) is a novel treatment paradigm used to restore asymmetries in the body (eg, pain, tightness, limited range of motion). Six primary movements, known as the Fab 6, are performed by the patient and scored using a 0 to 100 scale. Clinicians currently utilize the TMR® scale to modify treatment, assess patient progress, and measure treatment effectiveness; however, the reliability of the TMR® scale has not been determined. It is imperative to assess scale reliability and establish minimal detectable change (MDC) values to guide clinical practice. Objective: To assess the reliability of the TMR® scale and establish MDC values for each motion in healthy individuals in a group setting. Design: Retrospective analysis of group TMR® assessments. Setting: University classroom. Participants: A convenience sample of 61 students (23 males and 38 females; 25.48 [5.73] y), with (n = 31) and without (n = 30) previous exposure to TMR®. Intervention: The TMR® Fab 6 movements were tested at 2 time points, 2 hours apart. A clinician with previous training in TMR® led participant groups through both sessions while participants recorded individual motion scores using the 0 to 100 TMR® scale. Test–retest reliability was calculated using an intraclass correlation coefficient (2,1) for inexperienced, experienced, and combined student groups. Standard error of measurement and MDC values were also assessed for each intraclass correlation coefficient. Outcome Measure: Self-reported scores on the TMR® scale. Results: Test–retest reliability ranged from 0.57 to 0.95 across the Fab 6 movements, standard error of measurement values ranged from 4.85 to 11.77, and MDC values ranged from 13.45 to 32.62. Conclusion: The results indicate moderate to excellent reliability across the Fab 6 movements and a range of MDC values. Although this study is the first step in assessing the reliability of the TMR® scale for clinical practice, caution is warranted until further research is completed to establish reliability and MDC values of the TMR® scale in various settings to better guide patient care.

Sign in / Sign up

Export Citation Format

Share Document