Reproducibility and Validity of the 10-Meter Shuttle Ride Test in Wheelchair-Using Children and Adolescents With Cerebral Palsy

BackgroundFor children with cerebral palsy (CP) who are able to walk or run, the 10-m shuttle run test is currently the test of choice to assess cardiorespiratory fitness. This test, however, has not yet been examined in wheelchair-using youth with CP.ObjectiveThe purpose of this study was to investigate the test-retest reproducibility and validity of the 10-m shuttle ride test (SRiT) in youth with CP.DesignRepeated measurements of the SRiT were obtained.MethodsTwenty-three individuals with spastic CP (18 boys, 5 girls; mean age=13.3 years, SD=3.6 years) using a manual wheelchair for at least part of the day participated in this study. During the study, all participants performed one graded arm exercise test (GAET) and 2 identical SRiTs within 2 weeks. Peak oxygen uptake (V̇o2peak), peak heart rate (HRpeak), and respiratory exchange ratio (RER) were recorded. Intraclass correlation coefficients (2,1), the smallest detectable difference, and the limits of agreement (LOA) were calculated. The association between the results of the SRiT and GAET was tested using Pearson correlation coefficients.ResultsIntraclass correlation coefficients (.99, 95% confidence interval=.98–1.00) for all variables indicated highly acceptable reproducibility. The LOA analysis revealed satisfactory levels of agreement. The SRiT variables demonstrated strong, significant positive correlations for V̇o2peak values obtained during the SRiT and the GAET (r=.84, P<.01).LimitationsAlthough the GAET is considered the gold standard, the cardiorespiratory demand during the GAET was significantly lower compared with during the SRiT. Future studies should determine whether the GAET can still be accepted as the gold standard for upper-extremity exercise.ConclusionsThe SRiT is a reproducible and valid test for measuring cardiorespiratory fitness in youth with spastic CP who self-propel a manual wheelchair.

Download Full-text

A Quantitative Comparison of Multispectral Refraction Topography and Autorefractometer in Young Adults

Frontiers in Medicine ◽

10.3389/fmed.2021.715640 ◽

2021 ◽

Vol 8 ◽

Author(s):

Yunru Liao ◽

Zhenlan Yang ◽

Zijing Li ◽

Rui Zeng ◽

Jing Wang ◽

...

Keyword(s):

Correlation Coefficient ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Cross Sectional Study ◽

Cross Sectional ◽

High Agreement ◽

Intraclass Correlation Coefficients ◽

Repeatability And Reproducibility ◽

The Mean

Purpose: Purpose of this study is to evaluate the measuring consistency of central refraction between multispectral refraction topography (MRT) and autorefractometry.Methods: This was a descriptive cross-sectional study including subjects in Sun Yat-sen Memorial Hospital from September 1, 2020, to December 31, 2020, ages 20 to 35 years with a best corrected visual acuity of 20/20 or better. All patients underwent cycloplegia, and the refractive status was estimated with autorefractometer, experienced optometrist and MRT. We analyzed the central refraction of the autorefractometer and MRT. The repeatability and reproducibility of values measured using both devices were evaluated using intraclass correlation coefficients (ICCs).Results: A total of 145 subjects ages 20 to 35 (290 eyes) were enrolled. The mean central refraction of the autorefractometer was −4.69 ± 2.64 diopters (D) (range −9.50 to +4.75 D), while the mean central refraction of MRT was −4.49 ± 2.61 diopters (D) (range −8.79 to +5.02 D). Pearson correlation analysis revealed a high correlation between the two devices. The intraclass correlation coefficient (ICC) also showed high agreement. The intrarater and interrater ICC values of central refraction were more than 0.90 in both devices and conditions. At the same time, the mean central refraction of experienced optometrist was −4.74 ± 2.66 diopters (D) (range −9.50 to +4.75D). The intra-class correlation coefficient of central refraction measured by MRT and subjective refraction was 0.939.Conclusions: Results revealed that autorefractometry, experienced optometrist and MRT show high agreement in measuring central refraction. MRT could provide a potential objective method to assess peripheral refraction.

Download Full-text

Assessing the Motor Status Score: A Scale for the Evaluation of Upper Limb Motor Outcomes in Patients after Stroke

Neurorehabilitation and Neural Repair ◽

10.1177/154596830201600306 ◽

2002 ◽

Vol 16 (3) ◽

pp. 283-289 ◽

Cited By ~ 56

Author(s):

Mark Ferraro ◽

Jennifer Hogan Demaio ◽

Jennifer Krol ◽

Chris Trudell ◽

Keren Rannekleiv ◽

...

Keyword(s):

Correlation Coefficient ◽

Upper Limb ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Pearson Correlation Coefficient ◽

Maximum Score ◽

Intraclass Correlation Coefficients ◽

Upper Extremity Impairment ◽

Motor Outcomes

The Motor Status Scale (MSS) measures shoulder, elbow (maximum score = 40), wrist, hand, and finger movements (maximum score = 42), and expands the measurement of upper extremity impairment and disability provided by the Fugl-Meyer (FM) score. This work examines the interrater reliability and criterion validity of the MSS performed in patients admitted to a rehabilitation hospital 21 ± 4 days after stroke. Using the MSS and the FM, 7 occupational therapists masked to each other’s judgments, evaluated 12 consecutive patients with stroke. Two therapists evaluated 6 additional patients on consecutive days. Intraclass correlation coefficients were significant for each group of raters for the shoulder/elbow and for the wrist/hand (P < 0.0001); test-retest measures were also significant for the shoulder/elbow (Pearson correlation coefficient r = 0.99, P < 0.004) and for the wrist/hand (Pearson correlation coefficient r = 0.99, P < 0.003). The internal item consistency for the overall MSS was significant (Cronbach alpha = 0.98, P < 0.0001). Finally the correlation between the MSS and the FM (R 2 = 0.964) was significant (P < 0.0001). The MSS affords a reliable and valid assessment of upper limb impairment and disability following stroke.

Download Full-text

Inter-Operator Reliability of Dental Morphometric Measurements

Journal of Interdisciplinary Medicine ◽

10.2478/jim-2018-0040 ◽

2018 ◽

Vol 3 (4) ◽

pp. 225-228

Author(s):

Bernadette Kerekes-Máthé ◽

Csaba Dudás ◽

Nóra Csergő ◽

Krisztina Mártha

Keyword(s):

Image Analysis ◽

Measurement Errors ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Repeated Measurements ◽

Analysis Method ◽

Image Analysis Method ◽

Morphometric Measurements ◽

Occlusal View ◽

Intraclass Correlation Coefficients

Abstract Background: Measurement-based studies are prone to measurement errors, which occur at the same operator or between different operators during repeated measurements of the same sample. Aim of the study: To assess the inter-operator reliability of morphometric measurements using a bidimensional image analysis method. Material and methods: Eight study models have been selected, images of teeth and models were taken from vestibular and occlusal view. The following parameters were measured individually by three, previously trained operators: mesio-distal, occluso-gingival, and vestibulo-oral dimensions, vestibular and occlusal area, depth of palatal arch, arch breadth, arch circumference, and arch length. Intraclass correlation coefficients were calculated for each measurement. Results: The reliability of the measurements showed high degrees, all values being higher than 0.8. Conclusions: Dental morphometric measurements done by 2D image analysis can be performed by multiple operators with an excellent reliability.

Download Full-text

Test–Retest Reliability of a New Device Versus a Long-Arm Goniometer to Evaluate Knee Proprioception

Journal of Sport Rehabilitation ◽

10.1123/jsr.2021-0146 ◽

2021 ◽

pp. 1-6

Author(s):

Fei Tian ◽

Yaqi Zhao ◽

Jixin Li ◽

Wenjin Wang ◽

Danni Wu ◽

...

Keyword(s):

Standard Error ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Joint Position Sense ◽

Repeated Measurements ◽

Good Reliability ◽

Retest Reliability ◽

New Device ◽

Intraclass Correlation Coefficients ◽

Test Retest Reliability

Context: Many methods used to evaluate knee proprioception have shortcomings that limit their use in clinical settings. Based on an inexpensive 3D camera, a new portable device was recently used to evaluate the joint position sense (JPS) of the knee joint. However, the test–retest reliability of the new method remains unclear. This study aimed to evaluate the test–retest reliability of the new device and a long-arm goniometer for assessing knee JPS, and to compare the variability of the 2 methods. Design: Prospective observational study of the test–retest reliability of knee JPS measurements. Methods: Twenty-one healthy adults were tested in 2 sessions with a 1-week interval. Three target knee flexion angles (30°, 45°, and 60°) were reproduced in each session. Target and reproduced angles were measured with both methods. Intraclass correlation coefficients, standard error of the measurement, and Bland–Altman plots were used to quantify test–retest reliability. Paired t tests were used to compare knee JPS (absolute error of the target-reproduced angle) between the methods. Results: The new device (good to excellent intraclass correlation coefficients .74–.80; standard error of the measurement 0.52°–0.61°) demonstrated better test–retest reliability than the goniometer (poor to fair intraclass correlation coefficients .23–.43; standard error of the measurement 0.89°–2.07°) and better test–retest agreement (respective mean differences for the 30°, 45°, and 60° knee angles: 0.11°, 0.13°, and 0.41° for the new system; 0.84°, 1.52°, and 1.18° for the goniometer). The measurements (absolute errors of the target-reproduced angles) with the goniometer were significantly greater than those with the new device (P < .05); the SDs of repeated measurements with the goniometer (1.50°–2.41°) were greater than with the new device (1.08°–1.38°). Conclusions: Given that the new device has good reliability and sufficient precision, it is the better alternative for evaluating knee JPS. Goniometers should be used with caution to assess knee JPS.

Download Full-text

In Search of a Simple and Reliable Method of Measuring Intra-abdominal Pressure in Peritoneal Dialysis Patients

Canadian Journal of Kidney Health and Disease ◽

10.1177/2054358119892695 ◽

2019 ◽

Vol 6 ◽

pp. 205435811989269

Author(s):

Tharshika Thangarasa ◽

Dana Foisy ◽

Julie Leidecker ◽

Daniel J. Corsi ◽

Hilary Meggison ◽

...

Keyword(s):

Peritoneal Dialysis ◽

Gold Standard ◽

Reliable Method ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Abdominal Pressure ◽

Pressure Monitor ◽

Dialysis Unit ◽

Home Dialysis ◽

Intraclass Correlation Coefficients

Background: Patients treated with peritoneal dialysis (PD) are at increased risk of developing mechanical complications such as dialysate leaks and hernias thought to be partially related to an increase in intra-abdominal pressure (IAP) secondary to dialysate in the abdomen. However, measurement of IAP requires specialized equipment that is not readily available in the home dialysis unit. Objectives: To develop a reliable method of measuring IAP in PD patients that could be easily used in the home dialysis unit. We hypothesized that the handheld Stryker pressure monitor would be suitable for this purpose via connection to the PD catheter. Design: Cross-sectional. Setting: Tertiary Care Hospital, Ottawa, Ontario, Canada. Patients: Patients who were having a PD catheter inserted via laparoscopic surgery at The Ottawa Hospital were recruited for the study. Measurements: With the patients at end-expiration, the IAP measured with the Stryker monitor connected to the PD catheter was compared with the insufflator pressures of 15, 10, and 5 mm Hg. Methods: Bland-Altman plots were constructed and intraclass correlation coefficients were calculated for each pressure. Results: Twelve patients participated in the study: 9 men and 3 women. They were on average 53 ± 15 years old and 81 ± 13.4 kg. Two patients had to be excluded from the analysis due to difficulties zeroing the Stryker pressure monitor at the time of surgery. There were also rapid fluctuations in the insufflator pressure recording, creating additional challenges in comparing the 2 measurements at end-expiration. The 95% limits of agreement for the Bland-Altman plots ranged from 7.9 (@15 mm Hg) to 12.2 (@10 mm Hg). The intraclass correlation coefficients for reliability of the individual measurements ranged from 0.015 (10 mm Hg) to 0.634 (15 mm Hg). Limitations: Small sample size and lack of a gold standard comparator may have affected our results. Conclusions: In our study, we used the operating room insufflator as the gold standard for measuring IAP. By Bland-Altman plots and intraclass correlation coefficients, the pressure values obtained with the Stryker pressure monitor were not a reliable estimate of insufflator IAP especially at lower pressures. Further studies are needed to identify an ideal tool for measurement of IAP to guide PD management.

Download Full-text

Reliability of a Three-Dimensional Wound Camera and Correlation With Routine Ruler Measurement in Diabetes-Related Foot Ulceration

Journal of Diabetes Science and Technology ◽

10.1177/1932296820974654 ◽

2020 ◽

pp. 193229682097465

Author(s):

Joel Willem Johan Lasschuit ◽

Jill Featherston ◽

Katherine Thuy Trang Tonks

Keyword(s):

Interobserver Reliability ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Three Dimensional ◽

Correlation Coefficients ◽

Area Measurement ◽

Foot Care ◽

Foot Ulceration ◽

Intraclass Correlation Coefficients ◽

Service Setting

Background: In an era of increasing technology and telehealth utilization, three-dimensional (3D) wound cameras promise reliable, rapid, and touch-free ulceration measurements. However, reliability data for commercially available devices in the diabetes foot service setting is lacking. We aimed to evaluate the reliability of diabetes-related foot ulceration measurement using a 3D wound camera in comparison to the routinely used ruler and probe. Method: Participants were prospectively recruited from a tertiary interdisciplinary diabetes foot service. Ulcerations were measured at each visit by two blinded observers, first by ruler and probe, and then using a 3D wound camera twice. Reliability was evaluated using intraclass correlation coefficients (ICC). Measurement methods were compared by Pearson correlation. Results: Sixty-three ulcerations affecting 38 participants were measured over 122 visits. Interobserver reliability of ruler measurement was excellent for estimated area (ICC 0.98, 95% CI 0.97-0.98) and depth (ICC 0.93, 95% CI 0.90-0.95). Intraobserver and interobserver reliability of the 3D wound camera area was excellent (ICC 0.96, 95%CI 0.95-0.97 and 0.97 95% CI 0.96-0.98, respectively). Depth was unrecordable in over half of 3D wound camera measurements, and reliability was inferior to probe measurement. Area correlation between methods was good ( R = 0.88 and 0.94 per observer); however, depth correlation was poor ( R = 0.49 and 0.65). Conclusions: 3D wound cameras offer practical advantages over ruler-based measurement. In diabetes-related foot ulceration, the reliability and comparability of area measurement was excellent across both methods, although depth was more reliably obtained by the probe. These limitations, together with cost, are important considerations if implementing this technology in diabetes foot care.

Download Full-text

Influence of Radiographic Viewing Perspective on Glenoid Inclination Measurement

Journal of Shoulder and Elbow Arthroplasty ◽

10.1177/2471549218824986 ◽

2019 ◽

Vol 3 ◽

pp. 247154921882498 ◽

Cited By ~ 1

Author(s):

Peter N Chalmers ◽

Thomas Suter ◽

Matthijs Jacxsens ◽

Yue Zhang ◽

Chong Zhang ◽

...

Keyword(s):

Gold Standard ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Two Dimensional ◽

Viewing Angle ◽

Plain Radiographs ◽

3 Dimensional ◽

Intraclass Correlation Coefficients ◽

Orthopedic Surgeons ◽

Viewing Perspective

Introduction The purposes of this study were to determine (1) whether glenoid inclination (GI) could be accurately measured on plain radiographs as compared to a gold-standard 3-dimensional (3D) measure and (2) whether GI could be reliably measured on plain radiographs. Materials and Methods Digitally reconstructed radiographs (DRRs) were made from 3D computed tomography reconstructions of 68 normal cadaver scapulae. DRRs were made in a variety of viewing angles. Inclination was measured on these DRRs. These measurements were also made using a gold-standard 3D method. Measurements were made by 2 orthopedic surgeons and 1 surgeon twice, to calculate interrater and intrarater intraclass correlation coefficients (ICCs). Results The gold-standard 3D β was 83 ± 5° (72°–98°). On neutral plain radiographs, the mean ± standard deviation 2D β angle was 80 ± 6° (range, 66°–99°). With regard to accuracy, the 2D β angle was significantly different from the 3D β angle, with the 2D β underestimating the 3D β by 5° (95% confidence intervals −1 to 12). With regard to reliability, interrater ICCs for 2D β with a neutral viewing angle was 0.79. Two-dimensional β varied widely with viewing angle from 0.24 to 0.88. Interrater ICCs for the 3D method was 0.83 (0.60–0.92). Intrarater ICCs for all 3 techniques were high (>0.91). Conclusions Two-dimensional radiographic GI measurement is not accurate, as it underestimates the 3D value by an average of 5° when compared to the gold-standard 3D measurement. GI 2D measurement reliability varies with viewing angle on plain radiographs and thus to accurately and reliably measure inclination 3D imaging is necessary.

Download Full-text

Development and Reliability and Validity Testing of an Audit Tool for Trail/Path Characteristics: The Path Environment Audit Tool (PEAT)

Journal of Physical Activity and Health ◽

10.1123/jpah.3.s1.s158 ◽

2006 ◽

Vol 3 (s1) ◽

pp. S158-S175 ◽

Cited By ~ 43

Author(s):

Philip J. Troped ◽

Ellen K. Cromley ◽

Maren S. Fragala ◽

Steven J. Melly ◽

Hope H. Hasbrouck ◽

...

Keyword(s):

Gold Standard ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Correlation Coefficients ◽

Audit Tool ◽

Validity Testing ◽

Intraclass Correlation Coefficients ◽

Observer Reliability ◽

Acceptable Reliability

Background:To determine how trail characteristics may influence use, reliable and valid audit tools are needed.Methods:The Path Environment Audit Tool (PEAT) was developed with design, amenity, and aesthetics/maintenance items. Two observers independently audited 185 trail segments at 6 Massachusetts facilities. GPS-derived items were used as a “gold standard.” Kappa (k) statistics, observed agreement and intraclass correlation coefficients (ICCs) were calculated to assess inter-observer reliability and validity.Results:Fifteen of 16 primary amenity items had k-values ≥ 0.49 (“moderate”) and all had observed agreement ≥ 81%. Seven binary design items had k-values ranging from 0.19 to 0.71 and three of 5 ordinal items had ICCs ≥ 0.52. Only two aesthetics/maintenance items (n = 7) had moderate ICCs. Observed agreement between PEAT and GPS items was ≥ 0.77; k-values were ≥ 0.57 for 7 out of 10 comparisons.Conclusions:PEAT has acceptable reliability for most of its primary items and appears ready for use by researchers and practitioners.

Download Full-text

An Italian Validation of ABILHAND-Kids for Children With Cerebral Palsy

Perceptual and Motor Skills ◽

10.1177/00315125211049730 ◽

2021 ◽

pp. 003151252110497

Author(s):

Marco Tofani ◽

Giulia Blasetti ◽

Luca Lucibello ◽

Anna Berardi ◽

Giovanni Galeoto ◽

...

Keyword(s):

Cerebral Palsy ◽

Internal Consistency ◽

Pearson Correlation ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Cronbach’S Alpha ◽

Retest Reliability ◽

Cronbach's Alpha ◽

Children With Cerebral Palsy ◽

Test Retest Reliability

Limitations in hand function are common among children with cerebral palsy (CP), with almost 50% presenting an arm–hand dysfunction. However, there is no standardized assessment tool available in Italian for evaluating bimanual performance for this population. Our objective in this study was to evaluate the psychometric properties of an Italian translation of the ABILHAND-Kids (ABILHAND-Kids-IT) among children with CP. We examined internal consistency using Cronbach’s Alpha and Omega coefficients, and we investigated test-retest reliability with intraclass correlation coefficients (ICC). We performed explorative factor analysis (EFA) to investigate structural validity. We calculated Pearson’s correlation coefficients between the ABILAND-Kids IT and the Manual Ability Classification System (MACS) to assess criterion validity; and, to demonstrate the score variability of the ABILHAND-Kids-IT, we used analyses of variance (ANOVAs) to compare the 181 children with CP in this sample with their levels on the MACS. We enrolled 181 children with CP in the study. EFA confirmed a uni-dimensional scale. We obtained internal consistency on both Cronbach’s Alpha and Omega coefficient of 0.98, and a one-week test-retest reliability analysis revealed an ICC with 95% of confidence interval of .992. The ANOVA revealed significant score variability ( p < 0.01) and the Pearson correlation coefficient comparing the ABILHAND-Kids-It score with the MACS was –0.929 ( p < 0.01). We conclude that the ABILHAND-Kids-IT is valid and reliable for use with Italian children with CP.

Download Full-text

WITHIN-DAY AND BETWEEN-DAY RELIABILITY OF A FBG-BASED SMART SOCK SYSTEM FOR MEASURING ACTIVE TOE FLEXION DISPLACEMENT OF THE HALLUX

Journal of Mechanics in Medicine and Biology ◽

10.1142/s0219519421500573 ◽

2021 ◽

pp. 2150057

Author(s):

PUI WAH KONG ◽

JING WEN PAN ◽

DANIEL T. P. FONG ◽

YIXUAN LEOW ◽

YIMIN LIU ◽

...

Keyword(s):

Wearable Sensors ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Repeated Measurements ◽

Intraclass Correlation Coefficients ◽

Paired Samples ◽

Test Retest Reliability ◽

And Control ◽

Standard Error Of Measurement ◽

Prototype Design

This study examined the test-retest reliability of hallux flexion displacement measured using a smart sock system with embedded fiber Bragg grating (FBG) sensors. Thirty female participants consisting of 15 hallux valgus (HV) patients and 15 control participants were recruited. Maximum active hallux flexion displacement was measured twice on each participant in the first visit; the same procedures were repeated 7 days later. Intraclass correlation coefficients (ICC2,1) and standard error of measurement (SEM) were applied to test within-day and between-day reliability. Paired-samples T-test was performed to compare the displacements between trials. Results showed almost perfect within-day reliability for both HV and control groups ([Formula: see text] and 0.977, respectively) with small SEM (both 0.5[Formula: see text]cm). However, fair to moderate between-day reliability was found (0.323 and 0.438, respectively). Significant differences were found between repeated measurements taken on the same day (mean [Formula: see text][Formula: see text]cm, [Formula: see text]) and on different days (mean [Formula: see text][Formula: see text]cm, [Formula: see text]), though the effect size was small. The poorer between-day reliability is likely due to the inconsistency in fitting the sock onto the foot. Future optimization of the prototype design is called for to improve the fitting consistency of wearable sensors onto patients.

Download Full-text