Development and Reliability and Validity Testing of an Audit Tool for Trail/Path Characteristics: The Path Environment Audit Tool (PEAT)

2006 ◽  
Vol 3 (s1) ◽  
pp. S158-S175 ◽  
Author(s):  
Philip J. Troped ◽  
Ellen K. Cromley ◽  
Maren S. Fragala ◽  
Steven J. Melly ◽  
Hope H. Hasbrouck ◽  
...  

Background:To determine how trail characteristics may influence use, reliable and valid audit tools are needed.Methods:The Path Environment Audit Tool (PEAT) was developed with design, amenity, and aesthetics/maintenance items. Two observers independently audited 185 trail segments at 6 Massachusetts facilities. GPS-derived items were used as a “gold standard.” Kappa (k) statistics, observed agreement and intraclass correlation coefficients (ICCs) were calculated to assess inter-observer reliability and validity.Results:Fifteen of 16 primary amenity items had k-values ≥ 0.49 (“moderate”) and all had observed agreement ≥ 81%. Seven binary design items had k-values ranging from 0.19 to 0.71 and three of 5 ordinal items had ICCs ≥ 0.52. Only two aesthetics/maintenance items (n = 7) had moderate ICCs. Observed agreement between PEAT and GPS items was ≥ 0.77; k-values were ≥ 0.57 for 7 out of 10 comparisons.Conclusions:PEAT has acceptable reliability for most of its primary items and appears ready for use by researchers and practitioners.

2000 ◽  
Vol 80 (2) ◽  
pp. 168-178 ◽  
Author(s):  
Suh-Fang Jeng ◽  
Kuo-Inn Tsou Yau ◽  
Li-Chiou Chen ◽  
Shu-Fang Hsiao

Abstract Background and Purpose. The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Subjects. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. Methods. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Results. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97–.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and .90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). Conclusion and Discussion. The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.


2010 ◽  
Vol 7 (2) ◽  
pp. 214-223 ◽  
Author(s):  
Mona Seymour ◽  
Kim D. Reynolds ◽  
Jennifer Wolch

Background:Reliable audit tools are needed to examine the potential of built environment features for physical activity.Methods:An audit tool for alley environments was developed with land use, substrate, and use, condition, and safety items. Two audit teams independently audited 29 Los Angeles alleys, and interteam reliability was calculated with Cohen’s and prevalence-adjusted, bias-adjusted kappa (PABAK) statistics; intraclass correlation coefficients; and percent observed agreement.Results:Forty-two of 47 dichotomous items analyzed for reliability had PABAK values ≥ 0.61 (“substantial agreement”). Sixteen of 23 ordinal and continuous response items analyzed had ICCs ≥ 0.61, and an additional 6 with lower ICC values had observed agreement ≥ 79%. Items concerning the presence or absence of use-related alley features demonstrated the lowest reliability.Conclusions:The instrument has acceptable reliability for most of its items and appears to be a promising tool for use by other researchers and professionals in the measurement of alley environments.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Minjeong Kim ◽  
Ja Young Oh ◽  
Seon Ha Bae ◽  
Seung Hyeun Lee ◽  
Won Jun Lee ◽  
...  

AbstractWe evaluated the reliability and validity of the 5-scale grading system to interpret the point-of-care immunoassay for tear matrix metalloproteinase (MMP)-9. Six observers graded red bands of photographs of the readout window in MMP-9 immunoassay kit (InflammaDry) two times with 2-week interval based on the 5-scale grading system (i.e. grade 0–4). Interobserver and intraobserver reliability were evaluated using intraclass correlation coefficients. The interobserver agreements were analyzed according to the severity of tear MMP-9 expression. To validate the system, a concentration calibration curve was made using MMP-9 solutions with reference concentrations, then the distribution of MMP-9 concentrations was analyzed according to the 5-scale grading system. Both intraobserver and interobserver reliability was excellent. The readout grades were significantly correlated with the quantified colorimetric densities. The interobserver variance of readout grades had no correlation with the severity of the measured densities. The band density continued to increase up to a maximal concentration (i.e. 5000 ng/mL) according to the calibration curve. The difference of grades reflected the change of MMP-9 concentrations sensitively, especially between grade 2 and 4. Together, our data indicate that the subjective 5-scale grading system in the point-of-care MMP-9 immunoassay is an easy and reliable method with acceptable accuracy.


2020 ◽  
Author(s):  
Jiangang Sun ◽  
Yang Liu

BACKGROUND An increasing number of wrist-worn wearables are being examined in the context of health care. However, studies of their use during physical education (PE) lessons remain scarce. OBJECTIVE We aim to examine the reliability and validity of the Fizzo Smart Bracelet (Fizzo) in measuring heart rate (HR) in the laboratory and during PE lessons. METHODS In Study 1, 11 healthy subjects (median age 22.0 years, IQR 3.75 years) twice completed a test that involved running on a treadmill at 6 km/h for 12 minutes and 12 km/h for 5 minutes. During the test, participants wore two Fizzo devices, one each on their left and right wrists, to measure their HR. At the same time, the Polar Team2 Pro (Polar), which is worn on the chest, was used as the standard. In Study 2, we went to 10 schools and measured the HR of 24 students (median age 14.0 years, IQR 2.0 years) during PE lessons. During the PE lessons, each student wore a Polar device on their chest and a Fizzo on their right wrist to measure HR data. At the end of the PE lessons, the students and their teachers completed a questionnaire where they assessed the feasibility of Fizzo. The measurements taken by the left wrist Fizzo and the right wrist Fizzo were compared to estimate reliability, while the Fizzo measurements were compared to the Polar measurements to estimate validity. To measure reliability, intraclass correlation coefficients (ICC), mean difference (MD), standard error of measurement (SEM), and mean absolute percentage errors (MAPE) were used. To measure validity, ICC, limits of agreement (LOA), and MAPE were calculated and Bland-Altman plots were constructed. Percentage values were used to estimate the feasibility of Fizzo. RESULTS The Fizzo showed excellent reliability and validity in the laboratory and moderate validity in a PE lesson setting. In Study 1, reliability was excellent (ICC>0.97; MD<0.7; SEM<0.56; MAPE<1.45%). The validity as determined by comparing the left wrist Fizzo and right wrist Fizzo was excellent (ICC>0.98; MAPE<1.85%). Bland-Altman plots showed a strong correlation between left wrist Fizzo measurements (bias=0.48, LOA=–3.94 to 4.89 beats per minute) and right wrist Fizzo measurements (bias=0.56, LOA=–4.60 to 5.72 beats per minute). In Study 2, the validity of the Fizzo was lower compared to that found in Study 1 but still moderate (ICC>0.70; MAPE<9.0%). The Fizzo showed broader LOA in the Bland-Altman plots during the PE lessons (bias=–2.60, LOA=–38.89 to 33.69 beats per minute). Most participants considered the Fizzo very comfortable and easy to put on. All teachers thought the Fizzo was helpful. CONCLUSIONS When participants ran on a treadmill in the laboratory, both left and right wrist Fizzo measurements were accurate. The validity of the Fizzo was lower in PE lessons but still reached a moderate level. The Fizzo is feasible for use during PE lessons.


2013 ◽  
Vol 93 (7) ◽  
pp. 967-974 ◽  
Author(s):  
Olaf Verschuren ◽  
Maremka Zwinkels ◽  
Marjolijn Ketelaar ◽  
Femke Reijnders-van Son ◽  
Tim Takken

BackgroundFor children with cerebral palsy (CP) who are able to walk or run, the 10-m shuttle run test is currently the test of choice to assess cardiorespiratory fitness. This test, however, has not yet been examined in wheelchair-using youth with CP.ObjectiveThe purpose of this study was to investigate the test-retest reproducibility and validity of the 10-m shuttle ride test (SRiT) in youth with CP.DesignRepeated measurements of the SRiT were obtained.MethodsTwenty-three individuals with spastic CP (18 boys, 5 girls; mean age=13.3 years, SD=3.6 years) using a manual wheelchair for at least part of the day participated in this study. During the study, all participants performed one graded arm exercise test (GAET) and 2 identical SRiTs within 2 weeks. Peak oxygen uptake (V̇o2peak), peak heart rate (HRpeak), and respiratory exchange ratio (RER) were recorded. Intraclass correlation coefficients (2,1), the smallest detectable difference, and the limits of agreement (LOA) were calculated. The association between the results of the SRiT and GAET was tested using Pearson correlation coefficients.ResultsIntraclass correlation coefficients (.99, 95% confidence interval=.98–1.00) for all variables indicated highly acceptable reproducibility. The LOA analysis revealed satisfactory levels of agreement. The SRiT variables demonstrated strong, significant positive correlations for V̇o2peak values obtained during the SRiT and the GAET (r=.84, P<.01).LimitationsAlthough the GAET is considered the gold standard, the cardiorespiratory demand during the GAET was significantly lower compared with during the SRiT. Future studies should determine whether the GAET can still be accepted as the gold standard for upper-extremity exercise.ConclusionsThe SRiT is a reproducible and valid test for measuring cardiorespiratory fitness in youth with spastic CP who self-propel a manual wheelchair.


Sensors ◽  
2019 ◽  
Vol 19 (2) ◽  
pp. 265 ◽  
Author(s):  
Kristen Renner ◽  
DS Williams ◽  
Robin Queen

The assessment of loading during walking and running has historically been limited to data collection in laboratory settings or with devices that require a computer connection. This study aims to determine if the loadsol®—a single sensor wireless insole—is a valid and reliable method of assessing force. Thirty (17 male and 13 female) recreationally active individuals were recruited for a two visit study where they walked (1.3 m/s) and ran (3.0 and 3.5 m/s) at a 0%, 10% incline, and 10% decline, with the visits approximately one week apart. Ground reaction force data was collected on an instrumented treadmill (1440 Hz) and with the loadsol® (100 Hz). Ten individuals completed the day 1 protocol with a newer 200 Hz loadsol®. Intraclass correlation coefficients (ICC3,k) were used to assess validity and reliability and Bland–Altman plots were generated to better understand loadsol® validity. Across conditions, the peak force ICCs ranged from 0.78 to 0.97, which increased to 0.84–0.99 with the 200 Hz insoles. Similarly, the loading rate ICCs improved from 0.61 to 0.97 to 0.80–0.96 and impulse improved from 0.61 to 0.97 to 0.90–0.97. The 200 Hz insoles may be needed for loading rate and impulse in running. For both walking and running, the loadsol® has excellent between-day reliability (>0.76).


1989 ◽  
Vol 9 (5) ◽  
pp. 259-272 ◽  
Author(s):  
Jane Case-Smith

The Posture and Fine Motor Assessment of Infants (PFMAI) (Case-Smith, 1987) is a newly developed instrument for assessing the quality of motor function in infants. The test measures components of posture and fine motor control as they first develop. The purpose of this study was to support the test's reliability and validity. Interrater reliability, analyzed with intraclass correlation coefficients (ICCs), was high (.989 for total scores). Test-retest reliability, measured by ICCs, was .853 and .913 for the two test sections. The PFMAI demonstrated concurrent validity with the Peabody Developmental Motor Scales, Revised (Folio & Fewell, 1983) (correlations were .673 and .829 for the individual sections). Scores on the PFMAI were highly correlated with the infant's ages (.892 to .941); this finding provided one indication of construct validity.


2005 ◽  
Vol 25 (2) ◽  
pp. 44-54 ◽  
Author(s):  
Jeng-Liang Hwang

The purpose of this study was to examine the reliability and validity of the School Function Assessment (SFA)-Chinese version. The data drawn from the standardization sample of the instrument (N = 320) were used in the analyses. Using internal consistency procedures, Cronbach's alpha for each scale ranged from .94 to .98. The test—retest study reported intraclass correlation coefficients from .87 to .98 among the scales. Content validity of the SFA—Chinese version was confirmed by the overall high content validity indices (85% to 100%) determined by educational experts. Construct-related validity based on an exploratory factor analysis revealed two correlated functional domains of the SFA—Chinese version, “cognitive/behavioral” and “physical,” which were consistent with the theoretical construct hypothesized in the instrument. The known groups method demonstrated different patterns of the SFA scores among three different diagnostic groups. Moreover, discriminant analysis of the scores showed a high percentage of children correctly classified into their diagnostic groups. The overall results supported the psychometric properties of the SFA—Chinese version.


2015 ◽  
Vol 31 (3) ◽  
pp. 159-163 ◽  
Author(s):  
Nathan W. Saunders ◽  
Panagiotis Koutakis ◽  
Anne D. Kloos ◽  
Deborah A. Kegelmeyer ◽  
Jessica D. Dicke ◽  
...  

Clinicians are in need of valid and objective measures of postural sway. Accelerometers have been shown to be suitable alternatives to expensive and stationary force plates. We evaluated the test-retest reliability and balance task discrimination capability of a new wireless triaxial accelerometer (YEI 3-Space Sensor). Four testing conditions (eyes open or closed, while on a firm or compliant surface) were used to progressively challenge the static balance of 20 healthy male (n = 8) and female (n = 12) older adults (mean age 81 ± 4.3 y). Subjects completed 2 blocks of three 30-second trials per condition. The accelerometer was positioned on the lower back to acquire mediolateral (M-L) and anterior-posterior (A-P) accelerations. Intraclass correlation coefficients were all good to excellent, with values ranging from .736 to .972 for trial-to-trial and from .760 to .954 for block-to-block. A significant stepwise increase in center of mass acceleration root mean square values was found across the 4 balance conditions (F[1.49, 28.26] = 39.54, P < .001). The new accelerometer exhibited good to excellent trial-to-trial and block-to-block reliability and was sensitive to differences in visual and surface conditions and acceleration axes.


2021 ◽  
Vol 77 (2) ◽  
Author(s):  
Burçin Akçay ◽  
Tuğba Kuru Çolak ◽  
Adnan Apti ◽  
İlker Çolak ◽  
Önder Kızıltaş

Background: In pattern-specific scoliosis exercises and bracing, the corrective treatment plan differs according to different curve patterns. There are a limited number of studies investigating the reliability of the commonly used classifications systems.Objective: To test the reliability of the augmented Lehnert-Schroth (ALS) classification and the Rigo classification.Methods: X-rays and posterior photographs of 45 patients with scoliosis were sent by the first author to three clinicians twice at 1-week intervals. The clinicians classified images according to the ALS and Rigo classifications, and the data were analysed using SPSS V-16. Intraclass correlation coefficients (ICCs) and standard error measurement (SEM) were calculated to evaluate the inter- and intra-observer reliability.Results: The inter-observer ICC values were 0.552 (ALS), 0.452 (Rigo) for X-ray images and 0.494 (ALS), 0.518 (Rigo) for the photographs. The average intra-observer ICC value was 0.720 (ALS), 0.581 (Rigo) for the X-ray images and 0.726 (ALS) and 0.467 (Rigo) for the photographs.Conclusions: The results of our study indicate moderate inter-observer reliability for X-ray images using the ALS classification and clinical photographs using the Rigo classification. Intra-observer reliability was moderate to good for X-ray images and clinical photographs using the ALS classification and poor to moderate for X-ray and clinical photographs using the Rigo classification.Clinical implications: Pattern classifications assist in creating a plan and indication of correction in specific scoliosis physiotherapy and pattern-specific brace applications and surgical treatment. More sub-types are needed to address the individual patterns of curvature. The optimisation of curve classification will likely reduce failures in diagnosis and treatment.


Sign in / Sign up

Export Citation Format

Share Document