Reliability of an Audit Tool for Systematic Assessment of Urban Alleyways

2010 ◽  
Vol 7 (2) ◽  
pp. 214-223 ◽  
Author(s):  
Mona Seymour ◽  
Kim D. Reynolds ◽  
Jennifer Wolch
Keyword(s):  
Los Angeles ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Audit Tool ◽  
Substantial Agreement ◽  
Systematic Assessment ◽  
Intraclass Correlation Coefficients ◽  
Continuous Response ◽  
Promising Tool ◽  
Acceptable Reliability

Background:Reliable audit tools are needed to examine the potential of built environment features for physical activity.Methods:An audit tool for alley environments was developed with land use, substrate, and use, condition, and safety items. Two audit teams independently audited 29 Los Angeles alleys, and interteam reliability was calculated with Cohen’s and prevalence-adjusted, bias-adjusted kappa (PABAK) statistics; intraclass correlation coefficients; and percent observed agreement.Results:Forty-two of 47 dichotomous items analyzed for reliability had PABAK values ≥ 0.61 (“substantial agreement”). Sixteen of 23 ordinal and continuous response items analyzed had ICCs ≥ 0.61, and an additional 6 with lower ICC values had observed agreement ≥ 79%. Items concerning the presence or absence of use-related alley features demonstrated the lowest reliability.Conclusions:The instrument has acceptable reliability for most of its items and appears to be a promising tool for use by other researchers and professionals in the measurement of alley environments.

Development and Reliability and Validity Testing of an Audit Tool for Trail/Path Characteristics: The Path Environment Audit Tool (PEAT)

2006 ◽  
Vol 3 (s1) ◽  
pp. S158-S175 ◽  
Author(s):  
Philip J. Troped ◽  
Ellen K. Cromley ◽  
Maren S. Fragala ◽  
Steven J. Melly ◽  
Hope H. Hasbrouck ◽  
...  
Keyword(s):  
Gold Standard ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Audit Tool ◽  
Validity Testing ◽  
Intraclass Correlation Coefficients ◽  
Observer Reliability ◽  
Acceptable Reliability

Background:To determine how trail characteristics may influence use, reliable and valid audit tools are needed.Methods:The Path Environment Audit Tool (PEAT) was developed with design, amenity, and aesthetics/maintenance items. Two observers independently audited 185 trail segments at 6 Massachusetts facilities. GPS-derived items were used as a “gold standard.” Kappa (k) statistics, observed agreement and intraclass correlation coefficients (ICCs) were calculated to assess inter-observer reliability and validity.Results:Fifteen of 16 primary amenity items had k-values ≥ 0.49 (“moderate”) and all had observed agreement ≥ 81%. Seven binary design items had k-values ranging from 0.19 to 0.71 and three of 5 ordinal items had ICCs ≥ 0.52. Only two aesthetics/maintenance items (n = 7) had moderate ICCs. Observed agreement between PEAT and GPS items was ≥ 0.77; k-values were ≥ 0.57 for 7 out of 10 comparisons.Conclusions:PEAT has acceptable reliability for most of its primary items and appears ready for use by researchers and practitioners.

scholarly journals Alberta Infant Motor Scale: Reliability and Validity When Used on Preterm Infants in Taiwan

2000 ◽  
Vol 80 (2) ◽  
pp. 168-178 ◽  
Author(s):  
Suh-Fang Jeng ◽  
Kuo-Inn Tsou Yau ◽  
Li-Chiou Chen ◽  
Shu-Fang Hsiao
Keyword(s):  
Preterm Infants ◽  
Interrater Reliability ◽  
Physical Therapist ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Intraclass Correlation Coefficients ◽  
Scale Reliability ◽  
Scale Scores ◽  
Acceptable Reliability

Abstract Background and Purpose. The goal of this study was to examine the reliability and validity of measurements obtained with the Alberta Infant Motor Scale (AIMS) for evaluation of preterm infants in Taiwan. Subjects. Two independent groups of preterm infants were used to investigate the reliability (n=45) and validity (n=41) for the AIMS. Methods. In the reliability study, the AIMS was administered to the infants by a physical therapist, and infant performance was videotaped. The performance was then rescored by the same therapist and by 2 other therapists to examine the intrarater and interrater reliability. In the validity study, the AIMS and the Bayley Motor Scale were administered to the infants at 6 and 12 months of age to examine criterion-related validity. Results. Intraclass correlation coefficients (ICCs) for intrarater and interrater reliability of measurements obtained with the AIMS were high (ICC=.97–.99). The AIMS scores correlated with the Bayley Motor Scale scores at 6 and 12 months (r=.78 and .90), although the AIMS scores at 6 months were only moderately predictive of the motor function at 12 months (r=.56). Conclusion and Discussion. The results suggest that measurements obtained with the AIMS have acceptable reliability and concurrent validity but limited predictive value for evaluating preterm Taiwanese infants.

scholarly journals Development, Validation, and Application of School Audit Tool (SAT): An Effective Instrument for Assessing Traffic Safety and Operation around Schools

2019 ◽  
Vol 11 (22) ◽  
pp. 6438 ◽  
Author(s):  
Shaaban ◽  
Abdur-Rouf
Keyword(s):  
Traffic Safety ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Qualitative Evaluation ◽  
Audit Tool ◽  
School Site ◽  
Site Assessment ◽  
Intraclass Correlation Coefficients ◽  
Item Checklist ◽  
Effective Instrument

There is a need for a reliable school audit tool with well-defined scales to convert qualitative evaluation of existing school sites into a quantitative assessment in order to help public agencies to improve schools’ safety and efficiency. In this study, a new, simple, and versatile School Audit Tool (SAT) was developed and tested. SAT was formed using a 30-item checklist categorized into four domains: school site assessment, road network assessment, parking/loading assessment, and active transport assessment. The tool was applied on a sample of 22 schools. Then, categorical and item-by-item Intraclass Correlation Coefficients (ICC) were calculated to validate the tool. The results showed acceptable overall test-retest (ICC = 0.919) and inter-rater reliability (ICC = 0.843) across all items and domains. SAT’s adaptable framework to assess and compare the safety and efficiency of schools is reliable, easy-to-use, and comprehensive. The tool is also effective in ranking schools and identifying items that may require upgrades or modifications.

Reliability of the 7-Day Physical Activity Recall in a Biracial Group of Inactive and Active Adults

2006 ◽  
Vol 3 (4) ◽  
pp. 423-438 ◽  
Author(s):  
Leslie A. Pruitt ◽  
Abby C. King ◽  
Eva Obarzanek ◽  
Michael Miller ◽  
Mary O’Toole ◽  
...  
Keyword(s):  
Physical Activity ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Intraclass Correlation Coefficients ◽  
Gender And Age ◽  
Diverse Groups ◽  
White Adults ◽  
Active Adults ◽  
Physical Activity Recall ◽  
Acceptable Reliability

Background:Physical activity recall (PAR) reliability was estimated in a three-site sample of African American and white adults. The sample was sedentary at baseline and more varied in physical activity 24 months later. Intraclass correlation coefficients (ICCs) were used to estimate the number of PAR assessments necessary to obtain a reliability of 0.70 at both timepoints.Methods:The PAR was administered ≤ 30 d apart at baseline (n = 547) and 24 months (n = 648). Energy expenditure ICC was calculated by race, gender, and age.Results:Baseline reliability was low for all groups with 4–16 PARs estimated to attain reliable data. ICCs at 24 months were similar (ICC = 0.54–0.55) for race and age group, with 2–3 PARs estimated to reach acceptable reliability. At 24 months, women were more reliable reporters than men.Conclusion:Low sample variability in activity reduced reliability, highlighting the importance of evaluating diverse groups. Despite evaluating a sample with greater physical activity variability, an estimated 2–3 PARs were necessary to obtain acceptable reliability.

Interobserver Reliability Using the Phonetic Level Evaluation With Severely and Profoundly Hearing-Impaired Children

1991 ◽  
Vol 34 (5) ◽  
pp. 989-999 ◽  
Author(s):  
Stephanie Shaw ◽  
Truman E. Coggins
Keyword(s):  
Interrater Reliability ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Hearing Impaired ◽  
Intraclass Correlation Coefficients ◽  
Assessment Measure ◽  
Impaired Children ◽  
Speech Assessment ◽  
Hearing Impaired Children

This study examines whether observers reliably categorize selected speech production behaviors in hearing-impaired children. A group of experienced speech-language pathologists was trained to score the elicited imitations of 5 profoundly and 5 severely hearing-impaired subjects using the Phonetic Level Evaluation (Ling, 1976). Interrater reliability was calculated using intraclass correlation coefficients. Overall, the magnitude of the coefficients was found to be considerably below what would be accepted in published behavioral research. Failure to obtain acceptably high levels of reliability suggests that the Phonetic Level Evaluation may not yet be an accurate and objective speech assessment measure for hearing-impaired children.

scholarly journals Is there a relationship between the overhead press and split jerk maximum performance? Influence of sex

2021 ◽  
pp. 174795412110204
Author(s):  
Marcos A Soriano ◽  
G Gregory Haff ◽  
Paul Comfort ◽  
Francisco J Amaro-Gahete ◽  
Antonio Torres-González ◽  
...  
Keyword(s):  
Confidence Intervals ◽  
Body Mass ◽  
Upper Limb ◽  
High Reliability ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Training Experience ◽  
Maximum Performance ◽  
Repetition Maximum ◽  
Intraclass Correlation Coefficients

The aims of this study were to (I) determine the differences and relationship between the overhead press and split jerk performance in athletes involved in weightlifting training, and (II) explore the magnitude of these differences in one-repetition maximum (1RM) performances between sexes. Sixty-one men (age: 30.4 ± 6.7 years; height: 1.8 ± 0.5 m; body mass 82.5 ± 8.5 kg; weightlifting training experience: 3.7 ± 3.5 yrs) and 21 women (age: 29.5 ± 5.2 yrs; height: 1.7 ± 0.5 m; body mass: 62.6 ± 5.7 kg; weightlifting training experience: 3.0 ± 1.5 yrs) participated. The 1RM performance of the overhead press and split jerk were assessed for all participants, with the overhead press assessed on two occasions to determine between-session reliability. The intraclass correlation coefficients (ICC) and 95% confidence intervals showed a high reliability for the overhead press ICC = 0.98 (0.97 – 0.99). A very strong correlation and significant differences were found between the overhead press and split jerk 1RM performances for all participants (r = 0.90 [0.93 – 0.85], 60.2 ± 18.3 kg, 95.7 ± 29.3 kg, p ≤ 0.001). Men demonstrated stronger correlations between the overhead press and split jerk 1RM performances (r = 0.83 [0.73-0.90], p ≤ 0.001) compared with women (r = 0.56 [0.17-0.80], p = 0.008). These results provide evidence that 1RM performance of the overhead press and split jerk performance are highly related, highlighting the importance of upper-limb strength in the split jerk maximum performance.

scholarly journals Patient-Reported Dysphagia in Adults with Eosinophilic Esophagitis: Translation and Validation of the Swedish Eosinophilic Esophagitis Activity Index

Dysphagia ◽  
2021 ◽  
Author(s):  
Sofie Albinsson ◽  
Lisa Tuomi ◽  
Christine Wennerås ◽  
Helen Larsson
Keyword(s):  
Eosinophilic Esophagitis ◽  
Activity Index ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Control Group ◽  
Cronbach’S Alpha ◽  
Intraclass Correlation Coefficients ◽  
Cronbach's Alpha ◽  
Patient Reported ◽  
Eortc Qlq

AbstractThe lack of a Swedish patient-reported outcome instrument for eosinophilic esophagitis (EoE) has limited the assessment of the disease. The aims of the study were to translate and validate the Eosinophilic Esophagitis Activity Index (EEsAI) to Swedish and to assess the symptom severity of patients with EoE compared to a nondysphagia control group. The EEsAI was translated and adapted to a Swedish cultural context (S-EEsAI) based on international guidelines. The S-EEsAI was validated using adult Swedish patients with EoE (n = 97) and an age- and sex-matched nondysphagia control group (n = 97). All participants completed the S-EEsAI, the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire-Oesophageal Module 18 (EORTC QLQ-OES18), and supplementary questions regarding feasibility and demographics. Reliability and validity of the S-EEsAI were evaluated by Cronbach’s alpha and Spearman correlation coefficients between the domains of the S-EEsAI and the EORTC QLQ-OES18. A test–retest analysis of 29 patients was evaluated through intraclass correlation coefficients. The S-EEsAI had sufficient reliability with Cronbach’s alpha values of 0.83 and 0.85 for the “visual dysphagia question” and the “avoidance, modification and slow eating score” domains, respectively. The test–retest reliability was sufficient, with good to excellent intraclass correlation coefficients (0.60–0.89). The S-EEsAI domains showed moderate correlation to 6/10 EORTC QLQ-OES18 domains, indicating adequate validity. The patient S-EEsAI results differed significantly from those of the nondysphagia controls (p < 0.001). The S-EEsAI appears to be a valid and reliable instrument for monitoring adult patients with EoE in Sweden.

scholarly journals Diagnosis of left ventricular hypertrophy using non-ECG-gated 15O-water PET

2021 ◽  
Author(s):  
Jens Sörensen ◽  
Jonny Nordström ◽  
Tomasz Baron ◽  
Stellan Mörner ◽  
Sven-Olof Granstam ◽  
...  
Keyword(s):  
Method Development ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Roc Curves ◽  
Left Ventricular ◽  
Intraclass Correlation Coefficients ◽  
Concentric Hypertrophy ◽  
2D Echocardiography ◽  
Positron Emission ◽  
Septal Wall Thickness

Abstract Aim To develop a method for diagnosing left ventricular (LV) hypertrophy from cardiac perfusion 15O-water positron emission tomography (PET). Methods We retrospectively pooled data from 139 subjects in four research cohorts. LV remodeling patterns ranged from normal to severe eccentric and concentric hypertrophy. 15O-water PET scans (n = 197) were performed with three different PET devices. A low-end scanner (66 scans) was used for method development, and remaining scans with newer devices for a blinded evaluation. Dynamic data were converted into parametric images of perfusable tissue fraction for semi-automatic delineation of the LV wall and calculation of LV mass (LVM) and septal wall thickness (WT). LVM and WT from PET were compared to cardiac magnetic resonance (CMR, n = 47) and WT to 2D-echocardiography (2DE, n = 36). PET accuracy was tested using linear regression, Bland–Altman plots, and ROC curves. Observer reproducibility were evaluated using intraclass correlation coefficients. Results High correlations were found in the blinded analyses (r ≥ 0.87, P < 0.0001 for all). AUC for detecting increased LVM and WT (> 12 mm and > 15 mm) was ≥ 0.95 (P < 0.0001 for all). Reproducibility was excellent (ICC ≥ 0.93, P < 0.0001). Conclusion 15O-water PET might detect LV hypertrophy with high accuracy and precision.

Intersession reliability of GPS-based and accelerometer-based physical variables in small-sided games with and without the offside rule

2021 ◽  
pp. 175433712098764
Author(s):  
Igor Junio de Oliveira Custódio ◽  
Gibson Moreira Praça ◽  
Leandro Vinhas de Paula ◽  
Sarah da Glória Teles Bredt ◽  
Fabio Yuzo Nakamura ◽  
...  
Keyword(s):  
Root Mean Square ◽  
Global Positioning System ◽  
Intraclass Correlation ◽  
Correlation Coefficients ◽  
Mean Square ◽  
Physical Demands ◽  
Intraclass Correlation Coefficients ◽  
Total Distance ◽  
Global Positioning ◽  
High Level

This study aimed to analyze the intersession reliability of global positioning system (GPS-based) distances and accelerometer-based (acceleration) variables in small-sided soccer games (SSG) with and without the offside rule, as well as compare variables between the tasks. Twenty-four high-level U-17 soccer athletes played 3 versus 3 (plus goalkeepers) SSG in two formats (with and without the offside rule). SSG were performed on eight consecutive weeks (4 weeks for each group), twice a week. The physical demands were recorded using a GPS with an embedded triaxial accelerometer. GPS-based variables (total distance, average speed, and distances covered at different speeds) and accelerometer-based variables (Player Load™, root mean square of the acceleration recorded in each movement axis, and the root mean square of resultant acceleration) were calculated. Results showed that the inclusion of the offside rule reduced the total distance covered (large effect) and the distances covered at moderate speed zones (7–12.9 km/h – moderate effect; 13–17.9 km/h – large effect). In both SSG formats, GPS-based variables presented good to excellent reliability (intraclass correlation coefficients – ICC > 0.62) and accelerometer-based variables presented excellent reliability (ICC values > 0.89). Based on the results of this study, the offside rule decreases the physical demand of 3 versus 3 SSG and the physical demands required in these SSG present high intersession reliability.

scholarly journals Assessment of reliability and validity of the 5-scale grading system of the point-of-care immunoassay for tear matrix metalloproteinase-9

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Minjeong Kim ◽  
Ja Young Oh ◽  
Seon Ha Bae ◽  
Seung Hyeun Lee ◽  
Won Jun Lee ◽  
...  
Keyword(s):  
Matrix Metalloproteinase ◽  
Calibration Curve ◽  
Point Of Care ◽  
Interobserver Reliability ◽  
Intraclass Correlation ◽  
Reliability And Validity ◽  
Correlation Coefficients ◽  
Grading System ◽  
Intraclass Correlation Coefficients ◽  
The Difference

AbstractWe evaluated the reliability and validity of the 5-scale grading system to interpret the point-of-care immunoassay for tear matrix metalloproteinase (MMP)-9. Six observers graded red bands of photographs of the readout window in MMP-9 immunoassay kit (InflammaDry) two times with 2-week interval based on the 5-scale grading system (i.e. grade 0–4). Interobserver and intraobserver reliability were evaluated using intraclass correlation coefficients. The interobserver agreements were analyzed according to the severity of tear MMP-9 expression. To validate the system, a concentration calibration curve was made using MMP-9 solutions with reference concentrations, then the distribution of MMP-9 concentrations was analyzed according to the 5-scale grading system. Both intraobserver and interobserver reliability was excellent. The readout grades were significantly correlated with the quantified colorimetric densities. The interobserver variance of readout grades had no correlation with the severity of the measured densities. The band density continued to increase up to a maximal concentration (i.e. 5000 ng/mL) according to the calibration curve. The difference of grades reflected the change of MMP-9 concentrations sensitively, especially between grade 2 and 4. Together, our data indicate that the subjective 5-scale grading system in the point-of-care MMP-9 immunoassay is an easy and reliable method with acceptable accuracy.

Sign in / Sign up

Export Citation Format

Share Document