Construct validity and inter-rater reliability of the Gymnastic Functional Measurement Tool in the classification of female competitive gymnasts in Canada

Purpose: To adapt and validate a survey instrument to assess the nutrition environment of grab-and-go establishments at a university campus. Methods: A version of the Nutrition Environment Measures Survey for grab-and-go establishments (NEMS-GG) was adapted from existing NEMS instruments and tested for reliability and validity through a cross-sectional assessment of the grab-and-go establishments at the University of Toronto. Product availability, price, and presence of nutrition information were evaluated. Cohen’s kappa coefficient and intra-class correlation coefficients (ICC) were assessed for inter-rater reliability, and construct validity was assessed using the known-groups comparison method (via store scores). Results: Fifteen grab-and-go establishments were assessed. Inter-rater reliability was high with an almost perfect agreement for availability (mean κ = 0.995) and store scores (ICC = 0.999). The tool demonstrated good face and construct validity. About half of the venues carried fruit and vegetables (46.7% and 53.3%, respectively). Regular and healthier entrée items were generally the same price. Healthier grains were cheaper than regular options. Six establishments displayed nutrition information. Establishments operated by the university’s Food Services consistently scored the highest across all food premise types for nutrition signage, availability, and cost of healthier options. Conclusions: Health promotion strategies are needed to address availability and variety of healthier grab-and-go options in university settings.

Download Full-text

The Schedule for the Assessment of Drug-Induced Movement Disorders (SADIMoD): inter-rater reliability and construct validity

The International Journal of Neuropsychopharmacology ◽

10.1017/s1461145701002589 ◽

2001 ◽

Vol 4 (04) ◽

Cited By ~ 15

Author(s):

Anton J. M. Loonen ◽

Cees H. Doorschot ◽

Dianne A. van Hemert ◽

Marc C. J. M. Oostelbos ◽

Arnold E. S. Sijben ◽

...

Keyword(s):

Construct Validity ◽

Movement Disorders ◽

Drug Induced ◽

Rater Reliability

Download Full-text

16937 Evaluation of construct validity and inter-rater reliability of the Objective Structured Assessment of Technical Skills (OSATS) tool for assessment of surgical skills of dermatology trainees

Journal of the American Academy of Dermatology ◽

10.1016/j.jaad.2020.06.389 ◽

2020 ◽

Vol 83 (6) ◽

pp. AB75

Author(s):

Kristina Navrazhina ◽

Murad Alam ◽

Rebecca Tung ◽

David Surprenant ◽

Brienne D. Cressey ◽

...

Keyword(s):

Construct Validity ◽

Technical Skills ◽

Surgical Skills ◽

Rater Reliability

Download Full-text

Redundant nerve roots in lumbar spinal stenosis: inter- and intra-rater reliability of an MRI-based classification

Neuroradiology ◽

10.1007/s00234-019-02337-3 ◽

2019 ◽

Vol 62 (2) ◽

pp. 223-230 ◽

Cited By ~ 2

Author(s):

Luca Papavero ◽

Carlos J. Marques ◽

Jens Lohmann ◽

Thies Fitting ◽

Kathrin Schawjinski ◽

...

Keyword(s):

Spinal Stenosis ◽

Lumbar Spinal Stenosis ◽

Nerve Roots ◽

Severe Stenosis ◽

Rater Reliability ◽

Microsurgical Decompression ◽

Orthopedic Surgeons ◽

Symptom History ◽

Lumbar Spinal

Abstract Purpose Patients with central lumbar spinal stenosis (LSS) have a longer symptom history, more severe stenosis, and worse postoperative outcomes, when redundant nerve roots (RNRs) are evident in the preoperative MRI. The objective was to test the inter- and intra-rater reliability of an MRI-based classification for RNR. Methods This is a retrospective reliability study. A neuroradiologist, an orthopedic surgeon, a neurosurgeon, and three orthopedic surgeons in-training classified RNR on 126 preoperative MRIs of patients with LSS admitted for microsurgical decompression. On sagittal and axial T2-weighted images, the following four categories were classified: allocation (A) of the key stenotic level, shape (S), extension (E), and direction (D) of the RNR. A second read with cases ordered differently was performed 4 weeks later. Fleiss and Cohen’s kappa procedures were used to determine reliability. Results The allocation, shape, extension, and direction (ASED) classification showed moderate to almost perfect inter-rater reliability, with kappa values (95% CI) of 0.86 (0.83, 0.90), 0.62 (0.57, 0.66), 0.56 (0.51, 0.60), and 0.66 (0.63, 0.70) for allocation, shape, extension, and direction, respectively. Intra-rater reliability was almost perfect, with kappa values of 0.90 (0.88, 0.92), 0.86 (0.84, 0.88), and 0.84 (0.81, 0.87) for shape, extension, and direction, respectively. Intra-rater kappa values were similar for junior and senior raters. Kappa values for inter-rater reliability were similar between the first and second reads (p = 0.06) among junior raters and improved among senior raters (p = 0.008). Conclusions The MRI-based classification of RNR showed moderate-to-almost perfect inter-rater and almost perfect intra-rater reliability.

Download Full-text

The Reliability and Validity of Wearable Inertial Sensors Coupled with the Microsoft Kinect to Measure Shoulder Range-of-Motion

Sensors ◽

10.3390/s20247238 ◽

2020 ◽

Vol 20 (24) ◽

pp. 7238

Author(s):

Peter Beshara ◽

Judy F. Chen ◽

Andrew C. Read ◽

Pierre Lagadec ◽

Tian Wang ◽

...

Keyword(s):

Construct Validity ◽

Range Of Motion ◽

Inertial Sensors ◽

Objective Assessment ◽

Reliability And Validity ◽

Human Movement ◽

Microsoft Kinect ◽

Rater Reliability ◽

Shoulder Range Of Motion ◽

Shoulder Flexion

Background: Objective assessment of shoulder joint active range of motion (AROM) is critical to monitor patient progress after conservative or surgical intervention. Advancements in miniature devices have led researchers to validate inertial sensors to capture human movement. This study investigated the construct validity as well as intra- and inter-rater reliability of active shoulder mobility measurements using a coupled system of inertial sensors and the Microsoft Kinect (HumanTrak). Methods: 50 healthy participants with no history of shoulder pathology were tested bilaterally for fixed and free ROM: (1) shoulder flexion, and (2) abduction using HumanTrak and goniometry. The repeat testing of the standardised protocol was completed after seven days by two physiotherapists. Results: All HumanTrak shoulder movements demonstrated adequate reliability (intra-class correlation (ICC) ≥ 0.70). HumanTrak demonstrated higher intra-rater reliability (ICCs: 0.93 and 0.85) than goniometry (ICCs: 0.75 and 0.53) for measuring free shoulder flexion and abduction AROM, respectively. Similarly, HumanTrak demonstrated higher intra-rater reliability (ICCs: 0.81 and 0.94) than goniometry (ICCs: 0.70 and 0.93) for fixed flexion and abduction AROM, respectively. Construct validity between HumanTrak and goniometry was adequate except for free abduction. The differences between raters were predominately acceptable and below ±10°. Conclusions: These results indicated that the HumanTrak system is an objective, valid and reliable way to assess and track shoulder ROM.

Download Full-text