Validity and Reliability of a Protocol to Establish Human Critical Environmental Limits (PSU HEAT)

Ambient Water ◽

Experimental Paradigm ◽

Experimental Protocol ◽

Environmental Limits

The PSU HEAT protocol has been used to determine critical environmental limits, i.e., those combinations of ambient temperature and humidity above which heat stress becomes uncompensable and core temperature rises continuously. However, no studies have rigorously investigated the reliability and validity of this experimental protocol. Here, we assessed the (1) between-visit reliability and (2) validity of the paradigm. Twelve subjects (5M/7W; 25±4 yr) completed a progressive heat stress protocol during which they walked on a treadmill (2.2 mph, 3% gradient) in a controllable environmental chamber. After an equilibration period, either dry-bulb temperature (Tdb) was increased every 5 min while ambient water vapor pressure (Pa) was held constant (Tcrit experiments) or Pa was increased every 5 min while Tdb was held constant (Pcrit experiments) until an upward inflection in gastrointestinal temperature (Tgi) was observed. For reliability experiments, 11 subjects repeated the same protocol on a different day. For validity experiments, 10 subjects performed a Tcrit experiment at their previously determined Pcrit or vice versa. The between-visit reliability (intraclass correlation coefficient, ICC) for critical environmental limits was 0.98. Similarly, there was excellent agreement between original and validity trials for Tcrit (ICC = 0.95) and Pcrit (ICC = 0.96). Further, the wet-bulb temperature at the Tgi inflection point was not different during reliability (p = 0.78) or validity (p = 0.32) trials compared to original trials. These findings support the reliability and validity of this experimental paradigm for the determination of critical environmental limits for maintenance of human heat balance.

Validity and reliability of the Mandarin version of the Treatment Burden Questionnaire among stroke patients in Mainland China

Family Practice ◽

10.1093/fampra/cmab004 ◽

2021 ◽

Author(s):

Qi Zhang ◽

Ke Zhang ◽

Miao Li ◽

Jiaxin Gu ◽

Xintong Li ◽

...

Keyword(s):

Internal Consistency ◽

Convergent Validity ◽

Intraclass Correlation ◽

Therapeutic Interventions ◽

Treatment Burden ◽

Stroke Patients ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Objectives To examine the validity and reliability of the Mandarin version of the Treatment Burden Questionnaire (TBQ) among stroke patients. Background Stroke patients need long-term management of symptoms and life situation, and treatment burden has recently emerged as a new concept that can influence the health outcomes during the rehabilitation process. Methods The convenience sampling method was used to recruit 187 cases of stroke patients in a tertiary grade hospital in Tianjin for a formal investigation. Item analysis, reliability and validity tests were carried out. The reliability test included internal consistency and test–retest reliability. And as well as content, structure and convergent validity were performed for the validity test. Results Of the 187 completed questionnaires, only 180 (96.3%) were suitable for analysis. According to the experts’ evaluation, the I-CVI of each item was from 0.833 to 1.000, and the S-CVI was 0.967. The exploratory factor analysis yielded three-factor components with a cumulative variation of 53.054%. Convergent validity was demonstrated using measures of Morisky’s Medication Adherence Scale 8 (r = –0.450, P < 0.01). All correlations between items and global scores ranged from 0.403 to 0.638. Internal consistency reliability and test–retest reliability were found to be acceptable, as indicated by a Cronbach’s α of 0.824 and an intraclass correlation coefficient of 0.846, respectively. Conclusions The Mandarin TBQ had acceptable validity and reliability. The use of TBQ in the assessment of treatment burden of stroke survivor may benefit health resources allocation and provide tailor therapeutic interventions to construct minimally disruptive care.

Validity and Reliability of 2-Dimensional Video-Based Assessment to Analyze Foot Strike Pattern and Step Rate During Running: A Systematic Review

Sports Health A Multidisciplinary Approach ◽

10.1177/1941738119844795 ◽

2019 ◽

Vol 11 (5) ◽

pp. 409-415 ◽

Cited By ~ 2

Author(s):

Fábio Carlos Lucas de Oliveira ◽

Anny Fredette ◽

Sherezada Ochoa Echeverría ◽

Charles Sebiyo Batcho ◽

Jean-Sébastien Roy

Keyword(s):

Systematic Review ◽

Concurrent Validity ◽

Data Extraction ◽

Intraclass Correlation ◽

Level Of Evidence ◽

Step Rate ◽

Cosmin Checklist ◽

Foot Strike

Context: Two-dimensional (2D) video-based analysis is often used by clinicians to examine the foot strike pattern (FSP) and step rate in runners. Reliability and validity of 2D video-based analysis have been questioned. Objective: To synthesize the psychometric properties of 2D video-based analysis for assessing runners’ FSP and step rate while running. Data Sources: Medline/PubMed, Science Direct, Embase, EBSCOHost/CINAHL, and Scielo were searched from their inception to August 2018. Study Selection: Studies were included if (1) they were published in English, French, Portuguese or Spanish; (2) they reported at least 1 psychometric property (validity and/or reliability) of 2D video-based analysis to assess running kinematics; and (3) they assessed FSP or step rate during running. Study Design: Systematic review. Level of Evidence: Level 2. Data Extraction: Studies were screened for methodological (MacDermid checklist) and psychometric quality (COSMIN checklist) by 2 independent raters. Results: Eight studies, with a total of 702 participants, were included. Seven studies evaluated the reliability of 2D video to assess FSP and found very good to excellent reliability (0.41 ≤ κ ≤ 1.00). Two studies reported excellent reliability for the calculation of step rate (0.75 ≤ intraclass correlation coefficient [ICC] ≤ 1.00). One study demonstrated excellent concurrent validity between 2D and 3D (gold standard) motion capture systems to determine FSP (Gwet agreement coefficient [AC] > 0.90; ICC > 0.90), and another study found excellent concurrent validity between 2D video and another device to calculate step rate (0.84 ≤ ICC ≤ 0.95). Conclusion: Strong evidence suggests that 2D video-based analysis is a reliable method for assessing FSP and quantifying step rate, regardless of the experience of the assessor. Limited evidence exists on the validity of 2D video-based analysis in determining FSP and calculating step rate during running.

The Reliability and Validity of the Loadsol® under Various Walking and Running Conditions

Sensors ◽

10.3390/s19020265 ◽

2019 ◽

Vol 19 (2) ◽

pp. 265 ◽

Cited By ~ 12

Author(s):

Kristen Renner ◽

DS Williams ◽

Robin Queen

Keyword(s):

Reliable Method ◽

Loading Rate ◽

Reaction Force ◽

Intraclass Correlation ◽

Correlation Coefficients ◽

Intraclass Correlation Coefficients ◽

Single Sensor ◽

Force Data

The assessment of loading during walking and running has historically been limited to data collection in laboratory settings or with devices that require a computer connection. This study aims to determine if the loadsol®—a single sensor wireless insole—is a valid and reliable method of assessing force. Thirty (17 male and 13 female) recreationally active individuals were recruited for a two visit study where they walked (1.3 m/s) and ran (3.0 and 3.5 m/s) at a 0%, 10% incline, and 10% decline, with the visits approximately one week apart. Ground reaction force data was collected on an instrumented treadmill (1440 Hz) and with the loadsol® (100 Hz). Ten individuals completed the day 1 protocol with a newer 200 Hz loadsol®. Intraclass correlation coefficients (ICC3,k) were used to assess validity and reliability and Bland–Altman plots were generated to better understand loadsol® validity. Across conditions, the peak force ICCs ranged from 0.78 to 0.97, which increased to 0.84–0.99 with the 200 Hz insoles. Similarly, the loading rate ICCs improved from 0.61 to 0.97 to 0.80–0.96 and impulse improved from 0.61 to 0.97 to 0.90–0.97. The 200 Hz insoles may be needed for loading rate and impulse in running. For both walking and running, the loadsol® has excellent between-day reliability (>0.76).

Validation of an Internet-Based Long Version of the International Physical Activity Questionnaire in Danish Adults Using Combined Accelerometry and Heart Rate Monitoring

Journal of Physical Activity and Health ◽

10.1123/jpah.2012-0040a ◽

2014 ◽

Vol 11 (3) ◽

pp. 654-664 ◽

Cited By ~ 6

Author(s):

Andreas Wolff Hansen ◽

Inger Dahl-Petersen ◽

Jørn Wulff Helge ◽

Søren Brage ◽

Morten Grønbæk ◽

...

Keyword(s):

Physical Activity ◽

Heart Rate ◽

International Physical Activity Questionnaire ◽

Intraclass Correlation ◽

Health Examination ◽

Heart Rate Monitoring ◽

Physical Activity Questionnaire ◽

Activity Questionnaire

Background:The International Physical Activity Questionnaire (IPAQ) is commonly used in surveys, but reliability and validity has not been established in the Danish population.Methods:Among participants in the Danish Health Examination survey 2007–2008, 142 healthy participants (45% men) wore a unit that combined accelerometry and heart rate monitoring (Acc+HR) for 7 consecutive days and then completed the IPAQ. Background data were obtained from the survey. Physical activity energy expenditure (PAEE) and time in moderate, vigorous, and sedentary intensity levels were derived from the IPAQ and compared with estimates from Acc+HR using Spearman’s correlation coefficients and Bland-Altman plots. Repeatability of the IPAQ was also assessed.Results:PAEE from the 2 methods was significantly positively correlated (0.29 and 0.49; P = 0.02 and P < 0.001; for women and men, respectively). Men significantly overestimated PAEE by IPAQ (56.2 vs 45.3 kJ/kg/day, IPAQ: Acc+HR, P < .01), while the difference was nonsignificant for women (40.8 vs 44.4 kJ/kg/day). Bland-Altman plots showed that the IPAQ overestimated PAEE, moderate, and vigorous activity without systematic error. Reliability of the IPAQ was moderate to high for all domains and intensities (total PAEE intraclass correlation coefficient = 0.58).Conclusions:This Danish Internet-based version of the long IPAQ had modest validity and reliability when assessing PAEE at population level.

Reliability and Validity of the Footprint Assessment Method Using Photoshop CS5 Software in Young People with Down Syndrome

Journal of the American Podiatric Medical Association ◽

10.7547/15-012 ◽

2016 ◽

Vol 106 (3) ◽

pp. 207-213 ◽

Cited By ~ 3

Author(s):

Lourdes Gutiérrez-Vilahú ◽

Núria Massó-Ortigosa ◽

Ferran Rey-Abella ◽

Lluís Costa-Tutusaus ◽

Myriam Guerra-Balic

Keyword(s):

Down Syndrome ◽

Young People ◽

Intraclass Correlation ◽

Standing Position ◽

Assessment Method ◽

Validity Testing ◽

Systems Software ◽

Arch Index

Background: People with Down syndrome present skeletal abnormalities in their feet that can be analyzed by commonly used gold standard indices (the Hernández-Corvo index, the Chippaux-Smirak index, the Staheli arch index, and the Clarke angle) based on footprint measurements. The use of Photoshop CS5 software (Adobe Systems Software Ireland Ltd, Dublin, Ireland) to measure footprints has been validated in the general population. The present study aimed to assess the reliability and validity of this footprint assessment technique in the population with Down syndrome. Methods: Using optical podography and photography, 44 footprints from 22 patients with Down syndrome (11 men [mean ± SD age, 23.82 ± 3.12 years] and 11 women [mean ± SD age, 24.82 ± 6.81 years]) were recorded in a static bipedal standing position. A blinded observer performed the measurements using a validated manual method three times during the 4-month study, with 2 months between measurements. Test-retest was used to check the reliability of the Photoshop CS5 software measurements. Validity and reliability were obtained by intraclass correlation coefficient (ICC). Results: The reliability test for all of the indices showed very good values for the Photoshop CS5 method (ICC, 0.982–0.995). Validity testing also found no differences between the techniques (ICC, 0.988–0.999). Conclusions: The Photoshop CS5 software method is reliable and valid for the study of footprints in young people with Down syndrome.

The Vietnamese Version of the Nursing Critical Thinking in Clinical Practice Questionnaire: Translation and Psychometric Evaluation

10.21203/rs.3.rs-19956/v1 ◽

2020 ◽

Author(s):

Tuan Van Nguyen ◽

Hsueh-Erh Liu

Keyword(s):

Critical Thinking ◽

Nursing Education ◽

Clinical Practice ◽

Clinical Setting ◽

Intraclass Correlation ◽

International Comparisons ◽

Critical Thinking Ability ◽

Thinking Ability

Abstract Background: Many instruments measure critical thinking ability in nursing education. The Nursing Critical Thinking in Clinical Practice Questionnaire (N-CT-4 Practice) is a new tool to measure the level of critical thinking ability of nurses in a clinical setting. However, no study has evaluated the psychometric properties of the N-CT-4 Practice in Vietnam. Therefore, this study translated and evaluated the validity and reliability of the Vietnamese version of the Nursing Critical Thinking in Clinical Practice Questionnaire (V-N-CT-4 Practice). Results: The V-N-CT-4 Practice questionnaire retained the meaning of the original English version and was clear, explicit and easy for nurses to understand. The item content validity index of the V-N-CT-4 Practice was 1.0. The Cronbach’s alpha for the overall scales was .98. The intraclass correlation coefficient was .81. Confirmatory factor analysis indicated that this Vietnamese version fit the proposed model. Conclusions: The findings suggested that the V-N-CT-4 Practice has acceptable reliability and validity for Vietnamese nurses in a clinical setting. Nurse managers and educators can use the V-N-CT-4 Practice to measure the level of critical thinking ability of Vietnamese clinical nurses and make international comparisons possible.

Reliability and Validity of Thickness Measurements of the Supraspinatus Muscle of the Shoulder: An Ultrasonography Study

Journal of Sport Rehabilitation ◽

10.1123/jsr.2013-0023 ◽

2014 ◽

Vol 23 (2) ◽

Cited By ~ 5

Author(s):

William Temes ◽

Amy Temes Clifton ◽

Valerie Hilton ◽

Leslie Girard ◽

Neisha Strait ◽

...

Keyword(s):

Outcome Measures ◽

Muscle Function ◽

Physical Therapists ◽

Intraclass Correlation ◽

Quantitative Measure ◽

Ultrasound Images ◽

Supraspinatus Muscle ◽

Asymptomatic Subjects

Context: The supraspinatus is the most commonly affected muscle with rotator-cuff pathology and necessary for stability of the humeral head in the glenoid fossa. Rehabilitative ultrasound imaging (RUSI) of skeletal muscles provides a safe and clinically accessible measure of intact human muscle function at rest or during contracted states. The ability to perform accurate assessment of supraspinatus function has not been studied and may be of value in assessment and treatment. Objectives: To determine the validity and reliability of measures obtained using RUSI for assessing supraspinatus muscle at rest and contracted conditions. Design: Reliability and validity Setting: Outpatient physical therapy clinic. Subjects: 15 asymptomatic subjects age 30-49 y. Main Outcome Measures: The supraspinatus muscle was measured at rest and contracted with a 0.9-kg weight with the arm positioned in 45° of abduction in the plane of the scapula. Repeated ultrasound images of the supraspinatus were collected by 3 physical therapists on 2 separate days. Main Outcome Measures: Reliability was assessed with the intraclass correlation coefficient (ICC) and standard error of measurement (SEM). Validity was tested by comparing mean difference between active and passive states for all 3 rates on both days. Results: All ICC values were found to be at .9 or above. In addition, for all days and raters, the active condition was significantly thicker than the passive condition (P < .001). Conclusions: Thickness measures of the supraspinatus using RUSI, during passive and active conditions, demonstrate high interrater and intrarater reliability and can easily distinguish between active and passive states. These findings suggest that RUSI may provide an appropriate quantitative measure for changes in the thickness of supraspinatus that are important for determining improvement or deterioration in muscle function.

Reliability and validity of a new clinical test for assessment of the sacroiliac joint dysfunction

Hong Kong Physiotherapy Journal ◽

10.1142/s1013702518500026 ◽

2018 ◽

Vol 38 (01) ◽

pp. 13-22 ◽

Cited By ~ 3

Author(s):

Apurv Shimpi ◽

Renuka Hatekar ◽

Ashok Shyam ◽

Parag Sancheti

Keyword(s):

Sacroiliac Joint ◽

Clinical Utility ◽

Intraclass Correlation ◽

Clinical Test ◽

Clinical Tests ◽

Predictive Values ◽

Non Invasive ◽

Asymptomatic Volunteers

Background: Dysfunctional sacroiliac joint (SIJ) has been cited as a source of low backache (LBA). Numerous non-invasive clinical tests are available for its assessment having poor validity and reliability which challenges their clinical utility. Thus, introduction of a new clinical test may be necessary.Objective: To assess reliability and validity of a new clinical test for the assessment of patients with SIJ movement dysfunction.Methods: Forty-five subjects (23 having LBA of SIJ origin and 22 healthy asymptomatic volunteers) with mean age 28.62 [Formula: see text] 5.26 years were assessed by 2 blinded examiners for 3 different clinical tests of SIJ, including the new test. The obtained values were assessed for reliability by intraclass correlation, kappa coefficient and percentage agreement. Validity was assessed by averaging sensitivity and specificity. Positive and negative predictive values and accuracy were assessed.Results: The new test demonstrates good intra- [Formula: see text] and inter-rater [Formula: see text] reliability with substantial agreement between raters [Formula: see text]. It has 79.9% validity, 82% sensitivity, 77% specificity, 79% positive-predictive, 80% negative-predictive value and accuracy.Conclusion: The new “Shimpi Prone SIJ test” has a good intra- and inter-rater reliability with a substantial rater agreement and a good validity and accuracy for the assessment of patients with SIJ movement dysfunction.

Reliability and validity test of a Scoring Rubric for Information Literacy

Journal of Documentation ◽

10.1108/jd-05-2016-0066 ◽

2017 ◽

Vol 73 (2) ◽

pp. 305-316 ◽

Cited By ~ 4

Author(s):

Jos van Helvoort ◽

Saskia Brand-Gruwel ◽

Frank Huysmans ◽

Ellen Sjoer

Keyword(s):

Information Literacy ◽

Design Methodology ◽

Intraclass Correlation ◽

Content Type ◽

Valid Instrument ◽

Measure Reliability ◽

Scoring Rubric ◽

Pearson Correlations

Purpose The purpose of this paper is to measure reliability and validity of the Scoring Rubric for Information Literacy (Van Helvoort, 2010). Design/methodology/approach Percentages of agreement and Intraclass Correlation were used to describe interrater reliability. For the determination of construct validity factor analysis and reliability analysis were used. Criterion validity was calculated with Pearson correlations. Findings In the described case, the Scoring Rubric for Information Literacy appears to be a reliable and valid instrument for the assessment of information literate performance. Originality/value Reliability and validity are prerequisites to recommend a rubric for application. The results confirm that this Scoring Rubric for Information Literacy can be used in courses in higher education, not only for assessment purposes but also to foster learning.

Critical environmental limits for young, healthy adults (PSU HEAT)

Journal of Applied Physiology ◽

10.1152/japplphysiol.00737.2021 ◽

2021 ◽

Author(s):

S. Tony Wolf ◽

Rachel M. Cottle ◽

Daniel J. Vecellio ◽

W. Larry Kenney

Keyword(s):

Heat Stress ◽

Activities Of Daily Living ◽

Heat Production ◽

Daily Living ◽

Water Vapor Pressure ◽

Healthy Adults ◽

Metabolic Heat Production ◽

Metabolic Heat ◽

Increased Risk ◽

Environmental Limits

Critical environmental limits are those combinations of ambient temperature and humidity above which heat balance cannot be maintained for a given metabolic heat production, limiting exposure time and placing individuals at increased risk of heat-related illness. The aim of the present study was to establish those limits in young (18-34 yr) healthy adults during low-intensity activity approximating the metabolic demand of activities of daily living. Twenty-five (12 men/13 women) subjects were exposed to progressive heat stress in an environmental chamber at two rates of metabolic heat production chosen to represent minimal activity (MinAct) or light ambulation (LightAmb). Progressive heat stress was performed with either (1) constant dry-bulb temperature (Tdb) and increasing ambient water vapor pressure (Pa) (Pcrit trials; 36, 38, or 40 °C), or (2) constant Pa and increasing Tdb (Tcrit trials; 12, 16, or 20 mmHg). Each subject was tested during MinAct and LightAmb in 2-3 experimental conditions in random order, for a total of 4-6 trials per participant. Higher metabolic heat production (p < 0.001) during LightAmb compared to MinAct trials resulted in significantly lower critical environmental limits across all Pcrit and Tcrit conditions (all p < 0.001). These data, presented graphically herein on a psychrometric chart, are the first to define critical environmental limits for young adults during activity resembling those of light household tasks or other activities of daily living, and can be used to develop guidelines, policy decisions, and evidence-based alert communications to minimize the deleterious impacts of extreme heat events.