Proof-of-concept and concurrent validity of a prototype headset to assess peak oxygen uptake without a face mask

Objective Portable gas exchange instruments allow the assessment of peak oxygen uptake (V̇O2peak) but are often bulky, expensive and require wearing a face mask thereby limiting their routine application. A newly developed miniaturized headset (VitaScale, Nuremberg, Germany) may overcome these barriers and allow measuring V̇O2peak without applying a face mask. Here we aimed (i) to disclose the technical setup of a headset incorporating a gas and volume sensor to measure volume flow and expired oxygen concentration and (ii) to assess the concurrent criterion-validity of the headset to measure V̇O2peak in 44 individuals exercising on a stationary cycle ergometer in consideration of the test–retest reliability of the criterion measure. Results The coefficient of variation (CV%) while measuring V̇O2peak during incremental cycling with the headset was 6.8%. The CV% for reliability of the criterion measure was 4.0% for V̇O2peak. Based on the present data, the headset might offer a new technology for V̇O2peak measurement due to its low-cost and mask-free design.

Continuous Monitoring of Vital Signs With Wearable Sensors During Daily Life Activities: Validation Study

Background Continuous telemonitoring of vital signs in a clinical or home setting may lead to improved knowledge of patients’ baseline vital signs and earlier detection of patient deterioration, and it may also facilitate the migration of care toward home. Little is known about the performance of available wearable sensors, especially during daily life activities, although accurate technology is critical for clinical decision-making. Objective The aim of this study is to assess the data availability, accuracy, and concurrent validity of vital sign data measured with wearable sensors in volunteers during various daily life activities in a simulated free-living environment. Methods Volunteers were equipped with 4 wearable sensors (Everion placed on the left and right arms, VitalPatch, and Fitbit Charge 3) and 2 reference devices (Oxycon Mobile and iButton) to obtain continuous measurements of heart rate (HR), respiratory rate (RR), oxygen saturation (SpO2), and temperature. Participants performed standardized activities, including resting, walking, metronome breathing, chores, stationary cycling, and recovery afterward. Data availability was measured as the percentage of missing data. Accuracy was evaluated by the median absolute percentage error (MAPE) and concurrent validity using the Bland-Altman plot with mean difference and 95% limits of agreement (LoA). Results A total of 20 volunteers (median age 64 years, range 20-74 years) were included. Data availability was high for all vital signs measured by VitalPatch and for HR and temperature measured by Everion. Data availability for HR was the lowest for Fitbit (4807/13,680, 35.14% missing data points). For SpO2 measured by Everion, median percentages of missing data of up to 100% were noted. The overall accuracy of HR was high for all wearable sensors, except during walking. For RR, an overall MAPE of 8.6% was noted for VitalPatch and that of 18.9% for Everion, with a higher MAPE noted during physical activity (up to 27.1%) for both sensors. The accuracy of temperature was high for VitalPatch (MAPE up to 1.7%), and it decreased for Everion (MAPE from 6.3% to 9%). Bland-Altman analyses showed small mean differences of VitalPatch for HR (0.1 beats/min [bpm]), RR (−0.1 breaths/min), and temperature (0.5 °C). Everion and Fitbit underestimated HR up to 5.3 (LoA of −39.0 to 28.3) bpm and 11.4 (LoA of −53.8 to 30.9) bpm, respectively. Everion had a small mean difference with large LoA (−10.8 to 10.4 breaths/min) for RR, underestimated SpO2 (>1%), and overestimated temperature up to 2.9 °C. Conclusions Data availability, accuracy, and concurrent validity of the studied wearable sensors varied and differed according to activity. In this study, the accuracy of all sensors decreased with physical activity. Of the tested sensors, VitalPatch was found to be the most accurate and valid for vital signs monitoring.

Croatian Version of the Short Assessment of Health Literacy for Spanish Adults (SAHLSA-50): Cross-Cultural Adaptation and Psychometric Evaluation

(1) Background: Short Assessment of Health Literacy for Spanish Adults (SAHLSA-50) was originally designed for Spanish-speaking regions, and translations validated for several languages. The aim of the study was to adapt and verify the psychometric characteristics of SAHLSA-50 in the Croatian context; (2) Methods: The cross-sectional study included 590 respondents from the general population older than 18 years of age. Health literacy was measured by two scales: SAHLCA-50 and the Croatian version of the Newest Vital Sign screening test (NVS-HR), which was used as a measure of concurrent validity. Subjective Health Complaints (SHC) and Satisfaction with Life Scale (SWLS) questionnaires were also used to assess convergent validity; (3) Results: Internal consistency reliability of SAHLCA-50 was high and corresponds to the findings of the authors of the original research. The Cronbach alpha coefficient for SAHLCA-50 version was 0.91. The correlation of SAHLCA-50 with the NVS-HR test speaks in favor of concurrent validity. Correlation between health literacy and SHC speaks for convergent validity, just as was expected, while correlation with life satisfaction was not observed; (4) Conclusions: The SAHLCA-50 test can be a good and quick tool to assess health literacy of the adult population in the Croatian language. HL can affect the health and quality of life of the individual and the wider community.

Measuring implementation climate: psychometric properties of the Implementation Climate Scale (ICS) in Norwegian mental health care services

BackgroundEmployees’ perceptions of organizational climate for implementation of new methods are important in assessing and planning for implementation efforts. More specifically, feedback from employees’ points to which implementation strategies to select, adopt, and tailor in building positive climate for implementation of new evidence-based practices within the organization. Implementation climate can be measured with the Implementation Climate Scale (ICS). The purpose of this study was to investigate the psychometric properties of the Norwegian version of the ICS in outpatient mental health clinics.MethodsThe ICS was administered to 383 clinicians within 47 different child and adult mental health clinics across the country. We conducted confirmatory factor analysis to assess the psychometric functioning of the ICS. Cronbach’s alpha was examined to assess internal consistency. We also examined criterion related validity of the scale by comparing it with an alternative measure of implementation climate (concurrent validity) and by examining correlations with clinicians’ intentions to use evidence-based practices.ResultsResults supported the 6-factor structure and the internal consistency reliability of the ICS. One exception was poor functioning of the Reward scale. Concurrent validity was stronger at the group than at the individual level, and assessment of associations with clinicians’ intentions to use evidence- based practices showed positive correlations.ConclusionsThe Norwegian version of the ICS is a promising tool for assessing implementation climate which can provide organizations with specific feedback concerning which aspects of the implementation climate to attend to. Due to poor functioning of the Reward scale, adaptations and further testing of this is recommended.

Validity and reliability of Psychiatric Nurse Self-Efficacy Scales: cross-sectional study

ObjectivesTo develop the Psychiatric Nurse Self-Efficacy Scales, and to examine their reliability and validity.DesignWe developed the Improved Self-Efficacy Scale (ISES) and Decreased Self-Efficacy Scale (DSES) using existing evidence. Statistical analysis was conducted on the data to test reliability and validity.SettingThe study’s setting was psychiatric facilities in three prefectures in Japan.ParticipantsData from 514 valid responses were extracted of the 786 responses by psychiatric nurses.Outcome measuresThe study measured the reliability and validity of the scales.ResultsThe ISES has two factors (‘Positive changes in the patient’ and ‘Prospect of continuing in psychiatric nursing’) and the DSES has three (‘Devaluation of own role as a psychiatric nurse’, ‘Decrease in nursing ability due to overload’ and ‘Difficulty in seeing any results in psychiatric nursing’). With regard to scale reliability, the Cronbach’s alpha coefficient was 0.634–0.845. With regard to scale validity, as the factorial validity of the ISES and DSES, for the ISES, χ2/df (110.625/37) ratio=2.990 (p<0.001), goodness-of-fit index (GFI)=0.962, adjusted GFI (AGFI)=0.932, comparative fit index (CFI)=0.967 and root mean square error of approximation (RMSEA)=0.062; for the DSES, χ2/df (101.982/37) ratio=2.756 (p<0.001), GFI=0.966, AGFI=0.940, CFI=0.943, RMSEA=0.059 and Akaike Information Criterion=159.982. The concurrent validity of the General Self-Efficacy Scale was r=0.149–0.446 (p<0.01) for ISES and r=−0.154 to −0.462 (p<0.01) for DSES, and the concurrent validity of the Stress Reaction Scale was r=−0.128 to 0.168 for ISES, r=0.214–0.398 for DSES (p<0.01).Statistical analyses showed the scales to be reliable and valid measures.ConclusionsThe ISES and DSES can accurately assess psychiatric nurses’ self-efficacy. Using these scales, it is possible to formulate programmes for improving psychiatric nurses’ feelings of self-efficacy.

Charlson Comorbidity Index: A Critical Review of Clinimetric Properties

The present critical review was conducted to evaluate the clinimetric properties of the Charlson Comorbidity Index (CCI), an assessment tool designed specifically to predict long-term mortality, with regard to its reliability, concurrent validity, sensitivity, incremental and predictive validity. The original version of the CCI has been adapted for use with different sources of data, ICD-9 and ICD-10 codes. The inter-rater reliability of the CCI was found to be excellent, with extremely high agreement between self-report and medical charts. The CCI has also been shown either to have concurrent validity with a number of other prognostic scales or to result in concordant predictions. Importantly, the clinimetric sensitivity of the CCI has been demonstrated in a variety of medical conditions, with stepwise increases in the CCI associated with stepwise increases in mortality. The CCI is also characterized by the clinimetric property of incremental validity, whereby adding the CCI to other measures increases the overall predictive accuracy. It has been shown to predict long-term mortality in different clinical populations, including medical, surgical, intensive care unit (ICU), trauma, and cancer patients. It may also predict in-hospital mortality, although in some instances, such as ICU or trauma patients, the CCI did not perform as well as other instruments designed specifically for that purpose. The CCI thus appears to be clinically useful not only to provide a valid assessment of the patient’s unique clinical situation, but also to demarcate major diagnostic and prognostic differences among subgroups of patients sharing the same medical diagnosis.

Reliability and Validity of the Attitudes toward Your Child’s Speech

Objectives: The purpose of this study was to determine the validity and reliability of a scale of parents’ attitude toward their child’s speech (i.e., Attitude toward Your Child’s Speech, AYCS).Methods: The participants were 152 parents of children who stuttered (CWS). Participants completed a scale of parents’ attitudes toward their child’s speech and a scale of impact of stuttering on children and parents in the form of an online survey. Based on the collected data, the validity (i.e., content validity, construct validity, concurrent validity) and reliability (i.e., internal consistency reliability, test-retest reliability) of AYCS were assessed.Results: The 11 items of the AYCS demonstrated high content, construct and concurrent validity assessing three factors (i.e., Joy of talking to the child, Worry about the child’s stuttering, & Acceptance of the child’s stuttering). In addition, the ACYS demonstrated moderate to excellent test-retest reliability and high internal consistency.Conclusion: The findings indicated that the AYCS is a valid and reliable instrument to evaluate parents’ attitudes toward their child’s speech and stuttering. It is expected that the AYCS could be included as part of a comprehensive evaluation of stuttering and be used as a tool to document progress of parents’ attitudes toward stuttering during treatment of stuttering in children. Furthermore, researchers may be able to use the AYCS to test various research hypotheses regarding how parents’ attitudes toward stuttering affect their child’s development of stuttering.

Cultural Adaptation and Testing of the Italian Version of the Edmonton Functional Assessment Tool-2 (EFAT2-I)

Background Physiotherapy in Palliative Care (PC) is effective in the management of a series of respiratory, circulatory and motor symptoms, and often has a positive impact on the patient's mood. The Edmonton Functional Assessment Tool (EFAT) is the only existing validated tool specifically designed for functional assessment in PC, and its use has been recommended in clinical practice. To date, no Italian version of the tool has been validated. The aim of this study was to translate, cross-culturally adapt, and evaluate the psychometric properties of the Italian version of the EFAT2. Method After receiving formal permission from the author, Beaton guidelines for cross-cultural adaptation were followed, namely: (1) forward translation; (2) a multidisciplinary focus group (including 4 physiotherapists, 1 physician, 3 nurses, 1 occupational therapist, 1 psychologist) to assess semantic, idiomatic, experiential, and conceptual equivalence; (3) backward translation. The Content Validity Index (CVI) was used to assess content validity of the tool. Construct and concurrent validity were also evaluated. To evaluate the reliability of the EFAT2-I, reliability was measured using Cronbach alfa, item-total correlation, and Cohen's Kappa. Results 119 patients admitted to a Palliative Care Unit (Italy) agreed to participate in the study. The EFAT2-I mean score was 11.3, ranging from 0 to 30. Very good CVI scores were achieved, both in terms of single item validity (I-CVI) and of whole scale validity (S-CVI). Positive results were obtained from construct, concurrent validity assessment and measures of reliability. Discussion The EFAT2-I showed good psychometric properties and can be used as a rehabilitation assessment tool in palliative care settings. The validation of the Italian version will allow comparison of different centres and palliative care facilities on national and international levels.

Validity, reliability and viability of pre-school educators’ use of early years toolbox early numeracy

There is need and opportunity for assessments that support quick and playful – yet also accurate, rigorous and developmentally sensitive – appraisals of early numeracy. Ideally, these should be accessible to those who have opportunity to support children’s learning development and ultimately shift children’s trajectories. The iPad-based Early Years Toolbox (EYT) Early Numeracy assessment was developed and evaluated to determine its validity and reliability, and appropriateness of use by researchers and preschool educators. Results from two studies with 246 children aged 3–5 years indicated the following: construct validity and internal consistency, concurrent validity with established measures, developmental sensitivity, test–retest reliability and highly comparable results whether used by a researcher or an educator. This yields a brief and playful assessment of early numeracy and a potential approach to develop broad-use early years assessments.