scholarly journals Development and validation of a multi-lingual online questionnaire for surveying the COVID-19 prevention and control measures used in global workplaces

2022 ◽  
Vol 22 (1) ◽  
Author(s):  
Carolyn Ingram ◽  
Yanbing Chen ◽  
Conor Buggy ◽  
Vicky Downey ◽  
Mary Archibald ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Prevention And Control ◽  
Online Survey ◽  
Discriminant Validity ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
And Control ◽  
Occupational Settings

Abstract Background Despite widespread COVID-19 vaccination programs, there is an ongoing need for targeted disease prevention and control efforts in high-risk occupational settings. This study aimed to develop, pilot, and validate an instrument for surveying occupational COVID-19 infection prevention and control (IPC) measures available to workers in diverse geographic and occupational settings. Methods A 44-item online survey was developed in English and validated for face and content validity according to literature review, expert consultation, and pre-testing. The survey was translated and piloted with 890 workers from diverse industries in Canada, Ireland, Argentina, Poland, Nigeria, China, the US, and the UK. Odds ratios generated from univariable, and multivariable logistic regression assessed differences in ‘feeling protected at work’ according to gender, age, occupation, country of residence, professional role, and vaccination status. Exploratory factor analysis (EFA) was conducted, and internal consistency reliability verified with Cronbach’s alpha. Hypothesis testing using two-sample t-tests verified construct validity (i.e., discriminant validity, known-groups technique), and criterion validity. Results After adjustment for occupational sector, characteristics associated with feeling protected at work included being male (AOR = 1.88; 95% CI = 1.18,2.99), being over 55 (AOR = 2.17; 95% CI = 1.25,3.77) and working in a managerial position (AOR = 3.1; 95% CI = 1.99,4.83). EFA revealed nine key IPC domains relating to: environmental adjustments, testing and surveillance, education, costs incurred, restricted movements, physical distancing, masking, isolation strategies, and areas for improvement. Each domain showed sufficient internal consistency reliability (Cronbach’s alpha ≥0.60). Hypothesis testing revealed differences in survey responses by country and occupational sector, confirming construct validity (p < 0.001), criterion validity (p = 0.04), and discriminant validity (p < 0.001). Conclusions The online survey, developed in English to identify the COVID-19 protective measures used in diverse workplace settings, showed strong face validity, content validity, internal consistency, criterion validity, and construct validity. Translations in Chinese, Spanish, French, Polish, and Hindi demonstrated adaptability of the survey for use in international working environments. The multi-lingual tool can be used by decision makers in the distribution of IPC resources, and to guide occupational safety and health (OSH) recommendations for preventing COVID-19 and future infectious disease outbreaks.

scholarly journals Development and Validation of a Multi-lingual Online Questionnaire for Surveying the COVID-19 Prevention and Control Measures used in Global Workplaces

2021 ◽  
Author(s):  
Carolyn Ingram ◽  
Yanbing Chen ◽  
Conor Buggy ◽  
Vicky Downey ◽  
Mary Archibald ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Prevention And Control ◽  
Online Survey ◽  
Discriminant Validity ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
Cultural Validity ◽  
And Control ◽  
Occupational Settings

Abstract Background Despite widespread COVID-19 vaccination programs, there is an ongoing need for targeted disease prevention and control efforts in high-risk occupational settings. This study aimed to develop, pilot, and validate an instrument for surveying occupational COVID-19 infection prevention and control (IPC) measures available to workers in diverse geographic and occupational settings. Methods A 44-item online survey was developed, translated, and validated for face, content, and cross-cultural validity according to literature review, expert consultation, and pre-testing. The survey was piloted with 890 workers from diverse industries in Canada, Ireland, Argentina, Poland, Nigeria, China, the US, and the UK. Odds ratios generated from univariable, and multivariable logistic regression assessed differences in ‘feeling protected at work’ according to gender, age, occupation, country of residence, professional role, and vaccination status. Exploratory factor analysis (EFA) was conducted, and internal consistency reliability verified with Cronbach’s alpha. Hypothesis testing using two-sample t-tests verified construct validity (i.e., discriminant validity, known-groups technique), and criterion validity. Results After adjustment for occupational sector, characteristics associated with feeling protected at work included being male (AOR = 1.88; 95% CI = 1.18,2.99), being over 55 (AOR = 2.17; 95% CI = 1.25,3.77) and working in a managerial position (AOR = 3.1; 95% CI = 1.99,4.83). EFA revealed nine key IPC domains relating to: environmental adjustments, testing and surveillance, education, costs incurred, restricted movements, physical distancing, masking, isolation strategies, and areas for improvement. Each domain showed sufficient internal consistency reliability (Cronbach’s alpha ≥ 0.60). Hypothesis testing revealed differences in survey responses by country and occupational sector, confirming construct validity (p < 0.001), criterion validity (p = 0.04), and discriminant validity (p < 0.001). Conclusions The online survey, developed to identify the COVID-19 protective measures used in diverse, international workplace settings, showed strong face validity, content validity, cross-cultural validity, internal consistency, criterion validity, and construct validity. It can be used by decision makers in the distribution of IPC resources, and to guide occupational safety and health (OSH) recommendations for preventing COVID-19 and future infectious disease outbreaks.

scholarly journals Reliability and Validity of the German Version of the Emotional Style Questionnaire

2021 ◽  
Vol 12 ◽  
Author(s):  
Darko Jekauc ◽  
Lea Mülberger ◽  
Susanne Weyland ◽  
Fabienne Ennigkeit ◽  
Kathrin Wunsch ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Online Survey ◽  
Reliability And Validity ◽  
Criterion Validity ◽  
German Version ◽  
Personality Psychology ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Emotional Style

Until recently, emotional processes have played little role in personality psychology. Based on neuroscientific findings, Davidson and colleagues proposed a theory of emotional styles, postulating six dimensions of emotional life: outlook, resilience, social intuition, self-awareness, sensitivity to context, and attention. Recently, an English version of the Emotional Style Questionnaire (ESQ) was developed and tested for reliability and validity. The aim of the present work was to test the test–retest reliability, internal consistency, construct validity, and criterion validity of the German version of the ESQ. Two separate samples consisting of 365 and 344 subjects took part in an online survey. The results of the two studies indicated satisfactory test–retest reliability and internal consistency. Regarding the construct validity, the results from Study 1 to Study 2 indicate good model fit indices. Although there was a high correlation between the subscales outlook and resilience, the analyses supported the six-factor structure postulated by Davidson and colleagues. Substantial correlations were found between the dimensions of the ESQ and other validated scales, confirming the criterion validity of the questionnaire. Our results suggest that the German version of the ESQ is a reliable and valid measurement of emotional styles. It is a feasible and economical questionnaire that can be applied in various psychology disciplines, such as personality psychology, clinical psychology, industrial psychology or sport and exercise psychology.

scholarly journals Measuring advance care planning behavior in Dutch adults: translation, cultural adaptation and validation of the Advance Care Planning Engagement Survey

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Doris van der Smissen ◽  
Agnes van der Heide ◽  
Rebecca L. Sudore ◽  
Judith A. C. Rietjens ◽  
Ida J. Korfage
Keyword(s):  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Advance Care Planning ◽  
Content Validity ◽  
Intraclass Correlation ◽  
Criterion Validity ◽  
Care Planning ◽  
Validity And Reliability ◽  
Advance Care

Abstract Background Advance care planning (ACP) enables people to define, discuss, and record preferences for treatment and care. Measures of ACP behavior are lacking in the Netherlands. We aimed to translate, culturally adapt and validate the 34-item ACP Engagement Survey into Dutch. Methods Following validation guidelines, we tested content validity, internal consistency, reproducibility, construct validity, interpretability and criterion validity among persons with and without chronic disease. Results Forward-backward translation indicated the need of only minor adaptations. Two hundred thirty-two persons completed baseline and retest surveys; 121 were aged ≥60 years. Persons with chronic disease (n = 151) considered the survey more valuable than those without (66 vs. 59, p < 0.001, scale of 20–100), indicating good content validity. Internal consistency (Cronbach’s alpha: 0.97) and reproducibility (intraclass correlation: 0.88) were good. Total ACP Engagement was higher among persons with chronic disease than those without (2.9 vs. 2.4, p < 0.01, scale of 1 to 5), indicating good psychometric support for construct validity and interpretability. Positive correlations of the ACP Engagement Survey and the General Self-Efficacy survey indicated good criterion validity (p < 0.05). Conclusions This study provided good psychometric support for the validity and reliability of the Dutch 34-item ACP Engagement Survey. This instrument can be used to assess involvement in ACP in adults with and without chronic disease.

scholarly journals A Systematic Review of Measurement Properties of Spirituality related Assessment Tools Published in Korean Journals

2021 ◽  
Vol 28 (1) ◽  
pp. 133-148
Author(s):  
Il-Sun Ko ◽  
Jin Sook Kim ◽  
Soyoung Choi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Well Being ◽  
Criterion Validity ◽  
Assessment Tools ◽  
Measurement Properties ◽  
Korean Studies ◽  
Ceiling Effects ◽  
Spiritual Well Being

Purpose: The purpose of this study was to evaluate the measurement properties of spirituality-related assessment tools published in Korean journals.Methods: The databases used to search the literature reporting use of the spirituality-related assessment tools were RISS, NDSL, DBpia, KoreaMed, and KISS. The quality of the measurement properties was evaluated based on the reported internal consistency, content validity, criterion validity, construct validity, reproducibility, responsiveness, floor-ceiling effects and interpretability based on the tools review criteria suggested by Terwee et al.Results: Twenty-five assessment tools (including 7 original Korean versions) were identified from the 208 Korean studies published up to November, 2016. All of the 25 tools reported internal consistency and content validity; construct validity was reported in 21 tools while only six tools had reported on criterion validity. None of the studies reported on the reproducibility, responsiveness, and floor-ceiling effects. Among 25 spirituality-related assessment tools, the spiritual well-being scale was identified as the most commonly used tool for spirituality assessment.Conclusion: Among 25 spirituality-related assessment tools used in Korean studies, all of them satisfied only three criteria out of the eight criteria for measurement properties, internal consistency, content validity, and interpretability. The results of this study provide evidence to develop reliable and valid tools that will satisfy the criteria for measurement properties. In addition, standardized, reliable, and valid assessment tools must be chosen for spirituality-related study.

The Index of Readiness: Development and Psychometric Analysis

1994 ◽  
Vol 2 (2) ◽  
pp. 143-154 ◽  
Author(s):  
Julie Fleury
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Reliability And Validity ◽  
Psychometric Evaluation ◽  
Internal Consistency Reliability ◽  
Health Behavior Change ◽  
Rehabilitation Program ◽  
Goal Commitment ◽  
Validity Assessment

This article describes the development and initial psychometric evaluation of a measure of individual appraisal of readiness to initiate health behavior change. Items were developed from inductively generated data to index dimensions of individual appraisal of readiness. Quantification of Index of Readiness content validity was established through the ratings of 10 experts, following criteria established by Imle and Atwood (1988). The instrument was tested in successive steps with 146 individuals who were participating in an outpatient cardiac rehabilitation program, for reliability and validity, including internal consistency reliability, and three forms of validity assessment (content validity, criterion-related validity, and construct validity). The three subscales of Revaluation of Lifestyle, Identification of Barriers, and Goal Commitment demonstrated internal consistency. Criterion-related and construct validity were substantiated. With refinement, this measure will provide a basis for nursing interventions designed to enhance individual motivation in relation to specific health behaviors.

scholarly journals Development and cross-cultural testing of the International Depression Symptom Scale (IDSS): a measurement instrument designed to represent global presentations of depression

2017 ◽  
Vol 4 ◽  
Author(s):  
E. E. Haroz ◽  
J. Bass ◽  
C. Lee ◽  
S. S. Oo ◽  
K. Lin ◽  
...  
Keyword(s):  
Suicidal Ideation ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
Self Report ◽  
Depression Symptom ◽  
Symptom Scale ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundSelf-report measurement instruments are commonly used to screen for mental health disorders in Low and Middle-Income Countries (LMIC). The Western origins of most depression instruments may constitute a bias when used globally. Western measures based on the DSM, do not fully capture the expression of depression globally. We developed a self-report scale design to address this limitation, the International Depression Symptom Scale-General version (IDSS-G), based on empirical evidence of the signs and symptoms of depression reported across cultures. This paper describes the rationale and process of its development and the results of an initial test among a non-Western population.MethodsWe evaluated internal consistency reliability, test–retest reliability and inter-rater reliability of the IDSS-G in a sample N = 147 male and female attendees of primary health clinics in Yangon, Myanmar. For criterion validity, IDSS-G scores were compared with diagnosis by local psychiatrists using the Structured Clinical Interview for DSM (SCID). Construct validity was evaluated by investigating associations between the IDSS-G and the Patient Health Questionnaire (PHQ), impaired function, and suicidal ideation.ResultsThe IDSS-G showed high internal consistency reliability (α = 0.92), test–retest reliability (r = 0.87), and inter-rater reliability (ICC = 0.90). Strong correlations between the IDSS-G and PHQ-9, functioning, and suicidal ideation supported construct validity. Criterion validity was supported for use of the IDSS-G to identify people with a SCID diagnosed depressive disorder (major depression/dysthymia). The IDSS-G also demonstrated incremental validity by predicting functional impairment beyond that predicted by the PHQ-9. Results suggest that the IDSS-G accurately assesses depression in this population. Future testing in other populations will follow.

scholarly journals Development and Validation of an Evaluation Tool to Measure the Effectiveness of a Smoking Cessation Training among Healthcare Providers in Malaysia: The Providers’ Smoking Cessation Training Evaluation (ProSCiTE)

2019 ◽  
Vol 16 (21) ◽  
pp. 4297
Author(s):  
Siti Idayu Hasan ◽  
Farizah Mohd Hairi ◽  
Amer Siddiq Amer Nordin ◽  
Mahmoud Danaee
Keyword(s):  
Smoking Cessation ◽  
Construct Validity ◽  
Factor Structure ◽  
Internal Consistency ◽  
Content Validity ◽  
Training Programs ◽  
Training Evaluation ◽  
Healthcare Providers ◽  
Internal Consistency Reliability ◽  
Evaluation Tool

Background: In line with Article 14 of the Framework Convention for Tobacco Control, we have witnessed vast developments in smoking cessation training for healthcare providers, offering help for smokers. However, there is no specific evaluation tool to monitor and evaluate the effectiveness of these programs for future enhancement and sustainability. Objective: To develop and validate a new tool for evaluating smoking cessation training programs for healthcare providers called the Providers’ Smoking Cessation Training Evaluation (ProSCiTE). Methods: The 74-item ProSCiTE tool was developed based on a review of the literature and an expert panel review. The tool was validated in a sample of 403 healthcare providers using a cross-sectional study design from July to December 2016. Content validity was assessed by the Scale-Content Validity Index (S-CVI). The construct validity of the ProSCiTE was analyzed using exploratory factor analysis (EFA) to confirm psychometric properties. Internal consistency reliability was determined using Cronbach’s alpha. Results: The content validity showed that the S-CVI ranged from 0.82 to 1.00 for consistency, representativeness, relevancy, and the clarity of each construct, resulting in 67 items for the questionnaire. The construct validity of the ProSCiTE (based on eigenvalues and factor loadings to confirm the four-factor structure (attitude, self-efficacy, behavior, and barriers) with 54.74% total variance) was acceptable (Kaiser-Mayer-Olkin = 0.923; Bartlett’s test of sphericity was significant, p < 0.001). The internal consistency reliability of the four-factor structure was very good, with Cronbach’s alpha values at 0.89, 0.94, 0.95, and 0.90, respectively. Conclusions: This study showed that 67 items of the ProSCiTE demonstrated good content and construct validity, as well as a high internal consistency reliability for the measurement of knowledge, attitudes, self-efficacy, behavior, and barriers to smoking cessation interventions among healthcare providers. Therefore, the ProSCiTE is a valid and reliable research tool with which to evaluate the effectiveness of smoking cessation training programs.

Construct Validity and Internal Consistency of the Catalan Version of the Pain Self-Efficacy Questionnaire in Young People With Chronic Pain

2018 ◽  
Vol 43 (4) ◽  
pp. 213-221
Author(s):  
Elena Castarlenas ◽  
Ester Solé ◽  
Santiago Galán ◽  
Mélanie Racine ◽  
Mark P. Jensen ◽  
...  
Keyword(s):  
Chronic Pain ◽  
Young People ◽  
Construct Validity ◽  
Coping Strategies ◽  
Internal Consistency ◽  
Self Efficacy ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Internal Consistency Reliability ◽  
Validity And Reliability

The purpose of this study was to evaluate the construct validity and reliability of the Catalan version of the Pain Self-Efficacy Questionnaire (PSEQ) in a sample of young people with chronic pain. Two hundred twenty-seven young people with chronic pain (age range = 12–24 years, mean age = 17.87 years, SD = 3.08 years) participated in this study. The findings support a one-factor structure of the PSEQ, and the scale demonstrated excellent internal consistency reliability in our sample. In addition, convergent validity was supported by a loading of average variance extracted (AVE) greater than .50, and discriminant validity was supported by the finding that self-efficacy and pain-related anxiety AVEs were greater than the shared variance between both constructs. Further support for the measure’s construct validity was shown by (1) significant and positive associations between PSEQ scores and adaptive coping strategies and (2) negative and significant associations between PSEQ scores and maladaptive coping strategies and catastrophizing thoughts. The results of this study indicate that the Catalan version of the PSEQ is reliable and valid when used to assess pain self-efficacy beliefs in young people with chronic pain.

scholarly journals PSYCHOMETRIC EVALUATION OF FILIPINO VERSION OF PATIENT SATISFACTION INSTRUMENT

2019 ◽  
Vol 5 (6) ◽  
pp. 251-256
Author(s):  
Gil P Soriano ◽  
Kathyrine A Calong Calong
Keyword(s):  
Patient Satisfaction ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Psychometric Evaluation ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
Validity Index ◽  
Cross Sectional ◽  
Content Validity Index

Background: Patient satisfaction has been revealed to affect patient outcomes and has been used as an indicator for measuring quality in health care. However, there are no culturally appropriate instruments that measure Filipino patient satisfaction receiving nursing care.Objective: The objective of the study is to examine the validity and reliability of the Filipino version of Patient Satisfaction Instrument (F-PSI).Methods: The study utilized a cross-sectional study and included 131 Filipino patients in selected hospitals in Manila and were selected through convenience sampling. The tool undergone cross cultural adaptation following the WHO guidelines. Also, content validity following Davis technique and construct validity through confirmatory factor analysis was done to assessed its validity. To measure its internal consistency reliability, Cronbach’s α, inter-item and total-item correlation was conducted.Results: The construct validity of the Filipino version of PSI showed a good model fit while the item content validity index (I-CVI) ranges from 0.83-1.0 and a scale content validity index (S-CVI) of 0.96. Also, the translated tool showed an acceptable internal consistency reliability.Conclusion: The Filipino PSI is a valid and reliable instrument for measuring satisfaction among Filipino patients. Supplementary studies are needed to ascertain its validity and reliability for clinical use.

scholarly journals Using photos of basic facial expressions as a new approach to measuring implicit attitudes

PLoS ONE ◽  
2021 ◽  
Vol 16 (5) ◽  
pp. e0250922
Author(s):  
Klara Malinakova ◽  
Richard Korinek ◽  
Peter Tavel ◽  
Iva Polackova Solcova ◽  
Harold G. Koenig ◽  
...  
Keyword(s):  
Internal Consistency ◽  
Convergent Validity ◽  
Online Survey ◽  
Discriminant Validity ◽  
Implicit Attitudes ◽  
Selection Process ◽  
Reliability And Validity ◽  
Criterion Validity ◽  
Retest Reliability ◽  
Test Retest Reliability

Background Measuring implicit attitudes is difficult due to social desirability (SD). A new method, the Emotion Based Approach (EBA), can solve this by using emotions from a display of faces as response categories. We applied this on an EBA Spirituality tool (EBA-SPT) and an Actual Situation tool (EBA-AST). Our aim was to assess the structure, reliability and validity of the tools and to compare two EBA assessment approaches, i.e., an explicit one (only assessing final replies to items) and an implicit one (assessing also the selection process). Methods We obtained data on a sample of Czech adults (n = 522, age 30.3±12.58; 27.0% men) via an online survey; cortisol was assessed in 46 participants. We assessed the structure and psychometric properties (internal consistency and test-retest reliability; convergent, discriminant, and criterion validity) of the EBA, and examined the differences between explicit vs. implicit EBA approaches. Results We found an acceptable-good internal consistency reliability of the EBA tools, acceptable discriminant validity between them and low (neutral expression) to good (joy) test-retest reliability for concrete emotions assessed by the tools. An implicit EBA approach showed stronger correlations between emotions and weaker convergent validity, but higher criterion validity, than an explicit approach and standard questionnaires. Conclusion Compared to standard questionnaires, EBA is a more reliable approach for measuring attitudes, with an implicit approach that reflects the selection process yielding the best results.

Sign in / Sign up

Export Citation Format

Share Document