A Systematic Review of Measurement Properties of Spirituality related Assessment Tools Published in Korean Journals

Purpose: The purpose of this study was to evaluate the measurement properties of spirituality-related assessment tools published in Korean journals.Methods: The databases used to search the literature reporting use of the spirituality-related assessment tools were RISS, NDSL, DBpia, KoreaMed, and KISS. The quality of the measurement properties was evaluated based on the reported internal consistency, content validity, criterion validity, construct validity, reproducibility, responsiveness, floor-ceiling effects and interpretability based on the tools review criteria suggested by Terwee et al.Results: Twenty-five assessment tools (including 7 original Korean versions) were identified from the 208 Korean studies published up to November, 2016. All of the 25 tools reported internal consistency and content validity; construct validity was reported in 21 tools while only six tools had reported on criterion validity. None of the studies reported on the reproducibility, responsiveness, and floor-ceiling effects. Among 25 spirituality-related assessment tools, the spiritual well-being scale was identified as the most commonly used tool for spirituality assessment.Conclusion: Among 25 spirituality-related assessment tools used in Korean studies, all of them satisfied only three criteria out of the eight criteria for measurement properties, internal consistency, content validity, and interpretability. The results of this study provide evidence to develop reliable and valid tools that will satisfy the criteria for measurement properties. In addition, standardized, reliable, and valid assessment tools must be chosen for spirituality-related study.

Download Full-text

Development and validation of a multi-lingual online questionnaire for surveying the COVID-19 prevention and control measures used in global workplaces

BMC Public Health ◽

10.1186/s12889-022-12500-w ◽

2022 ◽

Vol 22 (1) ◽

Author(s):

Carolyn Ingram ◽

Yanbing Chen ◽

Conor Buggy ◽

Vicky Downey ◽

Mary Archibald ◽

...

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Content Validity ◽

Prevention And Control ◽

Online Survey ◽

Discriminant Validity ◽

Internal Consistency Reliability ◽

Criterion Validity ◽

And Control ◽

Occupational Settings

Abstract Background Despite widespread COVID-19 vaccination programs, there is an ongoing need for targeted disease prevention and control efforts in high-risk occupational settings. This study aimed to develop, pilot, and validate an instrument for surveying occupational COVID-19 infection prevention and control (IPC) measures available to workers in diverse geographic and occupational settings. Methods A 44-item online survey was developed in English and validated for face and content validity according to literature review, expert consultation, and pre-testing. The survey was translated and piloted with 890 workers from diverse industries in Canada, Ireland, Argentina, Poland, Nigeria, China, the US, and the UK. Odds ratios generated from univariable, and multivariable logistic regression assessed differences in ‘feeling protected at work’ according to gender, age, occupation, country of residence, professional role, and vaccination status. Exploratory factor analysis (EFA) was conducted, and internal consistency reliability verified with Cronbach’s alpha. Hypothesis testing using two-sample t-tests verified construct validity (i.e., discriminant validity, known-groups technique), and criterion validity. Results After adjustment for occupational sector, characteristics associated with feeling protected at work included being male (AOR = 1.88; 95% CI = 1.18,2.99), being over 55 (AOR = 2.17; 95% CI = 1.25,3.77) and working in a managerial position (AOR = 3.1; 95% CI = 1.99,4.83). EFA revealed nine key IPC domains relating to: environmental adjustments, testing and surveillance, education, costs incurred, restricted movements, physical distancing, masking, isolation strategies, and areas for improvement. Each domain showed sufficient internal consistency reliability (Cronbach’s alpha ≥0.60). Hypothesis testing revealed differences in survey responses by country and occupational sector, confirming construct validity (p < 0.001), criterion validity (p = 0.04), and discriminant validity (p < 0.001). Conclusions The online survey, developed in English to identify the COVID-19 protective measures used in diverse workplace settings, showed strong face validity, content validity, internal consistency, criterion validity, and construct validity. Translations in Chinese, Spanish, French, Polish, and Hindi demonstrated adaptability of the survey for use in international working environments. The multi-lingual tool can be used by decision makers in the distribution of IPC resources, and to guide occupational safety and health (OSH) recommendations for preventing COVID-19 and future infectious disease outbreaks.

Download Full-text

Measuring advance care planning behavior in Dutch adults: translation, cultural adaptation and validation of the Advance Care Planning Engagement Survey

BMC Medical Research Methodology ◽

10.1186/s12874-021-01389-5 ◽

2021 ◽

Vol 21 (1) ◽

Author(s):

Doris van der Smissen ◽

Agnes van der Heide ◽

Rebecca L. Sudore ◽

Judith A. C. Rietjens ◽

Ida J. Korfage

Keyword(s):

Chronic Disease ◽

Construct Validity ◽

Internal Consistency ◽

Advance Care Planning ◽

Content Validity ◽

Intraclass Correlation ◽

Criterion Validity ◽

Care Planning ◽

Validity And Reliability ◽

Advance Care

Abstract Background Advance care planning (ACP) enables people to define, discuss, and record preferences for treatment and care. Measures of ACP behavior are lacking in the Netherlands. We aimed to translate, culturally adapt and validate the 34-item ACP Engagement Survey into Dutch. Methods Following validation guidelines, we tested content validity, internal consistency, reproducibility, construct validity, interpretability and criterion validity among persons with and without chronic disease. Results Forward-backward translation indicated the need of only minor adaptations. Two hundred thirty-two persons completed baseline and retest surveys; 121 were aged ≥60 years. Persons with chronic disease (n = 151) considered the survey more valuable than those without (66 vs. 59, p < 0.001, scale of 20–100), indicating good content validity. Internal consistency (Cronbach’s alpha: 0.97) and reproducibility (intraclass correlation: 0.88) were good. Total ACP Engagement was higher among persons with chronic disease than those without (2.9 vs. 2.4, p < 0.01, scale of 1 to 5), indicating good psychometric support for construct validity and interpretability. Positive correlations of the ACP Engagement Survey and the General Self-Efficacy survey indicated good criterion validity (p < 0.05). Conclusions This study provided good psychometric support for the validity and reliability of the Dutch 34-item ACP Engagement Survey. This instrument can be used to assess involvement in ACP in adults with and without chronic disease.

Download Full-text

A meta-analysis of measurement properties of the Western Ontario Meniscal Evaluation Tool (WOMET)

Journal of Orthopaedic Surgery and Research ◽

10.1186/s13018-020-02103-9 ◽

2020 ◽

Vol 15 (1) ◽

Author(s):

Nikolas Leon Krott ◽

Marcel Betsch ◽

Michael Wild

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Content Validity ◽

Meta Analysis ◽

Cross Cultural ◽

Measurement Properties ◽

Consistency Test ◽

Retest Reliability ◽

Test Retest Reliability

Abstract Background We provide a meta-analysis for clinicians and researchers regarding the psychometric properties of the WOMET as a patient-reported outcome measure (PROM) for patients with meniscal pathologies. Methods A comprehensive literature search identified 6 eligible papers evaluating WOMET measurement properties in patients with different meniscal injuries and meniscal treatments following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement. The quality of the included studies was evaluated using the four-point Consensus-based Standard for the selection of health Measurement Instruments (COSMIN) Checklist for good measurement properties. The checklist was specifically developed for studies on health-related PROMs. Results Our meta-analysis suggests that the WOMET can be used to evaluate patients with different meniscal injuries and meniscal treatments, especially acute or chronic meniscal injuries and traumatic or degenerative meniscal injuries treated operatively or conservatively. The WOMET shows satisfactory internal consistency, test-retest reliability, and construct validity. Due to limitations in both sample sizes and methodologies of the included studies, no conclusions can be drawn regarding the WOMET’s content validity, structure validity, cross-cultural validity, measurement error, or responsiveness. A further limitation of the studies included in this meta-analysis is the lack of cross-cultural validation, although recommended by the COSMIN Standards. Conclusions The first meta-analysis on measurement properties of the WOMET demonstrates satisfactory internal consistency, test-retest reliability, and construct validity. Further studies are needed, focusing on the methodological deficiencies highlighted in this meta-analysis. To ensure that the WOMET adequately reflects the symptoms, functions, and quality of life of patients with meniscal tears based on COSMIN criteria, it is necessary to assess the structural validity and content validity of this PROM.

Download Full-text

Validity of the Brief Resilience Scale and Brief Resilient Coping Scale in a Chinese Sample

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph17041265 ◽

2020 ◽

Vol 17 (4) ◽

pp. 1265 ◽

Cited By ~ 4

Author(s):

Sai-fu Fung

Keyword(s):

Construct Validity ◽

Psychometric Properties ◽

Internal Consistency ◽

Well Being ◽

Criterion Validity ◽

Self Report ◽

Chinese Sample ◽

Chinese University ◽

Resilience Scale ◽

Coping Scale

This study presents a cross-cultural examination of the psychometric properties of two commonly used brief self-report resilience scales, the 6-item Brief Resilience Scale (BRS) and the 4-item Brief Resilient Coping Scale (BRCS). Five hundred and eleven Chinese university undergraduate students were recruited for this cross-sectional research. Various psychometric evaluation tools were used to evaluate the internal consistency, criterion validity, factorial validity and construct validity of these resilience scales. The results showed that both scales had good criterion validity, with well-established measures of well-being, optimism, self-esteem, self-efficacy and mental health, as suggested in the resilience literature. The BRS (a = 0.71) showed better internal consistency than the BRCS (a = 0.59). The confirmatory factor analysis (CFA) results also indicated that the BRS, with a two-factor structure, had better construct validity than the BRCS. The CFA results for the BRS met all of the criteria for a good model fit. The BRS was found to have better psychometric properties than the BRCS in the Chinese context. The findings will help researchers to select an appropriate resilience measure when conducting epistemological surveys of Chinese university students or the Chinese diaspora in other contexts.

Download Full-text

Psychometric analysis of the Brazilian-version Kidscreen-27 questionnaire

Health and Quality of Life Outcomes ◽

10.1186/s12955-021-01824-7 ◽

2021 ◽

Vol 19 (1) ◽

Author(s):

Pablo Magno da Silveira ◽

Alexsandra da Silva Bandeira ◽

Marcus Vinicius Veber Lopes ◽

Adriano Ferreti Borgatto ◽

Kelly Samara da Silva

Keyword(s):

Public Schools ◽

Construct Validity ◽

Internal Consistency ◽

Intraclass Correlation ◽

Well Being ◽

Discriminatory Power ◽

Brazilian Version ◽

Related Quality ◽

Health Related ◽

Delta G

Abstract Background The objective of this study was to verify the reliability, discriminatory power and construct validity of the Kidscreen-27 questionnaire in Brazilian adolescents. Methods Adolescents that participated of the pilot study (210 adolescents; 52.9% boys; 13.7 years old) and of the baseline (816 participants; 52.7% girls; 13.1 years old) of the Movimente Project in 2016/2017 composed the sample of the present study. This project was carried out in six public schools in the city of Florianópolis, Santa Catarina, Brazil. Test–retest reproducibility was assessed by the intraclass correlation coefficient and Gwet coefficient; internal consistency through McDonald's Omega; Hankins' Delta G coefficient verified the scale's discriminatory power and; confirmatory factor analysis to assess construct validity. Results Reproducibility values ranged from 0.71 to 0.78 for the dimensions (ICC), and ranged from 0.60 to 0.83 for the items (Gwet). McDonald's Ômega (0.82–0.91) for internal consistency measures. Discriminatory power ranging from 0.94 for the dimension Social Support and Friends to 0.98 for Psychological Well-Being. The factorial loads were > 0.40, except for item 19 (0.36). The fit quality indicators of the model were adequate (X2[df] = 1022.89 [311], p < 0.001; RMSEA = 0.053 (0.049–0.087); CFI = 0.988; TLI = 0.987), confirming the five-factor structure originally proposed. Conclusions The Brazilian-version Kidscreen-27 achieved good levels of reproducibility, internal consistency, discriminatory power and construct validity. Its use is adequate to measure the health-related quality of life of adolescents in the Brazilian context.

Download Full-text

Measuring Subjective Sleep Quality: A Review

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph18031082 ◽

2021 ◽

Vol 18 (3) ◽

pp. 1082

Author(s):

Marco Fabbri ◽

Alessia Beracci ◽

Monica Martoni ◽

Debora Meneo ◽

Lorenzo Tonetti ◽

...

Keyword(s):

Construct Validity ◽

Sleep Quality ◽

Psychometric Properties ◽

Internal Consistency ◽

Self Report ◽

Measurement Properties ◽

Poor Sleep ◽

Daily Routine ◽

Factorial Structure ◽

Poor Sleep Quality

Sleep quality is an important clinical construct since it is increasingly common for people to complain about poor sleep quality and its impact on daytime functioning. Moreover, poor sleep quality can be an important symptom of many sleep and medical disorders. However, objective measures of sleep quality, such as polysomnography, are not readily available to most clinicians in their daily routine, and are expensive, time-consuming, and impractical for epidemiological and research studies., Several self-report questionnaires have, however, been developed. The present review aims to address their psychometric properties, construct validity, and factorial structure while presenting, comparing, and discussing the measurement properties of these sleep quality questionnaires. A systematic literature search, from 2008 to 2020, was performed using the electronic databases PubMed and Scopus, with predefined search terms. In total, 49 articles were analyzed from the 5734 articles found. The psychometric properties and factor structure of the following are reported: Pittsburgh Sleep Quality Index (PSQI), Athens Insomnia Scale (AIS), Insomnia Severity Index (ISI), Mini-Sleep Questionnaire (MSQ), Jenkins Sleep Scale (JSS), Leeds Sleep Evaluation Questionnaire (LSEQ), SLEEP-50 Questionnaire, and Epworth Sleepiness Scale (ESS). As the most frequently used subjective measurement of sleep quality, the PSQI reported good internal reliability and validity; however, different factorial structures were found in a variety of samples, casting doubt on the usefulness of total score in detecting poor and good sleepers. The sleep disorder scales (AIS, ISI, MSQ, JSS, LSEQ and SLEEP-50) reported good psychometric properties; nevertheless, AIS and ISI reported a variety of factorial models whereas LSEQ and SLEEP-50 appeared to be less useful for epidemiological and research settings due to the length of the questionnaires and their scoring. The MSQ and JSS seemed to be inexpensive and easy to administer, complete, and score, but further validation studies are needed. Finally, the ESS had good internal consistency and construct validity, while the main challenges were in its factorial structure, known-group difference and estimation of reliable cut-offs. Overall, the self-report questionnaires assessing sleep quality from different perspectives have good psychometric properties, with high internal consistency and test-retest reliability, as well as convergent/divergent validity with sleep, psychological, and socio-demographic variables. However, a clear definition of the factor model underlying the tools is recommended and reliable cut-off values should be indicated in order for clinicians to discriminate poor and good sleepers.

Download Full-text

Psychometric Testing of the Spanish Modified Version of the Mini-Suffering State Examination

International Journal of Environmental Research and Public Health ◽

10.3390/ijerph18157821 ◽

2021 ◽

Vol 18 (15) ◽

pp. 7821

Author(s):

Daniel Gutiérrez-Sánchez ◽

Rafael Gómez-García ◽

Isabel María López-Medina ◽

Antonio I. Cuesta-Vargas

Keyword(s):

Internal Consistency ◽

Content Validity ◽

Convergent Validity ◽

Informal Caregivers ◽

Psychometric Testing ◽

Spanish Version ◽

Measurement Properties ◽

Quality Of Dying ◽

State Examination

Background: The mini-suffering state examination is a valid and reliable measure that have been used to assess suffering in patients with advanced cancer. The aim of this study was to carry out a psychometric analysis of the Spanish version of the mini-suffering state examination. Method: A validation study was conducted. Seventy-two informal caregivers of deceased patients in palliative care were included in this study. A psychometric testing of content validity, internal consistency, and convergent validity with the Spanish version of the quality of dying and death questionnaire was performed. Results: The original instrument was modified to be used by informal caregivers. The content validity was acceptable (0.96), and the internal consistency was moderate (α = 0.67). Convergent validity was demonstrated (r = −0.64). Conclusion: The Spanish modified version of the MSSE showed satisfactory measurement properties. The Spanish modified version of MSSE can be useful to facilitate screening, monitor progress, and guide treatment decisions in end-of-life cancer patients.

Download Full-text

Covid-19 Literacy Scale: Turkish Validity and Reliability Study

Clinical Nursing Research ◽

10.1177/10547738211059879 ◽

2021 ◽

pp. 105477382110598

Author(s):

Ganime Can Gür ◽

Yasemin Altinbaş

Keyword(s):

Construct Validity ◽

Factor Structure ◽

Internal Consistency ◽

Content Validity ◽

Model Data ◽

Validity And Reliability ◽

Turkish Version ◽

Reliability Study ◽

Reliability Method ◽

Test Retest Reliability

The current study was planned to test the validity and reliability of the Turkish version of the COVID-19 Literacy Scale. The sample of the study was taken from 473 individuals. In this study, language validity, content validity and construct validity were examined to determine the validity of the scale. Its reliability was evaluated by internal consistency, split-half reliability, and test-retest reliability method. It was defined that the scale has a two-factor structure as a result of EFA and its factor loadings are in the appropriate range (0.852–0.324). According to the CFA result, it was determined that the model-data fit was at a good level. The Cronbach values for the whole scale and subscales were .92, .90, and .87, respectively. It was observed that the test-retest value was .95. It was concluded that the Turkish form of the COVID-19 Literacy Scale is a reliable and valid tool.

Download Full-text

Psychometric evaluation and cultural adaptation of the Spanish version of the “Scale for End-of Life Caregiving Appraisal”

Palliative & Supportive Care ◽

10.1017/s1478951518000470 ◽

2018 ◽

Vol 17 (03) ◽

pp. 314-321

Author(s):

José Manuel Hernández-Padilla ◽

Matías Correa-Casado ◽

José Granero-Molina ◽

Alda Elena Cortés-Rodríguez ◽

Tamara María Matarín-Jiménez ◽

...

Keyword(s):

Factor Analysis ◽

Construct Validity ◽

End Of Life ◽

Exploratory Factor Analysis ◽

Content Validity ◽

Criterion Validity ◽

Spanish Version ◽

Validity Index ◽

Content Validity Index ◽

The Impact

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.

Download Full-text

Translation, Cross-Cultural Adaptation, Validity, and Reliability of the Indonesian Version of the IKDC Subjective Knee Form

Orthopaedic Journal of Sports Medicine ◽

10.1177/23259671211038372 ◽

2021 ◽

Vol 9 (9) ◽

pp. 232596712110383

Author(s):

Romy Deviandri ◽

Hugo C. van der Veen ◽

Andri M.T. Lubis ◽

Maarten J. Postma ◽

Inge van den Akker-Scheek

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Cultural Adaptation ◽

Acl Injury ◽

Cross Cultural ◽

Systematic Bias ◽

Validity And Reliability ◽

Acl Injuries ◽

Cross Cultural Adaptation ◽

Ceiling Effects

Background: No questionnaire is currently available for use in patients with anterior cruciate ligament (ACL) injuries in an Indonesian population. The most-used questionnaire in clinical research for these patients is the International Knee Documentation Committee (IKDC) Subjective Knee Form, as its psychometric properties are considered to be excellent. Purpose: To translate the IKDC into Indonesian and assess its validity for use in Indonesian-speaking patients with ACL injuries. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: After a forward-and-backward translation procedure and cross-cultural adaptation, the validity and reliability of the questionnaire were investigated. The responses of ACL injury patients on 3 questionnaires, the Indonesian-IKDC (I-IKDC), 36-Item Short Form Health Survey, and Kujala Anterior Knee Pain Scale, were compared. Following consensus-based standards for the selection of health measurement instruments guidelines, construct validity, test-retest reliability, internal consistency, floor and ceiling effects, and measurement error were determined. The Bland-Altman method was used to explore absolute agreement. Results: Of 253 ACL injury patients, 106 (42%) responded to the invitation. Construct validity was considered good, as all predefined hypotheses on correlations between the I-IKDC and other scores were confirmed. Reliability proved excellent, with a high test-retest correlation (intraclass correlation coefficient = 0.99). Bland-Altman analyses showed no systematic bias between test and retest. Internal consistency was good (Cronbach α = .90). There were no floor or ceiling effects. Standard error of measurement was 2.1, and the minimal detectable change was 5.8 at the individual level and 0.7 at the group level. Conclusion: The I-IKDC, as developed, appeared to be a good evaluation instrument for Indonesian patients with ACL injuries.

Download Full-text