scholarly journals Development and psychometric testing of the FLW-MSC scale for measuring frontline worker multisectoral collaboration in rural India

BMJ Open ◽  
2021 ◽  
Vol 11 (3) ◽  
pp. e037800
Author(s):  
Douglas Glandon ◽  
Jeannie-Marie Leoutsakos ◽  
Shivam Gupta ◽  
Jill Marsteller ◽  
Ligia Paina ◽  
...  
Keyword(s):  
Child Development ◽  
Construct Validity ◽  
Internal Consistency ◽  
Mean Squared Error ◽  
Psychometric Testing ◽  
Criterion Validity ◽  
Analysis Model ◽  
Factor Analysis Model ◽  
Catchment Areas ◽  
Frontline Worker

ObjectivesMultisectoral collaboration (MSC) is widely recognised as a critical aspect of policies, programmes and interventions addressing complex public health issues, yet it is undertheorised and difficult to measure. Limited understanding of the intermediate steps linking MSC formation to intended health outcomes leaves a substantial knowledge gap about the types of strategies that may be most effective in making such collaborations successful. This paper, which reports the quantitative strand of a broader mixed-methods study, takes a step toward filling in this ‘missing middle’ of MSC evaluation by developing and testing the FLW-MSC scale, an instrument to assess collaboration among the frontline workers of one of India’s largest and most widely known MSCs: the Integrated Child Development Services (ICDS) scheme.DesignThis study involved development, field-testing and psychometric testing of an 18-item, Likert-type frontline worker collaboration scale, including internal consistency, construct validity and criterion validity.SettingVillage-level primary healthcare in rural Uttar Pradesh, India.Participants281 anganwadi workers, 266 accredited social health activists and 124 auxiliary nurse midwives selected based on random sampling of anganwadi catchment areas from 346 gram panchayats (GPs), including 173 intervention GPs and 173 pair-matched control GPs from a parent evaluation study.ResultsResults support the scale’s internal consistency (ordinal α=0.92–0.95), construct validity (reasonable exploratory factor analysis model fit for five of the six dyadic relationships Tucker-Lewis Index=0.84–0.88; Root Mean Squared Error of Approximation=0.09–0.11), and criterion validity (regression of collaboration score on an information-sharing indicator β=3.528; p=0.006).ConclusionsThe scale may be useful for ICDS managers to detect and address poor collaboration as the Indian government redoubles its efforts to strengthen and monitor MSC, or ‘convergence’, with important implications for the critical priority of child development. Further, the FLW-MSC scale may be adapted for measuring frontline worker collaboration across sectors in many other scenarios and low/middle-income country contexts.

The Colorado Cognitive Assessment (CoCA): Development of an Advanced Neuropsychological Screening Tool

2019 ◽  
Author(s):  
Ashita S. Gurnani ◽  
Shayne S.-H. Lin ◽  
Brandon E Gavett
Keyword(s):  
Construct Validity ◽  
Psychometric Properties ◽  
Cognitive Assessment ◽  
Screening Tool ◽  
Depression Scale ◽  
Internal Consistency Reliability ◽  
Screening Tests ◽  
Cognitive Screening ◽  
Analysis Model ◽  
Factor Analysis Model

Objective: The Colorado Cognitive Assessment (CoCA) was designed to improve upon existing screening tests in a number of ways, including enhanced psychometric properties and minimization of bias across diverse groups. This paper describes the initial validation study of the CoCA, which seeks to describe the test; demonstrate its construct validity; measurement invariance to age, education, sex, and mood symptoms; and compare it to the Montreal Cognitive Assessment (MoCA). Method: Participants included 151 older adults (MAge = 71.21, SD = 8.05) who were administered the CoCA, MoCA, Judgment test from the Neuropsychological Assessment Battery (NAB), 15-item version of the Geriatric Depression Scale (GDS-15), and 10-item version of the Geriatric Anxiety Scale (GAS-10). Results: A single factor confirmatory factor analysis model of the CoCA fit the data well, CFI = 0.955; RMSEA = 0.033. The CoCA’s internal consistency reliability was .84, compared to .74 for the MoCA. The CoCA had stronger disattenuated correlations with the MoCA (r = .79) and NAB Judgment (r = .47) and weaker correlations with the GDS-15 (r = -.36) and GAS-10 (r = -.15), supporting its construct validity. Finally, when analyzed using multiple indicators, multiple causes (MIMIC) modeling, the CoCA showed no evidence of measurement non-invariance, unlike the MoCA. Conclusions: These results provide initial evidence to suggest that the CoCA is a valid cognitive screening tool that offers numerous advantages over the MoCA, including superior psychometric properties and measurement non-invariance. Additional validation and normative studies are warranted.

The Perception of Risk of Heart Disease Scale: Development and Psychometric Analysis

2008 ◽  
Vol 16 (2) ◽  
pp. 83-97 ◽  
Author(s):  
Ali A. Ammouri ◽  
Geri Neuberger
Keyword(s):  
Heart Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Healthy Lifestyle ◽  
Psychometric Testing ◽  
Perception Of Risk ◽  
Consistency Test ◽  
Unknown Risk ◽  
Dread Risk ◽  
Test Retest Reliability

Perception of risk of getting heart disease is an important predictor of individuals’ engagement in a healthy lifestyle. This study describes the development and testing of the Perception of Risk of Heart Disease Scale (PRHDS). The 20-item instrument was tested in successive steps with 295 individuals for internal consistency, test–retest reliability, and construct validity. The three subscales of dread risk, risk, and unknown risk had internal consistency values ranging from .68 to .80. The total scale alpha was .80. Evidence of the instrument’s stability over time was supported by subscale test–retest reliabilities ranging from .61 to .76. Construct validity was documented with a positive correlation between PRHDS and the Health Promotion Lifestyle Profile II (r = .20 to .39). Further psychometric testing of the PRHDS in a larger sample with a heterogeneous cultural background is recommended.

scholarly journals Development and validation of a multi-lingual online questionnaire for surveying the COVID-19 prevention and control measures used in global workplaces

2022 ◽  
Vol 22 (1) ◽  
Author(s):  
Carolyn Ingram ◽  
Yanbing Chen ◽  
Conor Buggy ◽  
Vicky Downey ◽  
Mary Archibald ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Prevention And Control ◽  
Online Survey ◽  
Discriminant Validity ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
And Control ◽  
Occupational Settings

Abstract Background Despite widespread COVID-19 vaccination programs, there is an ongoing need for targeted disease prevention and control efforts in high-risk occupational settings. This study aimed to develop, pilot, and validate an instrument for surveying occupational COVID-19 infection prevention and control (IPC) measures available to workers in diverse geographic and occupational settings. Methods A 44-item online survey was developed in English and validated for face and content validity according to literature review, expert consultation, and pre-testing. The survey was translated and piloted with 890 workers from diverse industries in Canada, Ireland, Argentina, Poland, Nigeria, China, the US, and the UK. Odds ratios generated from univariable, and multivariable logistic regression assessed differences in ‘feeling protected at work’ according to gender, age, occupation, country of residence, professional role, and vaccination status. Exploratory factor analysis (EFA) was conducted, and internal consistency reliability verified with Cronbach’s alpha. Hypothesis testing using two-sample t-tests verified construct validity (i.e., discriminant validity, known-groups technique), and criterion validity. Results After adjustment for occupational sector, characteristics associated with feeling protected at work included being male (AOR = 1.88; 95% CI = 1.18,2.99), being over 55 (AOR = 2.17; 95% CI = 1.25,3.77) and working in a managerial position (AOR = 3.1; 95% CI = 1.99,4.83). EFA revealed nine key IPC domains relating to: environmental adjustments, testing and surveillance, education, costs incurred, restricted movements, physical distancing, masking, isolation strategies, and areas for improvement. Each domain showed sufficient internal consistency reliability (Cronbach’s alpha ≥0.60). Hypothesis testing revealed differences in survey responses by country and occupational sector, confirming construct validity (p < 0.001), criterion validity (p = 0.04), and discriminant validity (p < 0.001). Conclusions The online survey, developed in English to identify the COVID-19 protective measures used in diverse workplace settings, showed strong face validity, content validity, internal consistency, criterion validity, and construct validity. Translations in Chinese, Spanish, French, Polish, and Hindi demonstrated adaptability of the survey for use in international working environments. The multi-lingual tool can be used by decision makers in the distribution of IPC resources, and to guide occupational safety and health (OSH) recommendations for preventing COVID-19 and future infectious disease outbreaks.

scholarly journals Reliability and Validity of the German Version of the Emotional Style Questionnaire

2021 ◽  
Vol 12 ◽  
Author(s):  
Darko Jekauc ◽  
Lea Mülberger ◽  
Susanne Weyland ◽  
Fabienne Ennigkeit ◽  
Kathrin Wunsch ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Online Survey ◽  
Reliability And Validity ◽  
Criterion Validity ◽  
German Version ◽  
Personality Psychology ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Emotional Style

Until recently, emotional processes have played little role in personality psychology. Based on neuroscientific findings, Davidson and colleagues proposed a theory of emotional styles, postulating six dimensions of emotional life: outlook, resilience, social intuition, self-awareness, sensitivity to context, and attention. Recently, an English version of the Emotional Style Questionnaire (ESQ) was developed and tested for reliability and validity. The aim of the present work was to test the test–retest reliability, internal consistency, construct validity, and criterion validity of the German version of the ESQ. Two separate samples consisting of 365 and 344 subjects took part in an online survey. The results of the two studies indicated satisfactory test–retest reliability and internal consistency. Regarding the construct validity, the results from Study 1 to Study 2 indicate good model fit indices. Although there was a high correlation between the subscales outlook and resilience, the analyses supported the six-factor structure postulated by Davidson and colleagues. Substantial correlations were found between the dimensions of the ESQ and other validated scales, confirming the criterion validity of the questionnaire. Our results suggest that the German version of the ESQ is a reliable and valid measurement of emotional styles. It is a feasible and economical questionnaire that can be applied in various psychology disciplines, such as personality psychology, clinical psychology, industrial psychology or sport and exercise psychology.

scholarly journals Measuring advance care planning behavior in Dutch adults: translation, cultural adaptation and validation of the Advance Care Planning Engagement Survey

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Doris van der Smissen ◽  
Agnes van der Heide ◽  
Rebecca L. Sudore ◽  
Judith A. C. Rietjens ◽  
Ida J. Korfage
Keyword(s):  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Advance Care Planning ◽  
Content Validity ◽  
Intraclass Correlation ◽  
Criterion Validity ◽  
Care Planning ◽  
Validity And Reliability ◽  
Advance Care

Abstract Background Advance care planning (ACP) enables people to define, discuss, and record preferences for treatment and care. Measures of ACP behavior are lacking in the Netherlands. We aimed to translate, culturally adapt and validate the 34-item ACP Engagement Survey into Dutch. Methods Following validation guidelines, we tested content validity, internal consistency, reproducibility, construct validity, interpretability and criterion validity among persons with and without chronic disease. Results Forward-backward translation indicated the need of only minor adaptations. Two hundred thirty-two persons completed baseline and retest surveys; 121 were aged ≥60 years. Persons with chronic disease (n = 151) considered the survey more valuable than those without (66 vs. 59, p < 0.001, scale of 20–100), indicating good content validity. Internal consistency (Cronbach’s alpha: 0.97) and reproducibility (intraclass correlation: 0.88) were good. Total ACP Engagement was higher among persons with chronic disease than those without (2.9 vs. 2.4, p < 0.01, scale of 1 to 5), indicating good psychometric support for construct validity and interpretability. Positive correlations of the ACP Engagement Survey and the General Self-Efficacy survey indicated good criterion validity (p < 0.05). Conclusions This study provided good psychometric support for the validity and reliability of the Dutch 34-item ACP Engagement Survey. This instrument can be used to assess involvement in ACP in adults with and without chronic disease.

Psychometric testing of the developmental care scale for neonates with congenital heart disease

2019 ◽  
Vol 29 (06) ◽  
pp. 749-755
Author(s):  
Sara Arter ◽  
Elaine Miller ◽  
Tamilyn Bakas ◽  
David S Cooper
Keyword(s):  
Congenital Heart Disease ◽  
Heart Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Congenital Heart ◽  
Psychometric Testing ◽  
Internal Consistency Reliability ◽  
Neurodevelopmental Outcomes ◽  
Developmental Care ◽  
Care Performance

AbstractPurpose:Developmental care of neonates with CHD is essential for proper neurodevelopment. Measurement of developmental care specific to these neonates is needed to ensure consistent implementation within and across cardiac ICUs. The purpose of this study was to psychometrically test the Developmental Care Scale for Neonates with Congenital Heart Disease, which measures the quality of developmental care provided by bedside nurses to neonates in the cardiac ICU.Methods:Psychometric testing was conducted with 119 cardiac ICU nurses to provide evidence of internal consistency reliability and construct validity. Participants were predominantly young (median = 32 years), white (90%) females (93%) with bachelor’s degrees (78%) and a median experience in the cardiac ICU of 7 years.Results:Evidence of internal consistency reliability (α =.89) was provided with corrected item-total correlations ranging from .31 to .77. Exploratory factor analysis provided evidence of construct validity as a unidimensional scale, as well as a multidimensional scale consisting of four subscales: creating the external environment, assessment of family well-being, caregiver activities toward the neonate, and basic human needs.Conclusions:Evidence of reliability and validity of the 31-item Developmental Care Scale for Neonates with Congenital Heart Disease was established with nurses caring for neonates in the cardiac ICU. This instrument will serve as a valuable outcome measure tasked with improving developmental care performance and makes it possible to identify relationships between developmental care performance and neonatal neurodevelopmental outcomes in future research.

: Evaluation of the Validity and Reliability of the Suicide Opinion Questionnaire as a Measure of Korean Nurses’ Attitudes toward Suicide

2017 ◽  
Vol 5 (4) ◽  
pp. 454 ◽  
Author(s):  
Eun Nam Lee ◽  
Jang Mi Kim
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Goodness Of Fit ◽  
Mean Squared Error ◽  
Internal Consistency Reliability ◽  
Validity And Reliability ◽  
Korean Version ◽  
Confirmatory Factor ◽  
Attitudes Toward Suicide ◽  
Fit Index

Background: The aim of this study was to investigate the validity and reliability of the Korean version of the Suicide Opinion Questionnaire to measure Korean nurses’ attitudes toward suicide attempters.Methods: The questionnaire data were collected from 191 nurses who worked in emergency rooms, emergency wards and psychiatry wards. The internal consistency reliability and construct validity were evaluated using exploratory and confirmatory factor analysis.Results: The Cronbach’s α values regarding internal consistency were 0.51-0.79 for the subscales of the Korean version of the Suicide Opinion Questionnaire. The factor loadings of 18 items on the 6 subscales ranged from 0.54 to 0.84. The 6 subscale model was validated by a confirmatory factor analysis. The goodness-of-fit indexes were verified to be χ2/df = 1.56, root mean square residual = 0.04, goodness of fit index = 0.91, adjusted goodness of fit index = 0.86, Tucker-Lewis index = 0.9, comparative fit index = 0.92 and root mean squared error of approximation = 0.05.Conclusion: The findings indicated relatively satisfactory construct validity for the Korean version of the Suicide Opinion Questionnaire, whereas the reliability was not high. The current study indicates that the questionnaire should be used with caution when measuring nurses’ attitudes toward suicide attempters.

scholarly journals Psychometric Testing of the Korean Version of the Caring Behaviors Inventory-24 in Clinical Nurses

2021 ◽  
Vol 28 (1) ◽  
pp. 96-104
Author(s):  
Younhee Kang ◽  
Sook Jung Kang ◽  
In-Suk Yang ◽  
Haeok Lee ◽  
Joyce Fitzpatrick
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Internal Consistency ◽  
Convergent Validity ◽  
Discriminant Validity ◽  
Psychometric Testing ◽  
Fit Indices ◽  
Caring Behaviors ◽  
Clinical Nurses ◽  
Model Fit Indices

Purpose: To determine psychometric properties of the Caring Behaviors Inventory-24 (CBI-24) among Korean clinical nurses.Methods: A methodological design was used. Data were collected from 408 clinical nurses. Construct validity analysis was performed, including factorial, convergent, and discriminant validity. Internal consistency was tested by Cronbach’s ⍺ coefficients, inter-item correlation, and corrected item-total correlation.Results: Exploratory factor analysis produced three factors: ‘empathy and supporting’, ‘knowledge and skills’, and ‘providing comfort’. In confirmatory factor analysis results, model fit indices were acceptable (x<sup>2</sup>/df=3.50, RMR=.05, RMSEA=.08, CFI=.90). The values obtained for the AVE ranged from .53 to .68, and for the CR ranged from .53 to .68. Convergent validity coefficients were noticeably greater in magnitude than discriminant validity coefficients: .53 (AVE<sub>1</sub> value) and .68 (AVE<sub>2</sub> value)≥.45 (r<sub>12</sub><sup>2</sup> value) and .68 (AVE<sub>2</sub> value) and .63 (AVE<sub>3</sub> value)≥.61 (r<sub>23</sub><sup>2</sup> value). Internal consistency (Cronbach’s ⍺) of CBI-K was .95.Conclusion: The CBI-K was shown to have acceptable construct validity and good internal consistency. Study findings imply that CBI-K could be a useful instrument for clinical administrators and nursing researchers to assess caring behaviors among Korean clinical nurses. Utilization of CBI-K might contribute to the building of empirical knowledge and the understanding of caring behaviors from nurses’ perspectives.

scholarly journals A Systematic Review of Measurement Properties of Spirituality related Assessment Tools Published in Korean Journals

2021 ◽  
Vol 28 (1) ◽  
pp. 133-148
Author(s):  
Il-Sun Ko ◽  
Jin Sook Kim ◽  
Soyoung Choi
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Well Being ◽  
Criterion Validity ◽  
Assessment Tools ◽  
Measurement Properties ◽  
Korean Studies ◽  
Ceiling Effects ◽  
Spiritual Well Being

Purpose: The purpose of this study was to evaluate the measurement properties of spirituality-related assessment tools published in Korean journals.Methods: The databases used to search the literature reporting use of the spirituality-related assessment tools were RISS, NDSL, DBpia, KoreaMed, and KISS. The quality of the measurement properties was evaluated based on the reported internal consistency, content validity, criterion validity, construct validity, reproducibility, responsiveness, floor-ceiling effects and interpretability based on the tools review criteria suggested by Terwee et al.Results: Twenty-five assessment tools (including 7 original Korean versions) were identified from the 208 Korean studies published up to November, 2016. All of the 25 tools reported internal consistency and content validity; construct validity was reported in 21 tools while only six tools had reported on criterion validity. None of the studies reported on the reproducibility, responsiveness, and floor-ceiling effects. Among 25 spirituality-related assessment tools, the spiritual well-being scale was identified as the most commonly used tool for spirituality assessment.Conclusion: Among 25 spirituality-related assessment tools used in Korean studies, all of them satisfied only three criteria out of the eight criteria for measurement properties, internal consistency, content validity, and interpretability. The results of this study provide evidence to develop reliable and valid tools that will satisfy the criteria for measurement properties. In addition, standardized, reliable, and valid assessment tools must be chosen for spirituality-related study.

scholarly journals Development and cross-cultural testing of the International Depression Symptom Scale (IDSS): a measurement instrument designed to represent global presentations of depression

2017 ◽  
Vol 4 ◽  
Author(s):  
E. E. Haroz ◽  
J. Bass ◽  
C. Lee ◽  
S. S. Oo ◽  
K. Lin ◽  
...  
Keyword(s):  
Suicidal Ideation ◽  
Construct Validity ◽  
Internal Consistency ◽  
Internal Consistency Reliability ◽  
Criterion Validity ◽  
Self Report ◽  
Depression Symptom ◽  
Symptom Scale ◽  
Retest Reliability ◽  
Test Retest Reliability

BackgroundSelf-report measurement instruments are commonly used to screen for mental health disorders in Low and Middle-Income Countries (LMIC). The Western origins of most depression instruments may constitute a bias when used globally. Western measures based on the DSM, do not fully capture the expression of depression globally. We developed a self-report scale design to address this limitation, the International Depression Symptom Scale-General version (IDSS-G), based on empirical evidence of the signs and symptoms of depression reported across cultures. This paper describes the rationale and process of its development and the results of an initial test among a non-Western population.MethodsWe evaluated internal consistency reliability, test–retest reliability and inter-rater reliability of the IDSS-G in a sample N = 147 male and female attendees of primary health clinics in Yangon, Myanmar. For criterion validity, IDSS-G scores were compared with diagnosis by local psychiatrists using the Structured Clinical Interview for DSM (SCID). Construct validity was evaluated by investigating associations between the IDSS-G and the Patient Health Questionnaire (PHQ), impaired function, and suicidal ideation.ResultsThe IDSS-G showed high internal consistency reliability (α = 0.92), test–retest reliability (r = 0.87), and inter-rater reliability (ICC = 0.90). Strong correlations between the IDSS-G and PHQ-9, functioning, and suicidal ideation supported construct validity. Criterion validity was supported for use of the IDSS-G to identify people with a SCID diagnosed depressive disorder (major depression/dysthymia). The IDSS-G also demonstrated incremental validity by predicting functional impairment beyond that predicted by the PHQ-9. Results suggest that the IDSS-G accurately assesses depression in this population. Future testing in other populations will follow.

Sign in / Sign up

Export Citation Format

Share Document