Psychometric Properties of the Short Versions of the EBP Beliefs Scale, the EBP Implementation Scale, and the EBP Organizational Culture and Readiness Scale

Author(s):  
Bernadette Mazurek Melnyk ◽  
Andreanna Pavan Hsieh ◽  
Lynn Gallagher‐Ford ◽  
Bindu Thomas ◽  
Jinhong Guo ◽  
...  
2021 ◽  
Vol 2 ◽  
pp. 263348952110188
Author(s):  
Byron J Powell ◽  
Kayne D Mettert ◽  
Caitlin N Dorsey ◽  
Bryan J Weiner ◽  
Cameo F Stanick ◽  
...  

Background: Organizational culture, organizational climate, and implementation climate are key organizational constructs that influence the implementation of evidence-based practices. However, there has been little systematic investigation of the availability of psychometrically strong measures that can be used to assess these constructs in behavioral health. This systematic review identified and assessed the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs as defined by the Consolidated Framework for Implementation Research (CFIR) and Ehrhart and colleagues. Methods: Data collection involved search string generation, title and abstract screening, full-text review, construct assignment, and citation searches for all known empirical uses. Data relevant to nine psychometric criteria from the Psychometric and Pragmatic Evidence Rating Scale (PAPERS) were extracted: internal consistency, convergent validity, discriminant validity, known-groups validity, predictive validity, concurrent validity, structural validity, responsiveness, and norms. Extracted data for each criterion were rated on a scale from −1 (“poor”) to 4 (“excellent”), and each measure was assigned a total score (highest possible score = 36) that formed the basis for head-to-head comparisons of measures for each focal construct. Results: We identified full measures or relevant subscales of broader measures for organizational culture ( n = 21), organizational climate ( n = 36), implementation climate ( n = 2), tension for change ( n = 2), compatibility ( n = 6), relative priority ( n = 2), organizational incentives and rewards ( n = 3), goals and feedback ( n = 3), and learning climate ( n = 2). Psychometric evidence was most frequently available for internal consistency and norms. Information about other psychometric properties was less available. Median ratings for psychometric properties across categories of measures ranged from “poor” to “good.” There was limited evidence of responsiveness or predictive validity. Conclusion: While several promising measures were identified, the overall state of measurement related to these constructs is poor. To enhance understanding of how these constructs influence implementation research and practice, measures that are sensitive to change and predictive of key implementation and clinical outcomes are required. There is a need for further testing of the most promising measures, and ample opportunity to develop additional psychometrically strong measures of these important constructs. Plain Language Summary Organizational culture, organizational climate, and implementation climate can play a critical role in facilitating or impeding the successful implementation and sustainment of evidence-based practices. Advancing our understanding of how these contextual factors independently or collectively influence implementation and clinical outcomes requires measures that are reliable and valid. Previous systematic reviews identified measures of organizational factors that influence implementation, but none focused explicitly on behavioral health; focused solely on organizational culture, organizational climate, and implementation climate; or assessed the evidence base of all known uses of a measure within a given area, such as behavioral health–focused implementation efforts. The purpose of this study was to identify and assess the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs that have been used in behavioral health-focused implementation research. We identified 21 measures of organizational culture, 36 measures of organizational climate, 2 measures of implementation climate, 2 measures of tension for change, 6 measures of compatibility, 2 measures of relative priority, 3 measures of organizational incentives and rewards, 3 measures of goals and feedback, and 2 measures of learning climate. Some promising measures were identified; however, the overall state of measurement across these constructs is poor. This review highlights specific areas for improvement and suggests the need to rigorously evaluate existing measures and develop new measures.


Author(s):  
Mirella Castelhano-Souza ◽  
Isabel Amélia Costa Mendes ◽  
José Carlos Amado Martins ◽  
Maria Auxiliadora Trevizan ◽  
Valtuir Duarte Souza-Júnior ◽  
...  

ABSTRACT Objective: to perform the semantic validation of the short versions of the Empathy-Systemizing Quotient Scales, intended to measure the empathetic and systemizing profiles of individuals. The scales originated in Cambridge and were validated in Portugal, and were assessed for their psychometric properties. Method: methodological study included the scales’ semantic validation (content validity) and verification of their psychometric properties (internal consistency). Five judges participated in the semantic validation. The Content Validity Index was calculated, a pretest was conducted with 18 undergraduate nursing students, and, finally, the scales were applied to a sample. Results: the sample was composed of 215 undergraduate nursing students, 186 (86.51%) of whom were women aged 21 years old, on average. The scales presented good internal consistency with global Cronbach’s alphas equal to 0.83 and 0.79 for the Empathy Quotient and the Systemizing Quotient, respectively. Correlations between the scales and subscales of the Empathy Quotient and Systemizing Quotient were all positive and significant according to the Pearson correlation coefficient. Conclusion: the scales are reliable and valid to measure the empathetic and systemizing profile of undergraduate nursing students and the final version was named “versões curtas das Escalas de Medição do Quociente de Empatia/Sistematização - Brasil” [short versions of the Empathy-Systemizing Quotient Scales - Brazil].


Author(s):  
Juliana Seidl ◽  
Elaine Rabelo Neiva ◽  
Jack H Noone ◽  
Gabriela Topa

Abstract Workers who plan for retirement generally adjust better to this phase of life. Therefore, retirees, researchers, and practitioners benefit from the development of retirement preparation measures and interventions. The Process of Retirement Planning Scale (PRePS), originally developed in New Zealand, considers retirement planning as a multidimensional process that happens in 4 stages: representations, goals, decisions, and behaviors. This study aimed to validate the complete and short versions of the PRePS in Spanish. The translated complete version was administrated in a sample of 1,827 Spanish employees aged from 26 to 68 (M = 46.8; SD = 11.9), which was further randomly split into 3 subsamples. Exploratory and confirmatory factor analyses demonstrated that both the complete version and the short version of the scale had satisfactory psychometric properties. The complete Spanish PRePS contains 37 items, which reflects 4 dimensions: financial (10 items), lifestyle (9 items), psychosocial (8 items), and health planning (10 items) and 4 stages: representations (12 items), goals (4 items), decisions (8 items), and preparedness (13 items). The short Spanish PRePS contains 24 items. Age, gender, and general self-efficacy were significant predictors of the PRePS dimensions, offering validity evidence from the standpoint of construct nomological network. The advantages of using the PRePS for researchers, professionals, and Spanish policy makers are discussed. As this scale has already been adapted to 5 different languages—English, Turkish, Korean, Portuguese, and now Spanish—cross-national studies about retirement planning are encouraged.


2021 ◽  
Vol 12 ◽  
Author(s):  
Chunhua Peng ◽  
Caizhen Yue ◽  
Andrew Avitt ◽  
Youguo Chen

The Zimbardo Time Perspective Inventory (ZTPI) is one of the most well-known and widely used measures of time perspective. Various short versions were proposed to resolve the psychometric problems of the ZTPI. The present study conducted a systematic review to obtain 25 short versions, calculated the frequency of each item of the ZTPI in short versions, and hypothesized that the more frequent the item is, the more robust it becomes. The hypothesis was tested by assessing the structural validity and internal consistency of short forms with high, medium, and low frequent items in Chinese samples (575 children, 407 undergraduates, and 411 older adults). Structural validity and internal consistency analyses showed that the form with more frequent items had better psychometric properties; item frequencies were positively correlated with factor loadings. The results suggest that the systematic review is an effective approach to identify the robust items of the ZTPI. This approach is general and can be the basis to improve the psychometric properties of scales in social science.


2010 ◽  
Vol 24 (2) ◽  
pp. 169-189 ◽  
Author(s):  
Yun Seok Choi ◽  
Minhee Seo ◽  
David Scott ◽  
Jeffrey Martin

The purpose of this study was to examine the psychometric properties of the Korean version of the Organizational Culture Assessment Instrument (OCAI) based on the Competing Values Framework (CVF). More specially, cultural equivalence between the Korean version and the original English version of the OCAI was evaluated using 39 bilingual Koreans. Next, a field test was conducted to examine scale reliability and construct validity of the Korean version of the OCAI using 133 organizational members from the Korean Professional Baseball League (KPBL). The findings indicate that the Korean version was successfully translated, items maintained the same meaning of the original OCAI items, and yielded acceptable psychometric properties making it applicable to Korean sport organizations.


2010 ◽  
Vol 13 (2) ◽  
pp. 1032-1043 ◽  
Author(s):  
Helder Miguel Fernandes ◽  
José Vasconcelos-Raposo ◽  
Carla Maria Teixeira

This article presents a set of research studies that aim to adapt Carol Ryff‘s scales of psychological well-being (SPWB) and to analyze its psychometric properties in adolescents. The first two studies focused on the reliability and factorial validity of different Portuguese short versions of SPWB, revealing measurement models inadequacies and low internal consistency. In the third study we developed a shortened version (30 items), taking into account the application of psychometric criteria suggested by van Dierendonck (2005). The scales of this version revealed better reliability and adequate goodness of fit indices for the six-factor model, as proposed by Carol Ryff’s PWB theory. Although further research focused on the psychometrical properties reanalysis of this shortened version of SPWB is needed, this article provides a contribution to the research and intervention on positive mental health during adolescence.


Sign in / Sign up

Export Citation Format

Share Document