Does Cognitive Fusion show up similarly across two behavioral health samples? Psychometric properties and invariance of the Greek–Cognitive Fusion Questionnaire (G-CFQ)

Author(s):  
Marianna Zacharia ◽  
Myria Ioannou ◽  
Artemis Theofanous ◽  
Vasilis S. Vasiliou ◽  
Maria Karekla
2021 ◽  
Vol 2 ◽  
pp. 263348952110188
Author(s):  
Byron J Powell ◽  
Kayne D Mettert ◽  
Caitlin N Dorsey ◽  
Bryan J Weiner ◽  
Cameo F Stanick ◽  
...  

Background: Organizational culture, organizational climate, and implementation climate are key organizational constructs that influence the implementation of evidence-based practices. However, there has been little systematic investigation of the availability of psychometrically strong measures that can be used to assess these constructs in behavioral health. This systematic review identified and assessed the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs as defined by the Consolidated Framework for Implementation Research (CFIR) and Ehrhart and colleagues. Methods: Data collection involved search string generation, title and abstract screening, full-text review, construct assignment, and citation searches for all known empirical uses. Data relevant to nine psychometric criteria from the Psychometric and Pragmatic Evidence Rating Scale (PAPERS) were extracted: internal consistency, convergent validity, discriminant validity, known-groups validity, predictive validity, concurrent validity, structural validity, responsiveness, and norms. Extracted data for each criterion were rated on a scale from −1 (“poor”) to 4 (“excellent”), and each measure was assigned a total score (highest possible score = 36) that formed the basis for head-to-head comparisons of measures for each focal construct. Results: We identified full measures or relevant subscales of broader measures for organizational culture ( n = 21), organizational climate ( n = 36), implementation climate ( n = 2), tension for change ( n = 2), compatibility ( n = 6), relative priority ( n = 2), organizational incentives and rewards ( n = 3), goals and feedback ( n = 3), and learning climate ( n = 2). Psychometric evidence was most frequently available for internal consistency and norms. Information about other psychometric properties was less available. Median ratings for psychometric properties across categories of measures ranged from “poor” to “good.” There was limited evidence of responsiveness or predictive validity. Conclusion: While several promising measures were identified, the overall state of measurement related to these constructs is poor. To enhance understanding of how these constructs influence implementation research and practice, measures that are sensitive to change and predictive of key implementation and clinical outcomes are required. There is a need for further testing of the most promising measures, and ample opportunity to develop additional psychometrically strong measures of these important constructs. Plain Language Summary Organizational culture, organizational climate, and implementation climate can play a critical role in facilitating or impeding the successful implementation and sustainment of evidence-based practices. Advancing our understanding of how these contextual factors independently or collectively influence implementation and clinical outcomes requires measures that are reliable and valid. Previous systematic reviews identified measures of organizational factors that influence implementation, but none focused explicitly on behavioral health; focused solely on organizational culture, organizational climate, and implementation climate; or assessed the evidence base of all known uses of a measure within a given area, such as behavioral health–focused implementation efforts. The purpose of this study was to identify and assess the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs that have been used in behavioral health-focused implementation research. We identified 21 measures of organizational culture, 36 measures of organizational climate, 2 measures of implementation climate, 2 measures of tension for change, 6 measures of compatibility, 2 measures of relative priority, 3 measures of organizational incentives and rewards, 3 measures of goals and feedback, and 2 measures of learning climate. Some promising measures were identified; however, the overall state of measurement across these constructs is poor. This review highlights specific areas for improvement and suggests the need to rigorously evaluate existing measures and develop new measures.


2013 ◽  
Vol 20 (3) ◽  
pp. 302-310 ◽  
Author(s):  
C. Alec Pollard ◽  
Ronald B. Margolis ◽  
Ryan Niemiec ◽  
Joanne Salas ◽  
Geeta Aatre

PeerJ ◽  
2022 ◽  
Vol 10 ◽  
pp. e12670
Author(s):  
Francisco J. Ruiz ◽  
Paula Odriozola-González ◽  
Juan C. Suárez-Falcón ◽  
Miguel A. Segura-Vargas

Background The Valuing Questionnaire (VQ) is considered as one of the most psychometrically robust instruments to measure valued living according to the acceptance and commitment therapy model. It consists of 10 items that are responded to on a 7-point Likert-type scale and has two factors: Progression and Obstruction. The Spanish version of the VQ showed good psychometric properties in Colombian samples. However, there is no evidence of the psychometric properties of the VQ in Spaniard samples. This study aims to analyze the validity of the VQ in a large Spaniard sample and analyze the measurement invariance with a similar Colombian sample. Method The VQ was administered to a Spaniard sample of 846 adult participants from general online population. Cronbach’s alpha and McDonald’s omega were computed to analyze the internal consistency of the VQ. The fit of the VQ’s two-factor model was tested through a confirmatory factor analysis with a robust maximum likelihood (MLR) estimation method. Afterward, we analyzed the measurement invariance across countries and gender. Convergent construct validity was analyzed with a package of questionnaires that evaluated experiential avoidance (Acceptance and Action Questionnaire-II, AAQ-II), emotional symptoms (Depression Anxiety and Stress Scale-21, DASS-21), life satisfaction (Satisfaction with Life Scale, SWLS), and cognitive fusion (Cognitive Fusion Questionnaire, CFQ). Results The internal consistency across samples was adequate (alphas and omegas were .85 for VQ-Progress and .84 for VQ-Obstruction). The two-factor model obtained a good fit to the data (RMSEA = 0.073, 90% CI [0.063, 0.083], CFI = 0.98, NNFI = 0.97, and SRMR = 0.053). The VQ showed strict invariance across countries and gender and showed theoretically coherent correlations with emotional symptoms, life satisfaction, experiential avoidance, and cognitive fusion. In conclusion, the Spanish version of the VQ demonstrated good psychometric properties in a large Spaniard sample.


2020 ◽  
Vol 1 ◽  
pp. 263348952093664 ◽  
Author(s):  
Kayne Mettert ◽  
Cara Lewis ◽  
Caitlin Dorsey ◽  
Heather Halko ◽  
Bryan Weiner

Background: Systematic reviews of measures can facilitate advances in implementation research and practice by locating reliable and valid measures and highlighting measurement gaps. Our team completed a systematic review of implementation outcome measures published in 2015 that indicated a severe measurement gap in the field. Now, we offer an update with this enhanced systematic review to identify and evaluate the psychometric properties of measures of eight implementation outcomes used in behavioral health care. Methods: The systematic review methodology is described in detail in a previously published protocol paper and summarized here. The review proceeded in three phases. Phase I, data collection, involved search string generation, title and abstract screening, full text review, construct assignment, and measure forward searches. Phase II, data extraction, involved coding psychometric information. Phase III, data analysis, involved two trained specialists independently rating each measure using PAPERS (Psychometric And Pragmatic Evidence Rating Scales). Results: Searches identified 150 outcomes measures of which 48 were deemed unsuitable for rating and thus excluded, leaving 102 measures for review. We identified measures of acceptability ( N = 32), adoption ( N = 26), appropriateness ( N = 6), cost ( N = 31), feasibility ( N = 18), fidelity ( N = 18), penetration ( N = 23), and sustainability ( N = 14). Information about internal consistency and norms were available for most measures (59%). Information about other psychometric properties was often not available. Ratings for internal consistency and norms ranged from “adequate” to “excellent.” Ratings for other psychometric properties ranged mostly from “poor” to “good.” Conclusion: While measures of implementation outcomes used in behavioral health care (including mental health, substance use, and other addictive behaviors) are unevenly distributed and exhibit mostly unknown psychometric quality, the data reported in this article show an overall improvement in availability of psychometric information. This review identified a few promising measures, but targeted efforts are needed to systematically develop and test measures that are useful for both research and practice. Plain language abstract: When implementing an evidence-based treatment into practice, it is important to assess several outcomes to gauge how effectively it is being implemented. Outcomes such as acceptability, feasibility, and appropriateness may offer insight into why providers do not adopt a new treatment. Similarly, outcomes such as fidelity and penetration may provide important context for why a new treatment did not achieve desired effects. It is important that methods to measure these outcomes are accurate and consistent. Without accurate and consistent measurement, high-quality evaluations cannot be conducted. This systematic review of published studies sought to identify questionnaires (referred to as measures) that ask staff at various levels (e.g., providers, supervisors) questions related to implementation outcomes, and to evaluate the quality of these measures. We identified 150 measures and rated the quality of their evidence with the goal of recommending the best measures for future use. Our findings suggest that a great deal of work is needed to generate evidence for existing measures or build new measures to achieve confidence in our implementation evaluations.


2014 ◽  
Vol 30 (4) ◽  
pp. 289-295 ◽  
Author(s):  
Hester R. Trompetter ◽  
Ernst T. Bohlmeijer ◽  
Bianca van Baalen ◽  
Marco Kleen ◽  
Albère Köke ◽  
...  

Psychological flexibility receives increasing attention as the overarching process in Acceptance and Commitment Therapy (ACT). This study investigates the psychometric properties of the Psychological Inflexibility in Pain Scale (PIPS), measuring “avoidance” and “cognitive fusion” with pain, in a heterogeneous clinical sample of 428 chronic pain patients from four rehabilitation centers. Furthermore, the relationship between the PIPS and mindfulness (Five Facet Mindfulness Questionnaire, FFMQ) as a theoretically related measure within ACT is explored. Confirmatory factor analyses replicated acceptable/good model fit and internal consistencies. In a subsample from two rehabilitation centers (n = 237), the PIPS showed moderate to high relationships with aspects of mindfulness, pain interference in daily life, pain disability and mental health, and small relationships with pain intensity and physical functioning. The avoidance subscale explained additional variance in outcome variables beyond the FFMQ, ranging from 4.5 to 15.8%. Outcomes support the psychometric properties of the PIPS in a heterogeneous chronic pain sample. The PIPS and FFMQ measure slightly overlapping, but distinct constructs, and can be used complementary to assess a broad range of processes within ACT. Potential problems with the cognitive fusion subscale are acknowledged for future research.


2015 ◽  
Vol 43 (10) ◽  
pp. 1715-1723 ◽  
Author(s):  
Bun-Ok Kim ◽  
Sungkun Cho

The Cognitive Fusion Questionnaire (CFQ) was developed to measure excessive attachment to the literal content of human thought that makes healthy psychological flexibility difficult or impossible. In this study our aim was to examine the psychometric properties of a Korean version of the CFQ (K-CFQ). Our participants were 410 students (n = 209 for sample 1, n = 201 for sample 2) at a university located in Daejeon, South Korea. Exploratory factor analysis provided support for the same unifactor structure for the measure that had been validated for the original CFQ. Confirmatory factor analysis demonstrated the adequacy of the unifactor structure of the K-CFQ. The K-CFQ was significantly negatively correlated with psychological flexibility, mindfulness, and quality of life among our participant group and significantly positively correlated with anxiety and depression. Our results supported the reliability and construct and criterion validity of the K-CFQ for assessing cognitive fusion in a Korean college sample.


2016 ◽  
Vol 10 (6) ◽  
pp. 822-831
Author(s):  
Kazuaki Uekawa ◽  
William Bryan Higgins ◽  
Samuel Golenbock ◽  
Amy R. Mack ◽  
Nikki D. Bellamy

AbstractObjectiveThe purpose of this article was to examine the psychometric properties of the Crisis Counseling Assistance and Training Program (CCP) data collection instrument, the Individual/Family Encounter Log (IFEL). Data collected from disaster survivors included how they reacted to events in emotional, behavioral, physical, and cognitive domains. These domains are based on conceptual categorization of event reactions and allow CCP staff to provide survivors with referrals to appropriate behavioral health support resources, if warranted.MethodsThis study explored the factor structure of these survey items to determine how best to use the available information as a screen of disaster-related behavioral health indicators. Specifically, our first research question explored and confirmed the optimal factor structure of the event reaction items, and our second question examined whether the new factor structure was similar across disaster types: hurricanes, tornadoes, floods, and wildfires. Using a factor analytic technique, we tested whether our event reaction outcomes achieved consistent and reliable measurement across different disaster situations. Finally, we assessed how the new subscales were correlated with the type of risk to which CCP disaster survivors were exposed.ResultsOur analyses revealed 3 factors: (1) depressive-like, (2) anxiety-like, and (3) somatic. In addition, we found that these factors were coherent for hurricanes, floods, and wildfires, although the basic factor structure was not equivalent for tornadoes.ConclusionImplications for use of the IFEL in disaster preparedness, response, and recovery are discussed. (Disaster Med Public Health Preparedness. 2016;10:822–831)


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Mohammad Reza Pirmoradi ◽  
Ali Asgharzadeh ◽  
Behrooz Birashk ◽  
Banafshe Gharaee ◽  
Razieh Salehian ◽  
...  

Abstract Background The present study aimed to investigate the psychometric properties of the Persian version of the weight-related experiential avoidance (AAQW) in overweight and obese treatment seeker in the clinical setting. Methods This sample consists of 220 male and female overweight or obesity treatment seeker from Overweight and obesity centers who agreed to fill out the self-reported measures. Results Confirmatory factor analysis (CFA) supported 3-factor structures of AAQW, including (weight as a barrier to living, Food as Control, and weight-stigma). Furthermore, the internal consistency of AAQW indicates an acceptable range (α = .70); Also, expected associations between AAQW and external correlates (e.g., BES, AAQ-II, KIMS, BDI-II, and CFQ) supported the measure’s convergent validity in a sample of overweight and obese treatment seeker in the clinical setting. Conclusions Overall, our study offers that the Persian version of weight-related experiential avoidance has psychometrically valid and reliable tools to assess experiential avoidance. Furthermore, weight-related experiential avoidance is associated with higher severity of binge eating symptoms, higher psychological inflexibility levels, experiential avoidance, and more cognitive fusion and depression symptomology.


2021 ◽  
Vol 2 ◽  
pp. 263348952110024
Author(s):  
Caitlin N Dorsey ◽  
Kayne D Mettert ◽  
Ajeng J Puspitasari ◽  
Laura J Damschroder ◽  
Cara C Lewis

Background: Measurement is a critical component for any field. Systematic reviews are a way to locate measures and uncover gaps in current measurement practices. The present study identified measures used in behavioral health settings that assessed all constructs within the Process domain and two constructs from the Inner setting domain as defined by the Consolidated Framework for Implementation Research (CFIR). While previous conceptual work has established the importance social networks and key stakeholders play throughout the implementation process, measurement studies have not focused on investigating the quality of how these activities are being carried out. Methods: The review occurred in three phases: Phase I, data collection included (1) search string generation, (2) title and abstract screening, (3) full text review, (4) mapping to CFIR-constructs, and (5) “cited-by” searches. Phase II, data extraction, consisted of coding information relevant to the nine psychometric properties included in the Psychometric And Pragmatic Rating Scale (PAPERS). In Phase III, data analysis was completed. Results: Measures were identified in only seven constructs: Structural characteristics ( n = 13), Networks and communication ( n = 29), Engaging ( n = 1), Opinion leaders ( n = 5), Champions ( n = 5), Planning ( n = 5), and Reflecting and evaluating ( n = 5). No quantitative assessment measures of Formally appointed implementation leaders, External change agents, or Executing were identified. Internal consistency and norms were reported on most often, whereas no studies reported on discriminant validity or responsiveness. Not one measure in the sample reported all nine psychometric properties evaluated by the PAPERS. Scores in the identified sample of measures ranged from “-2” to “10” out of a total of “36.” Conclusions: Overall measures demonstrated minimal to adequate evidence and available psychometric information was limited. The majority were study specific, limiting their generalizability. Future work should focus on more rigorous measure development and testing of currently existing measures, while moving away from creating new, single use measures. Plain Language Summary: How we measure the processes and players involved for implementing evidence-based interventions is crucial to understanding what factors are helping or hurting the intervention’s use in practice and how to take the intervention to scale. Unfortunately, measures of these factors—stakeholders, their networks and communication, and their implementation activities—have received little attention. This study sought to identify and evaluate the quality of these types of measures. Our review focused on collecting measures used for identifying influential staff members, known as opinion leaders and champions, and investigating how they plan, execute, engage, and evaluate the hard work of implementation. Upon identifying these measures, we collected all published information about their uses to evaluate the quality of their evidence with respect to their ability to produce consistent results across items within each use (i.e., reliable) and if they assess what they are intending to measure (i.e., valid). Our searches located over 40 measures deployed in behavioral health settings for evaluation. We observed a dearth of evidence for reliability and validity and when evidence existed the quality was low. These findings tell us that more measurement work is needed to better understand how to optimize players and processes for the purposes of successful implementation.


Sign in / Sign up

Export Citation Format

Share Document