What Makes or Breaks Evidence-Based Supervision? Staff and Organizational Predictors of Evidence-Based Practice in Probation

Author(s):  
Sara Debus-Sherrill ◽  
Alex Breno ◽  
Faye S. Taxman

Research on staff and organizational factors that affect receptivity, adoption, feasibility, and utilization of innovations in justice settings is limited. This study uses survey data from 349 employees in one probation agency to assess how staff and perceived organizational factors influence attitudes related to evidence-based practices (EBPs) and their self-reported use. Staff characteristics, including education and knowledge about EBPs, and perceptions of the organization, including cynicism about the organization’s ability to change, predicted EBP outcomes. Staff age, tenure at the agency, and caseload size affected perceptions of organizational culture, but did not predict attitudes or use of EBPs. There is weak evidence for a relationship between self-reported use of EBPs with attitudinal support for EBPs, prior EBP training, and knowledge of EBPs. This study contributes to an emerging body of literature about the impact of various individual and organizational factors on support for EBPs with important lessons for implementation.

Author(s):  
Gregory A. Aarons ◽  
Joanna C. Moullin ◽  
Mark G. Ehrhart

Both organizational characteristics and specific organizational strategies are important for the effective dissemination and implementation of evidence-based practices (EBPs) in health and allied health care settings, as well as mental health, alcohol/drug treatment, and social service settings. One of the primary goals of this chapter is to support implementers and leaders within organizations in attending to and shaping the context in which implementation takes place in order to increase the likelihood of implementation success and long-term sustainment. The chapter summarizes some of the most critical organizational factors and strategies likely to impact successful evidence-based practice implementation. There are myriad approaches to supporting organizational development and change—this chapter focuses on issues supported by relevant scientific literatures, particularly those germane to EBP implementation in health care and related settings.


2021 ◽  
Vol 7 ◽  
pp. 237796082110290
Author(s):  
Jing Xu ◽  
Kristen Hicks-Roof ◽  
Chloe E. Bailey ◽  
Hanadi Y. Hamadi

Introduction Delivery of healthcare services makes up a complex system and it requires providers to be competent and to be able to integrate each of the institute of medicine’s (IOM) 5 core competencies into practice. However, healthcare providers are challenged with the task to be able to understand and apply the IOM core competencies into practice. Objective The purpose of the study was to examine the factors that influence health professional’s likelihood of accomplishing the IOM core competencies. Methods A cross-sectional study design was used to administer a validated online survey to health providers. This survey was distributed to physicians, nursing professionals, specialists, and allied healthcare professionals. The final sample included 3,940 participants who completed the survey. Results The study findings show that younger health professionals more consistently practice daily competencies than their older counterparts, especially in the use of evidence-based practice, informatics, and working in interdisciplinary teams. Less experienced health professionals more consistently applied quality improvement methods but less consistently used evidence-based practice compared to their more experienced counterparts. Conclusion There is a need to understand how health professionals’ age and experience impact their engagement with IOM’s core competencies. This study highlights the need for educational resources on the competencies to be tailored to health providers’ age and experience.


2021 ◽  
Vol 2 ◽  
pp. 263348952110188
Author(s):  
Byron J Powell ◽  
Kayne D Mettert ◽  
Caitlin N Dorsey ◽  
Bryan J Weiner ◽  
Cameo F Stanick ◽  
...  

Background: Organizational culture, organizational climate, and implementation climate are key organizational constructs that influence the implementation of evidence-based practices. However, there has been little systematic investigation of the availability of psychometrically strong measures that can be used to assess these constructs in behavioral health. This systematic review identified and assessed the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs as defined by the Consolidated Framework for Implementation Research (CFIR) and Ehrhart and colleagues. Methods: Data collection involved search string generation, title and abstract screening, full-text review, construct assignment, and citation searches for all known empirical uses. Data relevant to nine psychometric criteria from the Psychometric and Pragmatic Evidence Rating Scale (PAPERS) were extracted: internal consistency, convergent validity, discriminant validity, known-groups validity, predictive validity, concurrent validity, structural validity, responsiveness, and norms. Extracted data for each criterion were rated on a scale from −1 (“poor”) to 4 (“excellent”), and each measure was assigned a total score (highest possible score = 36) that formed the basis for head-to-head comparisons of measures for each focal construct. Results: We identified full measures or relevant subscales of broader measures for organizational culture ( n = 21), organizational climate ( n = 36), implementation climate ( n = 2), tension for change ( n = 2), compatibility ( n = 6), relative priority ( n = 2), organizational incentives and rewards ( n = 3), goals and feedback ( n = 3), and learning climate ( n = 2). Psychometric evidence was most frequently available for internal consistency and norms. Information about other psychometric properties was less available. Median ratings for psychometric properties across categories of measures ranged from “poor” to “good.” There was limited evidence of responsiveness or predictive validity. Conclusion: While several promising measures were identified, the overall state of measurement related to these constructs is poor. To enhance understanding of how these constructs influence implementation research and practice, measures that are sensitive to change and predictive of key implementation and clinical outcomes are required. There is a need for further testing of the most promising measures, and ample opportunity to develop additional psychometrically strong measures of these important constructs. Plain Language Summary Organizational culture, organizational climate, and implementation climate can play a critical role in facilitating or impeding the successful implementation and sustainment of evidence-based practices. Advancing our understanding of how these contextual factors independently or collectively influence implementation and clinical outcomes requires measures that are reliable and valid. Previous systematic reviews identified measures of organizational factors that influence implementation, but none focused explicitly on behavioral health; focused solely on organizational culture, organizational climate, and implementation climate; or assessed the evidence base of all known uses of a measure within a given area, such as behavioral health–focused implementation efforts. The purpose of this study was to identify and assess the psychometric properties of measures of organizational culture, organizational climate, implementation climate, and related subconstructs that have been used in behavioral health-focused implementation research. We identified 21 measures of organizational culture, 36 measures of organizational climate, 2 measures of implementation climate, 2 measures of tension for change, 6 measures of compatibility, 2 measures of relative priority, 3 measures of organizational incentives and rewards, 3 measures of goals and feedback, and 2 measures of learning climate. Some promising measures were identified; however, the overall state of measurement across these constructs is poor. This review highlights specific areas for improvement and suggests the need to rigorously evaluate existing measures and develop new measures.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Venancio Tauringana

PurposeThe purpose of this paper is threefold. First, it aims to identify managerial perceptions-based research determinants of sustainability reporting. Second, it sets out to evaluate the impact of the Global Reporting Initiative (GRI) efforts in increasing SR in developing countries. Third, the researcher argues for the adoption of management perceptions research evidence-based practices (EBP) to address SR challenges in developing countries.Design/methodology/approachThe study was undertaken using a desk-based review of management perceptions-based research literature on the determinants of SR. The impact of GRI efforts in increasing adoption of SR was undertaken through both desk-based research and descriptive analysis of data obtained from the GRI database from 2014 to 2019 relating to 107 developing countries. The call for the adoption of management perceptions research EBP is based on a critical analysis of both the management perceptions of the determinants of SR research and evaluation the impact of GRI efforts to increase SR in developing countries.FindingsTraining, legislation, issuing of guidance, stakeholder pressure, awareness campaigns, market and public pressure were identified as some of the determinants of SR. The evaluation of the impact of GRI efforts shows they had limited impact on increasing SR in developing countries. Research needed to adopt management perceptions research EBP is identified.Research limitations/implicationsThis study is conceptual. Management perceptions-based research is needed in more developing countries to better understand the determinants of SR and identify the most effective policies or practices to address related challenges.Originality/valueThe findings contribute to the calls to make academic research more relevant to policy formulation. In particular, the proposal for research needed to inform EBP adoption to address SR challenges in developing countries is new.


Autism ◽  
2020 ◽  
pp. 136236132097450
Author(s):  
Nathaniel J Williams ◽  
Lindsay Frederick ◽  
Alix Ching ◽  
David Mandell ◽  
Christina Kang-Yi ◽  
...  

Schools play a major role in delivering behavioral health services to autistic youth. School culture and climate are strong predictors of the extent to which these services incorporate evidence-based practices; however, little is known about how school leaders shape culture and climate. Drawing on the concept of culture and climate embedding mechanisms, we conducted a qualitative study to understand the ways in which school principals embed cultures and climates that support effective implementation of evidence-based practices for youth with autism. Semi-structured interviews with 32 teachers in schools that implemented three closely related evidence-based practices for youth with autism (discrete trial training, pivotal response training, and visual schedules) explored teachers’ experiences regarding (a) implementation of the three evidence-based practices, (b) perceptions of school culture and climate, and (c) principals’ behaviors, practices, and decisions that supported or detracted from the aspects of culture and climate that supported successful implementation. Thematic analysis detailed seven mechanisms that principals used to embed cultures and climates that shaped evidence-based practice implementation. These mechanisms represent actionable targets for school leaders and inform strategies to improve the implementation of evidence-based practices for youth with autism in schools. Lay abstract Schools play a major role in providing services to youth with autism; however, not all schools use evidence-based practices, defined as interventions that are proven to improve youth well-being through rigorous research. School culture and climate are strong predictors of whether or not a school uses evidence-based practices; however, little is known about how principals can create school cultures and climates that support the use of these practices. This study interviewed 32 teachers in elementary schools that implemented three closely related evidence-based practices for youth with autism to better understand how principals create school cultures and climates that support effective services. Analysis of the teachers’ responses identified seven strategies principals can use to create school cultures and climates that support the implementation of effective practices for youth with autism. The strategies include the following: (a) support teachers to obtain professional development focused on autism, (b) align performance expectations and evaluations with the needs of students with autism and evidence-based practice delivery, (c) allocate resources to ensure adequate staff, materials, and training are available to implement evidence-based practices, (d) be open and flexible to allow teachers to use the building and resources as needed to meet students’ needs, (e) provide direct assistance, feedback, and coaching to troubleshoot challenges or involve outside experts to do so, (f) openly value the work of special education teachers and provide recognition to those who develop expertise in evidence-based practices, and (g) look for opportunities to integrate special and general education teachers and students to foster a truly inclusive climate.


Sign in / Sign up

Export Citation Format

Share Document