Advancing Evidence-Based Practice Through Program Evaluation

Author(s):  
Julie Q. Morrison ◽  
Anna L. Harms

The demand for results-driven accountability is pervasive in all aspects of education today. The shift in emphasis from compliance to accountability for closing achievement gaps and improving student outcomes creates challenges and opportunities for school-based professionals. School-based professionals have a significant role to play in supporting school improvement efforts and improving outcomes for students in their role as program evaluators. Despite the need for advanced knowledge and skills in program evaluation, resources dedicated to developing the competencies of school-based professionals in evaluation approaches, methods, and tools are scarce. This book addresses this need by serving as a practical resource for school-based professionals seeking to use program evaluation to enhance data-based decision making and accountability as informed by implementation research and within the context of a multi-tier system of supports framework. Throughout this book, school-based professionals are positioned as change agents guiding their school or school districts in the adoption, implementation, and evaluation of evidence-based interventions and systems of support to meet students’ academic and behavioral needs.

Author(s):  
Julie Q. Morrison ◽  
Anna L. Harms

The objective of this chapter is to provide the school-based professional a concise introduction to program evaluation. Program evaluation is defined and the distinguishing characteristics of program evaluation and research are described. An overview of the most prominent evaluation approaches relevant to a school-based context is provided. The distinction between formative and summative evaluation is presented. Throughout this chapter, evaluation approaches, purposes, and foci are presented as they relate to the evaluation of a multi-tier system of supports (MTSS) framework. Finally, the distinction between an internal and external evaluator is outlined in terms of the relative advantages and disadvantages of each. The role of the school-based professional as an internal or external evaluator is illustrated given the current context in education emphasizing results-driven accountability.


2020 ◽  
Vol 29 (2) ◽  
pp. 688-704
Author(s):  
Katrina Fulcher-Rood ◽  
Anny Castilla-Earls ◽  
Jeff Higginbotham

Purpose The current investigation is a follow-up from a previous study examining child language diagnostic decision making in school-based speech-language pathologists (SLPs). The purpose of this study was to examine the SLPs' perspectives regarding the use of evidence-based practice (EBP) in their clinical work. Method Semistructured phone interviews were conducted with 25 school-based SLPs who previously participated in an earlier study by Fulcher-Rood et al. 2018). SLPs were asked questions regarding their definition of EBP, the value of research evidence, contexts in which they implement scientific literature in clinical practice, and the barriers to implementing EBP. Results SLPs' definitions of EBP differed from current definitions, in that SLPs only included the use of research findings. SLPs seem to discuss EBP as it relates to treatment and not assessment. Reported barriers to EBP implementation were insufficient time, limited funding, and restrictions from their employment setting. SLPs found it difficult to translate research findings to clinical practice. SLPs implemented external research evidence when they did not have enough clinical expertise regarding a specific client or when they needed scientific evidence to support a strategy they used. Conclusions SLPs appear to use EBP for specific reasons and not for every clinical decision they make. In addition, SLPs rely on EBP for treatment decisions and not for assessment decisions. Educational systems potentially present other challenges that need to be considered for EBP implementation. Considerations for implementation science and the research-to-practice gap are discussed.


Author(s):  
Alexander L. Chapman

This chapter discusses and illustrates how behavioural theory and science guide many aspects of Dialectical Behaviour Therapy (DBT). Behavioural theory informs the DBT approach to case formulation, the ongoing assessment of behaviour throughout therapy, and the selection, implementation, and evaluation of evidence-based interventions. As described later in this chapter, behavioural theory also influences the style and “flavour” of DBT sessions. As the focus of the first stage of DBT often focuses on the treatment of suicidal and self-injurious behaviour, the chapter emphasizes these behaviours via several examples, and also touches upon some other common behaviours targeted in DBT.


2016 ◽  
Vol 32 (1) ◽  
pp. 91-108 ◽  
Author(s):  
Blanche Higgins ◽  
Ian Thomas

AbstractEducation for sustainability (EfS) is widely supported and researched; however, the broad and deep implementation of EfS in universities that is needed lags behind the goals of change agents. This article reviews literature on change procedures; in particular, curriculum change in universities. Our aim was to develop insights into strategies change agents can use to bolster their efforts to implement EfS. We found that change in universities is commonly acknowledged as a complex process, and that taking account of institutional culture is an integral step in curriculum change efforts. We also explored the struggles and successes of attempts to diversify the curriculum in order to find parallels that EfS change agents can learn from.


2007 ◽  
Vol 32 (4) ◽  
pp. 267-281 ◽  
Author(s):  
Daniel J. Gulchak ◽  
João A. Lopes

Students with emotional and behavioral disorders (EBD) are found internationally. This systematic literature review identifies interventions conducted on these students. Although the U.S. produces abundant studies on effective school-based academic and behavioral interventions, a search of over 4,000 articles published over 6 years yielded only 11 international studies meeting the selection criteria. Out of 11 qualified studies, 6 reported therapeutic treatments, 8 targeted elementary students, 9 were conducted in self-contained classrooms, and 9 were from the U.K. These findings indicate a paucity of quantitative research determining effectiveness of EBD interventions currently used in schools worldwide. The results indicate that quantitative studies are not the standard of evidence-based practice internationally, and diagnostic criteria and terms used to identify students vary worldwide.


2021 ◽  
Vol 10.47389/36 (No 2) ◽  
pp. 34-41
Author(s):  
Kamarah Pooley ◽  
Sonia Nunez ◽  
Mark Whybro

School-based fire safety education programs are implemented by fire services organisations around the world to improve children’s fire safety knowledge and skills. Such education is considered the single most modifiable strategy that fire services organisations can implement to reduce the risk that children will misuse fire or be harmed by fire. Despite this, there are no overarching and evidence-based guidelines for the development of new programs or the evaluation and modification of existing ones. To fill this void, a rapid evidence assessment of existing literature was conducted. Results revealed 25 evidence-based practices that held true in a variety of contexts and methodologically diverse studies. These practices inform an empirical framework that can be used to guide fire safety education programs for children.


10.2196/14816 ◽  
2020 ◽  
Vol 9 (8) ◽  
pp. e14816
Author(s):  
Bo Wang ◽  
Lynette Deveaux ◽  
Sonja Lunn ◽  
Veronica Dinaj-Koci ◽  
Samiran Ghosh ◽  
...  

Background Sustained implementation of school-based prevention programs is low. Effective strategies are needed to enhance both high-level implementation fidelity and sustainability of prevention programs. Objective This proposed study aims to determine if the provision of either biweekly monitoring and feedback and site-based assistance and mentorship or both to at-risk and moderate-performing teachers with monitoring through an enhanced decision-making platform by the Ministry of Education (MOE) and Ministry of Health (MOH) based on the real-time implementation data will increase national implementation fidelity and result in sustained implementation over time. Methods This study will target government schools including 200 grade 6 teachers in 80 primary schools and 100 junior/middle high school teachers (and their classes) on 12 Bahamian islands. Teacher and school coordinator training will be conducted by the MOE in year 1, followed by an optimization trial among teachers in the capital island. Informed by these results, an implementation intervention will be conducted to train using different levels of educational intensity all at-risk and moderate-performing teachers. Subsequently selected training and implementation strategies will be evaluated for the national implementation of Focus on Youth in the Caribbean and Caribbean Informed Parents and Children Together in years 2 to 5. Results It is hypothesized that a more intensive training and supervision program for at-risk and moderate-performing teachers will enhance their implementation fidelity to the average level of the high-performing group (85%), an HIV prevention program delivered at the national level can be implemented with fidelity in grade 6 and sustained over time (monitored annually), and student outcomes will continue to be highly correlated with implementation fidelity and be sustained over time (assessed annually through grade 9). The proposed study is funded by the National Institute of Child Health and Human Development from August 1, 2018, through May 31, 2023. Conclusions The study will explore several theory-driven implementation strategies to increase sustained teacher implementation fidelity and thereby increase the general public health impact of evidence-based interventions. The proposed project has potential to make significant contributions to advancing school-based HIV prevention research and implementation science and serve as a global model for the Fast Track strategy. International Registered Report Identifier (IRRID) PRR1-10.2196/14816


2021 ◽  
Vol 2 ◽  
pp. 263348952110494
Author(s):  
Rachel C. Shelton ◽  
Prajakta Adsul ◽  
April Oh ◽  
Nathalie Moise ◽  
Derek M. Griffith

Background Despite the promise of implementation science (IS) to reduce health inequities, critical gaps and opportunities remain in the field to promote health equity. Prioritizing racial equity and antiracism approaches is critical in these efforts, so that IS does not inadvertently exacerbate disparities based on the selection of frameworks, methods, interventions, and strategies that do not reflect consideration of structural racism and its impacts. Methods Grounded in extant research on structural racism and antiracism, we discuss the importance of advancing understanding of how structural racism as a system shapes racial health inequities and inequitable implementation of evidence-based interventions among racially and ethnically diverse communities. We outline recommendations for explicitly applying an antiracism lens to address structural racism and its manifests through IS. An anti-racism lens provides a framework to guide efforts to confront, address, and eradicate racism and racial privilege by helping people identify racism as a root cause of health inequities and critically examine how it is embedded in policies, structures, and systems that differentially affect racially and ethnically diverse populations. Results We provide guidance for the application of an antiracism lens in the field of IS, focusing on select core elements in implementation research, including: (1) stakeholder engagement; (2) conceptual frameworks and models; (3) development, selection, adaptation of EBIs; (4) evaluation approaches; and (5) implementation strategies. We highlight the need for foundational grounding in antiracism frameworks among implementation scientists to facilitate ongoing self-reflection, accountability, and attention to racial equity, and provide questions to guide such reflection and consideration. Conclusion We conclude with a reflection on how this is a critical time for IS to prioritize focus on justice, racial equity, and real-world equitable impact. Moving IS towards making consideration of health equity and an antiracism lens foundational is central to strengthening the field and enhancing its impact. Plain language abstract There are important gaps and opportunities that exist in promoting health equity through implementation science. Historically, the commonly used frameworks, measures, interventions, strategies, and approaches in the field have not been explicitly focused on equity, nor do they consider the role of structural racism in shaping health and inequitable delivery of evidence-based practices/programs. This work seeks to build off of the long history of research on structural racism and health, and seeks to provide guidance on how to apply an antiracism lens to select core elements of implementation research. We highlight important opportunities for the field to reflect and consider applying an antiracism approach in: 1) stakeholder/community engagement; 2) use of conceptual frameworks; 3) development, selection and adaptation of evidence-based interventions; 4) evaluation approaches; 5) implementation strategies (e.g., how to deliver evidence-based practices, programs, policies); and 6) how researchers conduct their research, with a focus on racial equity. This is an important time for the field of implementation science to prioritize a foundational focus on justice, equity, and real-world impact through the application of an anti-racism lens in their work.


Sign in / Sign up

Export Citation Format

Share Document