A program evaluation of the Innovative Teen Pregnancy Prevention Programs (iTP3) Project

Background Teen pregnancy prevention in the United States has traditionally focused on the development, testing, and subsequent implementation of a set of evidence-based programs (EBPs), recommended nationally. However, these existing EBPs often do not prioritize the most at-risk or vulnerable populations. Methods The Innovative Teen Pregnancy Prevention Programs (iTP3) project was funded to facilitate the development of new, innovative programs to reach disparate populations. Through a mixed methods design, iTP3 evaluated the process and resulting innovative programs from five iterative cohorts of funded organizations, referred to as Innovators. iTP3 utilized both a traditional funding model with more traditional methods of capacity building assistance, but transitioned over time to a design-focused funding model in which organizations and individuals developed innovative programs through an intensive human centered design process. Results Evaluation results showed that the resulting portfolio of programs had differences in the types of programs resulting from the differing funding models. Notable differences among programs from the two funding models include program length, along with personnel, time, and resources needed to develop and manage. Conclusion Both traditional and design funding models led to innovative programs, with notable differences in the development process and resulting programs.

Identifying Implementation Drivers for Teen Sexual Health Education Curricula

This article focuses on examining the implementation of evidence-based teen pregnancy prevention programming in a select school district. Results are presented based on the following implementation drivers: (1) actions taken by leadership to make decisions, provide guidance, and support how the school site and community-based organizations are functioning in support of implementation; (2) actions taken to ensure competent staff delivery of the curricula; and (3) actions taken to create and sustain a hospitable context in order to implement the interventions at the school site. The need for adolescent sexual health education is evident in this geographic location where Hispanic or Latino teens consistently have higher birth rates among race and ethnicities that are routinely reported. For 2018, when this project started, those rates were 40 births per 1,000 females aged 15 to 19 years. For 2018, the birth rates for African Americans was 31 and for Whites was 17 per 1,000 females aged 15 to 19 years. The project goals were to reduce teen birth rates by (1) providing evidence-based teen pregnancy prevention curricula to youth aged 11 to 19 years over the course of the 5-year project period, (2) training school staff and community members in the curricula, and (3) generating community support of youth access to reproductive health care and education. Despite a funding interruption to implementation of the project and the impact of COVD-19, educational programming was provided to 9,616 youth. The article details the key implementation strategies and solutions so that other practitioners can consider application of these implementation drivers in their own adolescent health education programming.

Implementing a Sexual Risk Avoidance Intervention in a Juvenile Justice Setting: What We Learned, and How it Can Help Others

Despite relatively high rates of teen pregnancy and sexual risk-taking among justice-involved youth, there is a scarcity of programming to help these youth become better informed about sexual health and decision making. The lack of adequate programming may in part be due to challenges that exist when trying to develop and implement programs in juvenile justice settings. Project With is a sexual risk avoidance intervention that includes storytelling and mentoring components and is currently being implemented within a large juvenile justice agency in California. This paper shares the lessons learned through implementation of the Project With program at five juvenile justice facilities. These lessons focus on the relationships, processes, and logistics that facilitated and impeded implementation, as well as aspects of the Project With design that promoted youth engagement. In particular, insights about the importance of leveraging relationships, gathering buy-in at multiple levels, understanding the system, and allowing for flexibility are highlighted. A checklist is included to support other program developers and researchers who seek to create, implement, and study teen pregnancy prevention programming for justice-involved youth.

A Program Evaluation of the Innovative Teen Pregnancy Prevention Programs (iTP3) Project

Background: Teen pregnancy prevention in the United States has traditionally focused on the development, testing, and subsequent implementation of a set of evidence-based programs (EBPs), recommended nationally. However, these existing EBPs often do not prioritize the most at-risk or vulnerable populations. Methods: The Innovative Teen Pregnancy Prevention Programs (iTP3) project was funded to facilitate the development of new, innovative programs to reach disparate populations. Through a mixed methods design, iTP3 evaluated the process and resulting innovative programs from five iterative cohorts of funded organizations, referred to as Innovators. iTP3 utilized both a traditional funding model with more traditional methods of capacity building assistance, but transitioned over time to a design-focused funding model in which organizations and individuals developed innovative programs through an intensive human centered design process. Results: Evaluation results showed that the resulting portfolio of programs had differences in the types of programs resulting from the differing funding models. Notable differences among programs from the two funding models include program length, along with personnel, time, and resources needed to develop and manage. Conclusion: Both traditional and design funding models led to innovative programs, with notable differences in the development process and resulting programs.

Teen Pregnancy Prevention Evaluation Technical Assistance: A Case Study

Purpose: This case study discusses Mathematica’s experience providing large-scale evaluation technical assistance (ETA) to 65 grantees across two cohorts of Teen Pregnancy Prevention (TPP) Program grants. The grantees were required to conduct rigorous evaluations with specific evaluation benchmarks. This case study provides an overview of the TPP grant program, the evaluation requirements, the ETA provider, and other key stakeholders and the ETA provided to the grantees. Finally, it discusses the successes, challenges, and lessons learned from the effort. Conclusion: One important lesson learned is that there are two related evaluation features, strong counterfactuals and insufficient target sample sizes, that funders should attend to prior to selecting awardees because they are not easy to change through ETA. In addition, if focused on particular outcomes (for TPP, the goal was to improve sexual behavior outcomes), the funder should prioritize studies with an opportunity to observe differences in these outcomes across conditions; several TPP grantees served young populations, and sexual behavior outcomes were not observed or were rare, limiting the opportunity to observe impacts. Unless funders are attentive to weaning out evaluations with critical limitations during the funding process, requiring grantees to conduct impact evaluations supported by ETA might unintentionally foster internally valid, yet underpowered studies that show nonsignificant program impacts. The TPP funder was able to overcome some of the limitations of the grantee evaluations by funding additional evidence-building activities, including federally led evaluations and a large meta-analysis of the effort, as part of a broader learning agenda.