Repetita Iuvant? A Repeated Randomized Controlled Trial on the Effectiveness of an At-Scale Teacher Professional Development Program

2021 ◽  
pp. 0193841X2110553
Author(s):  
Giovanni Abbiati ◽  
Gianluca Argentin ◽  
Andrea Caputo ◽  
Aline Pennisi
Keyword(s):  
Professional Development ◽  
Teacher Collaboration ◽  
Program Implementation ◽  
Program Effectiveness ◽  
Controlled Trial ◽  
Development Program ◽  
Professional Development Program ◽  
Small Scale ◽  
Randomized Controlled ◽  
The Impact

Background A recent stream of literature recognizes the impact of good/poor implementation on the effectiveness of programs. However, implementation is often disregarded in randomized controlled trials (RCTs) because they are run on a small scale. Replicated RCTs, although rare, provide a unique opportunity to study the relevance of implementation for program effectiveness. Objectives Evaluating the effectiveness of an at-scale professional development program for lower secondary school math teachers through two repeated RCTs. Research Design The program lasts a full school year and provides innovative methods for teaching math. The evaluation was conducted on two cohorts of teachers in the 2009/10 and 2010/11 school years. The program and RCTs were held at scale. Participating teachers and their classes were followed for 3 years. Impact is estimated by comparing the math scores of treatment and control students. Subjects The evaluation involved 195 teachers and their 3940 students (first cohort) and 146 teachers and their 2858 students (second cohort). Measures The key outcome is students’ math achievement, measured through standardized assessment. Results In the first wave, the program did not impact on students’ achievement, while in the second wave, a positive, persistent, and not insignificant effect was found. After excluding other sources of change, different findings across waves are interpreted in the light of improvements in the program implementation, such as enrollment procedure, teacher collaboration, and integration of innovation in daily teaching. Conclusions Repeated assessment of interventions already at-scale provides the opportunity to better identify and correct sources of weak implementation, potentially improving effectiveness.

A Randomized Controlled Trial of Professional Development for Interdisciplinary Civic Education: Impacts on Humanities Teachers and Their Students

2015 ◽  
Vol 117 (2) ◽  
pp. 1-52
Author(s):  
Dennis J. Barr ◽  
Beth Boulay ◽  
Robert L. Selman ◽  
Rachel Mccormick ◽  
Ethan Lowenstein ◽  
...  
Keyword(s):  
Professional Development ◽  
Randomized Controlled Trial ◽  
Self Efficacy ◽  
Controlled Trial ◽  
The United States ◽  
Performance Measure ◽  
Civic Learning ◽  
Randomized Controlled ◽  
10Th Grade ◽  
The Impact

Background/Context Billions of dollars are spent annually on professional development (PD) for educators, yet few randomized controlled trials (RCT) have demonstrated the ultimate impact PD has on student learning. Further, while policymakers and others speak to the role schools should play in developing students’ civic awareness, RCTs of PD designed to foster civic learning are rare. This randomized controlled trial contributes to the knowledge base on the effectiveness of PD designed to integrate civic learning, ethical reflection, and historical thinking skills into high school humanities courses. Focus of Study The study examined the impact of a PD intervention in two areas: (a) teacher self-efficacy, burnout, and professional engagement and satisfaction; and (b) the academic, civic, social, and ethical competencies of 9th and 10th grade students in the teachers’ classes. Population/Participants/Subjects The study involved 113 teachers and 1,371 9th and 10th grade students in 60 high schools from eight metropolitan regions in the United States. Intervention/Program/Practice The intervention, Facing History and Ourselves, provides PD through a five-day seminar, curricular materials, and follow-up coaching and workshops to help teachers develop their capacities to implement an interdisciplinary historical case study unit using student-centered pedagogy. Research Design The study used a school-level, randomized, experimental design to investigate impacts of the intervention for teachers and their 9th and 10th grade students. Findings/Results Intervention teachers showed significantly greater self-efficacy in all eight assessed domains, more positive perceptions of professional support, satisfaction and growth, and greater personal accomplishment. Intervention students demonstrated stronger skills for analyzing evidence, agency, and cause and effect on a historical understanding performance measure; greater self-reported civic efficacy and tolerance for others with different views; and more positive perceptions of the classroom climate and the opportunities afforded for engaging with civic matters. Fidelity analysis found these causal effects despite the fact that roughly half of the intervention teachers did not fully implement the program. Conclusions/Recommendations Educators need evidence-based approaches for teaching complex social, civic, and political issues enabling students of diverse mindsets and backgrounds to engage constructively with one another while obtaining necessary skills and knowledge. These findings provide empirical support for a professional development approach that engages teachers in fostering academic and civic competencies critical to both participation in a democracy and success in college and career.

scholarly journals THE EFFECTIVENESS OF THE BOARDING TEACHER PROFESSIONAL DEVELOPMENT PROGRAM: AN APPROACH OF PROCESS EVALUATION

2018 ◽  
Author(s):  
Friyatmi
Keyword(s):  
Professional Development ◽  
Teacher Professional Development ◽  
Process Evaluation ◽  
Program Implementation ◽  
Development Program ◽  
Evaluation Study ◽  
Professional Development Program ◽  
State University ◽  
Teacher Professional ◽  
Research Questions

This study aimed to evaluate the effectiveness of the implementation of the boarding Teacher Professional Development Program (PPG SM-3T) in State University of Padang (SUP). This research was an evaluation study using a part of the CIPP model, namely the process evaluation. The research questions for this study were 1) how is the effectiveness of the implementation of PPG SM-3T boarding program? 2) what are the weaknesses in implementing the PPG SM-3T boarding program in SUP? Data in this study were collecting using questionnaires and interview techniques. Informants of this study were the participants of the PPG SM-3T PSU and managers program. The data were analyzed using descriptive statistic techniques. The results of this study revealed that all over management of program implementation was considered less effective by the participants. The weaknesses of the program implementation are as follows. 1) The boarding education programs was less-organized, causing some programs were not function properly and often the schedule were not followed strictly; (2) Lack of coordination between the management and weakness supervision/controlling manager on the boarding activities resulted in less well executed program. (3) Meals service agent were less professional, resulting in the low quality and less variation food being served to the participants.

scholarly journals Using an Adversary Hearing to Evaluate the Effectiveness of a Military Program

2015 ◽  
Author(s):  
Richard Miller ◽  
Jeanne Butler
Keyword(s):  
Professional Development ◽  
Program Effectiveness ◽  
Development Program ◽  
Professional Development Program ◽  
Design And Implementation ◽  
Key Issues ◽  
Development Initiatives ◽  
Survey Evaluation

This study describes the design and implementation of an adversary hearing used to evaluate professional development initiatives in a military environment. The adversary hearing model used in the evaluation was developed to meet the requirements of an environment that differs from other environments in which adversary hearings have been used. The evaluation was conducted to determine whether a professional development program of the U. S. Army, Europe, actually enhanced soldier development and demonstrated consideration by leaders for their followers. Several key issues relate d to program effectiveness were discovered in the process of the adversary hearing that were not evident in a survey evaluation of the program.

scholarly journals The translation of an evidence-based preschool physical activity intervention from in-person to online delivery of professional development to preschool teachers

2019 ◽  
Vol 9 (6) ◽  
pp. 1186-1196 ◽  
Author(s):  
Ruth P Saunders ◽  
Michaela A Schenkelberg ◽  
Christina Moyer ◽  
Erin K Howie ◽  
William H Brown ◽  
...  
Keyword(s):  
Professional Development ◽  
Large Scale ◽  
Physical Activity Intervention ◽  
Preschool Teachers ◽  
Controlled Trial ◽  
Development Program ◽  
Evidence Based ◽  
Timely Manner ◽  
Online Delivery ◽  
Randomized Controlled

An intervention shown to be effective in a randomized controlled trial can be translated into an online professional development program and disseminated on a large scale in a timely manner.

Written Speech

2018 ◽  
Vol 8 (4) ◽  
pp. 38-49
Author(s):  
Pamela Moen ◽  
Kelley Walters
Keyword(s):  
Professional Development ◽  
Blended Learning ◽  
Teacher Professional Development ◽  
Knowledge Building ◽  
Virtual Community ◽  
Development Program ◽  
Professional Development Program ◽  
Teacher Professional ◽  
The Impact ◽  
Written Speech

Data collected within this qualitative, multiple-case study included teachers' knowledge building preferences for written speech in a virtual community of practice (VCoP), blended learning, teacher professional development program. This data was analyzed using the theoretical tenets of Vygotsky's social constructivist learning theory. Through heterogeneous sampling, six sites were selected from 11 program participating schools, with 11 participating teachers purposively selected from these sites. Following semi-structured participant interviews, data were coded and analyzed, where the findings indicated that participants preferred the audiovisual learning content to the written activity format in the blended learning, VCoP teacher professional development program. Program developers may use the research findings to guide the development of VCoP content alternatives to singularly text based online professional development delivery models. Recommendations for future research include studies that address the impact of audiovisual VCoP content on knowledge building.

Sign in / Sign up

Export Citation Format

Share Document