Value-Added Models for Teacher Preparation Programs: Validity and Reliability Threats, and a Manageable Alternative

2016 ◽  
Vol 80 (3) ◽  
pp. 339-352 ◽  
Author(s):  
Michael P. Brady ◽  
Lawrence A. Heiser ◽  
Jazarae K. McCormick ◽  
James Forgan
2016 ◽  
Vol 32 (5) ◽  
pp. 728-750 ◽  
Author(s):  
Michael P. Brady ◽  
Katie Miller ◽  
Jazarae McCormick ◽  
Lawrence A. Heiser

Educators struggle with “value-added” teacher evaluation models based on high-stakes student assessments. Despite validity and reliability threats, these models evaluate university-based teacher preparation programs (TPPs), and play a role in state and professional accreditation. This study reports a more rational value-added evaluation model linking student performance to teacher candidates’ lessons during Practicum and Student Teaching. Results indicate that K-12 students showed learning gains on these lessons, with mixed findings on comparisons of part-time to full-time internships, academic and functional lessons, and candidates’ grade point averages (GPAs). Results indicated that teacher candidates’ lessons are a viable value-added model (VAM) alternative for TPPs.


2018 ◽  
Vol 26 ◽  
pp. 33
Author(s):  
Charisse Gulosino

Evaluations of teacher preparation programs (TPPs) based in part on the performance of program completers have emerged as an education reform strategy in several states and have become central features of the Race to the Top (RTTT) grant competition. The objective of this policy review is to examine how the state of Tennessee measured and reported the extent to which teacher preparation programs (TPPs) explain the variation of the test score gains for public school students taught by program graduates. This review breaks down the findings by institution and certification pathway, comparing statistically significant outcomes at the state level produced by teachers from each TPP. An analysis of Tennessee's report card reveals considerable variation in the value-added estimates of beginning teachers, depending on the institution where they were trained.  These results, however, should be interpreted with caution. This review offers several technical considerations associated with the interpretation of Tennessee's report card on the effectiveness of TPPs and explains how these considerations may affect the interpretation of the findings.


2014 ◽  
Vol 116 (1) ◽  
pp. 1-48 ◽  
Author(s):  
Rick Ginsberg ◽  
Neal Kingston

Background Despite polling data that suggests that teachers are well respected by the general public, criticism of teacher preparation by various organizations and interest groups is common, often highlighting the perceived need for increasing their rigor and performance. A number of studies and reports have critiqued teacher preparation, and high-profile leaders like Secretary of Education Arne Duncan have called for substantive changes. At the same time, the field of teacher preparation has been embracing change with the idea of accountability based on student performance. Indeed, recently released evidence suggests that in the area of clinical preparation, education programs require many hours of field placement experiences, countering one of the key criticisms of the preparation programs. Purpose The purpose of this study is to examine the field of teacher preparation in the current era of accountability and testing. After a brief overview of the current context facing teacher preparation, the issue of outcome measures for varying professions is explored by comparing accreditation outcome measures utilized in selected professions. Then, the strengths and weaknesses of currently emerging assessment models are explored. Finally, a discussion of potential ways to assess teacher preparation program performance with an array of sources and measures is presented. Research Design The study is a combination of a secondary analysis and analytic essay. The use of outcomes associated with 10 professions was examined by reviewing accreditation standards and documentation from published reports available on websites for the specific measures used to assess student success and program outcomes. As a means of validating findings, feedback was obtained from accreditation coordinators and/or other leaders in each profession. The analysis of currently emerging assessment models for teacher preparation was based upon a review of literature on value added and other similar assessments. Conclusions/Recommendations The review of professions found that all are struggling with better means for assessing program outcomes, with a great deal of similarity in the processes currently in place used across fields. Teacher education was found to include more of the different ways for assessing outcomes than any other profession. Significant concerns with currently promoted value-added models for assessing outcomes of teacher preparation were identified, with the use of multiple measures of evidence suggested as the best means for moving forward. We argue that teacher preparation programs are caught in a vise—with an appreciation and desire among those in the field for greater accountability while being squeezed by a sense that the approaches being suggested are prone to error and misuse.


2017 ◽  
Vol 69 (5) ◽  
pp. 429-447 ◽  
Author(s):  
Kevin C. Bastian ◽  
Kristina M. Patterson ◽  
Yi Pan

States are incorporating evaluation ratings into new, multioutcome teacher preparation program (TPP) evaluation systems, yet little is known about the relationships between TPPs and the evaluation ratings of program graduates. To address this gap, we use teachers’ ratings on the North Carolina Educator Evaluation System to determine whether TPPs are associated with the evaluation ratings of their initially prepared teachers. We find that (a) teachers from certain TPPs have significantly different evaluation ratings than graduates of other programs; (b) it is important to adjust for elements of school context when analyzing the evaluation ratings of program graduates; (c) evaluation ratings are a function of preparation quality, not just selection into programs; and (d) evaluation ratings provide evidence on the performance of TPPs that is distinct from value-added. Our results indicate that evaluation ratings can be a valuable component of TPP evaluation systems and provide guidance for incorporating ratings into such systems.


2018 ◽  
Vol 70 (2) ◽  
pp. 128-138 ◽  
Author(s):  
George H. Noell ◽  
Jeanne M. Burns ◽  
Kristin A. Gansle

Systemic efforts to strengthen teacher preparation in Louisiana led to the first statewide value-added assessment (VAA) of teacher preparation programs (TPPs). Subsequently, a number of states have adopted VAA of TPPs. The authors describe challenges that were confronted around the deployment of Louisiana’s VAA of TPPs. The discussion is organized around the challenges emerging from calculation, communication, and change. The discussion provides information that policy makers and teacher education leaders, rather than analysts, might find useful, and focuses on the types of challenges that a state or university system can expect to encounter in developing a VAA. We describe decisions made in response to specific challenges that appear to have been successful and some that in retrospect appear to have been mistakes. In addition, consideration is given to some unintended consequences of policy choices as well as the continuously changing policy landscape for the assessment of teacher preparation.


2018 ◽  
Vol 70 (2) ◽  
pp. 90-101 ◽  
Author(s):  
Dan Goldhaber

Teacher preparation programs (TPPs) have received a great deal of policy and research attention of late. And despite the commonsense notion that preparation for formal classroom responsibilities should improve the readiness of teacher candidates, the value of formalized preservice teacher education is unclear. In this review of the quantitative evidence about TPPs, I find that most studies show only minor differences in the value added of teachers who graduate from different programs, and that there are only a few studies that focus on the association between the features of teacher preparation and teacher workforce outcomes. The lack of evidence on the importance of the features of teacher preparation is primarily due to data deficiencies: data often do not permit connections between TPP features and teacher workforce outcomes. As a consequence, feedback loops that could theoretically provide TPPs with actionable information about program design typically do not exist.


Author(s):  
Frank C. Worrell ◽  
Mary M. Brabeck ◽  
Carol Anne Dwyer ◽  
Kurt F. Geisinger ◽  
Ronald W. Marx ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document