Teacher Effects and Teacher Effectiveness: A Validity Investigation of the Tennessee Value Added Assessment System

2003 ◽  
Vol 25 (3) ◽  
pp. 287-298 ◽  
Author(s):  
Haggai Kupermintz

This article addresses the validity of teacher evaluation measures produced by the Tennessee Value Added Assessment System (TVAAS). The system analyzes student test score data and estimates the effects of individual teachers on score gains. These effects are used to construct teacher value-added measures of teaching effectiveness. We describe the process of generating teacher effectiveness estimates in TVAAS and discuss policy implications of using these estimates for accountability purposes. Specifically, the article examines the TVAAS definition of teacher effectiveness, the mechanism employed in calculating numerical estimates of teacher effectiveness, and the relationships between these estimates and student ability and socioeconomic background characteristics. Our validity analyses point to several logical and empirical weaknesses of the system, and underscore the need for a strong validation research program on TVAAS.

2017 ◽  
Vol 68 (4) ◽  
pp. 377-393 ◽  
Author(s):  
Dan Goldhaber ◽  
James Cowan ◽  
Roddy Theobald

We use longitudinal data from Washington State to provide estimates of the extent to which performance on the edTPA, a performance-based, subject-specific assessment of teacher candidates, is predictive of the likelihood of employment in the teacher workforce and value-added measures of teacher effectiveness. While edTPA scores are highly predictive of employment in the state’s public teaching workforce, evidence on the relationship between edTPA scores and teaching effectiveness is more mixed. Specifically, continuous edTPA scores are a significant predictor of student mathematics achievement in some specifications, but when we consider that the edTPA is a binary screen of teaching effectiveness (i.e., pass/fail), we find that passing the edTPA is significantly predictive of teacher effectiveness in reading but not in mathematics. We also find that Hispanic candidates in Washington were more than 3 times more likely to fail the edTPA after it became consequential in the state than non-Hispanic White candidates.


2004 ◽  
Vol 29 (1) ◽  
pp. 37-65 ◽  
Author(s):  
Dale Ballou ◽  
William Sanders ◽  
Paul Wright

The Tennessee Value-Added Assessment System measures teacher effectiveness on the basis of student gains, implicitly controlling for socioeconomic status and other background factors that influence initial levels of achievement. The absence of explicit controls for student background has been criticized on the grounds that these factors influence gains as well. In this research we modify the TVAAS by introducing commonly used controls for student SES and demographics. The introduction of controls at the student level has a negligible impact on estimated teacher effects in the TVAAS, though not in a simple fixed effects estimator with which the TVAAS is compared. The explanation lies in the TVAAS’s exploitation of the covariance of tests in different subjects and grades, whereby a student’s history of test performance substitutes for omitted background variables.


2017 ◽  
Vol 12 (3) ◽  
pp. 369-395 ◽  
Author(s):  
Jason A. Grissom ◽  
Susanna Loeb

Teacher effectiveness varies substantially, yet principals’ evaluations of teachers often fail to differentiate performance among teachers. We offer new evidence on principals’ subjective evaluations of their teachers’ effectiveness using two sources of data from a large, urban district: principals’ high-stakes personnel evaluations of teachers, and their low-stakes assessments of a subsample of those teachers provided to the researchers. We find that principals’ evaluations of teachers are quite positive whether the stakes are high or low, but the low-stakes evaluations show substantially more use of lower rating categories, and many teachers rated ineffective on the low-stakes assessment receive “effective” or “highly effective” high-stakes ratings. Teacher characteristics, such as experience, partially explain the discrepancy between the two scores. Also, despite the fact that principals overwhelmingly assign teachers to the two highest rating categories on the high-stakes evaluation, their high- and low-stakes ratings show similar correlations with teacher value-added measures.


Author(s):  
Audrey Amrein-Beardsley ◽  
Clarin Collins

At the time of this study, the Texas Value-Added Assessment System (TxVAAS) was being piloted throughout Texas to hold teachers more accountable for their effects on students' achievement (i.e., teachers’ value added). It is still being used by districts throughout Texas today. Using a framework informed by the<em> Standards for Educational and Psychological Testing</em>, researchers conducted a content analysis of the marketing and research-based claims asserted about the TxVAAS, to (a) examine the “truth” of each claim to (b) help others critically consume the marketing claims using (c) nonproprietary, peer-reviewed literature. Given that the more popular, and also proprietary version of the TxVAAS—the Education Value-Added Assessment System—continues to be sold and marketed to other states and districts in similar ways, researchers deemed it critical to intervene before other states and districts might blindly trust the marketing and research-based claims presented.


2018 ◽  
Vol 32 (1) ◽  
pp. 2-26 ◽  
Author(s):  
Iris BenDavid-Hadar

Purpose Resource allocation is a key policy instrument that affects the educational achievement distribution (EAD). The literature on methods of allocation is focused mainly on equity issues. The purpose of this paper is to develop a composite funding formula, which adds to the equity-based element (i.e. a needs-based element compensating for students’ low starting points), an element of rewarding improvement in schools’ educational achievement distribution (IEAD) (i.e. raising the overall level of achievement and narrowing the achievement gap). Design/methodology/approach This formula is developed using advanced regression models as well as integrating further policy considerations. The data sets are comprised of nation-wide student-level information on longitudinal students’ achievements (8th graders of 2006, and four years later 12th graders 2010), as well as student background characteristics, and teacher profiles and school features. The Israel data serve as an interesting case study for other countries which are similarly characterized by its students’ diversity, and by its aspiration to improve its EAD and to narrow the achievement gap. Findings Results reveal that the variance among students’ performance is mostly explained by their past performance. In addition, other background characteristics also contribute to the explained variation in students’ performance; however, a lower contribution was found, compared with that of the previous performance. Specifically, schools’ value added contributes 25 percent to the overall 50 percent of explained variance. In other words, allocating resources to schools solely with accordance to equity issues might have an adverse effect on improvement. Yet, designing a composite mechanism that integrates both equity and improvement issues might be more effective. Practical implications Policy makers in other countries that strive to achieve improvement as well as equity in education might consider adjusting the technique developed in this work. The proposed technique might be adjusted based on each country’s nation-wide student-level data. The design of a research-based funding formula aimed at improvement in education as well as considering equity issues might be more effective, equitable, and efficient. Originality/value The main contribution of this work is the conceptual development of IEAD, as well as its measured weight in the funding formula. This work suggests an innovative method of allocation that rewards schools by allocating larger resources based on the improvement gained in the process of learning (not just on the inputs or outputs/outcomes). This research value lays in its design of a composite funding formula that takes into account, in addition to the equity component, an innovative improvement-based component. In addition to that, the value of this research lays on its policy implications. This research suggests and develops a technique for developing a research-based funding formula that might be useful for other countries aspire to improve their education.


2013 ◽  
Vol 8 (4) ◽  
pp. 494-527 ◽  
Author(s):  
Dan Goldhaber ◽  
Roddy Theobald

Over 2,000 teachers in the state of Washington received reduction-in-force (RIF) notices across the 2008–09 and 2009–10 school years. We link data on these RIF notices to an administrative data set that includes student, teacher, school, and district variables to determine the factors that predict the likelihood of a teacher receiving a RIF notice. Not surprisingly, we find that a teacher's seniority is the strongest predictor, but we also find (all else equal) that teachers with master's degrees and those credentialed in the high-need areas of math, science, and special education were less likely to receive a RIF notice. Value-added measures of teacher effectiveness, which can be calculated for a subset of the teachers, were not correlated with the probability of receiving a RIF notice. Finally, simulations suggest that a very different group of teachers would be targeted for layoffs under an effectiveness-based layoff scenario than under the seniority-driven system that exists today.


Sign in / Sign up

Export Citation Format

Share Document