LARGE-SCALE WRITING ASSESSMENT PRACTICES AND THE INFLUENCE OF OBJECTIVITY

2017 ◽  
pp. 17-43
2019 ◽  
pp. 10-17
Author(s):  
Olga Kvasova ◽  
Tamara Kavytska ◽  
Viktoriya Osidak

The rating process of students’ writing has been a long-standing concern in L2 large-scale standardized and classroom-based assessment. Several studies have tried to identify how the raters make scoring decisions and assign scores to ensure validity of writing assessment. The current paper addresses the issue of writing assessment practices of Ukrainian university teachers, how they approach rating scales and criteria with an attempt to understand culturally specific challenges of teachers’ writing assessment in Ukraine. To investigate the issue, this study employs the analysis of the survey results obtained from 104 university teachers of English. The survey consisted of 13 questions that provided insight into current practices in assessment of writing, such as frequency of assessment, use of rating scales, rater’s profile, criteria of assessment, feedback and rewriting, training in assessment of writing. The survey responses show that assessment in Ukraine is not regulated by common standard, and thus the approach to students’ writing assessment is often intuitive. A frequent practice is that teachers tend to rely on errors – as observable features of the text – to justify their rating decisions, Consequently, by shifting focus onto the surface features of writing, grammar mistakes in particular, the teachers underrate such criteria as “register”, “compliance with textual features” and “layout”. Additionally, the data reveal contradictory findings about writing assessment literacy of the teachers questioned. Even though most teachers claim they apply scales while rating, many confess they cannot tell the difference between holistic and analytic scales. Moreover, the results indicate that feedback is not yet a meaningful interaction between a Ukrainian teacher and a learner. Therefore, the results of the study demonstrate the need for the improvement in writing assessment practices, which could be achieved through providing training and reorientation to help Ukrainian teachers develop common understanding and interpretation of task requirements and scale features.


Author(s):  
Alice Alonzo

Like all models, learning progressions (LPs) provide simplified representations of complex phenomena. One key simplification is the characterisation of student thinking in terms of levels. This characterisation is both essential for large-scale applications, such as informing standards, but potentially problematic for smaller-scale applications. In this paper, I describe a program of research designed to explore the smaller-scale use of LPs as supports for teacher classroom assessment practices in light of this simplification. Based on this research, I conclude that LP levels may serve as a generative heuristic, particularly when teachers are engaged with evidence of the limitations of LP levels and supported to use LPs in ways that do not rely on their levels.


Neofilolog ◽  
2019 ◽  
pp. 171-182
Author(s):  
Melanie Ellis

Findings from “Learning and teaching foreign languages in lower secondary school”, (BUNJO 2012): Implications for the education of teachers of English.This paper takes data from the first part of a longitudinal study, “Learn-ing and Teaching Foreign Languages in lower secondary school”, con-ducted by the Educational Research Institute in Warsaw. The sample is large scale and representative at the level of school, which allows us to generalise to the general population with some degree of confidence. From the data several areas appear to give cause for concern. The first is organisation of work in class, where pair and group work were found to be rare. The focus of lessons would currently appear to more often em-phasize grammar, vocabulary or receptive skills than productive skills. What is tested does not always seem to reflect what is taught, which suggests that assessment practices may not be fully informed. Motivating learners and engaging them in the lesson is also reported as a cause of dissatisfaction. Teachers were found to hold mixed views regarding the importance of independent learning, which suggests more emphasis needs to be placed on the understanding of learner autonomy. This pa-per discusses each of these areas in turn, with illustrations from the data, and makes suggestions for how teacher education could be enhanced.


1992 ◽  
pp. 101 ◽  
Author(s):  
Henk Blok ◽  
Kees de Glopper

1995 ◽  
Vol 2 (2) ◽  
pp. 207-242 ◽  
Author(s):  
Maryl Gearhart ◽  
Joan L. Herman ◽  
John R. Novak ◽  
Shelby A. Wolf

2012 ◽  
Vol 10 (4) ◽  
pp. 447-460 ◽  
Author(s):  
Don A. Klinger ◽  
Louis Volante ◽  
Christopher Deluca

Lost in the focus on large-scale educational assessments for accountability purposes is the important role of teachers' classroom assessment practices. Teachers must understand the use of both large-scale and classroom assessment practices and theories, and professional development remains the primary method to develop these assessment capacities. However, traditional models of professional development typically have little, if any, effect. In recognition of the importance of building teachers' assessment capacity, and the limitations of traditional professional development, the Elementary Teachers' Federation of Ontario, Canada, developed a Classroom Assessment Workshop Series to begin to build a systemic assessment framework for teachers. Through pre- and post-series surveys with 300 participants, and interviews and focus groups with facilitators, the authors' review and research explored the impact of the series on teachers' beliefs, self-efficacy, and knowledge of assessment practices and theory. The authors also explored the challenges that teachers experienced as they worked to understand and implement current conceptions of assessment. While teachers certainly valued the community created through the series and the opportunities to share their experiences, the findings found that teachers struggled to understand the theoretical foundations and use these foundations to further develop their own assessment practices. The research highlights the need for teachers to embrace a philosophy that integrates formative assessment practices and theories into their teaching and learning while also identifying the challenges associated with creating such an assessment culture. Current models of professional development may be more aligned with principles of effective professional learning, but truly changing teachers' classroom assessment practices may require a much more prolonged effort than those being provided.


Sign in / Sign up

Export Citation Format

Share Document