scholarly journals THE MÊTIS OF RELIABILITY: Using the Framework for Success to Aid the Performance of Neutrality Within Writing Assessment

2020 ◽  
pp. 176-190
Author(s):  
Tristan Abbott
Keyword(s):  
Writing Assessment

Development a Python-based Writing Assessment Practice Program

2019 ◽  
Vol 19 (12) ◽  
pp. 769-787
Author(s):  
Yeongmi Choi ◽  
Sumi Kim ◽  
So hyeon Lee ◽  
Youngmin Park
Keyword(s):  
Writing Assessment ◽  
Assessment Practice

General Models for Automated Essay Scoring: Exploring an Alternative to the Status Quo

2005 ◽  
Vol 33 (1) ◽  
pp. 101-113 ◽  
Author(s):  
P. Adam Kelly
Keyword(s):  
Empirical Evidence ◽  
Writing Assessment ◽  
Model Performance ◽  
Status Quo ◽  
Automated Essay Scoring ◽  
The Status ◽  
Essay Scoring ◽  
Better Than

Powers, Burstein, Chodorow, Fowles, and Kukich (2002) suggested that automated essay scoring (AES) may benefit from the use of “general” scoring models designed to score essays irrespective of the prompt for which an essay was written. They reasoned that such models may enhance score credibility by signifying that an AES system measures the same writing characteristics across all essays. They reported empirical evidence that general scoring models performed nearly as well in agreeing with human readers as did prompt-specific models, the “status quo” for most AES systems. In this study, general and prompt-specific models were again compared, but this time, general models performed as well as or better than prompt-specific models. Moreover, general models measured the same writing characteristics across all essays, while prompt-specific models measured writing characteristics idiosyncratic to the prompt. Further comparison of model performance across two different writing tasks and writing assessment programs bolstered the case for general models.

Sign in / Sign up

Export Citation Format

Share Document