Automated Essay Scoring Using Recurrence over BERT (RoBERT)

2021 ◽  
Vol 37 (3) ◽  
pp. 7-28
Author(s):  
Ingu Lee ◽  
Hosung Nam
Keyword(s):  
Automated Essay Scoring ◽  
Essay Scoring

Automated Essay Scoring: A Human's Review

PsycCRITIQUES ◽  
2004 ◽  
Vol 49 (Supplement 14) ◽  
Author(s):  
Steven E. Stemler
Keyword(s):  
Automated Essay Scoring ◽  
Essay Scoring

Learning writing skills using feedback from automated essay scoring

2009 ◽  
Author(s):  
Ronald T. Kellogg ◽  
Alison P. Whiteford ◽  
Thomas Quinlan
Keyword(s):  
Writing Skills ◽  
Automated Essay Scoring ◽  
Essay Scoring

EVALD – a Pioneer Application for Automated Essay Scoring in Czech

2019 ◽  
Vol 113 (1) ◽  
pp. 9-30
Author(s):  
Kateřina Rysová ◽  
Magdaléna Rysová ◽  
Michal Novák ◽  
Jiří Mírovský ◽  
Eva Hajičová
Keyword(s):  
Czech Republic ◽  
Native Speakers ◽  
Threshold Level ◽  
Automated Essay Scoring ◽  
The Czech Republic ◽  
Linguistic Differences ◽  
Supervised Training ◽  
Language Data ◽  
Overall Performance ◽  
Essay Scoring

Abstract In the paper, we present EVALD applications (Evaluator of Discourse) for automated essay scoring. EVALD is the first tool of this type for Czech. It evaluates texts written by both native and non-native speakers of Czech. We describe first the history and the present in the automatic essay scoring, which is illustrated by examples of systems for other languages, mainly for English. Then we focus on the methodology of creating the EVALD applications and describe datasets used for testing as well as supervised training that EVALD builds on. Furthermore, we analyze in detail a sample of newly acquired language data – texts written by non-native speakers reaching the threshold level of the Czech language acquisition required e.g. for the permanent residence in the Czech Republic – and we focus on linguistic differences between the available text levels. We present the feature set used by EVALD and – based on the analysis – we extend it with new spelling features. Finally, we evaluate the overall performance of various variants of EVALD and provide the analysis of collected results.

General Models for Automated Essay Scoring: Exploring an Alternative to the Status Quo

2005 ◽  
Vol 33 (1) ◽  
pp. 101-113 ◽  
Author(s):  
P. Adam Kelly
Keyword(s):  
Empirical Evidence ◽  
Writing Assessment ◽  
Model Performance ◽  
Status Quo ◽  
Automated Essay Scoring ◽  
The Status ◽  
Essay Scoring ◽  
Better Than

Powers, Burstein, Chodorow, Fowles, and Kukich (2002) suggested that automated essay scoring (AES) may benefit from the use of “general” scoring models designed to score essays irrespective of the prompt for which an essay was written. They reasoned that such models may enhance score credibility by signifying that an AES system measures the same writing characteristics across all essays. They reported empirical evidence that general scoring models performed nearly as well in agreeing with human readers as did prompt-specific models, the “status quo” for most AES systems. In this study, general and prompt-specific models were again compared, but this time, general models performed as well as or better than prompt-specific models. Moreover, general models measured the same writing characteristics across all essays, while prompt-specific models measured writing characteristics idiosyncratic to the prompt. Further comparison of model performance across two different writing tasks and writing assessment programs bolstered the case for general models.

scholarly journals A Study for the Development of Automated Essay Scoring (AES) in Malaysian English Test Environment

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Wee Sian Wong ◽  
Chih How Bong
Keyword(s):  
Reliability And Validity ◽  
Theoretical Aspect ◽  
Local Context ◽  
Test Environment ◽  
Automated Essay Scoring ◽  
Scoring Rubrics ◽  
Essay Scoring ◽  
Assessment Environment ◽  
Future Work ◽  
Assessment Context

Automated Essay Scoring (AES) is the use of specialized computer programs to assign grades to essays written in an educational assessment context. It is developed to overcome time, cost, and reliability issues in writing assessment. Most of the contemporary AES are “western” proprietary product, designed for native English speakers, where the source code is not made available to public and the assessment criteria may tend to be associated with the scoring rubrics of a particular English test context. Therefore, such AES may not be appropriate to be directly adopted in Malaysia context. There is no actual software development work found in building an AES for Malaysian English test environment. As such, this work is carried out as the study for formulating the requirement of a local AES, targeted for Malaysia's essay assessment environment. In our work, we assessed a well-known AES called LightSide for determining its suitability in our local context. We use various Machine Learning technique provided by LightSide to predict the score of Malaysian University English Test (MUET) essays; and compare its performance, i.e. the percentage of exact agreement of LightSide with the human score of the essays. Besides, we review and discuss the theoretical aspect of the AES, i.e. its state-of-the-art, reliability and validity requirement. The finding in this paper will be used as the basis of our future work in developing a local AES, namely Intelligent Essay Grader (IEG), for Malaysian English test environment.

A Bi-modal Automated Essay Scoring System for Handwritten Essays

2021 ◽  
Author(s):  
Jinghua Gao ◽  
Qichuan Yang ◽  
Yang Zhang ◽  
Liuxin Zhang ◽  
Siyun Wang
Keyword(s):  
Scoring System ◽  
Automated Essay Scoring ◽  
Essay Scoring
Sign in / Sign up

Export Citation Format

Share Document