Training and Scoring Issues Involved in Large-Scale Writing Assessments

Personality is an inherent rater’s characteristic influencing rating severity, but very few studies examined their relationship and the findings were inconclusive. This study aimed to re-investigate the relationship between raters’ personality and rating severity with more control on relevant variables and more reliable analysis of rating severity. Female novice raters ( n = 28) from a demographically homogeneous background were recruited to rate on two occasions essays written by 111 students in an intermediate-level Chinese as a foreign language program. Raters’ personality traits were measured using the complete version of NEO-PI-R. Many-faceted Rasch measurement model and repeated measurement were applied to yield more robust estimates of rating severity. In addition, rating order effect was carefully controlled. Extroversion was found to be positively correlated with severity, r(26) = .495, p = .010. Furthermore, Extroversion was found to be a valid predictor of severity, t(24) = 2.792, p = .010, R2 = .21, Cohen’s d = .77, Hattie’s r = .37. Practical implications for developing more individualized online rater calibration for large-scale writing assessments were discussed, followed by limitations of the present study.

Download Full-text

Differences Across Levels in the Language of Agency and Ability in Rating Scales for Large-Scale Second Language Writing Assessments

Studia Anglica Posnaniensia ◽

10.1515/stap-2017-0006 ◽

2017 ◽

Vol 52 (2) ◽

pp. 147-172

Author(s):

Salena Sampson Anderson

Keyword(s):

Second Language ◽

Writing Assessment ◽

Large Scale ◽

Second Language Writing ◽

Rating Scales ◽

Reliability And Validity ◽

College Level ◽

Writing Assessments ◽

The Public ◽

Language Writing

Abstract While large-scale language and writing assessments benefit from a wealth of literature on the reliability and validity of specific tests and rating procedures, there is comparatively less literature that explores the specific language of second language writing rubrics. This paper provides an analysis of the language of performance descriptors for the public versions of the TOEFL and IELTS writing assessment rubrics, with a focus on linguistic agency encoded by agentive verbs and language of ability encoded by modal verbs can and cannot. While the IELTS rubrics feature more agentive verbs than the TOEFL rubrics, both pairs of rubrics feature uneven syntax across the band or score descriptors with either more agentive verbs for the highest scores, more nominalization for the lowest scores, or language of ability exclusively in the lowest scores. These patterns mirror similar patterns in the language of college-level classroom-based writing rubrics, but they differ from patterns seen in performance descriptors for some large-scale admissions tests. It is argued that the lack of syntactic congruity across performance descriptors in the IELTS and TOEFL rubrics may reflect a bias in how actual student performances at different levels are characterized.

Download Full-text

Some comments about observations and image processing of comet 29P/Schwassmann-Wachmann 1

International Astronomical Union Colloquium ◽

10.1017/s0252921100031493 ◽

1999 ◽

Vol 173 ◽

pp. 243-248

Author(s):

D. Kubáček ◽

A. Galád ◽

A. Pravda

Keyword(s):

Image Processing ◽

Large Scale ◽

Harvard College ◽

Oak Ridge ◽

Large Scale Structures ◽

Short Period Comet ◽

Short Period ◽

Scale Structures ◽

Harvard College Observatory ◽

Period Comet

AbstractUnusual short-period comet 29P/Schwassmann-Wachmann 1 inspired many observers to explain its unpredictable outbursts. In this paper large scale structures and features from the inner part of the coma in time periods around outbursts are studied. CCD images were taken at Whipple Observatory, Mt. Hopkins, in 1989 and at Astronomical Observatory, Modra, from 1995 to 1998. Photographic plates of the comet were taken at Harvard College Observatory, Oak Ridge, from 1974 to 1982. The latter were digitized at first to apply the same techniques of image processing for optimizing the visibility of features in the coma during outbursts. Outbursts and coma structures show various shapes.

Download Full-text

Evolution of Large-Scale Coronal Structures

International Astronomical Union Colloquium ◽

10.1017/s0252921100024945 ◽

1994 ◽

Vol 144 ◽

pp. 29-33

Author(s):

P. Ambrož

Keyword(s):

Magnetic Field ◽

Field Line ◽

Large Scale ◽

Coronal Magnetic Field ◽

Source Surface ◽

Solar Cycles ◽

Characteristic Relationship ◽

The Magnetic Field ◽

Coronal Structures

AbstractThe large-scale coronal structures observed during the sporadically visible solar eclipses were compared with the numerically extrapolated field-line structures of coronal magnetic field. A characteristic relationship between the observed structures of coronal plasma and the magnetic field line configurations was determined. The long-term evolution of large scale coronal structures inferred from photospheric magnetic observations in the course of 11- and 22-year solar cycles is described.Some known parameters, such as the source surface radius, or coronal rotation rate are discussed and actually interpreted. A relation between the large-scale photospheric magnetic field evolution and the coronal structure rearrangement is demonstrated.

Download Full-text