Scoring Fairness in Large-Scale High-Stakes English Language Testing: An Examination of the National Matriculation English Test

Author(s):  
Yi Mei ◽  
Liying Cheng
2019 ◽  
Vol 9 (1) ◽  
Author(s):  
M. Obaidul Hamid ◽  
Ian Hardy ◽  
Vicente Reyes

Abstract Although language test-takers have been the focus of much theoretical and empirical work in recent years, this work has been mainly concerned with their attitudes to test preparation and test-taking strategies, giving insufficient attention to their views on broader socio-political and ethical issues. This article examines test-takers’ perceptions and evaluations of the fairness, justice and validity of global tests of English, with a particular focus upon the International English Language Testing System (IELTS). Based on relevant literature and theorizing into such tests, and on self-reported test experience data gathered from test-takers (N = 430) from 49 countries, we demonstrate how test-takers experienced fairness and justice in complex ways that problematized the purported technical excellence and validity of IELTS. Even as there was some evidence of support for the test as a fair measure of students’ English capacity, the extent to which it actually reflected their language capabilities was open to question. At the same time, the participants expressed concerns about whether IELTS was a vehicle for raising revenue and for justifying immigration policies, thus raising questions about the justness of the test. The research foregrounds the importance of focusing attention upon the socio-political and ethical circumstances that currently attend large-scale, standardized English language testing.


2011 ◽  
Vol 28 (3) ◽  
pp. 367-382 ◽  
Author(s):  
Lorena Llosa

With the United States’ adoption of a standards-based approach to education, most attention has focused on the large-scale, high-stakes assessments intended to measure students’ mastery of standards for accountability purposes. Less attention has been paid to the role of standards-based assessments in the classroom. The purpose of this paper is to discuss key issues and challenges related to the use of standards-based classroom assessments to assess English language learners’ English proficiency. First, the paper describes a study of a standards-based classroom assessment of English proficiency in a large urban school district in California. Second, using this study as an example and drawing from the literature in language testing on classroom assessment, this paper highlights the major issues and challenges involved in using English proficiency standards as the basis for classroom assessment. Finally, the article outlines a research agenda for the field given current developments in the areas of English proficiency standards and classroom assessment.


2021 ◽  
Vol 12 ◽  
Author(s):  
Leyi Qian ◽  
Yan Cheng ◽  
Yali Zhao

In studies on second language writing, linguistic complexity exhibited by learners has long been regarded as being indicative of writing proficiency. However, there are relatively scant studies focusing on the diversity and structural elaboration of complexity in L2 production data that are extracted from high-stakes tests [such as Test of English as a Foreign Language (TOEFL) and International English Language Testing System (IELTS)]. Using a large-scale learner corpus collected from a TOEFL (internet-based test (iBT), this study aims to explore the extent to which the three dimensions of linguistic complexity, syntactic, lexical, and morphological complexity, are associated with human scoring in high-stakes tests. In addition, we also tend to tap into within-genre topic effects on the production of complexity measures by learners. To this end, a total of 1,002 writing samples were collected from a TOEFL11 corpus, and six automated-coding instruments were used to investigate the variations of complexity among Chinese English as a Foreign Language (EFL) learners. The results from the correlation analysis, multiple linear regression, and independent sample t-tests indicated that there was not a linear correlation between the majority of linguistic complexity and human-rated score levels and that proficiency among Chinese EFL learners did not signal a discriminative power in their language production. In the meantime, strong within-proficiency topic effects were found on the majority of measures in the syntactic, lexical, and morphological dimensions.


2020 ◽  
Vol 23 (2) ◽  
pp. 1-19
Author(s):  
Michelle Chen ◽  
Jennifer J. Flasko

Seeking evidence to support content validity is essential to test validation. This is especially the case in contexts where test scores are interpreted in relation to external proficiency standards and where new test content is constantly being produced to meet test administration and security demands. In this paper, we describe a modified scale- anchoring approach to assessing the alignment between the Canadian English Language Proficiency Index Program (CELPIP) test and the Canadian Language Benchmarks (CLB), the proficiency framework to which the test scores are linked. We discuss how proficiency frameworks such as the CLB can be used to support the content validation of large-scale standardized tests through an evaluation of the alignment between the test content and the performance standards. By sharing both the positive implications and challenges of working with the CLB in high-stakes language test validation, we hope to help raise the profile of this national language framework among scholars and practitioners.


2019 ◽  
Vol 8 (2) ◽  
Author(s):  
Dinh Thi Bac Binh ◽  
Dinh Thi Kieu Trinh

The International English Language Testing System (IELTS) is recognized as an accountable tool to assess whether aperson is able to study or train in English. Every year, thousandsof students sit for IELTS. However, the number of those who arerecognized to be capable enough to take a course in English issomehow limited, especially for those who are not major inEnglish at their universities.IELTS Reading is considered as a discerning skill and it is of theequal importance to listening, speaking and writing in obtainingthe objectives of IELTS of band 6 or 6.5. Being teachers of Englishat a training institution, the authors recognize that students canmake time-saving improvements in their reading command undertheir teachers’ insightful guidance.


2016 ◽  
Author(s):  
Josefina C. Santana ◽  
Arturo Garcca Santillln ◽  
Karen Michelle Ventura Michel ◽  
Teresa Zamora Lobato

2021 ◽  
Vol 13 (3) ◽  
pp. 1158
Author(s):  
Cecilia M. Onyango ◽  
Justine M. Nyaga ◽  
Johanna Wetterlind ◽  
Mats Söderström ◽  
Kristin Piikki

Opportunities exist for adoption of precision agriculture technologies in all parts of the world. The form of precision agriculture may vary from region to region depending on technologies available, knowledge levels and mindsets. The current review examined research articles in the English language on precision agriculture practices for increased productivity among smallholder farmers in Sub-Saharan Africa. A total of 7715 articles were retrieved and after screening 128 were reviewed. The results indicate that a number of precision agriculture technologies have been tested under SSA conditions and show promising results. The most promising precision agriculture technologies identified were the use of soil and plant sensors for nutrient and water management, as well as use of satellite imagery, GIS and crop-soil simulation models for site-specific management. These technologies have been shown to be crucial in attainment of appropriate management strategies in terms of efficiency and effectiveness of resource use in SSA. These technologies are important in supporting sustainable agricultural development. Most of these technologies are, however, at the experimental stage, with only South Africa having applied them mainly in large-scale commercial farms. It is concluded that increased precision in input and management practices among SSA smallholder farmers can significantly improve productivity even without extra use of inputs.


Sign in / Sign up

Export Citation Format

Share Document