Measuring language ability of students with compensatory multidimensional CAT: A post-hoc simulation study

The computerized adaptive tests (CAT) apply an adaptive process in which the items are tailored to individuals' ability scores. The multidimensional CAT (MCAT) designs differ in terms of different item selection, ability estimation, and termination methods being used. This study aims at investigating the performance of the MCAT designs used to measure the language ability of students and to compare the results of MCAT designs with the outcomes of corresponding paper–pencil tests. For this purpose, items in the English Proficiency Tests (EPT) were used to create a multi-dimensional item pool that consists of 599 items. The performance of the MCAT designs was evaluated and compared based on the reliability coefficients, root means square error (RMSE), test-length, and root means squared difference (RMSD) statistics, respectively. Therefore, 36 different conditions were investigated in total. The results of the post-hoc simulation designs indicate that the MCAT designs with the A-optimality item selection method outperformed MCAT designs with other item selection methods by decreasing the test length and RMSD values without any sacrifice in test reliability. Additionally, the best error variance stopping rule for each MCAT algorithm with A-optimality item selection could be considered as 0.25 with 27.9 average test length and 30 items for the fixed test-length stopping rule for the Bayesian MAP method. Overall, MCAT designs tend to decrease the test length by 60 to 65 percent and provide ability estimations with higher precision compared to the traditional paper–pencil tests with 65 to 75 items. Therefore, it is suggested to use the A-optimality method for item selection and the Bayesian MAP method for ability estimation for the MCAT designs since the MCAT algorithm with these specifications shows better performance than others.

Comics for inclusive English language learning: the CIELL app, supporting dyslexic English language learners

As teaching moves increasingly online, language teachers are faced with the challenge of how to support dyslexic students in an inclusive manner in and out of the classroom. This paper will focus on an innovative educational multi-modal, mobile application – Comics for Inclusive English Language Learning (CIELL) – supporting upper-intermediate and advanced English as a Foreign Language (EFL) students with dyslexia when faced with language proficiency tests and academic writing tasks. A cyclical educational design research methodology (McKenney & Reeves, 2019) was used to include three cycles of feedback from stakeholders so that their views and suggestions would inform the development of an alpha, beta, and gamma version of the app, thereby maximising practical relevance. The discussion of the quantitative and qualitative feedback is supported by educational design research.

Undertaking a New Regulatory Challenge: Monitoring of Ergot Alkaloids in Italian Food Commodities

The present manuscript reports on monitoring data of 12 ergot alkaloids (EAs) in cereal and cereal-derived products, collected in Italy over the period 2017–2020, for official control purposes under the edge of the Commission Recommendation 2012/154/EU on the monitoring of the presence of EAs in feed and food. To these purposes, an LC-MS/MS method was set up and applied, after in-house verification of its analytical performance. Besides satisfactory recoveries and precision, the method’s quantification limits proved suitable to assess the compliance of cereals and cereal-based foods with the recently issued EU maximum permitted levels (Commission Regulation 2021/1399/EU). The validity of the generated data was also evaluated through the adoption of four proficiency tests, from which acceptable z-score values (−2 ≤ z ≤ 2) were obtained. The method was then applied to analyse a total of 67 samples, collected in Italy over the period 2017–2020. The samples consisted of 18 cereal grains, 16 flours (14 of wheat and 2 of spelt) and 31 other types of cereals derivatives (including 9 for infants). Overall, the EAs analysis returned a high percentage of left-censored data (>86%). Among the positive samples, the highest contamination levels, up to 94.2 µg/kg, were found for ergocristine (12% incidence), followed by ergocristinine (7% incidence) with levels of up to 48.3 µg/kg.

The Influence of Theme-Based Language Teaching toward Indonesian Students’ Reading Comprehension

Reading is one of the essential skills in English language learning. In the Indonesian context, reading has been one of the essential subjects to be taught among schools and universities since English is one of the compulsory requirements for graduation. Theme-based Language Teaching (TBLT) is a prominent approach used by the teacher and the students to understand the reading. This study aimed at examining the influence of TBLT on the students' reading comprehension. This research used quantitative research with an experimental study. The study selected participants from Madrasah Aliyah (MA) NW Narmada, Indonesia. The study recruited 20 students taken from the second grade of MA NW Narmada. Pre- and post-proficiency tests were used to assemble data of the study. To analyze data, this study employed a T-test to determine the significant result. The result indicated that the pretest score achieved 71.12 and the posttest value reached 89.05. It performed that different values occur on the students' reading comprehension after the TBLT implementation. The significant value (p) also indicated that the output reaches 0.00 < 0.05, which represented the result is under the significant level (0.05). It means that there is a significant influence of the TBLT method on the students' reading comprehension. In other words, TBLT method contributes positive in+uence on the students' English reading comprehension.

Perspectives of Test Examiners of the Localized Speaking Assessment Framework: A Case Study in Vietnam

The present study explores the test examiners'' perspectives on the role and qualitative aspects of the current localized speaking assessment framework used in Vietnam. A case study with two experienced test examiner-cum-English lecturers was conducted. Inductive content analysis was used to analyze the qualitative data findings obtained from individual semi-structured interviews. Drawbacks, merits, and standardization issues of the current localized speaking assessment frameworks, i.e., the Vietnamese Standardized Test of English Proficiency (VSTEP), were also discussed, especially in comparison to internationally recognized examinations and frameworks such as the International English Language Testing System (IELTS) and the Certificate in Advanced English (CAE) as well as the Common European Framework of Reference for Languages (CEFR). The study informed both English educators and policymakers to improve localized speaking assessment to suit the local teaching needs while still meeting the requirements of widely accepted international proficiency tests.

Comparison of test performance on paper-based testing (PBT) and computer-based testing (CBT) by English-majored undergraduate students in China

Computer-based testing (CBT), which refers to delivering assessments with computers, has been widely used in large English proficiency tests worldwide. Despite an increasing CBT in China, limited research is available concerning whether CBT can be used for the Test for English Majors-Band 4 (TEM 4). The current study investigated whether testing mode impacted TEM 4 score and factors (i.e., computer familiarity level and attitude towards CBT) that might correlate with performance on CBT of TEM 4. Overall 92 Chinese undergraduate students were randomly assigned to one of the groups, i.e., CBT or paper-based testing (PBT), and took the test. A mixed method was employed, including (1) quantitative and qualitative analysis of test performance in two modes, as well as CBT group participants’ computer familiarity and attitudes towards the mode; and (2) thematic analysis of semi-structured interviews. The results revealed that (1) test scores in CBT and PBT were comparable; (2) two items in the computer familiarity questionnaire, i.e., comfort level of reading articles on the computer and forgetting time when using computers, positively correlated with CBT scores; and (3) participants’ attitude towards CBT did not impact test performance.

The Development of Discourse and Morphological Features in L2 Narratives: A Study with Classroom Spanish-Speaking Learners of French

Previous research has examined the organization of second-language French narratives through discourse or morphological analyses. At the discourse level, the analyses have investigated the foreground/background relationship. Conversely, at the morphological level, the analyses have examined the role played by verbal morphology and verbal predicates. Different methodological caveats have limited the interpretation of findings in both types of analyses. In order to provide new data, this cross-sectional study examined the evolution of discourse and morphological resources in the written narratives of Mexican Spanish-speaking learners of French whose language learning experience is limited to the classroom. The learners in the cross-sectional sample (n = 11) were selected from a population of 88 participants who completed lexical, past-tense and general proficiency tests. They also generated two written narratives during silent-film retelling tasks. The cross-sectional sample selection was based on the learners’ test scores and the results of parametric statistical analyses. The narratives were analyzed for the identification of foreground/background clauses, verbal morphology and verbal predicates. The results reveal that, as learners’ past-tense knowledge increases, the organization of narratives consolidates through a developmental path that involves the interrelated growth of discourse and morphological features.