scholarly journals Validated tests for language research with university students: Tests of vocabulary, general knowledge, author recognition, reading comprehension, reading frequency, attention check

2022 ◽  
Author(s):  
Hanke Vermeiren ◽  
Aaron Vandendaele ◽  
Marc Brysbaert

We present five studies aimed at developing a new vocabulary test for university students. Such a test isuseful as an indication of crystallized intelligence and because vocabulary size correlates well withreading comprehension. In the first study, a list of 100 words based on Nation’s Vocabulary Size Test waspresented to 195 participants and compared to other tests of crystallized intelligence. Analysis suggestedthe presence of two distinct factors, which we interpreted as evidence for the possible existence of twotypes of difficult words: Unfamiliar words for general knowledge and unfamiliar words for specializedknowledge. In the subsequent studies we tried to develop vocabulary tests for each type of words, at thesame time trying out various reading comprehension tests to use as validation criterion. However, in thefinal study a high correlation (r =.82) was found between our two vocabulary tests, indicating that theymeasure the same latent factor, contrary to our initial assumption. Both tests have high reliability (r >.85) and correlate well (r > .4) with general knowledge, author recognition, and reading comprehension.As part of our research efforts, a collection of new and existing tests was used and (often) improved toverify the validity of the vocabulary tests. An exploratory factor analysis on all tests established 3 factors(text comprehension, crystallized intelligence, and reading rate), with the vocabulary tests loading on thefactor of crystallized intelligence, which in turn correlated with reading comprehension. Structuralequation modeling corroborated the interpretation. We end by providing an overview of the differenttests that were developed or improved throughout the studies. They are freely available for researchpurposes at https://osf.io/ef3s4/.

Author(s):  
Francisco Buades-Sitjar ◽  
Roger Boada ◽  
Marc Guasch ◽  
Pilar Ferré ◽  
José Antonio Hinojosa ◽  
...  

AbstractStudies on sociodemographic data and crystallized intelligence have often struggled to recruit enough participants to achieve sufficient validity. However, the advent of the internet now allows this problem to be solved through the creation of megastudies. Yet, this methodology so far has only been used in studies on vocabulary size, while general knowledge, another key component of crystallized intelligence, remains unexamined. In the present study, regression models were used to examine the impact of sociodemographic variables—gender, age, years of study and socioeconomic status—on general knowledge scores. The sample comprised 48,234 participants, each of whom answered 60 general knowledge questions, their data being fully available online. Men were found to score higher than women in general knowledge. Years of study and socioeconomic status acted as strong and weak positive predictors, respectively. Age acted as a strong positive predictor until the age of 50, where it became progressively detrimental. These results are discussed relative to other studies on crystallized intelligence, highlighting the need to study each of its components individually.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Dang Arif Hartono ◽  
Stefanus Angga Badara Prima

While the literature has shown that vocabulary mastery affects reading comprehension, only a few Indonesian researchers investigated this. To narrow this gap, this study aims to: 1) measure Indonesian university students' knowledge of receptive vocabulary, 2) measure their reading comprehension level, and 3) investigate the association between the two variables. The participants in this study were 168 first-year university students from a private university implementing English-medium instruction (EMI). We utilized the updated vocabulary level test to measure their receptive vocabulary size and the IELTS academic reading test to measure their reading comprehension level. The participants mean scores on the updated VLT were 28.73, 26.63, 22.27, 22.42 and 23.12 at the 1,000, 2,000, 3,000, 4,000, and 5,000-word level respectively. Only 34 out of 168 participants could be considered to have a sufficient vocabulary size. On average they scored 16.08 (SD = 7.96) on the IELTS academic reading test, which was roughly equivalent to 5 in IELTS band score. We also found strong and significant correlations between the participants’ scores on the IELTS academic reading test and the updated VLT at all levels, with the largest effect size on the 4,000-word level (r = .71, p .001, BCa 95% CI [0.64, 0.78], r2 = .50). These findings indicated that the participants did not have sufficient vocabulary knowledge and had a low reading proficiency, potentially inhibiting progress in their academic pursuits. We discussed the findings in relation to the teaching of English in EFL, ESL, and EMI contexts. Practical implications of the findings are also discussed.


2017 ◽  
Vol 47 (1) ◽  
pp. 27-57
Author(s):  
Benjamin Thanyawatpokin

In recent years, video games have slowly been gaining more traction as a learning tool in the academic world. Evidence has been shown that video games can be used as tools to support language acquisition. However, studies, which focus on single-player games and their use outside of a classroom environment, are still sparse. This paper investigates single-player video games and their effect on University student reading and vocabulary comprehension in a mixed-method study. The participants in the study included a treatment group of nine second-year university students and a control group of ten second-year university students. All the students were volunteers from the same program and came from the same university. Data taken included vocabulary size and word recognition tests followed by a reading rate and reading comprehension test. In addition to this data, qualitative data in the form of interviews were included to support the findings of the reading and vocabulary tests. Over two months, data taken from subjects suggests reading rate, reading comprehension, and word recognition speeds showed a statistically significant rise. On the other hand, vocabulary size scores showed the treatment group had lower vocabulary sizes. In addition, the diaries show evidence that repeated incidental encounters with the same word and phrase may have played a part in the above-mentioned benefits. Motivation to play the game was also upheld throughout the two months according to the qualitative data. The data suggest that certain dimensions of reading and vocabulary comprehension such as word recognition speed and reading speed can be developed by using video games as a learning support tool.


2019 ◽  
Vol 50 (4) ◽  
pp. 562-578 ◽  
Author(s):  
Dawna Duff

Purpose Vocabulary intervention can improve comprehension of texts containing taught words, but it is unclear if all middle school readers get this benefit. This study tests 2 hypotheses about variables that predict response to vocabulary treatment on text comprehension: gains in vocabulary knowledge due to treatment and pretreatment reading comprehension scores. Method Students in Grade 6 ( N = 23) completed a 5-session intervention based on robust vocabulary instruction (RVI). Knowledge of the semantics of taught words was measured pre- and posttreatment. Participants then read 2 matched texts, 1 containing taught words (treated) and 1 not (untreated). Treated texts and taught word lists were counterbalanced across participants. The difference between text comprehension scores in treated and untreated conditions was taken as a measure of the effect of RVI on text comprehension. Results RVI resulted in significant gains in knowledge of taught words ( d RM = 2.26) and text comprehension ( d RM = 0.31). The extent of gains in vocabulary knowledge after vocabulary treatment did not predict the effect of RVI on comprehension of texts. However, untreated reading comprehension scores moderated the effect of the vocabulary treatment on text comprehension: Lower reading comprehension was associated with greater gains in text comprehension. Readers with comprehension scores below the mean experienced large gains in comprehension, but those with average/above average reading comprehension scores did not. Conclusion Vocabulary instruction had a larger effect on text comprehension for readers in Grade 6 who had lower untreated reading comprehension scores. In contrast, the amount that children learned about taught vocabulary did not predict the effect of vocabulary instruction on text comprehension. This has implications for the identification of 6th-grade students who would benefit from classroom instruction or clinical intervention targeting vocabulary knowledge.


2009 ◽  
Vol 10 (3) ◽  
pp. 82-89
Author(s):  
Janet L. Proly ◽  
Jessica Rivers ◽  
Jamie Schwartz

Abstract Graphic organizers are a research based strategy used for facilitating the reading comprehension of expository text. This strategy will be defined and the evolution and supporting evidence for the use of graphic organizers will be discussed. Various types of graphic organizers and resources for SLPs and other educators will also be discussed.


2011 ◽  
Vol 28 (2) ◽  
pp. 51 ◽  
Author(s):  
Kei Mihara

This study focuses on two pre-reading strategies: vocabulary pre-teaching and comprehension question presentation. Researchers have claimed that a vocabulary strategy is less effective than any other pre-reading strategy. This study investigates whether their claim is true of Japanese university students. The purpose of the study is twofold. The first goal is to examine the effects of the two pre-reading strategies; the second is to discuss the relationships between students’ English proficiency and their reading comprehension. The participants in the present study were asked to perform a pre-reading strategy, read a passage, and then answer comprehension questions. They read four passages altogether. Three weeks after they read the fourth passage, they were asked to answer a questionnaire. This study indicates that vocabulary pre-teaching is less effective for Japanese students, although students with higher English proficiency outperformed lowerlevel students regardless of which pre-reading strategy they used.


Sign in / Sign up

Export Citation Format

Share Document