VALIDITY EVIDENCE: UNDERGRADUATE STUDENTS’ PERCEPTIONS OF TOEFL IBT HIGH SCORE SPOKEN RESPONSES

Author(s):  
Mohammadreza Dalman ◽  
Okim Kang
2019 ◽  
Author(s):  
Patricio Mena-Chamorro ◽  
Rodrigo Ferrer

Background: STIs, principally HIV/AIDS, are public health problems that are transmitted by sexual risk behaviours, which have been associated with the sexual sensation seeking (an specific personality factor). In South American context, there are no measurement instruments with psychometric evidence for their use and, in other contexts, only the Sexual sensation seeking scale (Kalichman et al., 1994) is available, which is outdated in content and validity evidence. The purpose of this work is development a scale, in accordance with contemporary psychometric standards, to assess sexual sensation seeking for South Americans young people and adults. Method: instrumental study, with time-space sampling (n=813) of undergraduate students from the two Chilean cities with the highest rates of HIV. Results: Final scale have 8 items to assess two dimensions: 1) sexual emotions seeking; and 2) tendency to sexual boredom. The identified structure provides adequate levels of reliability (ω> .8; α> .7), presents validity evidence, based on the internal structure of the test, using CFA and ESEM (CFI> .95, TLI> .95, RMSEA <. 06), and based on the convergence with other measures (sexual activity with multiple partners, inadequate or insufficient use of protective barriers and sexual activity under the influence of alcohol or drugs). Conclusions: The Multidimensional Scale of Sexual Sensation Seeking evidence adequate psychometric properties to evaluate the search for sexual sensations in equivalents samples.


2010 ◽  
Vol 27 (3) ◽  
pp. 335-353 ◽  
Author(s):  
Sara Cushing Weigle

Automated scoring has the potential to dramatically reduce the time and costs associated with the assessment of complex skills such as writing, but its use must be validated against a variety of criteria for it to be accepted by test users and stakeholders. This study approaches validity by comparing human and automated scores on responses to TOEFL® iBT Independent writing tasks with several non-test indicators of writing ability: student self-assessment, instructor assessment, and independent ratings of non-test writing samples. Automated scores were produced using e-rater ®, developed by Educational Testing Service (ETS). Correlations between both human and e-rater scores and non-test indicators were moderate but consistent, providing criterion-related validity evidence for the use of e-rater along with human scores. The implications of the findings for the validity of automated scores are discussed.


2015 ◽  
Vol 2 (4) ◽  
Author(s):  
Dr. Rachna Jain ◽  
Ms. Bharti Chaudhary

The purpose of this study was to apply the College Self-Efficacy Inventory (CSEI) scale to measure the social and psychological factors on Indian students. The major research question of the study is to answer whether the CSEI scale fit the data. The sample of the study is 141 in BBA and B.Com (H) first year in affiliated college of Guru Gobind Singh Indraprastha University Delhi. Path analysis has been used in the study to examine the interrelationship between course-roommate-social self-efficacy. To analyse the data correlation, CFI, RMSEA, Cron bach alpha, regression weights, Durbin – Watson test etc. has been used. The study found affirmative steps in collecting validity evidence for the CSEI scale as well as found significant inter – relationship between course-roommate-social self-efficacy of Indian undergraduate students. It has been also found that CSEI scale can be used to measure college self- efficacy for the broader college experience of Indian students.


1998 ◽  
Vol 82 (1) ◽  
pp. 27-31 ◽  
Author(s):  
Kenneth S. Shultz ◽  
Hideya Koshino

Reliability and validity evidence as well as normative data are provided for Wise's 1985 Attitudes Toward Statistics scale for 36 undergraduate and 38 graduate psychology students. In general, the two subscales of Field and Course appear to be reliable and valid measures of these students' attitudes toward statistics. In addition, normative data suggest different norms should be used for graduate and undergraduate students. Replication is needed.


2020 ◽  
pp. 073428292094614
Author(s):  
Jihyun Lee ◽  
Tracy L. Durksen

Using an established global academic interest scale, academic interest dimensions of undergraduate ( n = 326) and graduate ( n = 401) students were compared. The four-factor structure, consisting of passion for learning, confidence in the future, career aspiration, and self-expression, held for both student groups. However, the item scores and mean factor scores as well as the pattern of factor correlations differed between the two groups. While the sample of graduate students exhibited greater levels of passion for learning, the undergraduate students showed higher levels of confidence in the future. Overall, a broad range of correlates of academic interest employed in this study provided construct validity evidence of academic interest, supporting the main tenants of the motivational theory of life-span development. Limitations and directions for future work are discussed.


2018 ◽  
Vol 36 (2) ◽  
pp. 235-263 ◽  
Author(s):  
Lorena Llosa ◽  
Margaret E. Malone

Investigating the comparability of students’ performance on TOEFL writing tasks and actual academic writing tasks is essential to provide backing for the extrapolation inference in the TOEFL validity argument (Chapelle, Enright, & Jamieson, 2008). This study compared 103 international non-native-English-speaking undergraduate students’ performance on two TOEFL iBT® writing tasks with their performance in required writing courses in US universities as measured by instructors’ ratings of student proficiency, instructor-assigned grades on two course assignments, and five dimensions of writing quality of the first and final drafts of those course assignments: grammatical, cohesive, rhetorical, sociopragmatic, and content control. Also, the quality of the writing on the TOEFL writing tasks was compared with the first and final drafts of responses to written course assignments using a common analytic rubric along the five dimensions. Correlations of scores from TOEFL tasks (Independent, Integrated, and the total Writing section) with instructor ratings of students’ overall English proficiency and writing proficiency were moderate and significant. However, only scores on the Integrated task and the Writing section were correlated with instructor-assigned grades on course assignments. Correlations between scores on TOEFL tasks and all dimensions of writing quality were positive and significant, though of lower magnitude for final drafts than for first drafts. The TOEFL scores were most highly correlated with cohesive and grammatical control and had the lowest correlations with rhetorical organization. The quality of the writing on the TOEFL tasks was comparable to that of the first drafts of course assignment but not the final drafts. These findings provide backing for the extrapolation inference, suggesting that the construct of academic writing proficiency as assessed by TOEFL “accounts for the quality of linguistic performance in English-medium institutions of higher education” (Chapelle, Enright, & Jamieson, 2008, p. 21).


2020 ◽  
Vol 43 ◽  
pp. 100420 ◽  
Author(s):  
Johanna Fleckenstein ◽  
Stefan Keller ◽  
Maleika Krüger ◽  
Richard J. Tannenbaum ◽  
Olaf Köller

2021 ◽  
Author(s):  
Lilach Dahoah Dahoah-Halevi

When measuring state body dissatisfaction, it is common for researchers to use idiosyncratic versions of the Body Dissatisfaction – Visual Analogue Scales (BD-VASs). However, the BDVAS variants vary in their scale and psychometric properties and impede comparability of results across studies. This thesis aims to review all available BD-VAS variants and their psychometric properties (Study 1), and empirically study the effects of scale modifications on BD-VASs’ validity and reliability (Study 2). Study 1 revealed a total of 61 BD-VAS variants. Many of these variants were modified for a single study (77%) and had no supporting reliability and validity evidence (39%). In Study 2, 413 female undergraduate students completed one of six BD-VAS versions varying in extremity and scale polarity. Contrary to predictions, the BDVAS variants had comparable score distributions, reliability, and validity evidence. While there is unnecessary variability across BD-VASs, such modifications may not greatly impact responses or study results.


2016 ◽  
Vol 35 (6) ◽  
pp. 599-614 ◽  
Author(s):  
Karen C. H. Zhoc ◽  
Johnson C. H. Li ◽  
Beverley J. Webster

Emotional Intelligence Scale (EIS) is a popular EI measure. Yet, it has been criticized for an unclear factor structure, and its psychometric properties were mainly examined in the Western context. This study was to evaluate its psychometric properties based on 1,724 Hong Kong undergraduate students, including its (a) factor structure, (b) internal consistency, and (c) criterion validity. We compared different factor structures reported in the literature. The confirmatory factor analysis (CFA) results supported a six-factor structure, which is tallied with Salovey and Mayer’s EI conceptualization. A multigroup CFA also rendered the structure as gender invariant. The scale was internally consistent with high McDonald’s omega coefficients. Significant association between EI and grade point average (GPA) was revealed in the faculties with people-oriented studies. Furthermore, EI was correlated with social, cognitive, and self-growth outcomes and satisfaction of university experience. The study contributes to clarify the factor structure and provides new reliability and validity evidence of the EIS in the Eastern context.


Sign in / Sign up

Export Citation Format

Share Document