scholarly journals The comparison of differential item functioning predicted through experts and statistical techniques

2018 ◽  
Vol 13 (2) ◽  
pp. 137-148
Author(s):  
Nuri Doğan ◽  
Ronald K Hambleton ◽  
Meltem Yurtcu ◽  
Sinan Yavuz

Validity is one of the psychometric properties of the achievement tests. To determine the validity, one of the examinations is item bias studies, which are based on Differential Item Functioning (DIF) analyses and field experts’ opinion. In this study, field experts were asked to estimate the DIF levels of the items to compare the estimations obtained from different statistical techniques. Firstly, the experts were asked to examine the questions and make the DIF level estimations according to the gender variable for the DIF estimation, and the agreement of the experts was examined. Secondly, DIF levels were calculated by using logistic regression and the Mantel-Haenszel (MH) statistical method. Thirdly, the experts’ estimations and the statistical analysis results were compared. As a conclusion, it was observed that the experts and the statistical techniques were in agreement among themselves, and they were partially different from each other for the Sciences test and equal for the Social Sciences test. Keywords: Item bias, differential item functioning (DIF), expert estimation.

1982 ◽  
Vol 11 (1) ◽  
pp. 59-74 ◽  
Author(s):  
Edward P. Caffarella

The introductory graduate level educational statistics course at the University of Maine at Orono is taught using an interactive computer system. The students enter the course with no skills in educational statistics nor any skills in the utilization of computers. By the end of the course, the students are proficient in basic statistical techniques used in educational research and in the use of the computer to calculate the statistics. The major computer packages utilized include MSUSTAT Interactive Statistical Analysis Package and the Statistical Package for the Social Sciences.


Author(s):  
Sonia Brito-Costa ◽  
Ana Moisão ◽  
Hugo De Almeida ◽  
Florencio Vicente Castro

This study based on the Five Factor Model of Costa and McCrae (1987) sought to determine theninternal consistency and the psychometric properties of the Ten Item Personality Inventory (TIPI) of Gosling, Rentfrow, & Swann (2003), Lima and Castro (2009) Portuguese version. The sample consisted of 170 male soccer athletes whose average age stood at 18.50 years, with a minimum of 13 and a maximum of 33 years. Statistical analysis was performed by the Statistical Software Package for the Social Sciences (SPSS) in its 19 version for Windows. The TIPI showed low internal consistency (=0.462) and factor analysis that meets the criteria postulated by the instrument authors, so considered it valid to evaluate the personality rapidly in samples with little time available, for example elite athletes.


1997 ◽  
Vol 85 (1) ◽  
pp. 66-66
Author(s):  
Michael C. White ◽  
Rebecca G. Long ◽  
Richard Tansey

A new statistical technique is now being used quite frequently in the behavioral and social sciences but appears to be poorly understood due to undue reliance perhaps on explanations in statistical packages.


Psych ◽  
2020 ◽  
Vol 2 (1) ◽  
pp. 44-51
Author(s):  
Vladimir Shibaev ◽  
Andrei Grigoriev ◽  
Ekaterina Valueva ◽  
Anatoly Karlin

National IQ estimates are based on psychometric measurements carried out in a variety of cultural contexts and are often obtained from Raven’s Progressive Matrices tests. In a series of studies, J. Philippe Rushton et al. have argued that these tests are not biased with respect to ethnicity or race. Critics claimed their methods were inappropriate and suggested differential item functioning (DIF) analysis as a more suitable alternative. In the present study, we conduct a DIF analysis on Raven’s Standard Progressive Matrices Plus (SPM+) tests administered to convenience samples of Yakuts and ethnic Russians. The Yakuts scored lower than the Russians by 4.8 IQ points, a difference that can be attributed to the selectiveness of the Russian sample. Data from the Yakut (n = 518) and Russian (n = 956) samples were analyzed for DIF using logistic regression. Although items B9, B10, B11, B12, and C11 were identified as having uniform DIF, all of these DIF effects can be regarded as negligible (R2 <0.13). This is consistent with Rushton et al.’s arguments that the Raven’s Progressive Matrices tests are ethnically unbiased.


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Lisong Zhang ◽  
Zhongquan Li

Abstract Background The aging population increases rapidly across the world. Timely and effective screening of their mental-health problems is important to individuals, families, and the whole society. The Kessler-6 screening measure (K6) is a very popular instrument for non-specific psychological distress. However, few studies have focused on the psychometric properties of this instrument in the older population. Methods The present study employed Mokken scale analysis to evaluate its dimensionality and structure. This study also used differential item functioning (DIF) to examine whether the same structure existed across sex in a national representative sample of old Chinese people. Data were drawn from a public data set, the 2010 China Family Panel Studies (CFPS2010), and responses from a total of 6450 participants aged 60 years old and above (3136 males and 3314 females) were included in the final analysis. Results Mokken scale analysis supported the unidimensional structure of the K6. Differential item functioning (DIF) analysis revealed that two of the six items (“Hopeless” and “Everything was an effort”) were marked for DIF based on the Chi-square. However, their impacts were negligible in terms of McFadden’s pseudo R2. Conclusions The K6 demonstrates adequate psychometric properties in the old Chinese population. The sum of all six items can be used as an indicator of non-specific psychological distress. Differences in the indicator across sex should be considered as a real difference in psychological distress between the female and the male.


Sign in / Sign up

Export Citation Format

Share Document