MEASUREMENT INVARIANCE OF PISA 2018 MOTIVATIONAL CONSTRUCTS ACROSS EU COUNTRIES

Author(s):  
Saulė Raižienė ◽  
Laura Ringienė ◽  
Inga Laukaityte ◽  
Audronė Jakaitienė
2020 ◽  
Vol 36 (5) ◽  
pp. 777-786 ◽  
Author(s):  
Julia Waldeyer ◽  
Jens Fleischer ◽  
Joachim Wirth ◽  
Detlev Leutner

Abstract. There is substantial evidence that students in higher education who have sophisticated resource-management skills are more successful in their studies. Nevertheless, research shows that students are often not adequately prepared to use resource-management strategies effectively. It is thus crucial to screen and identify students who are at risk of poor resource management (and consequently, reduced academic achievement) to provide them with appropriate support. For this purpose, we extend the validation of a situational-judgment-based instrument called Resource-Management Inventory (ReMI), which assesses resource-management competency (including knowledge of resource-management strategies and the self-reported ability to use this knowledge in learning situations). We evaluated the ReMI regarding factor structure, measurement invariance, and its impact on academic achievement in different study domains in a sample of German first-year students ( N = 380). The results confirm the five-factor structure that has been found in a previous study and indicate strong measurement invariance. Furthermore, taking cognitive covariates into account, the results confirm that the ReMI can predict students’ grades incrementally. Finally, a multi-group analysis shows that the findings can be generalized across different study domains. Overall, we provide evidence for a valid and efficient instrument for the assessment of resource-management competency in higher education.


2019 ◽  
Vol 35 (6) ◽  
pp. 771-778 ◽  
Author(s):  
Bernhard Piskernik ◽  
Barbara Supper ◽  
Lieselotte Ahnert

Abstract. While parenting research continues to compare similarities and differences in mothers’ and fathers’ behaviors based on mean values on the respective dimensions, measurement invariance as a prerequisite for these comparisons has seldom been assured. The present study thus subjected the well-known Parenting Stress Index (PSI), widely used in models of family functioning, to a rigorous measurement invariance analysis based on ( N = 214) Austrian couples with children younger than 3 years of age. We evaluated configural, metric, scalar, and uniqueness invariance on item and subscale levels, and tested for structural invariance of means and variances of the PSI parent and child domain by second-order confirmatory factor analyses. As a result, only measurement differences on the scalar levels affected the factor scores, though negligibly. On the structural levels, no differences were found on the PSI child domain across parents, but on the PSI parent domain, mothers reported more stress.


2018 ◽  
Vol 34 (2) ◽  
pp. 87-100 ◽  
Author(s):  
Gino Casale ◽  
Robert J. Volpe ◽  
Brian Daniels ◽  
Thomas Hennemann ◽  
Amy M. Briesch ◽  
...  

Abstract. The current study examines the item and scalar equivalence of an abbreviated school-based universal screener that was cross-culturally translated and adapted from English into German. The instrument was designed to assess student behavior problems that impact classroom learning. Participants were 1,346 K-6 grade students from the US (n = 390, Mage = 9.23, 38.5% female) and Germany (n = 956, Mage = 8.04, 40.1% female). Measurement invariance was tested by multigroup confirmatory factor analysis (CFA) across students from the US and Germany. Results support full scalar invariance between students from the US and Germany (df = 266, χ2 = 790.141, Δχ2 = 6.9, p < .001, CFI = 0.976, ΔCFI = 0.000, RMSEA = 0.052, ΔRMSEA = −0.003) indicating that the factor structure, the factor loadings, and the item thresholds are comparable across samples. This finding implies that a full cross-cultural comparison including latent factor means and structural coefficients between the US and the German version of the abbreviated screener is possible. Therefore, the tool can be used in German schools as well as for cross-cultural research purposes between the US and Germany.


2009 ◽  
Vol 25 (1) ◽  
pp. 1-7 ◽  
Author(s):  
Jörg-Tobias Kuhn ◽  
Heinz Holling

The present study explores the factorial structure and the degree of measurement invariance of 12 divergent thinking tests. In a large sample of German students (N = 1328), a three-factor model representing verbal, figural, and numerical divergent thinking was supported. Multigroup confirmatory factor analyses revealed that partial strong measurement invariance was tenable across gender and age groups as well as school forms. Latent mean comparisons resulted in significantly higher divergent thinking skills for females and students in schools with higher mean IQ. Older students exhibited higher latent means on the verbal and figural factor, but not on the numerical factor. These results suggest that a domain-specific model of divergent thinking may be assumed, although further research is needed to elucidate the sources that negatively affect measurement invariance.


2018 ◽  
Vol 34 (5) ◽  
pp. 352-360 ◽  
Author(s):  
Silvia Bonino ◽  
Federica Graziano ◽  
Martina Borghi ◽  
Davide Marengo ◽  
Giorgia Molinengo ◽  
...  

Abstract. This research developed a new scale to evaluate Self-Efficacy in Multiple Sclerosis (SEMS). The aim of this study was to investigate dimensionality, item functioning, measurement invariance, and concurrent validity of the SEMS scale. Data were collected from 203 multiple sclerosis (MS) patients (mean age, 39.5 years; 66% women; 95% having a relapsing remitting form of MS). Fifteen items of the SEMS scale were submitted to patients along with measures of psychological well-being, sense of coherence, depression, and coping strategies. Data underwent Rasch analysis and correlation analysis. Rasch analysis indicates the SEMS as a multidimensional construct characterized by two correlated dimensions: goal setting and symptom management, with satisfactory reliability coefficients. Overall, the 15 items reported acceptable fit statistics; the scale demonstrated measurement invariance (with respect to gender and disease duration) and good concurrent validity (positive correlations with psychological well-being, sense of coherence, and coping strategies and negative correlations with depression). Preliminary evidence suggests that SEMS is a psychometrically sound measure to evaluate perceived self-efficacy of MS patients with moderate disability, and it would be a valuable instrument for both research and clinical applications.


2018 ◽  
Vol 34 (4) ◽  
pp. 238-246 ◽  
Author(s):  
Iris A. M. Smits ◽  
Meinou H. C. Theunissen ◽  
Sijmen A. Reijneveld ◽  
Maaike H. Nauta ◽  
Marieke E. Timmerman

Abstract. The Strengths and Difficulties Questionnaire (SDQ) is a popular screening instrument for the detection of social-emotional and behavioral problems in children in community and clinical settings. To sensibly compare SDQ scores across these settings, the SDQ should measure psychosocial difficulties and strengths in the same way across community and clinical populations, that is, the SDQ should be measurement invariant across both populations. We examined whether measurement invariance of the parent version of the SDQ holds using data from a community sample (N = 707) and a clinical sample (N = 931). The results of our analysis suggest that measurement invariance of the SDQ parent version across community and clinical populations is tenable, implying that one can compare the SDQ scores of children across these populations. This is a favorable result since it is common clinical practice to interpret the scores of a clinical individual relative to norm scores that are based on community samples. The findings of this study support the continued use of the parent version of the SDQ in community and clinical settings.


2020 ◽  
Vol 36 (4) ◽  
pp. 670-680 ◽  
Author(s):  
Bojana M. Dinić ◽  
Aleksandar Vujić

Abstract. The aim of this research was to explore measurement invariance across samples from Serbia and the USA (Study 1) and to further validate the Serbian adaptation of the Pathological Narcissism Inventory – PNI (Study 2). The results supported the original seven-factor first-order structure as well as the hierarchical structure of the PNI with Narcissistic grandiosity and vulnerability as the second-order factors. Further, scalar invariance between the two versions of the PNI was achieved. Relations between Narcissistic grandiosity and vulnerability and other measures of grandiose and hypersensitive narcissism supported the validity of their scores. Among HEXACO traits, both Narcissistic grandiosity and vulnerability showed substantial negative correlations with Honesty-Humility. The main distinctions between the two aspects of narcissism lie in the positive relations with Neuroticism and negative relations with self-esteem, both of which are higher for Narcissistic vulnerability. The results support good psychometric properties of the PNI scores and add to the PNI’s cross-cultural validity.


2016 ◽  
Vol 32 (4) ◽  
pp. 265-272 ◽  
Author(s):  
Mohsen Joshanloo ◽  
Ali Bakhshi

Abstract. This study investigated the factor structure and measurement invariance of the Mroczek and Kolarz’s scales of positive and negative affect in Iran (N = 2,391) and the USA (N = 2,154), and across gender groups. The two-factor model of affect was supported across the groups. The results of measurement invariance testing confirmed full metric and partial scalar invariance of the scales across cultural groups, and full metric and full scalar invariance across gender groups. The results of latent mean analysis revealed that Iranians scored lower on positive affect and higher on negative affect than Americans. The analyses also showed that American men scored significantly lower than American women on negative affect. The significance and implications of the results are discussed.


Methodology ◽  
2018 ◽  
Vol 14 (4) ◽  
pp. 177-188 ◽  
Author(s):  
Martin Schultze ◽  
Michael Eid

Abstract. In the construction of scales intended for the use in cross-cultural studies, the selection of items needs to be guided not only by traditional criteria of item quality, but has to take information about the measurement invariance of the scale into account. We present an approach to automated item selection which depicts the process as a combinatorial optimization problem and aims at finding a scale which fulfils predefined target criteria – such as measurement invariance across cultures. The search for an optimal solution is performed using an adaptation of the [Formula: see text] Ant System algorithm. The approach is illustrated using an application to item selection for a personality scale assuming measurement invariance across multiple countries.


Sign in / Sign up

Export Citation Format

Share Document