Three Paradoxical Effects on Academic Self-Concept Across Countries, Schools, and Students

2019 ◽  
Vol 24 (3) ◽  
pp. 231-242 ◽  
Author(s):  
Herbert W. Marsh ◽  
Philip D. Parker ◽  
Reinhard Pekrun

Abstract. We simultaneously resolve three paradoxes in academic self-concept research with a single unifying meta-theoretical model based on frame-of-reference effects across 68 countries, 18,292 schools, and 485,490 15-year-old students. Paradoxically, but consistent with predictions, effects on math self-concepts were negative for: • being from countries where country-average achievement was high; explaining the paradoxical cross-cultural self-concept effect; • attending schools where school-average achievement was high; demonstrating big-fish-little-pond-effects (BFLPE) that generalized over 68 countries, Organisation for Economic Co-operation and Development (OECD)/non-OECD countries, high/low achieving schools, and high/low achieving students; • year-in-school relative to age; unifying different research literatures for associated negative effects for starting school at a younger age and acceleration/skipping grades, and positive effects for starting school at an older age (“academic red shirting”) and, paradoxically, even for repeating a grade. Contextual effects matter, resulting in significant and meaningful effects on self-beliefs, not only at the student (year in school) and local school level (BFLPE), but remarkably even at the macro-contextual country-level. Finally, we juxtapose cross-cultural generalizability based on Programme for International Student Assessment (PISA) data used here with generalizability based on meta-analyses, arguing that although the two approaches are similar in many ways, the generalizability shown here is stronger in terms of support for the universality of the frame-of-reference effects.

2018 ◽  
Vol 39 (1) ◽  
pp. 39-47 ◽  
Author(s):  
Thomas R. Coyle ◽  
Heiner Rindermann ◽  
Dale Hancock ◽  
Jacob Freeman

Abstract. Cognitive capitalism theory argues that the positive effects of cognitive ability on economic productivity should increase nonlinearly, with increases in ability amplifying increases in productivity. The theory was tested using country-level indicators of cognitive ability and productivity. Cognitive ability was based on international student assessments (e.g., Program for International Student Assessment, PISA), and productivity was based on economic inputs (e.g., scientific achievements and competitiveness) and outputs (e.g., gross domestic product). As predicted, the effects of cognitive ability on all productivity measures increased nonlinearly at higher levels of ability, suggesting that higher ability levels disproportionately boost a nation’s productivity. The findings are discussed in light of standard theories of cognitive ability (e.g., Spearman’s law of diminishing returns and differentiation theories), and suggest that interventions that boost cognitive ability can have large, amplifying effects on economic productivity.


2017 ◽  
Vol 25 ◽  
pp. 92 ◽  
Author(s):  
Steven Lewis

This paper examines the Organization for Economic Cooperation and Development’s (OECD) PISA for Schools, a new variant of the Programme for International Student Assessment (PISA) that compares school-level performance on reading, math and science with international schooling systems (e.g., Shanghai-China, Finland). Specifically, I focus here on a professional learning community – the Global Learning Network (GLN) – of U.S. schools and districts that have voluntarily participated in PISA for Schools, and how this, arguably, helps to normatively determine ‘what works’ in education. Drawing suggestively across diverse thinking around contemporary modes of governance, and emerging topological spaces and relations associated with globalization, and informed by interviews with 33 policy actors across the PISA for Schools policy cycle, my analyses suggest that GLN allows the OECD to discursively and normatively constrain how ‘world-class’ schools and systems, and their policies and practices, are defined. However, and in light of the productive capacities of power relations, I also argue that GLN provides opportunities for local educators and leaders to undertake meaningful collaboration and sharing, and to find policy spaces outside of those defined by more performative discursive framings of school accountability. To this end, I explore how GLN may help to foster alternative policy spaces from which educators can ‘talk back’ to national and state authorities, and potentially promote more ‘authentic’ understandings of, and possibilities for, schooling accountability.


2021 ◽  
Vol 62 (2) ◽  
pp. 115-140
Author(s):  
Josef Kuo-Hsun Ma

Despite efforts to improve digital access in schools, a persistent digital divide is identified worldwide. Drawing on data from the 2018 Organisation for Economic Co-operation and Development (OECD) Programme for International Student Assessment (PISA) for 15-year-olds, I examine how students’ digital use for educational purposes (at school and at home) and their perceived digital competence differ between schools by socioeconomic status (SES) and vary across 47 countries. Using multilevel modeling, I find that the second-level digital divide between schools exists even among more developed societies. Students attending high-SES schools are more likely to use computers for schoolwork within and outside of schools, and have more digital competence than those attending low-SES schools. These differences remain substantial and statistically significant even when controlling for school-level resources. Moreover, the between-school digital divide in students’ digital competence is negatively associated with economic development and educational expenditures, and positively associated with income inequality. In conclusion, I discuss implications of the findings and highlight the importance of examining how schools with varying socioeconomic profiles provide different e-learning experiences for individual students, explained by the different institutional settings and cultural features of schools.


Author(s):  
S. Marshall Perry ◽  
Karen M. Sealy ◽  
Héctor X. Ramírez-Pérez ◽  
Thomas C. DeNicola ◽  
Yair Cohen

Connections between principal leadership activities, school context, and student achievement are examined within this paper. Data for this quantitative study are from the 2013 Teaching and Learning International Survey (TALIS) and the 2012 Programme for International Student Assessment (PISA). The eight countries of examination participated in both the TALIS and PISA and the researchers merged datasets, yielding a study sample of 1,301 schools. This paper supports a context-specific view of instructional leadership. When looking across countries, the researchers found different practices were more strongly associated with the academic achievement of students, and suggest that school leaders have a meaningful overall relationship with academic achievement, both directly and indirectly. This study therefore supports prior research about the direct and indirect effects of instructional leadership. Further study, which accounts for differences in family academic resources and school-level opportunities to learn, will better illuminate the connection between instructional leadership practices and academic achievement.


2018 ◽  
Vol 1 (3) ◽  
pp. 69-95 ◽  
Author(s):  
Xiangyi Liao ◽  
Xiaoting Huang

Purpose In recent years, private tutoring has become increasingly prevalent in China and has become both a dominant way for students to learn after school and a major component of family educational expenditure. This paper aims to analyze the factors that affect Chinese students’ participation in private tutoring and the effectiveness of private tutoring. Design/Approach/Methods We use data from the Programme for International Student Assessment (PISA) 2015 of Mainland China area and focus specifically on science-related private tutoring. Multilevel logistic model and hierarchical linear model based on coarsened exact matching (CEM) are used to conduct the investigations. Findings Empirical results show that individual level factors including student's interest in science, educational expectations, and school-level factors such as school autonomy, science-related learning resources and school size pose a significant influence on the likelihood of participation in private tutoring. Moreover, science-related private tutoring has not significantly improved the overall scientific literacy scores of students. In addition, private tutoring has widened the performance gap among students from different socioeconomic backgrounds, with students from socioeconomically advantaged family experiencing more significant gains from tutoring. Originality/Value These findings suggest that providing free high-quality tutoring to students from disadvantaged families might be an effective way of promoting educational equity.


2020 ◽  
Vol 51 (10) ◽  
pp. 794-813
Author(s):  
Jia He ◽  
Joanne M. Chung ◽  
Fons J. R. van de Vijver

This study aims to examine different scale usage correction procedures that are meant to enhance the cross-cultural comparability of Likert scale data. Specifically, we examined a priori study design (i.e., anchoring vignettes and overclaiming) and post hoc statistical procedures (i.e., ipsatization and extreme response style correction) in data from the 2012 Programme for International Student Assessment across 64 countries. We analyzed both original item responses and corrected item scores from two targeted scales in an integrative fashion by using multilevel confirmatory factor analysis and multilevel regressions. Results indicate that mean levels and structural relations varied across the correction procedures, although the psychological meaning of the constructs examined did not change. Furthermore, scores were least affected by these procedures for females who did not repeat a grade and students with higher math achievement. We discuss the implications of our findings and offer recommendations for researchers who are considering scale usage correction procedures.


2018 ◽  
Vol 49 (8) ◽  
pp. 1247-1268 ◽  
Author(s):  
Hana Vonkova ◽  
Ondrej Papajoanu ◽  
Jiri Stipek

The overclaiming technique (OCT) is a novel way of measuring how socially desirable responding influences survey responses. It has the potential to enhance the cross-cultural comparability of survey data. It allows the identification of respondents’ knowledge accuracy and exaggeration by comparing their assessments of familiarity with existing and nonexisting concepts in a particular field of knowledge. We aim to compare the response patterns of countries and world regions based on their OCT accuracy and exaggeration-index values and validate these OCT scores using external variables. We also introduce a general model for the categorization of respondents based on their OCT indices values. We use the Programme for International Student Assessment (PISA) 2012 data from 64 countries ( N = 275,904). We found considerable differences in response patterns across world regions: high accuracy values in East Asia, low accuracy values in Southern and Central America, high exaggeration values in Southern Europe, and low exaggeration values in Western Europe. Furthermore, we show that familiarity with math concepts changes substantially after adjustment using the OCT. The correlation between unadjusted math familiarity and math test scores is weak and nonsignificant (.13) whereas after adjustment the correlation becomes strong and significant (.66). Concerning other indicators such as gross domestic product (GDP), public expenditure in education, and Corruption Perceptions Index (CPI), before adjustment the correlation is negative and even significant for CPI (–.11, –.22, and –.45) whereas after adjustment the correlation becomes, though nonsignificant, positive (.05, .19, and .07). We also discuss the OCT in the context of other methods indicative of culturally preferred scale usage.


Author(s):  
S. Marshall Perry ◽  
Karen M. Sealy ◽  
Héctor X. Ramírez-Pérez ◽  
Thomas C. DeNicola ◽  
Yair Cohen

Connections between principal leadership activities, school context, and student achievement are examined within this paper. Data for this quantitative study are from the 2013 Teaching and Learning International Survey (TALIS) and the 2012 Programme for International Student Assessment (PISA). The eight countries of examination participated in both the TALIS and PISA and the researchers merged datasets, yielding a study sample of 1,301 schools. This paper supports a context-specific view of instructional leadership. When looking across countries, the researchers found different practices were more strongly associated with the academic achievement of students, and suggest that school leaders have a meaningful overall relationship with academic achievement, both directly and indirectly. This study therefore supports prior research about the direct and indirect effects of instructional leadership. Further study, which accounts for differences in family academic resources and school-level opportunities to learn, will better illuminate the connection between instructional leadership practices and academic achievement.


Author(s):  
Betül Alatlı

This study aimed to investigate cross-cultural measurement invariance of the PISA (Programme for International Student Assessment, 2015) science literacy test and items and to carry out a bias study on the items which violate measurement invariance. The study used a descriptive review model. The sample of the study consisted of 2224 students taking the S12 test booklet from Australia, France, Singapore, and Turkey. Measurement invariance analyses for the test were done using Multi-Group Confirmatory Factor Analysis (MGCFA). Differential Item Functioning (DIF), in other words, measurement invariance of the test items, was analyzed using the item response theory log-likelihood ratio (IRTLR), Hierarchical Generalized Linear Model (HGLM), and the Simultaneous Item Bias Test (SIBTEST) methods.According to the findings, the test was determined to exhibit structural invariance across cultures. The highest number of items showing DIF was observed in the comparisons of Australia-Singapore and Australia-France with 35%. The number of items showing DIF, with 24%, determined in bilateral comparisons which included Turkey, the only country taking the translated form among other countries, did not show a significant difference compared to the other comparisons. While the lowest number of items showing DIF was obtained from Singapore-France samples with 12%, the rate of items indicating DIF in the France-Turkey samples was 18%. On the other hand, 35% of the items showed cross cultural measurement invariance. An item bias study was carried out based on expert opinions on items identified and released as showing DIF in the comparisons of Turkey with Australia and Singapore.According to the findings, translation-bound differentiation of the items, familiarity of a culture group with the contents of the items, polysemy in the expressions or words used in the items, the format, or the stylistic characteristics of the items were determined to be the cause of the bias in the skills measured with the items.


Author(s):  
Pei-Yi Lin ◽  
Ching Sing Chai ◽  
Morris Siu-Yung Jong

The aim of the present study is twofold: (1) to identify a factor structure between variables-interest in broad science topics, perceived information and communications technology (ICT) competence, environmental awareness and optimism; and (2) to explore the relations between these variables at the country level. The first part of the aim is addressed using exploratory factor analysis with data from the Program for International Student Assessment (PISA) for 15-year-old students from Singapore and Finland. The results show that a comparable structure with four factors was verified in both countries. Correlation analyses and linear regression were used to address the second part of the aim. The results show that adolescents’ interest in broad science topics can predict perceived ICT competence. Their interest in broad science topics and perceived ICT competence can predict environmental awareness in both countries. However, there is difference in predicting environmental optimism. Singaporean students’ interest in broad science topics and their perceived ICT competences are positive predictors, whereas environmental awareness is a negative predictor. Finnish students’ environmental awareness negatively predicted environmental optimism.


Sign in / Sign up

Export Citation Format

Share Document