Further Validation and Cross-Cultural Replication of the Video Game Demand Scale

2020 ◽  
pp. 1-10 ◽  
Author(s):  
Kevin Koban ◽  
Nicholas D. Bowman
Keyword(s):  
Measurement Invariance ◽  
Video Game ◽  
Need Satisfaction ◽  
Cross Cultural ◽  
German Language ◽  
Partial Metric ◽  
Task Load ◽  
Cultural Research ◽  
Validity Tests ◽  
Future Work

Abstract. The Video Game Demand Scale (VGDS) is a 26-item, five-factor scale designed to assess the cognitive, emotional, physical, and social demands experienced by video game players. Given the international relevance of video games, cross-cultural research focusing on gamers beyond the US community holds promise to substantiate and refine extant approaches. The current study introduces a German-language VGDS, which was tested for measurement invariance with respect to the original US scale as well as predictive, convergent, and concurrent validity (replicating the original VGDS validity tests). Results revealed configural and partial metric measurement invariance when compared with data from the original scale. Validity tests between the German-language VGDS and common measures of task load, entertainment, need satisfaction, and game ratings largely replicated original results. Overall, we conclude that the VGDS is a reliable, valid, and useful contribution to media psychological game research and suggest areas of future work for which an interactivity-as-demand focus might benefit.

Measurement Invariance of a Universal Behavioral Screener Across Samples From the USA and Germany

2018 ◽  
Vol 34 (2) ◽  
pp. 87-100 ◽  
Author(s):  
Gino Casale ◽  
Robert J. Volpe ◽  
Brian Daniels ◽  
Thomas Hennemann ◽  
Amy M. Briesch ◽  
...  
Keyword(s):  
Measurement Invariance ◽  
Student Behavior ◽  
Cross Cultural ◽  
Cross Cultural Comparison ◽  
School Based ◽  
Cultural Research ◽  
Universal Screener ◽  
Confirmatory Factor ◽  
The Us ◽  
The Usa

Abstract. The current study examines the item and scalar equivalence of an abbreviated school-based universal screener that was cross-culturally translated and adapted from English into German. The instrument was designed to assess student behavior problems that impact classroom learning. Participants were 1,346 K-6 grade students from the US (n = 390, Mage = 9.23, 38.5% female) and Germany (n = 956, Mage = 8.04, 40.1% female). Measurement invariance was tested by multigroup confirmatory factor analysis (CFA) across students from the US and Germany. Results support full scalar invariance between students from the US and Germany (df = 266, χ2 = 790.141, Δχ2 = 6.9, p < .001, CFI = 0.976, ΔCFI = 0.000, RMSEA = 0.052, ΔRMSEA = −0.003) indicating that the factor structure, the factor loadings, and the item thresholds are comparable across samples. This finding implies that a full cross-cultural comparison including latent factor means and structural coefficients between the US and the German version of the abbreviated screener is possible. Therefore, the tool can be used in German schools as well as for cross-cultural research purposes between the US and Germany.

scholarly journals Analyzing Measurement Invariance of the Students’ Engagement Instrument Brief Version: The Cases of Denmark, Finland, and Portugal

2017 ◽  
Vol 33 (4) ◽  
pp. 297-313 ◽  
Author(s):  
T. E. Virtanen ◽  
P. Moreira ◽  
H. Ulvseth ◽  
H. Andersson ◽  
S. Tetler ◽  
...  
Keyword(s):  
Student Engagement ◽  
Measurement Invariance ◽  
Cross Cultural ◽  
School Contexts ◽  
Invariance Testing ◽  
National School ◽  
Cultural Research ◽  
Cross Cultural Research ◽  
Different Levels ◽  
Cross National

The promotion of students’ engagement with school is an internationally acknowledged challenge in education. There is a need to examine the structure of the concept of student engagement and to discover the best practices for fostering it across societies. That is why the cross-cultural invariance testing of students’ engagement measures is highly needed. This study aimed, first, to find the reduced set of theoretically valid items to represent students’ affective and cognitive engagement forming the Brief-SEI (brief version of the Student Engagement Instrument; SEI). The second aim was to test the measurement invariance of the Brief-SEI across three countries (Denmark, Finland, and Portugal). A total of 4,437 seventh-grade students completed the SEI questionnaires in the three countries. The analyses revealed that of the total 33 original instrument items, 15 items indicated acceptable psychometric properties of the Brief-SEI. With these 15 items, cross-national factorial validity and invariances across genders and students with different levels of academic performance (samples from Finland and Portugal) were demonstrated. This article discusses the utility of the Brief-SEI in cross-cultural research and its applicability in different national school contexts.

scholarly journals Cultural concepts of parenting. A linguistic analysis

2006 ◽  
Vol 29 (4) ◽  
Author(s):  
Elke Hentschel ◽  
Heidi Keller
Keyword(s):  
Parental Care ◽  
Cross Cultural ◽  
German Language ◽  
Modal Particles ◽  
Central Focus ◽  
Cultural Concepts ◽  
Cultural Research ◽  
Cross Cultural Research ◽  
Low Incidence ◽  
Parenting Behaviours

This study is part of a larger cross cultural research project on "parenting ethnotheories", where mothers of three months old infants were interviewed about their ideas on good parental care for small babies. They were confronted with picture cards, displaying different parenting behaviours from their own cultural community and were asked to comment on the appropriateness and inappropriateness of such behaviour. This paper addresses 40 of the German language interviews with a total 78,484 words. The central focus of this analysis is the frequency and distribution of modal particles as used in these interviews and as compared to two other corpora with a total of 60,000 words. The results indicate substantial differences with respect to the most frequently used particles, which can be explained by the attitudes of these women towards the particular topic being addressed in the interviews. The particle halt was used 17 times more often, whereas the usually very frequent doch was used 16 times less than usual. Based on the meaning of these particles in the German language, conclusions can be drawn concerning the more or less conscious representation of parenting ideas. The women interviewed regarded their ideas as unchangeable (as expressed in halt) and are convinced that others share their worldview (as expressed in the low incidence of doch).

Methodological Issues in Cross-Cultural Large-Survey Research on Violence

1993 ◽  
Vol 8 (3) ◽  
pp. 199-215 ◽  
Author(s):  
Rosemary Gartner
Keyword(s):  
Survey Data ◽  
Social Factors ◽  
Cross Cultural ◽  
Cultural Perspective ◽  
Methodological Issues ◽  
Cultural Research ◽  
Cross Cultural Research ◽  
Large Survey ◽  
Future Work ◽  
Existing Data

Researchers concur on the importance of a cross-cultural perspective for understanding and preventing violence, but not on the particular analytic strategy that should inform such a perspective. This paper examines the actual and potential contributions of one of the dominant analytic strategies in cross-cultural research on violence: research based on large-survey data. I review the major sources of large-survey data, and evaluate these data and the research based on them. I then suggest directions for future work that could compensate for limitations of existing data and research. In particular, I argue for two innovations: (1) development of new sources of cross-cultural survey data on violence based on sub-national sampling units, and (2) multilevel strategies that would balance within-society and between-society analyses and examine intervening mechanisms linking macro-social factors with violent outcomes.

scholarly journals Compiling Measurement Invariant Short Scales in Cross–Cultural Personality Assessment Using Ant Colony Optimization

2020 ◽  
Vol 34 (3) ◽  
pp. 470-485 ◽  
Author(s):  
Kristin Jankowsky ◽  
Gabriel Olaru ◽  
Ulrich Schroeders
Keyword(s):  
Ant Colony Optimization ◽  
Measurement Invariance ◽  
Large Scale ◽  
Sampling Procedure ◽  
Cross Cultural ◽  
Ant Colony ◽  
Implicit Assumption ◽  
Cultural Research ◽  
Cross Cultural Research ◽  
Item Sampling

Examining the influence of culture on personality and its unbiased assessment is the main subject of cross–cultural personality research. Recent large–scale studies exploring personality differences across cultures share substantial methodological and psychometric shortcomings that render it difficult to differentiate between method and trait variance. One prominent example is the implicit assumption of cross–cultural measurement invariance in personality questionnaires. In the rare instances where measurement invariance across cultures was tested, scalar measurement invariance—which is required for unbiased mean–level comparisons of personality traits—did not hold. In this article, we present an item sampling procedure, ant colony optimization, which can be used to select item sets that satisfy multiple psychometric requirements including model fit, reliability, and measurement invariance. We constructed short scales of the IPIP–NEO–300 for a group of countries that are culturally similar (USA, Australia, Canada, and UK) as well as a group of countries with distinct cultures (USA, India, Singapore, and Sweden). In addition to examining factor mean differences across countries, we provide recommendations for cross–cultural research in general. From a methodological perspective, we demonstrate ant colony optimization's versatility and flexibility as an item sampling procedure to derive measurement invariant scales for cross–cultural research. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology

scholarly journals Testing measurement invariance across groups: applications in cross-cultural research.

2010 ◽  
Vol 3 (1) ◽  
pp. 111-130 ◽  
Author(s):  
Taciano L. Milfont ◽  
Ronald Fischer
Keyword(s):  
Factor Analysis ◽  
Measurement Invariance ◽  
Psychological Research ◽  
Cross Cultural ◽  
Methodological Issues ◽  
Psychological Variables ◽  
Invariance Testing ◽  
Cultural Research ◽  
Confirmatory Factor ◽  
Cross Cultural Research

Researchers often compare groups of individuals on psychological variables. When comparing groups an assumption is made that the instrument measures the same psychological construct in all groups. If this assumption holds, the comparisons are valid and differences/similarities between groups can be meaningfully interpreted. If this assumption does not hold, comparisons and interpretations are not fully meaningful. The establishment of measurement invariance is a prerequisite for meaningful comparisons across groups. This paper first reviews the importance of equivalence in psychological research, and then the main theoretical and methodological issues regarding measurement invariance within the framework of confirmatory factor analysis. A step-by-step empirical example of measurement invariance testing is provided along with syntax examples for fitting such models in LISREL.

Consequences of Not Conducting Measurement Invariance Tests in Cross-Cultural Studies: A Review of Current Research Practices and Recommendations

2019 ◽  
Vol 21 (4) ◽  
pp. 466-483
Author(s):  
Shinhee Jeong ◽  
Yunsoo Lee
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Human Resource Development ◽  
Measurement Invariance ◽  
Human Resource ◽  
Cross Cultural ◽  
Measurement Models ◽  
Cultural Research ◽  
Confirmatory Factor ◽  
Cross Cultural Research

The Problem Cross-cultural research has received substantial attention from both academia and practice as it contributes to expand current theory and implements culturally successful human resource strategies. Although the quantity of this type of research has increased, several researchers have raised methodological concerns that the majority of cross-cultural research has simply assumed or ignored measurement invariance. The Solution In this article, we first provide the meaning for measurement invariance, discuss why it is important, and then explain stepwise confirmatory factor analysis procedures to test measurement invariance. We also diagnose the current research practice in the field of human resource development (HRD) based on a review of cross-cultural, comparative research published in the major HRD journals. Finally, we demonstrate that the group difference test results that have been found without ensuring measurement invariance can, in fact, be false. The Stakeholders This article contributes to the HRD literature and practice in two ways. First, HRD researchers are invited to recognize the importance of sophisticated research methodology, such as measurement invariance, and to examine item bias across different groups so they can make a meaningful and valid comparison. The same attention is advisable to any practitioner who attempts to identify group differences using multinational/cultural data. This article also provides HRD scholars and practitioners with specific multigroup confirmatory factor analysis (MGCFA) procedures to facilitate empirical tests of measurement models across different groups and thus disseminate the methodological advances in the field of HRD. It is our hope that the present article raises awareness, circulates relevant knowledge, and encourages more HRD scholars to think critically about measurement.

Linguistic Equivalence, Construct Validity, But Lack Measurement Invariance: An Illustration of Challenges in Cross-Cultural Research on Adolescent Adjustment

2020 ◽  
Vol 54 (4) ◽  
pp. 323-345 ◽  
Author(s):  
Tony Xing Tan ◽  
Zhiyao Yi ◽  
Eunsook Kim ◽  
Zhengjie Li ◽  
Ke Cheng
Keyword(s):  
Construct Validity ◽  
Measurement Invariance ◽  
Behavioral Assessment ◽  
Negative Attitude ◽  
The United States ◽  
Cross Cultural ◽  
Self Report ◽  
Adolescent Adjustment ◽  
Cultural Research ◽  
Cross Cultural Research

In this study, we illustrated issues related to measure invariance in cross-cultural research involving instrument translation between Chinese and English. We translated and back-translated the third edition of the Behavioral Assessment for Children-Self Report of Personality (BASC-3-SRP) and administered it to 1,574 youth in China and 512 youth in the United States. We found that despite a rigorous approach to achieving linguistic equivalence, statistically demonstrating acceptable internal consistency and construct validity, measurement invariance tests revealed that six of the 16 BASC-3-SRP subscales lacked measurement invariance. Constructs for the first three of the six subscales that lacked measurement invariance (i.e., Negative Attitude toward School, Negative Attitude toward Teachers, and Self-Esteem) are known to be conceptualized differently in collectivistic societies, while constructs for the second three subscales (i.e., Atypicality, Sense of Inadequacy, and Hyperactivity) lacked measurement invariance without known cultural reasons. These results highlight instrument development issues and measurement variance issues that cross-cultural researchers must grapple with.

scholarly journals The Necessity of Testing Measurement Invariance in Cross-Cultural Research: On Potential Bias in Cross-Cultural Comparisons with Individualism–Collectivism Self-Report Scales

2021 ◽  
Author(s):  
David Lacko ◽  
Jiří Čeněk ◽  
Jaroslav Točík ◽  
Andreja Avsec ◽  
Vladimir Đorđević ◽  
...  
Keyword(s):  
Measurement Invariance ◽  
Cross Cultural ◽  
Equation Modeling ◽  
Potential Bias ◽  
Modeling Framework ◽  
Arithmetic Means ◽  
Cultural Research ◽  
Individualism And Collectivism ◽  
Cross Cultural Research ◽  
Cultural Comparisons

Individualism and collectivism are some of the most widely applied concepts in cultural and cross-cultural research. They are commonly applied by scholars who use arithmetic means or sum indexes of items on a scale to examine the potential similarities and differences in samples from various countries. For many reasons, cross-cultural research implicates numerous methodological and statistical pitfalls. The aim of this article is to summarize some of those pitfalls, particularly the problem of measurement (non)invariance, which stems from the different understandings of questionnaire items or even different character of constructs between countries. This potential bias (i.e., systematic measurement error) is reduced by latent mean comparisons performed with Multigroup Confirmatory Factor Analysis and the Measurement Invariance procedure within a Structural Equation Modeling framework. These procedures have been neglected by many researchers in the field of cross-cultural psychology, however. In this article we compare “traditional” (comparison of arithmetic means) and “invariant” (latent means comparisons) approaches. Both approaches are demonstrated with data gathered on an Independent and Interdependent Self-Scale from 1386 participants across six countries (Slovenia, Croatia, Bosnia and Herzegovina, Serbia, Macedonia, and Albania). Our results revealed considerable differences between the “invariant” and “traditional” approach, especially in post-hoc analyses. Since “invariant” results can be considered less biased, this finding suggests that the currently prevalent method of comparing the arithmetic means of cross-cultural scales of individualism and collectivism can potentially cause systematically biased results. As we demonstrate, the evaluation of measurement invariance properties of scales used in cross-cultural research has the potential to improve the validity of cross-cultural comparisons of individualism and collectivism.

Sign in / Sign up

Export Citation Format

Share Document