Measurement invariance of the Brief Symptom Inventory-18 (BSI-18) across Asian American ethnic, nativity, and gender groups.

It has recently been demonstrated that metrics of structural validity are severely underreported in social and personality psychology. We comprehensively assessed structural validity in a uniquely large and varied data set ( N = 144,496 experimental sessions) to investigate the psychometric properties of some of the most widely used self-report measures ( k = 15 questionnaires, 26 scales) in social and personality psychology. When the scales were assessed using the modal practice of considering only internal consistency, 88% of them appeared to possess good validity. Yet when validity was assessed comprehensively (via internal consistency, immediate and delayed test-retest reliability, factor structure, and measurement invariance for age and gender groups), only 4% demonstrated good validity. Furthermore, the less commonly a test was reported in the literature, the more likely the scales were to fail that test (e.g., scales failed measurement invariance much more often than internal consistency). This suggests that the pattern of underreporting in the field may represent widespread hidden invalidity of the measures used and may therefore pose a threat to many research findings. We highlight the degrees of freedom afforded to researchers in the assessment and reporting of structural validity and introduce the concept of validity hacking ( v-hacking), similar to the better-known concept of p-hacking. We argue that the practice of v-hacking should be acknowledged and addressed.

Download Full-text

Psychometric Properties and Measurement Invariance of the Brief Symptom Inventory-18 Among Chinese Insurance Employees

Frontiers in Psychology ◽

10.3389/fpsyg.2018.00519 ◽

2018 ◽

Vol 9 ◽

Cited By ~ 5

Author(s):

Mingshu Li ◽

Meng-Cheng Wang ◽

Yiyun Shou ◽

Chuxian Zhong ◽

Fen Ren ◽

...

Keyword(s):

Psychometric Properties ◽

Measurement Invariance ◽

Brief Symptom Inventory ◽

Symptom Inventory

Download Full-text

Multigroup CFA and alignment approaches for testing measurement invariance and factor score estimation: Illustration with the schoolwork-related anxiety survey across countries and gender

Methodology ◽

10.5964/meth.2281 ◽

2021 ◽

Vol 17 (1) ◽

pp. 22-38

Author(s):

Jason C. Immekus

Keyword(s):

Measurement Invariance ◽

Large Scale ◽

International Student ◽

Student Assessment ◽

International Studies ◽

Invariance Testing ◽

International Student Assessment ◽

Item Parameters ◽

And Gender ◽

Gender Groups

Within large-scale international studies, the utility of survey scores to yield meaningful comparative data hinges on the degree to which their item parameters demonstrate measurement invariance (MI) across compared groups (e.g., culture). To-date, methodological challenges have restricted the ability to test the measurement invariance of item parameters of these instruments in the presence of many groups (e.g., countries). This study compares multigroup confirmatory factor analysis (MGCFA) and alignment method to investigate the MI of the schoolwork-related anxiety survey across gender groups within the 35 Organisation for Economic Co-operation and Development (OECD) countries (gender × country) of the Programme for International Student Assessment 2015 study. Subsequently, the predictive validity of MGCFA and alignment-based factor scores for subsequent mathematics achievement are examined. Considerations related to invariance testing of noncognitive instruments with many groups are discussed.

Download Full-text

The Academic Buoyancy Scale: Measurement Invariance across Culture and Gender in Egyptian and Omani Undergraduates

European Journal of Educational Research ◽

10.12973/eu-jer.10.4.2121 ◽

2021 ◽

Vol 10 (4) ◽

pp. 2121-2131

Author(s):

Mustafa Ali ◽

Mohammed A.

Keyword(s):

Measurement Invariance ◽

A Priori ◽

Evidence Based ◽

Validity Evidence ◽

Academic Buoyancy ◽

Multiple Group ◽

Confirmatory Factor ◽

Score Reliability ◽

And Gender ◽

Gender Groups

<p style="text-align: justify;">The academic buoyancy scale (ABS) is one of the most widely used instruments for measuring academic buoyancy. To obtain meaningful and valid comparisons across groups using ABS, however, measurement invariance should be ascertained a priori. To that end, we examined its measurement invariance, validity evidence based on relations to other variables, and score reliability using categorical omega across culture and gender among Egyptian and Omani undergraduates. Participants were 345 college students: Egyptian sample (N=191) and Omani sample (N=154). To assess measurement invariance across culture and gender, multiple–group confirmatory factor analysis was performed with four successive invariance models: (a) configural, (b) metric, (c) scalar, and (d) residual. Results revealed that the unidimensional baseline model had adequate fit to the data in the full sample. Moreover, measurement invariance was found to hold across culture but not across gender and consequently the ABS could be used to yield valid cross-cultural comparisons between the Egyptian and Omani students. Conversely, it cannot be used to yield valid inferences related to comparing gender groups within each culture. Validity evidence based on relations to other variables was supported by the significantly moderate correlation between ABS and academic achievement (GPA; r =.435 and r = .457, P < .01) for the Egyptian and Omani samples, respectively. With regard to score reliability, categorical omega coefficients were moderate across both samples. Educational and psychological implications, limitations and suggestions for improving the scale are discussed.</p>

Download Full-text

Testing measurement invariance and latent mean differences across gender groups in college students’ Internet-specific epistemic beliefs

Australasian Journal of Educational Technology ◽

10.14742/ajet.1437 ◽

2015 ◽

Vol 31 (4) ◽

Cited By ~ 6

Author(s):

Yen-Lin Chiu ◽

Chin-Chung Tsai ◽

Jyh-Chong Liang

Keyword(s):

Measurement Invariance ◽

Gender Gap ◽

Structural Equation ◽

Epistemic Beliefs ◽

Equation Modeling ◽

The Internet ◽

And Gender ◽

Mean Differences ◽

Gender Groups ◽

Latent Mean Analysis

<p>The purposes of this study were to investigate the measurement invariance and gender differences in the Internet-specific epistemic beliefs between male and female undergraduates. A total of 735 university students in Taiwan were surveyed using the Internet-specific epistemic beliefs questionnaire (ISEQ). By conducting structural equation modeling (SEM), the measurement invariance and latent mean comparisons across gendered groups were tested. After the invariance tests were all satisfied, the latent mean analysis approach was conducted. The results of the latent mean comparisons revealed that a gender gap occurred in the uncertainty, complexity and source of Internet-specific epistemic beliefs; however no gender difference was found in the justification dimension. In general, the study findings suggest that differences in beliefs regarding Internet-based knowledge exist between undergraduate males and females. The gendered issue of Internet-based learning and epistemic beliefs cannot be ignored. Finally, some suggestions for developing Internet-related curricula and instruction were also proposed.</p>

Download Full-text

Longitudinal Measurement Invariance of the Brief Symptom Inventory (BSI)-18 in Psychotherapy Patients

European Journal of Psychological Assessment ◽

10.1027/1015-5759/a000480 ◽

2020 ◽

Vol 36 (1) ◽

pp. 12-18 ◽

Cited By ~ 1

Author(s):

Ruth von Brachel ◽

Angela Bieda ◽

Jürgen Margraf ◽

Gerrit Hirschfeld

Keyword(s):

Measurement Invariance ◽

Brief Symptom Inventory ◽

Chi Square ◽

Model Comparisons ◽

Longitudinal Measurement Invariance ◽

Symptom Inventory ◽

Longitudinal Measurement ◽

Confirmatory Factor ◽

Mean Differences ◽

Fit Index

Abstract. The Brief Symptom Inventory (BSI)-18 is a widely-used tool to assess changes in general distress in patients despite an ongoing debate about its factorial structure and lack of evidence for longitudinal measurement invariance (LMI). We investigated BSI-18 scores from 1,081 patients from an outpatient clinic collected after the 2nd, 6th, 10th, 18th, and 26th therapy session. Confirmatory factor analysis (CFA) was used to compare models comprising one, three, and four latent dimensions that were proposed in the literature. LMI was investigated using a series of model comparisons, based on chi-square tests, effect sizes, and changes in comparative fit index (CFI). Psychological distress diminished over the course of therapy. A four-factor structure (depression, somatic symptoms, generalized anxiety, and panic) showed the best fit to the data at all measurement occasions. The series of model comparisons showed that constraining parameters to be equal across time resulted in very small decreases in model fit that did not exceed the cutoff for the assumption of measurement in variance. Our results show that the BSI-18 is best conceptualized as a four-dimensional tool that exhibits strict longitudinal measurement invariance. Clinicians and applied researchers do not have to be concerned about the interpretation of mean differences over time.

Download Full-text

Cross-Cultural and Gender Measurement Invariance of the Intrapersonal and Interpersonal Emotional Competence Questionnaire

Psihologijske teme ◽

10.31820/pt.29.1.10 ◽

2020 ◽

Vol 29 (1) ◽

pp. 167-190

Author(s):

Andreja Avsec ◽

Irina Belasheva ◽

Jiri Cenek ◽

Azizuddin Khan ◽

Tamara Mohorić ◽

...

Keyword(s):

Measurement Invariance ◽

Convergent Validity ◽

Emotional Competence ◽

Well Being ◽

Cross Cultural ◽

Men And Women ◽

Emotional Skills ◽

Scalar Invariance ◽

And Gender ◽

Gender Groups

The Intrapersonal and Interpersonal Emotional Competence Questionnaire (IIECQ) was developed from the Emotional Skills and Competence Questionnaire, addressing some of its content issues. Measurement invariance of the two-factor IIECQ model (interpersonal and intrapersonal emotional competence factors) was examined across countries and gender groups using a sample of 998 students from five different countries (Slovenia, Russia, Croatia, India, and theCzech Republic). Our results supported partial scalar invariance of the IIECQ across countries with three items having varying intercepts in different countries. Scalar invariance was fully confirmed across gender groups. Latent means for the two IIECQ factors were compared between the five countries and the two gender groups. While men and women reported similar levels of intrapersonal and interpersonal emotional competences, significant differences were observed between some of the countries. To assess the construct validity of the IIECQ, correlations were examined between the IIECQ subscale scores and the measures of emotion regulation, personality, and well-being. In general, correlations were low to moderate and in accordance with expectations, showing adequate convergent validity of the new scales. Overall, the IIECQ represents a psychometrically sound measure of the intrapersonal and interpersonal emotional competences, which are measured in the same way across the five countries examined as well as across genders.

Download Full-text

Examining factorial structure and measurement invariance of the Brief Symptom Inventory (BSI)-18 among drug users

Addictive Behaviors ◽

10.1016/j.addbeh.2009.08.003 ◽

2010 ◽

Vol 35 (1) ◽

pp. 23-29 ◽

Cited By ~ 43

Author(s):

Jichuan Wang ◽

Brian C. Kelly ◽

Brenda M. Booth ◽

Russel S. Falck ◽

Carl Leukefeld ◽

...

Keyword(s):

Measurement Invariance ◽

Drug Users ◽

Brief Symptom Inventory ◽

Factorial Structure ◽

Symptom Inventory

Download Full-text

Measurement Invariance of the Modified Yale Food Addiction Scale 2.0 Across Gender and Racial Groups

Assessment ◽

10.1177/1073191118786576 ◽

2018 ◽

Vol 27 (2) ◽

pp. 356-364 ◽

Cited By ~ 3

Author(s):

Meagan M. Carr ◽

Erica M. Schulte ◽

Karen K. Saules ◽

Ashley N. Gearhardt

Keyword(s):

Measurement Invariance ◽

Food Addiction ◽

Reference Population ◽

Racial Groups ◽

Heterogeneous Samples ◽

Yale Food Addiction Scale ◽

Confirmatory Factor ◽

And Gender ◽

Gender Groups ◽

Racial Ethnic

Objective: Food addiction reflects a substance use disorder framework, suggesting certain foods (e.g., high-fat, high-sugar foods) may trigger an addictive-like eating response in vulnerable individuals. This study explored whether the Modified Yale Food Addiction Scale 2.0 (mYFAS 2.0), a newly validated and shortened measure of food addiction, is appropriate for use in heterogeneous samples. Assessment of mYFAS 2.0 invariance is essential, as this measure was developed for use as a brief screener in large epidemiological samples that are likely demographically diverse. Method: Multigroup confirmatory factor analysis examined measurement invariance across racial/ethnic (White, Black, and Hispanic) and gender (male, female) groups. Participants were recruited through Qualtrics qBus, which uses demographic quotas to recruit a sample representative of the U.S. census reference population. Individuals were included in analyses if they identified their race/ethnicity as White, Black, or Hispanic ( N = 923). Results: Results supported full and partial measurement invariance across racial and gender groups, respectively. Discussion: Results increase confidence in the generalizability of findings using the mYFAS 2.0 and indicate that observed differences in prevalence rates, such as the higher rates of food addiction observed for women and Hispanic individuals, are likely due to true differences in the population rather than due to measurement bias.

Download Full-text