Measurement validity in cross-cultural comparative research

2008 ◽  
Vol 17 (3) ◽  
pp. 211-220 ◽  
Author(s):  
Martin Prince
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Measurement Invariance ◽  
Comparative Research ◽  
Cross Cultural ◽  
Research Translation ◽  
Factor Loadings ◽  
Criterion Validation ◽  
Recent Developments ◽  
Measurement Validity

SummaryBackground – The purpose of this article is to review the procedures to establish measurement validity in crosscultural comparative research, including recent developments in the quantitative assessment of cross-cultural construct validity. Methods – A narrative review, illustrated by selected examples, of methods in four areas – formative conceptual research, translation and adaptation, criterion validity and construct validity. Results – Valid assessment across cultures requires qualitative research to investigate the cultural relevance of the construct, a careful translation and adaptation of a common measure, followed by pre-testing and cognitive interviews on the populations to be tested. Full criterion validation across diverse cultures may be a chimera given the difficulty in establishing a universally applicable ‘gold standard'. Quantitative analyses can, however, have a part to play in establishing construct validity across cultures. Scale internal consistency, inter-item and item-total correlations and test-retest reliability provide basic support for the viability of a measure in a new cultural setting. Exploratory factor analysis can be used to compare factors and factor loadings. The hypothesis of ‘measurement invariance’ across countries and cultures can be tested explicitly using confirmatory factor analysis (common underlying factors and factor loadings) and Rasch models (common hierarchality of items). Despite measurement invariance, threshold effects arising from cultural differences in norms, or expectations, or expressions of mental distress may still be a problem. Conclusions – There are few examples in the cross-cultural mental health literature of demonstrably valid culture-fair comparison. Much more, could, in principle, be done either to demonstrate measurement invariance, or to identify and explore sources of heterogeneity.Declaration of Interest: None.

Statistical Techniques for Making Cross-Cultural Comparisons on Organizational Instruments

2021 ◽  
pp. 70-80
Author(s):  
Tanesia R. Beverly
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Measurement Invariance ◽  
Measurement Equivalence ◽  
Cross Cultural ◽  
Necessary Condition ◽  
Confirmatory Factor ◽  
Cultural Comparisons ◽  
Mean Differences ◽  
Psychological Instruments

Researchers tend to evaluate psychological instruments in terms of reliability (internal consistency) and construct validity (exploratory factor analysis and confirmatory factor analysis). In many instances, these instruments are used for cross-cultural comparisons such as gender and race—however, many of these studies do not provide evidence of measurement invariance or measurement equivalence. Measurement equivalence is a statistical property of an instrument that indicates that participants interpret and respond to the items similarly or that the same latent construct is being measured across observed groups of people. Partial measurement equivalence is a necessary condition for comparing latent mean differences across cultures. This area of construct validity is often neglected in the literature; therefore, this chapter aims to introduce the concept of measurement invariance. Additionally, it highlights the necessity of testing for measurement invariance when making cross-cultural comparisons on organizational leadership instruments.

Development of the destination food image scale (DFIS) and examination of measurement invariance by gender

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Hakan Görür ◽  
Cem Oktay Güzeller
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Scale Development ◽  
Construct Validity ◽  
Measurement Invariance ◽  
Content Type ◽  
Scale Adaptation ◽  
Confirmatory Factor ◽  
Food Image ◽  
Image Component

PurposeThe main purpose of this study is to create a reliable and valid scale to assess the destination food image perceived by the tourists regarding the food in Turkey within the cognitive and affective image component framework. In line with this purpose, both scale development and scale adaptation studies are conducted, and measurement invariance of the scale for gender is analyzed.Design/methodology/approachThis study uses the survey model among quantitative research methods. Scale development processes are used to assess the cognitive image; the construct validity is analyzed with exploratory factor analysis (n = 328), confirmatory factor analysis (n = 425) and convergent and discriminant validity. Scale adaptation processes are followed to assess the affective image, and construct validity is tested with confirmatory factor analysis (n = 425). The reliability of both scales is investigated with Cronbach's alpha. Cochran–Mantel–Haenszel (CMH) analysis is conducted for measurement invariance for gender.FindingsConstruct validity and reliability provided the desired values in all processes. Measurement invariance results proved that the scale does not change according to genders.Research limitations/implicationsThe data obtained in this study have geographical limitations, and the data represent tourists visiting Antalya, an important tourism destination in Turkey.Practical implicationsThe scale will provide concrete information about the destination food image and help practitioners to test the model and develop future strategies for the destination.Originality/valueThis study presents an integrated approach to understanding the destination food image and expands theoretical and empirical evidence by creating a scale that measures both cognitive and affective image component. Scale-invariant shows that there is no item bias for analyzed gender and contributes to generalizability.

Validation of a Chinese Version of the Attitudes Toward Prisoners Scale

2019 ◽  
Vol 99 (5) ◽  
pp. 614-635
Author(s):  
Wing Hong Chui ◽  
Kevin Kwok-yin Cheng
Keyword(s):  
Factor Analysis ◽  
Hong Kong ◽  
Construct Validity ◽  
Psychometric Properties ◽  
Exploratory Factor Analysis ◽  
Factor Structure ◽  
Cross Cultural ◽  
Chinese Version ◽  
One Dimensional ◽  
Dimensional Spectrum

Using a Hong Kong–sourced sample of participants, this study set out to validate the Chinese version of the Attitudes Toward Prisoners (ATP-C) Scale and evaluate its psychometric properties. To provide further evidence for the ATP-C Scale’s validity, it was then administered to three groups varying in their volunteering experience in Hong Kong. Exploratory factor analysis revealed a four-factor structure that differs from the unidimensional model proposed by the scale developers. Cronbach’s alpha values were satisfactory for all four subscales, and construct validity of the ATP-C Scale was also assessed with a second sample of participants. Implications for the assessment of attitudes toward prisoners away from a one-dimensional spectrum and further directions for cross-cultural studies on related topics are discussed.

Factor Analysis of the Kirton Adaption-Innovation Inventory

1988 ◽  
Vol 66 (2) ◽  
pp. 667-671 ◽  
Author(s):  
J. Morris Beene ◽  
Paul F. Zelhart
Keyword(s):  
College Students ◽  
Factor Analysis ◽  
Factor Structure ◽  
Cultural Factor ◽  
Cross Cultural ◽  
Original Sample ◽  
University Administrators ◽  
Factor Loadings ◽  
Rule Group ◽  
Original Analysis

Kirton (7) reported that the factor structure of the Kirton Adaption-Innovation Inventory involved three factors which were labeled, (a) originality, (b) efficiency, and (c) rule-group conformity. The present study is a replication of Kirton's study, using a sample of 249 American college students and 40 university administrators. The items found in each of the three factors replicated Kirton's original analysis in items placed in each factor. This result and the similarity of factor loadings of the original sample (from England) and the present one supports the cross-cultural factor stability of the inventory.

scholarly journals Lack of cross-cultural validity of the Endometriosis Health Profile-30

2018 ◽  
Vol 10 (2) ◽  
pp. 107-115 ◽  
Author(s):  
Nina Julie Verket ◽  
Marit Helen Andersen ◽  
Leiv Sandvik ◽  
Tom Gunnar Tanbo ◽  
Erik Qvigstad
Keyword(s):  
Factor Analysis ◽  
Construct Validity ◽  
Internal Consistency ◽  
Cross Cultural ◽  
Health Profile ◽  
Cultural Validity ◽  
Self Image ◽  
Norwegian Version ◽  
Test Retest Reliability ◽  
Cultural Validation

Introduction: The Endometriosis Health Profile-30 is a disease-specific patient-reported outcome measure of health-related quality of life. Cross-cultural validation of the Endometriosis Health Profile-30 has been performed for several translated versions. The aim of this study was to evaluate the measurement properties of a Norwegian version Endometriosis Health Profile-30. Methods: This study was designed as a cross-sectional anonymous postal questionnaire study. A total of 157 women with endometriosis were included during a period from 2012 to 2013. Women aged 18–45 years were recruited from the Norwegian Endometriosis Association. Principal components analysis with varimax rotation was used to assess construct validity. Short Form-36 was used to determine convergent validity. Cronbach’s alpha was used to measure internal consistency. Intraclass correlation coefficients and paired t-tests were used to evaluate test–retest reliability. Floor and ceiling effects were estimated. Results: Factor analysis resulted in a three and five-factor model for the core and modular questionnaire, respectively. Factor analysis could not support construct validity of the scales self-image and treatment. The Norwegian version Endometriosis Health Profile-30 demonstrated acceptable internal consistency and test–retest reliability, except for the scale relationship with children. Floor effects were observed for the scales self-image (20.1%), work life (33.9%), relationship with children (34.2%), and medical profession (20.5%). Conclusion: The construct self-image does not seem to be measured appropriately by the Norwegian version Endometriosis Health Profile-30, suggesting a lack of cross-cultural validity of the Endometriosis Health Profile-30. With multinational studies increasing, adequate translation, cross-cultural adaptation, and cross-cultural validation of instruments are essential to ensure equivalence in languages and cultures other than the original.

scholarly journals Altruistic Attitudes Among Older Adults: Examining Construct Validity and Measurement Invariance of a New Scale

2020 ◽  
Author(s):  
Tirth R Bhatta ◽  
Eva Kahana ◽  
Nirmala Lekhak ◽  
Boaz Kahana ◽  
Elizabeth Midlarsky
Keyword(s):  
Older Adults ◽  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Measurement Invariance ◽  
Well Being ◽  
Partial Metric ◽  
Psychological Well Being ◽  
Nested Models ◽  
Confirmatory Factor

Abstract Background and Objectives Scholarly research has established the role of altruism in facilitating human cooperation and prosocial behaviors and highlighted its contribution to psychological well-being. Given the health significance of altruistic attitudes and orientations, we developed a valid and reliable measure of this construct that is suitable for use with older adults. Research Design and Methods Based on data from a long-term panel study on adaptation to frailty among older adults (n = 366; mean age = 86 years), we used confirmatory factor analysis to perform construct validation of a five-item Elderly Care Research Center (ECRC) Altruism Scale among older adults (e.g., “Seeing others prosper makes me happy”). Moreover, we examined the invariance of the scale’s factor structure across time and gender using nested models. Results Composite reliability (coefficient omega = 0.78), factor loadings (>0.45 with eigenvalue = 2.84) from exploratory factor analysis, and model fit indices (e.g., comparative fit index = 0.999) from confirmatory factor analysis suggest a single factor, supporting a unidimensional reliable construct of altruistic orientation at baseline. The results provided support for configural, metric, and scalar invariance across time. Findings pertaining to measurement invariance across gender confirmed full configural invariance but only offered support for partial metric, scalar, and residual invariance at baseline. Strong correlations among the altruism scale, salient personality traits, psychological well-being, religiosity, and meaning in life help establish construct validity. Discussion and Implications The availability of a reliable and valid measure of altruistic attitudes enables a comprehensive evaluation of altruism’s influence on later-life health and well-being.

scholarly journals ANALISIS FAKTOR: KONSEP, PROSEDUR UJI DAN INTERPRETASI

2018 ◽  
Vol 4 (15) ◽  
pp. 153
Author(s):  
Dr. Purwanto
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Exploratory Factor Analysis ◽  
Correlation Matrix ◽  
The Other ◽  
Common Variance ◽  
Factor Loadings ◽  
Other Hand ◽  
Confirmatory Factor

Factor analysis is a test of construct validity. The test is taken by testing so much items or variables and extracting to be lesser and simpler factors. The extraction is carried by unifying some items or variables having significant common variance as they measure the same dimension. In its application, factor analysis can be exploratory or confirmatory. Exploratory factor analysis is used to understand some factors explaining a variabel that analysis does not work under a hyphotesis. On the other hand, confirmatory factor analysis hyphotezise some factors from some items or variables to guide its work. The analysis runs some steps : testing of analysis property, serving correlation matrix, doing extraction, making rotation, and labeling factors. The results of testing are interpreted in some ways. Data can be analyzed if assumptions are approved. Index of Kaiser Meyer Olkin must be over 0,80. Data must also be normal in Bartlet’s test of sphericity. Items or variables make the same dimension or factor if they have intercolinnearity over 0,20. A factor can be developed if it has eigenvalues more than 1,00. An item support a factor if it has factor loadings more than 0,30. Then, the developed factors are labelled or named according to the characteristic of supporting items.

scholarly journals Finding clusters of groups with measurement invariance: Unraveling intercept non-invariance with mixture multigroup factor analysis

2020 ◽  
Author(s):  
Kim De Roover
Keyword(s):  
Factor Analysis ◽  
Measurement Invariance ◽  
Behavioral Research ◽  
Invariant Factor ◽  
Factor Loadings ◽  
Latent Constructs ◽  
Daunting Task ◽  
Scalar Invariance ◽  
Metric Invariance ◽  
Latent Means

Comparisons of latent constructs across groups are ubiquitous in behavioral research and, nowadays, often numerous groups are involved. Measurement invariance of the constructs across the groups is imperative for valid comparisons and can be tested by multigroup factor analysis. For many groups, metric invariance (invariant factor loadings) often holds, whereas scalar invariance (invariant intercepts) is rarely supported. Scalar invariance is a prerequisite for comparing latent means, however. One may inspect group-specific intercepts to pinpoint non-invariances, but this is a daunting task in case of many groups. This paper presents mixture multigroup factor analysis (MMG-FA) for clustering groups based on their intercepts. Clusters of groups with scalar invariance are obtained by imposing cluster-specific intercepts and invariant loadings whereas unique variances, factor means and factor (co)variances can differ between groups. Thus, MMG-FA ties down the number of intercepts to inspect and generates clusters of groups wherein latent means can be validly compared.

scholarly journals Cross-cultural adaptation and validation of the Infant Feeding Style Questionnaire in Brazil

PLoS ONE ◽  
2021 ◽  
Vol 16 (9) ◽  
pp. e0257991
Author(s):  
Jéssica Pedroso ◽  
Muriel Bauermann Gubert
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Infant Feeding ◽  
Cultural Adaptation ◽  
Cross Cultural ◽  
Alpha Coefficient ◽  
Cross Cultural Adaptation ◽  
Feeding Style ◽  
Confirmatory Factor

We cross-culturally adapted and validated the Infant Feeding Style Questionnaire (IFSQ) in Brazil. The cross-cultural adaptation and content validity assessment was conducted in five steps: translation, synthesis of translations, back-translation, evaluation by experts, and pre-test. To evaluate reliability, construct validity, and floor and ceiling effects, interviews were conducted with 465 mother-infant pairs at Primary Health Centers in the Federal District, Brazil. The mothers answered the Brazilian Portuguese version of the IFSQ (IFSQ-Br), which evaluated four feeding styles (laissez-faire, pressuring, restrictive, and responsive) from 9 sub-constructs. The indulgent style was not evaluated due to time limitation. We performed reliability analysis using Cronbach’s alpha coefficient and construct validity was evaluated through Confirmatory Factor Analysis. Higher means were found in the sub-constructs of the responsive and restrictive styles. The IFSQ-Br presented adequate reliability (α = 0.73) with values for the Cronbach’s alpha coefficient of the sub-constructs ranging from 0.42 to 0.75. In the Confirmatory Factor Analysis, the final models presented good fit, with the Comparative Fit Indices (CFI) ranging from 0.86 to 1.0 and the Root-Mean Squared Error of Approximation (RMSEA) between 0.0 and 0.09. The IFSQ-Br was shown to be a valid and reliable questionnaire to evaluate maternal feeding beliefs and behaviors in Brazil. Future studies should evaluate the psychometric properties of the indulgent style and include mother-infant pairs from different cultural contexts in Brazil.

Sign in / Sign up

Export Citation Format

Share Document