scholarly journals The Ethical Use of Fit Indices in Structural Equation Modeling: Recommendations for Psychologists

2021 ◽  
Vol 12 ◽  
Author(s):  
Bryant M. Stone

Fit indices provide helpful information for researchers to assess the fit of their structural equation models to their data. However, like many statistics and methods, researchers can misuse fit indices, which suggest the potential for questionable research practices that might arise during the analytic and interpretative processes. In the current paper, the author highlights two critical ethical dilemmas regarding the use of fit indices, which are (1) the selective reporting of fit indices and (2) using fit indices to justify poorly-fitting models. The author highlights the dilemmas and provides potential solutions for researchers and journals to follow to reduce these questionable research practices.

2016 ◽  
Vol 77 (1) ◽  
pp. 5-31 ◽  
Author(s):  
Hsien-Yuan Hsu ◽  
Jr-Hung Lin ◽  
Oi-Man Kwok ◽  
Sandra Acosta ◽  
Victor Willson

Several researchers have recommended that level-specific fit indices should be applied to detect the lack of model fit at any level in multilevel structural equation models. Although we concur with their view, we note that these studies did not sufficiently consider the impact of intraclass correlation (ICC) on the performance of level-specific fit indices. Our study proposed to fill this gap in the methodological literature. A Monte Carlo study was conducted to investigate the performance of (a) level-specific fit indices derived by a partially saturated model method (e.g., [Formula: see text] and [Formula: see text]) and (b) [Formula: see text] and [Formula: see text] in terms of their performance in multilevel structural equation models across varying ICCs. The design factors included intraclass correlation (ICC: ICC1 = 0.091 to ICC6 = 0.500), numbers of groups in between-level models (NG: 50, 100, 200, and 1,000), group size (GS: 30, 50, and 100), and type of misspecification (no misspecification, between-level misspecification, and within-level misspecification). Our simulation findings raise a concern regarding the performance of between-level-specific partial saturated fit indices in low ICC conditions: the performances of both [Formula: see text] and [Formula: see text] were more influenced by ICC compared with [Formula: see text] and SRMRB. However, when traditional cutoff values ( RMSEA≤ 0.06; CFI, TLI≥ 0.95; SRMR≤ 0.08) were applied, [Formula: see text] and [Formula: see text] were still able to detect misspecified between-level models even when ICC was as low as 0.091 (ICC1). On the other hand, both [Formula: see text] and [Formula: see text] were not recommended under low ICC conditions.


1986 ◽  
Vol 14 (4) ◽  
pp. 345-352
Author(s):  
Margaret E. Bell ◽  
Jean A. Massey

Validation of the sequencing of objectives is an important step in structural design. Prior statistical techniques, such as the reproducibility coefficient, have yielded only summary information. In contrast, structural equation modeling provides both goodness-of-fit indices and effect coefficients for links or paths between time-ordered events, i.e., objectives. Discussed here is the application of structural equation modeling to a set of objectives in a senior-level cardiovascular nursing course. Consistent with the theory-based requirement of structural equation modeling, the objectives were developed using Robert Gagné's conditions of learning. Also discussed is the use of “t” values, which indicate statistical significance of the paths, for testing instructional links in the learning model.


One Ecosystem ◽  
2020 ◽  
Vol 5 ◽  
Author(s):  
James Grace

It is possible that model selection has been the most researched and most discussed topic in the history of both statistics and structural equation modeling (SEM). The reason for this is because selecting one model for interpretive use from amongst many possible models is both essential and difficult. The published protocols and advice for model evaluation and selection in SEM studies are complex and difficult to integrate with current approaches used in biology. Opposition to the use of p-values and decision thresholds has been voiced by the statistics community, yet certain phases of model evaluation have been historically tied to reliance on p-values. In this paper, I outline an approach to model evaluation, comparison and selection based on a weight-of-evidence paradigm. The details and proposed sequence of steps are illustrated using a real-world example. At the end of the paper, I briefly discuss the current state of knowledge and a possible direction for future studies.


Author(s):  
SAMIRA GHIYASI ◽  
FATEMEH VERDI BAGHDADI ◽  
FARSHAD HASHEMZADEH ◽  
AHMAD SOLTANZADEH

Enhancing the index of crisis resilience is one of the key goals in medical environments. Various parameters can affect crisis resilience. The current study was designed to analyze crisis resilience in medical environments based on the crisis management components. This cross-sectional and descriptive-analytical study was performed in 14 hospitals and medical centers, in 2020. A sample size of 343.5 was determined based on the Cochran's formula. We used a 44-item crisis management questionnaire of Azadian et al. to collect data. The components of this questionnaire included management commitment, error learning, culture learning, awareness, preparedness, flexibility, and transparency. The data was analyzed based on the structural equation modeling approach using IBM SPSS AMOS v. 23.0. The participants’ age and work experience mean were 37.78±8.14 and 8.22±4.47 years. The index of crisis resilience was equal to 2.96±0.87. The results showed that all components of crisis management had a significant relationship with this index (p <0.05). The highest and lowest impact on the resilience index were related to preparedness (E=0.88) and transparency (E=0.60). The goodness of fit indices of this model including RMSEA, CFI, NFI, and NNFI (TLI) was 2.86, 0.071, 0.965, 0.972, and 0.978. The index of crisis resilience in the medical environments was at a moderate level. Furthermore, the structural equation modeling findings indicated that the impact of each component of crisis management should be considered in prioritizing measures to increase the level of resilience.  


Athenea ◽  
2021 ◽  
Vol 2 (4) ◽  
pp. 5-18
Author(s):  
Juan Enrique Villalva A.

Modeling using structural equations, is a second generation statistical data analysis technique, it has been positioned as the methodological options most used by researchers in various fields of science. The best known method is the covariance-based approach, but it presents some limitations for its application in certain cases. Another alternative method is based on the variance structure, through the analysis of partial least squares, which is an appropriate option when the research involves the use of latent variables (for example, composite indicators) prepared by the researcher, and where it is necessary to explain and predict complex models. This article presents a brief summary of the structural equation modeling technique, with an example on the relationship of constructs, sustainability and competitiveness in iron mining, and is intended to be a brief guide for future researchers in the engineering sciences. Keywords: Competitiveness, Structural equations, Iron mining, Sustainability. References [1]J. Hair, G. Hult, C. Ringle and M. Sarstedt. A Primer on Partial Least Square Structural Equation Modeling (PLS-SEM). California: United States. Sage, 2017. [2]H. Wold. Model Construction and Evaluation when Theoretical Knowledge Is Scarce: An Example of the Use of Partial Least Squares. Genève. Faculté des Sciences Économiques et Sociales, Université de Genève. 1979. [3]J. Henseler, G. Hubona & P. Ray. “Using PLS path modeling new technology research: updated guidelines”. Industrial Management & Data Systems, 116(1), 2-20. 2016. [4]G. Cepeda and Roldán J. “Aplicando en la Práctica la Técnica PLS en la Administración de Empresas”. Congreso de la ACEDE, Murcia, España, 2004. [5]D. Garson. Partial Least Squares. Regresión and Structural Equation Models. USA. Statistical Associates Publishing: 2016. [6]D. Barclay, C. Higgins & R. Thompson. “The Partial Least Squares (PLS) Approach to Causal Modeling: Personal Computer Adoption and Use as an Illustration”. Technology Studies. Special Issue on Research Methodology. (2:2), pp. 285-309. 1995. [7]J. Medina, N. Pedraza & M. Guerrero. “Modelado de Ecuaciones Estructurales. Un Enfoque de Partial Least Square Aplicado en las Ciencias Sociales y Administrativas”. XIV Congreso Internacional de la Academia de Ciencias Administrativas A.C. (ACACIA). EGADE – ITESM. Monterrey, México, 2010. [8]J. Medina & J. Chaparro. “The Impact of the Human Element in the Information Systems Quality for Decision Making and User Satisfaction”. Journal of Computer Information Systems. (48:2), pp. 44-52. 2008. [9]D. Leidner, S. Carlsson, J. Elam & M. Corrales. “Mexican and Swedish Managers’ Perceptions of the Impact of EIS on Organizational Intelligence, Decisión Making, and Structure”. Decision Science. (30:3), pp. 633-658. 1999.[10]W. Chin. “The partial least squares approach for structural equation modeling”. Chapter Ten, pp. 295-336 in Modern methods for business research. Edited by Macoulides, G. A., New Jersey: Lawrence Erlbaum Associates, 1998. [11]M. Höck & C. Ringle M. “Strategic networks in the software industry: An empirical analysis of the value continuum”. IFSAM VIIIth World Congress, Berlin 2006. [12]J. Henseler, Ch. Ringle & M. Sarstedt. Handbook of partial least squares: Concepts, methods and applications in marketing and related fields. Berlin: Springer, 2012. [13]S. Daskalakis & J. Mantas. “Evaluating the impact of a service-oriented framework for healthcare interoperability”. Studies in Health Technology and Informatics. pp. 285-290. 2008. [14]C. Fornell & D. Larcker: “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error”, Journal of Marketing Research, vol. 18, pp. 39-50. Februay 1981. [15]C. Fornell. A Second Generation of Multivariate Analysis: An Overview. Vol. 1. New York, U.S.A. Praeger Publishers: 1982. [16]R. Falk and N. Miller. A Primer for Soft Modeling. Ohio: The University of Akron. 1992. [17]M. Martínez. Aplicación de la técnica PLS-SEM en la gestión del conocimiento: un enfoque técnico práctico. Revista Iberoamericana para Investigación y el Desarrollo Educativo. Vol. 8, Núm. 16. 2018. [18]S. Geisser. “A predictive approach to the random effects model”. Biometrika, Vol. 61(1), pp. 101-107. 1974. [19]J. Cohen. Statistical power analysis for the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum, 1988. [20]GRI (2013). G4 Sustainability Reporting Guidelines. Global Reporting Initiative. Available: www.globalreporting.org


2021 ◽  
pp. 004912412110431
Author(s):  
Bert Weijters ◽  
Eldad Davidov ◽  
Hans Baumgartner

In factorial survey designs, respondents evaluate multiple short descriptions of social objects (vignettes) that experimentally vary different levels of attributes of interest. Analytical methods (including individual-level regression analysis and multilevel models) estimate the weights (or utilities) assigned to the levels of the different attributes by participants to arrive at an overall response to the vignettes. In the current paper, we explain how data from factorial surveys can be analyzed in a structural equation modeling framework using an approach called structural equation modeling for within-subject experiments. We review the use of factorial surveys in social science research, discuss typically used methods to analyze factorial survey data, introduce the structural equation modeling for within-subject experiments approach, and present an empirical illustration of the proposed method. We conclude by describing several extensions, providing some practical recommendations, and discussing potential limitations.


2021 ◽  
Author(s):  
Mike W.-L. Cheung

Structural equation modeling (SEM) and meta-analysis are two popular techniques in the behavioral, medical, and social sciences. They have their own research communities, terminologies, models, software packages, and even journals. This chapter introduces SEM-based meta-analysis, an approach to conduct meta-analyses using the SEM framework. By conceptualizing studies in a meta-analysis as subjects in a structural equation model, univariate, multivariate, and three-level meta-analyses can be fitted as structural equation models using definition variables. We will review fixed-, random-, and mixed-effects models using the SEM framework. Examples will be used to illustrate the procedures using the metaSEM and OpenMx packages in R. This chapter closes with a discussion of some future directions for research.


Author(s):  
Mike W.-L. Cheung

Meta-analysis and structural equation modeling (SEM) are two popular statistical models in the social, behavioral, and management sciences. Meta-analysis summarizes research findings to provide an estimate of the average effect and its heterogeneity. When there is moderate to high heterogeneity, moderators such as study characteristics may be used to explain the heterogeneity in the data. On the other hand, SEM includes several special cases, including the general linear model, path model, and confirmatory factor analytic model. SEM allows researchers to test hypothetical models with empirical data. Meta-analytic structural equation modeling (MASEM) is a statistical approach combining the advantages of both meta-analysis and SEM for fitting structural equation models on a pool of correlation matrices. There are usually two stages in the analyses. In the first stage of analysis, a pool of correlation matrices is combined to form an average correlation matrix. In the second stage of analysis, proposed structural equation models are tested against the average correlation matrix. MASEM enables researchers to synthesize researching findings using SEM as the research tool in primary studies. There are several popular approaches to conduct MASEM, including the univariate-r, generalized least squares, two-stage SEM (TSSEM), and one-stage MASEM (OSMASEM). MASEM helps to answer the following key research questions: (a) Are the correlation matrices homogeneous? (b) Do the proposed models fit the data? (c) Are there moderators that can be used to explain the heterogeneity of the correlation matrices? The MASEM framework has also been expanded to analyze large datasets or big data with or without the raw data.


Sign in / Sign up

Export Citation Format

Share Document