scholarly journals Measures of fit impacts: Application to the causal model of consumer involvement

2018 ◽  
Vol 61 (1) ◽  
pp. 77-92
Author(s):  
Eric Rakotoasimbola ◽  
Sam Blili

Using the Monte Carlo simulation method, this study analyzes the impacts on fit indices by the degree of nonnormality of variables, the sample size, and the choice of estimation method. To address these issues, we use the causal model of consumer involvement as elaborated by Mittal and Lee. Results of this study show that adjusted goodness of fit index (AGFI) and goodness of fit index (GFI) are subject to variation in sample size, and their use requires a sample size of at least 300 observations to be reliable. Comparative fit index (CFI) and root mean square error of approximation (RSMEA) are more reliable with the generalized least squares (GLS) compared with maximum likelihood estimation (MLE) method under different settings of sample size and degree of nonnormality. Finally, for the standardized root mean square residual (SRMR), it is recommended that it is used with the MLE method. This study provides prescriptions for the choice of fit indices and the requirements of sample size and estimation method to test the causal model of consumer involvement. The method used here can be extended to any model before fitting it to real data. It helps researchers to prevent conflictual results regarding the choice of fit indices.

2021 ◽  
Vol 26 ◽  
pp. 1-8
Author(s):  
Thiago Ferreira de Sousa ◽  
Sueyla Ferreira da Silva dos Santos ◽  
Silvio Aparecido Fonseca ◽  
Gerleison Ribeiro Barros ◽  
Mauro Virgílio Gomes de Barros ◽  
...  

Os objetivos do estudo foram estimar o nível de confiabilidade e validade fatorial da escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social, por meio da análise fatorial confirmatória (AFC). Para tanto, a escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social foi empregada em um estudo realizado com amostras de estudantes e servidores de instituições de ensino superior de diferentes regiões brasileiras. A amostra final correspondeu a 4.694 adultos que responderam o formulário on-line. Para a avaliação de constructo foi realizada a análise de consistência interna via Alfa de Cronbach’s (a) e correlação de Spearman. Empregou-se a AFC para testar a estrutura fatorial hipotética da escala. A consistência interna geral foi de a de 0,778 e houve correlações significativas, porém, inferiores a ± 0,799 para os itens dos mesmos constructos e ± 0,499 entre os itens de constructos diferentes. Na AFC, após ajustes na estrutura do modelo, ocorreu a adequação para todos os indicadores (Goodness-of-fit Index: 0,976; Comparative Fit Index: 0,937; Normalized Fit Indices: 0,932; Tucker-Lewis Indices: 0,914; Root Mean Square Error of Approximation: 0,047; Root Mean-Square Residual: 0,031; Standardized Root Mean-Square Residual: 0,0337), com a exceção para os valores de p do Qui-quadrado e razão entre Qui-quadrado e graus de liberdade. Conclui-se que a escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social, mostrou consistência interna e estrutura fatorial satisfatórias para orientar a avaliação do estilo de vida (individual ou de grupos) e as intervenções para promover estilos de vida saudáveis.


2021 ◽  
Vol 45 (2) ◽  
pp. 179-192
Author(s):  
Dexin Shi ◽  
Christine DiStefano ◽  
Xiaying Zheng ◽  
Ren Liu ◽  
Zhehan Jiang

This study investigates the performance of robust maximum likelihood (ML) estimators when fitting and evaluating small sample latent growth models with non-normal missing data. Results showed that the robust ML methods could be used to account for non-normality even when the sample size is very small (e.g., N < 100). Among the robust ML estimators, “MLR” was the optimal choice, as it was found to be robust to both non-normality and missing data while also yielding more accurate standard error estimates and growth parameter coverage. However, the choice “MLMV” produced the most accurate p values for the χ2 test statistic under conditions studied. Regarding the goodness of fit indices, as sample size decreased, all three fit indices studied (i.e., comparative fit index, root mean square error of approximation, and standardized root mean square residual) exhibited worse fit. When the sample size was very small (e.g., N < 60), the fit indices would imply that a proposed model fit poorly, when this might not be actually the case in the population.


2012 ◽  
Vol 46 (5) ◽  
pp. 816-824 ◽  
Author(s):  
Juliana Alvares Duarte Bonini Campos ◽  
João Maroco

OBJETIVO: Realizar a adaptação transcultural da versão em português do Inventário de Burnout de Maslach para estudantes e investigar sua confiabilidade, validade e invariância transcultural. MÉTODOS: A validação de face envolveu participação de equipe multidisciplinar. Foi realizada validação de conteúdo. A versão em português foi preenchida em 2009, pela internet, por 958 estudantes universitários brasileiros e 556 portugueses da zona urbana. Realizou-se análise fatorial confirmatória utilizando-se como índices de ajustamento o χ²/df, o comparative fit index (CFI), goodness of fit index (GFI) e o root mean square error of approximation (RMSEA). Para verificação da estabilidade da solução fatorial conforme a versão original em inglês, realizou-se validação cruzada em 2/3 da amostra total e replicada no 1/3 restante. A validade convergente foi estimada pela variância extraída média e confiabilidade composta. Avaliou-se a validade discriminante e a consistência interna foi estimada pelo coeficiente alfa de Cronbach. A validade concorrente foi estimada por análise correlacional da versão em português e dos escores médios do Inventário de Burnout de Copenhague; a divergente foi comparada à Escala de Depressão de Beck. Foi avaliada a invariância do modelo entre a amostra brasileira e a portuguesa. RESULTADOS: O modelo trifatorial de Exaustão, Descrença e Eficácia apresentou ajustamento adequado (χ²/df = 8,498; CFI = 0,916; GFI = 0,902; RMSEA = 0,086). A estrutura fatorial foi estável (λ: χ²dif = 11,383, p = 0,50; Cov: χ²dif = 6,479, p = 0,372; Resíduos: χ²dif = 21,514, p = 0,121). Observou-se adequada validade convergente (VEM = 0,45;0,64, CC = 0,82;0,88), discriminante (ρ² = 0,06;0,33) e consistência interna (α = 0,83;0,88). A validade concorrente da versão em português com o Inventário de Copenhague foi adequada (r = 0,21;0,74). A avaliação da validade divergente do instrumento foi prejudicada pela aproximação do conceito teórico das dimensões Exaustão e Descrença da versão em português com a Escala de Beck. Não se observou invariância do instrumento entre as amostras brasileiras e portuguesas (λ:χ²dif = 84,768, p < 0,001; Cov: χ²dif = 129,206, p < 0,001; Resíduos: χ²dif = 518,760, p < 0,001). CONCLUSÕES: A versão em português do Inventário de Burnout de Maslach para estudantes apresentou adequada confiabilidade e validade, mas sua estrutura fatorial não foi invariante entre os países, apontando ausência de estabilidade transcultural.


2016 ◽  
Vol 20 (2) ◽  
pp. 221-233 ◽  
Author(s):  
Nurhening Yuniarti ◽  
Soenarto Soenarto

Penelitian ini bertujuan untuk mendapatkan bukti validitas konstrak dari instrumen yang digunakan untuk kegiatan evaluasi outcome dari lembaga pendidikan guru vokasional. Instrumen ini terdiri atas 3 jenis instrumen. Teknik analisis data yang digunakan adalah confirmatory factor analysis (CFA). Kriteria yang digunakan untuk melihat kecocokan model adalah: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), dan CFI (Comparative Fit Index). Bukti validitas instrumen dapat dilihat pada besarnya faktor loading dan t-value.  Jika loading factor lebih besar dari 0,3 dengan t-valuelebih besar dari 1,96 maka butir pernyataan dapat dikategorikan valid. Berdasarkan hasil analisis diperoleh hasil: (1) pada instrumen I terdapat 26 butir yang dinyatakan valid; (2) pada instrumen II terdapat 23 butir yang dinyatakan valid; dan (3) pada instrumen III terdapat 18 butir yang dinyatakan valid.Kata kunci: validitas konstrak, evaluasi, lembaga pendidikan guru vokasional CONSTRUCT VALIDITY OF OUTCOME EVALUATION INSTRUMENT IN VOCATIONAL TEACHER EDUCATION INSTITUTIONAbstractThis research aims to get the construct validity evidence of the outcome evaluation instrument of vocational teacher education institution. The instrument consists of 3 kinds of instruments. The analysis technique that is used to test the construct validity is confirmatory factor analysis (CFA). The criteria used to determine the goodness of fit were: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), and CFI (Comparative Fit Index). The evidence of the construct validity was based on the standardized loading factor and t-value. If the loading factor > 0.3 with t-value > 1.96, the item is valid. Based on the analysis, the research results are: (1) 26 item of the instrument I are categorized valid; (2) 23 items of instrument II are categorized valid; and (3) 18 items of instrument III are categorized valid.Keywords: construct validity, evaluation, vocational teacher education institution


Author(s):  
Rubén Trigueros ◽  
Noelia Navarro-Gómez ◽  
José M. Aguilar-Parra ◽  
Adolfo J. Cangas

The objective of the present study was to validate and adapt the Acceptance and Action Questionnaire-Stigma (AAQ-S) to the Spanish context. Method: The study included the participation of 1212 subjects, with an average age of 17.12 years old. Results: The confirmatory factorial analysis revealed a number of adequate fit indices for the new version of the scale χ2/df = 3.24; Comparative Fit Index = 0.96; Incremental Fit Index = 0.96; Root Mean Square Error of Approximation = 0.060; Standardized Root Mean Square Residual = 0.035, in which the factorial structures displayed gender invariance. The two factors comprise the scale both exhibited high internal consistency (+0.90) and temporal stability. Conclusion: The Spanish version of the AAQ-S proved to be a robust and adequate psychometric instrument. In this sense, future lines of research focused on determining the role of psychological flexibility in stigma and the processes of change at the base of interventions could benefit substantially from the use of AAQ-S.


2020 ◽  
Vol 34 (1) ◽  
pp. 58-69
Author(s):  
Kristina Zeljic ◽  
Yingying Zhang ◽  
Xian Qiu ◽  
Xi Chen ◽  
Hengfen Gong ◽  
...  

Although the Sheehan Disability Scale (SDS) is one of the most extensively used and tested disability measurements, there has only been one psychometric evaluation of its properties in a Chinese-speaking population. Here, we provide a comprehensive psychometric assessment of the scale in 465 Mandarin-speakers who were accessing information online regarding psychotherapy. Principal component analysis and subsequent confirmatory factor analysis indicated that the SDS is one-dimensional (normed fit index = 0.976, non-normed fit index = 0.97, comparative fit index = 0.98, goodness-of-fit index = 0.967, standardized root mean-square residual = 0.023, root mean-square error of approximation = 0.149). The SDS exhibited excellent internal consistency (α = .89) and moderate test–retest reliability when readministered approximately 8 days later (intraclass correlation coefficient = 0.55). Convergent validity was demonstrated by strong relationships with other measures of functional impairment (FI), while divergent validity was evidenced by fair correlation with a treatment ambivalence measure. Known-groups validity analyses showed that high FI was associated with significantly higher clinical scores of anxiety, depression, and obsessive-compulsive symptoms. Regression analysis indicated that the Depression Anxiety Stress Scale-21 score accounted for 37.6% of variance in FI. Overall, these findings support the reliability and validity of the SDS when used in Chinese treatment-seeking individuals, as well its usefulness as an online screening tool of FI.


SAGE Open ◽  
2019 ◽  
Vol 9 (1) ◽  
pp. 215824401882519 ◽  
Author(s):  
Konstantinos Papazoglou ◽  
Mari Koskelainen ◽  
Natalie Stuewe

Police officers are often exposed to violence and potentially traumatic encounters, but they have not been a focus of research on compassion fatigue or compassion satisfaction. The current study examines compassion fatigue and satisfaction among police officers and how these variables are influenced by negative personality traits. This study’s participants were police officers ( n = 1,173) from the National Police of Finland, and its aims were twofold: (a) to explore the prevalence rates and relationships between compassion fatigue, compassion satisfaction, burnout, and personality traits (Machiavellianism, `narcissism, psychopathy) among study participants; and (b) to explore whether compassion satisfaction, burnout, years of police experience, and negative personality traits are predictors of compassion fatigue. The results of the current study indicated that 10% of police officers indicated high levels of compassion fatigue and 40% revealed low levels of compassion satisfaction. In addition, compassion fatigue was found to be negatively correlated with compassion satisfaction ( r = −.33, p < .01), whereas negative personality traits were positively correlated with compassion fatigue (Machiavellianism: r = .20; narcissism: r = .19; psychopathy: r = .23; p < .01). Furthermore, negative personality traits (except narcissism) were negatively correlated with compassion satisfaction (Machiavellianism: r = −.22; psychopathy: r = −.32). Structural equation modeling (SEM) was performed to assess predictors of compassion fatigue and it indicated good model fit to the data (goodness of fit index, GFI = .976; comparative fit index, CFI = .934; root mean square error of approximation, RMSEA = .092; standardized root mean square residual, SRMR = .421). In addition, SEM revealed that compassion satisfaction, burnout, and personality traits (Machiavellianism, narcissism, and psychopathy) were significant predictors of compassion fatigue. Clinical and training implications as well as future research recommendations are also discussed.


Author(s):  
José Leudo Maia ◽  
Marcos Antonio Martins Lima

Resumo Este estudo teve como objetivo fazer uso da Modelagem de Equações Estruturais – MEE, para avaliar a qualidade do modelo empregado pela Universidade Estadual do Ceará (UECE), no processo de seleção de seus vestibulandos, o qual é baseado na Teoria Clássica dos Testes (TCT), assim como propor ajuste a esse modelo pelo uso da Análise Fatorial de Segunda Ordem e da Análise de Regressão, via MEE. Utilizou-se um banco de dados composto dos resultados das provas de 11.060 candidatos ao vestibular de 2018.1, cujo tratamento se deu por meio do software IBM SPSS Amos (2013, v.22), obtendo-se os seguintes indicadores de qualidade: CFI ( Comparative Fit Index ) = 0,925; GFI ( Goodness-of-fit Index ) = 0,965; TLI ( Tucker Lewis Index ) = 0,922, e RMSEA ( Root Mean Square Error of Aproximation ) = 0,019. Juntos, esses indicadores demonstraram que o modelo é robusto e bastante consistente, apresentando um R 2 (Coeficiente de Correlação de Pearson ) = 0,965, indicando que a proporção das covariâncias observadas entre as variáveis manifestas e explicada pelo modelo ajustado é bastante significativa. Todas as variáveis do modelo ajustado apresentaram elevados coeficientes de regressão com valores entre 0,87 e 0,99, permitindo uma boa discriminação entre as notas dos vestibulandos, principalmente aqueles com o mesmo número de questões respondidas corretamente.


2015 ◽  
Vol 32 (2) ◽  
pp. 151-161 ◽  
Author(s):  
Valdiney Veloso Gouveia ◽  
Leogildo Alves Freires ◽  
Rildésia Silva Veloso Gouveia ◽  
José Farias de Souza Filho ◽  
Roosevelt Vilar Lobo de Souza ◽  
...  

Este artigo teve como objetivo adaptar para o contexto brasileiro a Escala de Disposição para Perdoar, conhecendo evidências de validade (fatorial e convergente) e precisão (consistência interna, homogeneidade e confiabilidade composta). Nesse sentido, realizaram-se dois estudos. No estudo 1, participaram 220 estudantes universitários de uma instituição privada de João Pessoa, Paraíba, com idade média de 24 anos (81,7% do sexo feminino), que responderam à Escala de Disposição para Perdoar e a perguntas demográficas. Uma análise de componentes principais revelou uma estrutura unifatorial, explicando 44,3% da variância total, com alfa de Cronbach (α) de 0,88. No estudo 2, participaram 302 estudantes universitários de uma instituição pública da mesma cidade, apresentando idade média de 22 anos (52,3% do sexo masculino), tendo respondido aos mesmos instrumentos. Uma análise fatorial confirmatória corroborou a estrutura unifatorial (Goodness-of-Fit Index = 0,90, Root Mean-Square Error of Approximation = 0,09), que se mostrou invariante quanto ao gênero dos participantes (ΔRoot Mean-Square Error of Approximation <0,01). Além disso, observaram-se índices favoráveis de precisão (α = 0,85, homogeneidade = 0,30 e confiabilidade composta = 0,85), mostrando evidências de validade convergente (Variância Média Extraída = 0,82). Concluiu-se que a medida apresenta evidências de validade e precisão no contexto de pesquisa, porém são demandados novos estudos sobre sua estabilidade temporal e validade discriminante.


2014 ◽  
Vol 18 (2) ◽  
pp. 215-233
Author(s):  
Muyasaroh Muyasaroh ◽  
Sutrisno Sutrisno

Studi ini bertujuan untuk: (1) menghasilkan model pengembangan evaluasi program pembelajar’an tahfiẓ al-Quran diberi nama Coni P2, (2) menghasilkan teknik pelaksanaan evaluasi program pembelajaran tahfiẓ al-Qur’an, dan (3) menghasilkan struktur komponen dan indikator model evaluasi. Studi ini merupakan penelitian dan pengembangan (R&D) dengan menggunakan sembilan langkah dari 10 langkah model Borg dan Gall. Jumlah subjek uji coba pertama 33 orang, uji coba kedua 49 orang, dan uji coba ketiga 224 orang. Komponen model evaluasi yang digunakan adalah model evaluasi Stufflebeam (CIPP). Langkah-langkah evaluasi yang digunakan adalah langkah Malcolm Provus. Teknik pengumpul data yang digunakan adalah Delphi, FGD, kuesioner, observasi, wawancara, dan studi dokumentasi. Validitas konstruk dianalisis menggunakan CFA dan Reliabilitas menggunakan Cronbach Alpha. Hasil penelitian: (1) model evaluasi program Coni P2 dikembangkan dengan cara kajian teori, temuan di lapangan, Delphi, FGD, uji coba sebanyak tiga kali; (2) evaluasi di tiga pondok pesantren: Al-Ittifaqiah, Raudhatul Ulum, dan Raudhatul Qur’an ditemukan kesenjangan sarana belajar, kinerja guru, dan motivasi belajar santri; (3) komponen konstruk model evaluasi Coni P2 terdiri atas konteks, input, proses, dan produk, yang terbagi menjadi 13 indikator. Hasil analisis CFA: (1) Chi Square (χ²) = kecil; (2) ρ-value > 0,05; (3) Root Mean Square Error of Approximation (RMSEA) < 0,08; dan (4) Goodness of Fit Index (GFI) < 0,90.Kata kunci: pengembangan, evaluasi, tahfiẓ al-Qur’an______________________________________________________________ DEVELOPING CIPP EVALUATION INSTRUMENT FOR TAHFIZ AL-QUR’AN IN PONDOK PESANTRENAbstract The study aimed to: (1) generate an evaluation development  model of tahfiz Al-Qur’an learning program entitled Coni P2; (2) generate a technique of tahfiz Al-Qur’an learning program evaluation implementation; and (3) generate component structures and an indicators of evaluation model. The study was a research and development (R&D) type by implementing 9 of 10 steps in Borg and Gall’s model. The subject for the first trial the 33 people, for the second trial were 49 people, and for the third trial were 224 people. The implemented component of evaluation model was Stufflebeam Evaluation Model (CIPP). The evaluation steps that the researchers implemented were the ones taken from Malcolm Provus. The data gathering techniques that the researchers implemented were Delphi, FGD, questionnaires, observation, interview and study of documentation. The construct validity was analyzed by implementing CFA and the construct reliability was analyzed by implementing Cronbach Alpha. The results of the research were as follows: (1) the model of Coni P2 evaluation program was developed by implementing theoretical review, field findings, Delphi, FGD and three-time experiments; (2) from the evaluations performed in three pondok pesantren, namely Al-Ittifaqiah, Raudhatul Ulum and Raudhatul Qur’an, the researchers found discrepancy in learning facilities, teacher performance and santri’s learning motivation; and (3) the construct components of Coni P2 evaluation model consisted of context, input, process and product that were divided into 13 indicators. The results of CFA analysis were as follows: (1) (1) Chi Square (χ²) = kecil; (2) ρ-value > 0.05; (3) Root Mean Square Error of Approximation (RMSEA) < 0.08; dan (4) Goodness of Fit Index (GFI) < 0.90.Keywords: development, evaluation, tahfiz Al-Qur’an


Sign in / Sign up

Export Citation Format

Share Document