scholarly journals Cross-validation of the Student Perceptions of Team-Based Learning Scale in the United States

Author(s):  
Donald H. Lein ◽  
John D. Lowman ◽  
Christopher A. Eidson ◽  
Hon K. Yuen

Purpose: The purpose of this study was to cross-validate the factor structure of the previously developed Student Perceptions of Team-Based Learning (TBL) Scale among students in an entry-level doctor of physical therapy (DPT) program in the United States.Methods: Toward the end of the semester in 2 patient/client management courses taught using TBL, 115 DPT students completed the Student Perceptions of TBL Scale, with a response rate of 87%. Principal component analysis (PCA) and confirmatory factor analysis (CFA) were conducted to replicate and confirm the underlying factor structure of the scale. Results: Based on the PCA for the validation sample, the original 2-factor structure (preference for TBL and preference for teamwork) of the Student Perceptions of TBL Scale was replicated. The overall goodness-of-fit indices from the CFA suggested that the original 2-factor structure for the 15 items of the scale demonstrated a good model fit (comparative fit index, 0.95; non-normed fit index/Tucker-Lewis index, 0.93; root mean square error of approximation, 0.06; and standardized root mean square residual, 0.07). The 2 factors demonstrated high internal consistency (alpha= 0.83 and 0.88, respectively). DPT students taught using TBL viewed the factor of preference for teamwork more favorably than preference for TBL.Conclusion: Our findings provide evidence supporting the replicability of the internal structure of the Student Perceptions of TBL Scale when assessing perceptions of TBL among DPT students in patient/client management courses.

2020 ◽  
Vol 34 (1) ◽  
pp. 58-69
Author(s):  
Kristina Zeljic ◽  
Yingying Zhang ◽  
Xian Qiu ◽  
Xi Chen ◽  
Hengfen Gong ◽  
...  

Although the Sheehan Disability Scale (SDS) is one of the most extensively used and tested disability measurements, there has only been one psychometric evaluation of its properties in a Chinese-speaking population. Here, we provide a comprehensive psychometric assessment of the scale in 465 Mandarin-speakers who were accessing information online regarding psychotherapy. Principal component analysis and subsequent confirmatory factor analysis indicated that the SDS is one-dimensional (normed fit index = 0.976, non-normed fit index = 0.97, comparative fit index = 0.98, goodness-of-fit index = 0.967, standardized root mean-square residual = 0.023, root mean-square error of approximation = 0.149). The SDS exhibited excellent internal consistency (α = .89) and moderate test–retest reliability when readministered approximately 8 days later (intraclass correlation coefficient = 0.55). Convergent validity was demonstrated by strong relationships with other measures of functional impairment (FI), while divergent validity was evidenced by fair correlation with a treatment ambivalence measure. Known-groups validity analyses showed that high FI was associated with significantly higher clinical scores of anxiety, depression, and obsessive-compulsive symptoms. Regression analysis indicated that the Depression Anxiety Stress Scale-21 score accounted for 37.6% of variance in FI. Overall, these findings support the reliability and validity of the SDS when used in Chinese treatment-seeking individuals, as well its usefulness as an online screening tool of FI.


2020 ◽  
Vol 37 (1) ◽  
pp. 90-111
Author(s):  
K. Andrew R. Richards ◽  
Wesley J. Wilson ◽  
Steven K. Holland ◽  
Justin A. Haegele

Although much has been learned about the workplace experiences of physical education teachers, less is known about the unique experiences of adapted physical educators (APEs). Grounded in role socialization theory, the purpose of this study was to understand the relationships among perceived organizational support, resilience, perceived mattering, emotional exhaustion, and job satisfaction in APEs. The participants included 237 APEs from the United States, who completed an online survey. The primary data analyses included confirmatory factor analysis and structural equation modeling. The final structural model was a good fit for the data, χ2(199) = 327.25, p < .001, χ2/df = 1.64; root-mean-square error of approximation = .052 (90% confidence interval [.042, .062], p = .354); standardized root-mean-square residual = .050; nonnormed fit index = .959; comparative-fit index = .964. The results of this study highlight the importance of developing a workplace environment in which APEs feel supported in developing perceptions of matter, reducing emotional exhaustion, and improving job satisfaction.


2012 ◽  
Vol 46 (5) ◽  
pp. 816-824 ◽  
Author(s):  
Juliana Alvares Duarte Bonini Campos ◽  
João Maroco

OBJETIVO: Realizar a adaptação transcultural da versão em português do Inventário de Burnout de Maslach para estudantes e investigar sua confiabilidade, validade e invariância transcultural. MÉTODOS: A validação de face envolveu participação de equipe multidisciplinar. Foi realizada validação de conteúdo. A versão em português foi preenchida em 2009, pela internet, por 958 estudantes universitários brasileiros e 556 portugueses da zona urbana. Realizou-se análise fatorial confirmatória utilizando-se como índices de ajustamento o χ²/df, o comparative fit index (CFI), goodness of fit index (GFI) e o root mean square error of approximation (RMSEA). Para verificação da estabilidade da solução fatorial conforme a versão original em inglês, realizou-se validação cruzada em 2/3 da amostra total e replicada no 1/3 restante. A validade convergente foi estimada pela variância extraída média e confiabilidade composta. Avaliou-se a validade discriminante e a consistência interna foi estimada pelo coeficiente alfa de Cronbach. A validade concorrente foi estimada por análise correlacional da versão em português e dos escores médios do Inventário de Burnout de Copenhague; a divergente foi comparada à Escala de Depressão de Beck. Foi avaliada a invariância do modelo entre a amostra brasileira e a portuguesa. RESULTADOS: O modelo trifatorial de Exaustão, Descrença e Eficácia apresentou ajustamento adequado (χ²/df = 8,498; CFI = 0,916; GFI = 0,902; RMSEA = 0,086). A estrutura fatorial foi estável (λ: χ²dif = 11,383, p = 0,50; Cov: χ²dif = 6,479, p = 0,372; Resíduos: χ²dif = 21,514, p = 0,121). Observou-se adequada validade convergente (VEM = 0,45;0,64, CC = 0,82;0,88), discriminante (ρ² = 0,06;0,33) e consistência interna (α = 0,83;0,88). A validade concorrente da versão em português com o Inventário de Copenhague foi adequada (r = 0,21;0,74). A avaliação da validade divergente do instrumento foi prejudicada pela aproximação do conceito teórico das dimensões Exaustão e Descrença da versão em português com a Escala de Beck. Não se observou invariância do instrumento entre as amostras brasileiras e portuguesas (λ:χ²dif = 84,768, p < 0,001; Cov: χ²dif = 129,206, p < 0,001; Resíduos: χ²dif = 518,760, p < 0,001). CONCLUSÕES: A versão em português do Inventário de Burnout de Maslach para estudantes apresentou adequada confiabilidade e validade, mas sua estrutura fatorial não foi invariante entre os países, apontando ausência de estabilidade transcultural.


2018 ◽  
Vol 61 (1) ◽  
pp. 77-92
Author(s):  
Eric Rakotoasimbola ◽  
Sam Blili

Using the Monte Carlo simulation method, this study analyzes the impacts on fit indices by the degree of nonnormality of variables, the sample size, and the choice of estimation method. To address these issues, we use the causal model of consumer involvement as elaborated by Mittal and Lee. Results of this study show that adjusted goodness of fit index (AGFI) and goodness of fit index (GFI) are subject to variation in sample size, and their use requires a sample size of at least 300 observations to be reliable. Comparative fit index (CFI) and root mean square error of approximation (RSMEA) are more reliable with the generalized least squares (GLS) compared with maximum likelihood estimation (MLE) method under different settings of sample size and degree of nonnormality. Finally, for the standardized root mean square residual (SRMR), it is recommended that it is used with the MLE method. This study provides prescriptions for the choice of fit indices and the requirements of sample size and estimation method to test the causal model of consumer involvement. The method used here can be extended to any model before fitting it to real data. It helps researchers to prevent conflictual results regarding the choice of fit indices.


2016 ◽  
Vol 20 (2) ◽  
pp. 221-233 ◽  
Author(s):  
Nurhening Yuniarti ◽  
Soenarto Soenarto

Penelitian ini bertujuan untuk mendapatkan bukti validitas konstrak dari instrumen yang digunakan untuk kegiatan evaluasi outcome dari lembaga pendidikan guru vokasional. Instrumen ini terdiri atas 3 jenis instrumen. Teknik analisis data yang digunakan adalah confirmatory factor analysis (CFA). Kriteria yang digunakan untuk melihat kecocokan model adalah: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), dan CFI (Comparative Fit Index). Bukti validitas instrumen dapat dilihat pada besarnya faktor loading dan t-value.  Jika loading factor lebih besar dari 0,3 dengan t-valuelebih besar dari 1,96 maka butir pernyataan dapat dikategorikan valid. Berdasarkan hasil analisis diperoleh hasil: (1) pada instrumen I terdapat 26 butir yang dinyatakan valid; (2) pada instrumen II terdapat 23 butir yang dinyatakan valid; dan (3) pada instrumen III terdapat 18 butir yang dinyatakan valid.Kata kunci: validitas konstrak, evaluasi, lembaga pendidikan guru vokasional CONSTRUCT VALIDITY OF OUTCOME EVALUATION INSTRUMENT IN VOCATIONAL TEACHER EDUCATION INSTITUTIONAbstractThis research aims to get the construct validity evidence of the outcome evaluation instrument of vocational teacher education institution. The instrument consists of 3 kinds of instruments. The analysis technique that is used to test the construct validity is confirmatory factor analysis (CFA). The criteria used to determine the goodness of fit were: p-value, normed Chi-square (X2/df), RMSEA (Root Mean Square Error of Approximation), RMR (Root Mean-square Residual), GFI (Goodness-of-Fit Index), NFI (Normed Fit Index), Non-Normed Fit Index (NNFI), and CFI (Comparative Fit Index). The evidence of the construct validity was based on the standardized loading factor and t-value. If the loading factor > 0.3 with t-value > 1.96, the item is valid. Based on the analysis, the research results are: (1) 26 item of the instrument I are categorized valid; (2) 23 items of instrument II are categorized valid; and (3) 18 items of instrument III are categorized valid.Keywords: construct validity, evaluation, vocational teacher education institution


SAGE Open ◽  
2019 ◽  
Vol 9 (1) ◽  
pp. 215824401882519 ◽  
Author(s):  
Konstantinos Papazoglou ◽  
Mari Koskelainen ◽  
Natalie Stuewe

Police officers are often exposed to violence and potentially traumatic encounters, but they have not been a focus of research on compassion fatigue or compassion satisfaction. The current study examines compassion fatigue and satisfaction among police officers and how these variables are influenced by negative personality traits. This study’s participants were police officers ( n = 1,173) from the National Police of Finland, and its aims were twofold: (a) to explore the prevalence rates and relationships between compassion fatigue, compassion satisfaction, burnout, and personality traits (Machiavellianism, `narcissism, psychopathy) among study participants; and (b) to explore whether compassion satisfaction, burnout, years of police experience, and negative personality traits are predictors of compassion fatigue. The results of the current study indicated that 10% of police officers indicated high levels of compassion fatigue and 40% revealed low levels of compassion satisfaction. In addition, compassion fatigue was found to be negatively correlated with compassion satisfaction ( r = −.33, p < .01), whereas negative personality traits were positively correlated with compassion fatigue (Machiavellianism: r = .20; narcissism: r = .19; psychopathy: r = .23; p < .01). Furthermore, negative personality traits (except narcissism) were negatively correlated with compassion satisfaction (Machiavellianism: r = −.22; psychopathy: r = −.32). Structural equation modeling (SEM) was performed to assess predictors of compassion fatigue and it indicated good model fit to the data (goodness of fit index, GFI = .976; comparative fit index, CFI = .934; root mean square error of approximation, RMSEA = .092; standardized root mean square residual, SRMR = .421). In addition, SEM revealed that compassion satisfaction, burnout, and personality traits (Machiavellianism, narcissism, and psychopathy) were significant predictors of compassion fatigue. Clinical and training implications as well as future research recommendations are also discussed.


Author(s):  
Diana M. Bravo ◽  
Juan C. Suárez-Falcón ◽  
Javier M. Bianchi ◽  
Miguel A. Segura-Vargas ◽  
Francisco J. Ruiz

The Maslach Burnout Inventory–General Survey (MBI-GS) is a widely used scale that measures burnout in the general professions. Debate persists regarding the factor structure of the MBI-GS, and there is scarce empirical evidence about the reliability, validity, and measurement invariance of the MBI-GS in Spanish-speaking samples. Moreover, the psychometric properties of the MBI-GS have not been analyzed in Colombia. This study aimed to analyze the internal consistency, factor structure, measurement invariance, and convergent validity of the MBI-GS in a large sample of Colombian workers. The MBI-GS was administered to a total sample of 978 workers from three private companies in Bogotá (66.9% males, 32.7% females, 0.4% other). All subscales showed adequate internal consistency (alphas ranging from 0.72 to 0.86). The three-factor model demonstrated a very good fit to the data (root mean square error of approximation − RMSEA = 0.05, comparative fit index − CFI = 0.99, non-normed fit index − NNFI = 0.98, and standardized root mean square residual − SRMR = 0.06). The measurement invariance both at a metric and scalar level was supported across gender, age group, and socioeconomic status. The MBI-GS subscales showed the expected correlations with job satisfaction, work engagement, psychological distress, and psychological inflexibility. In conclusion, the Spanish version of the MBI-GS demonstrated good psychometric properties in a Colombian sample.


2021 ◽  
Vol 26 ◽  
pp. 1-8
Author(s):  
Thiago Ferreira de Sousa ◽  
Sueyla Ferreira da Silva dos Santos ◽  
Silvio Aparecido Fonseca ◽  
Gerleison Ribeiro Barros ◽  
Mauro Virgílio Gomes de Barros ◽  
...  

Os objetivos do estudo foram estimar o nível de confiabilidade e validade fatorial da escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social, por meio da análise fatorial confirmatória (AFC). Para tanto, a escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social foi empregada em um estudo realizado com amostras de estudantes e servidores de instituições de ensino superior de diferentes regiões brasileiras. A amostra final correspondeu a 4.694 adultos que responderam o formulário on-line. Para a avaliação de constructo foi realizada a análise de consistência interna via Alfa de Cronbach’s (a) e correlação de Spearman. Empregou-se a AFC para testar a estrutura fatorial hipotética da escala. A consistência interna geral foi de a de 0,778 e houve correlações significativas, porém, inferiores a ± 0,799 para os itens dos mesmos constructos e ± 0,499 entre os itens de constructos diferentes. Na AFC, após ajustes na estrutura do modelo, ocorreu a adequação para todos os indicadores (Goodness-of-fit Index: 0,976; Comparative Fit Index: 0,937; Normalized Fit Indices: 0,932; Tucker-Lewis Indices: 0,914; Root Mean Square Error of Approximation: 0,047; Root Mean-Square Residual: 0,031; Standardized Root Mean-Square Residual: 0,0337), com a exceção para os valores de p do Qui-quadrado e razão entre Qui-quadrado e graus de liberdade. Conclui-se que a escala “Perfil do Estilo de Vida Individual” em tempos de distanciamento social, mostrou consistência interna e estrutura fatorial satisfatórias para orientar a avaliação do estilo de vida (individual ou de grupos) e as intervenções para promover estilos de vida saudáveis.


Author(s):  
José Leudo Maia ◽  
Marcos Antonio Martins Lima

Resumo Este estudo teve como objetivo fazer uso da Modelagem de Equações Estruturais – MEE, para avaliar a qualidade do modelo empregado pela Universidade Estadual do Ceará (UECE), no processo de seleção de seus vestibulandos, o qual é baseado na Teoria Clássica dos Testes (TCT), assim como propor ajuste a esse modelo pelo uso da Análise Fatorial de Segunda Ordem e da Análise de Regressão, via MEE. Utilizou-se um banco de dados composto dos resultados das provas de 11.060 candidatos ao vestibular de 2018.1, cujo tratamento se deu por meio do software IBM SPSS Amos (2013, v.22), obtendo-se os seguintes indicadores de qualidade: CFI ( Comparative Fit Index ) = 0,925; GFI ( Goodness-of-fit Index ) = 0,965; TLI ( Tucker Lewis Index ) = 0,922, e RMSEA ( Root Mean Square Error of Aproximation ) = 0,019. Juntos, esses indicadores demonstraram que o modelo é robusto e bastante consistente, apresentando um R 2 (Coeficiente de Correlação de Pearson ) = 0,965, indicando que a proporção das covariâncias observadas entre as variáveis manifestas e explicada pelo modelo ajustado é bastante significativa. Todas as variáveis do modelo ajustado apresentaram elevados coeficientes de regressão com valores entre 0,87 e 0,99, permitindo uma boa discriminação entre as notas dos vestibulandos, principalmente aqueles com o mesmo número de questões respondidas corretamente.


2019 ◽  
Author(s):  
Minjoo Hong ◽  
Jennie C De Gagne ◽  
Hyewon Shin ◽  
Suhye Kwon ◽  
Gum-Hee Choi

BACKGROUND Cybercivility, the practice of what to say and how to say it in online environments, encourages individuals to treat each other with respect. However, the anonymity of online communities may lead some individuals to behave in ways that violate social and cultural norms. These individuals treat others with a lack of regard and even bully others in faceless online confrontations. This practice of cyberincivility can be found across the internet, on commercial sites, and in schools offering online courses. Research on cybercivility and cyberincivility has increased in the United States, where instruments have been developed to measure the impact of cyberincivility in health profession education. However, there is no available instrument that measures nursing students’ online behaviors in South Korea. OBJECTIVE The aim of this study was to develop and evaluate a Korean version of the Academic Cyberincivility Assessment Questionnaire developed in the United States. METHODS Data were collected from 213 nursing students in three South Korean colleges. The Academic Cyberincivility Assessment Questionnaire developed by De Gagne and colleagues was adapted to measure students’ knowledge of cybercivility, and their experiences with and acceptability of cyberincivility. Content validity was tested using the content validity index (CVI). Criterion validity was tested using the digital citizenship scale. Reliability was evaluated using Cronbach alpha. The goodness-of-fit of construct validity was determined through exploratory and confirmatory factor analyses. RESULTS The CVI was 0.8 or higher for all items. Kuder–Richardson Formula 20, measuring reliability of the knowledge scale, was 0.22 and Cronbach alpha, measuring reliability of the experience scale, was .96. The goodness-of-fit of the model was Chi square=5568.63 (<i>P</i>&lt;.001), the comparative fit index (CFI) was 0.92, and the root mean square error of approximation (RMSEA) was 0.08, which satisfied the criteria. The reliability of the acceptability scale was .96, and the goodness-of-fit indices satisfied the criteria (minimum Chi square/df=2.34, Tucker-Lewis Index =0.92, incremental fit index=0.93, root mean square residual=0.05, CFI=0.93, and RMSEA=0.08). CONCLUSIONS This study extended and reevaluated the US version of cybercivility scales in a culturally distinct context. The three dimensions of cybercivility include knowledge, experience, and acceptability. Acceptability is well-validated as a dimension, whereas the knowledge dimension requires reexamination for application to Koreans. A revision of the instrument is needed that considers the cultural differences between South Korea and the United States. This paper calls for more attention to be paid to contextualized cybercivility scales among health professions in countries outside the United States.


Sign in / Sign up

Export Citation Format

Share Document