The overuse of Cronbach’s alpha in psychology of religion: A suggested alternative with a primer on how & when to use them

2020 ◽  
Author(s):  
Sarah Jane Charles

The Psychology of Religion has had a tradition measuring things that are seemingly difficult to measure, such as one’s level of religiosity or spirituality – concepts that are polysemantic, so do not have a simple definition. In doing so, researchers have developed scales to measure such constructs. This trend in Psychology of Religion research will continue as researchers start to conduct studies in non-Western Educated Industrialized Rich Democratic (WEIRD) populations, as they will require new scales that are appropriate for the way that these populations conceptualize religiosity and spirituality. Scale construction takes multiple steps, which most researchers are well-acquainted with. One important step is to demonstrate both validity and reliability. In the Psychology of Religion, an overwhelming majority of researchers use Cronbach’s alpha to estimate scale reliability. However, alpha has multiple preconditions that can easily be violated in psychology research that are rarely tested for, let alone adjusted for. Much like with using parametric statistical analyses when parametric assumptions are violated, this approach may be leading to inaccurate reporting. This article will discuss; (1) whether alpha should be used at all in Psychology of Religion research and, if so, when it is appropriate; (2) introduce another estimate of scale reliability, Omega, and show how and it might be calculated; (3) provide examples of how these techniques might be taught to students studying Psychology of Religion at undergraduate and higher levels. In doing so, I hope to move the entire field of Psychology of Religion forward in terms of methodological rigor.

PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0249660
Author(s):  
Mohd Noor Norhayati ◽  
Zanaridah Mat Nawi

Background Evidence-based medicine (EBM) is a widely accepted scientific advancement in clinical settings that helps achieve better, safer, and more cost-effective healthcare. However, presently, validated instruments to evaluate healthcare professionals’ attitude and practices toward implementing EBM are not widely available. Therefore, the present study aimed to determine the validity and reliability of a newly developed knowledge, attitude, and practice (KAP) questionnaire on EBM for use among healthcare professionals. Methods The Noor Evidence-Based Medicine Questionnaire was tested among physicians in a government hospital between July and August 2018. Exploratory factor analysis and internal consistency reliability-based Cronbach’s alpha statistic were conducted. Results The questionnaire was distributed among 94 physicians, and 90 responded (response rate of 95.7%). The initial number of items in the KAP domains of the Noor Evidence-Based Medicine Questionnaire were 15, 17, and 13, respectively; however, two items in the practice domain with communalities <0.25 and factor loadings <0.4 were removed. The factor structure accounted for 52.33%, 66.29%, and 55.39% of data variance in the KAP domains, respectively. Cronbach’s alpha values were 0.81, 0.81, and 0.84 for KAP domains, respectively, indicating high reliability. Conclusions This questionnaire can be used to evaluate the knowledge, attitudes, and behaviour of healthcare professionals toward EBM. Future testing of this questionnaire among other medical personnel groups will help expand the scope of this tool.


2017 ◽  
Vol 5 (4) ◽  
pp. 44
Author(s):  
Rüştü Yeşil

use after also being checked by linguists. The validity analysis of the scale for the data collected was performed with exploratory factor analysis and item-total correlation tests, while the property of reliability was determined using the Cronbach’s alpha internal consistency coefficient and the stability test was carried out by determining the relationship between two applications conducted at an interval of the five weeks. The scale, which is called the “Scale for Determining the Civic-Mindedness Levels of Individuals” is a five-step Likert-type scale and consists of 27 items that can be collected under three factors. The factor names are “Openness to Criticism/Development”, “Participation/Activeness” and “Lack of Prejudice/Flexibility”. The KMO value of the scale was 0.956; and the Bartlett Test values were x2=11001.719; sd=351; p<0.000. Items in the scale accounted for 56.619% of the total variance. As a result of the confirmatory factor analysis, the χ2 value was 808.07 and the degree of freedom was 321. Χ2/df is 2.51. The fit indices of the scale were determined as RMSEA=0.067; S-RMR=0.049; NFI=0.97. The item-total corrected correlation coefficients of the items in the scale varied between 0.40 and 0.703 (p<.01). The reliability coefficient of the scale was Cronbach’s alpha at 0.954 and the stability coefficients of the items were between 0.496 and 0.674 (p<,01).


2020 ◽  
Author(s):  
Behrouz Attarbashi Moghadam ◽  
Hasan Tamartash ◽  
Sara Fereydunnia ◽  
Mahdieh Ravand

The Minnesota Living with Heart Failure Questionnaire (MLHFQ) has been developed to measure health-related quality of life (HRQoL) status of Heart Failure (HF) patients. The aim of this study was to translate MLHFQ into the Persian version and assess the validity and reliability of the translated version. We used a forward-backward procedure for translation. In a cross-sectional study, 105 HF patients and 50 healthy subjects were selected to assess the reliability and construct validity of the instrument. The face and content validity were used to assess the questionnaire validity. Validity was examined on the HF patients group, using the Persian version of the Short form-36 health survey (SF-36) Questionnaire. In order to assess the questionnaire’s reliability, the Intraclass correlation coefficient (ICC) and Cronbach’s alpha were calculated. Test-retest reliability was examined by re-administering the MLHFQ after 2 weeks. Test-retest results demonstrated that the Persian version has excellent reliability (ICC for all 2 domains were higher than 0.91, P≤0.000). Internal consistency for Physical domain (PD), emotional domain (ED) and total scores using Cronbach’s alpha were 0.90, 0.84 and 0.92, respectively. ICC for PD, ED and total scores were 0.95, 0.94, and 0.97, respectively. Good and very good Pearson's Correlation Coefficient was seen between MLHFQ and SF-36 (r= -0.47 to -0.775, P≤0.000 for PD; r= -0.47 to -0.65, P≤0.000 for ED). The Persian version of the MLHFQ had satisfactory reliability and validity for assessing HRQoL status of Iranian HF patients. © 2019 Tehran University of Medical Sciences. All rights reserved. Acta Med Iran 2019;57(7):435-441.


2021 ◽  
Vol 42 ◽  
Author(s):  
Mireille Janczyk Hereibi ◽  
Juliana Perez Arthur ◽  
Maria de Fátima Mantovani ◽  
Ângela Taís Mattei ◽  
Wendy Julia Mariano Viante ◽  
...  

ABSTRACT Objective: To validate the construct and test the reliability of the Brazilian version of Hypertension Knowledge-Level Scale. Methods: Methodological research with 220 participants in a primary health care unit from Curitiba, Paraná. The data were collected with a social demographic questionnaire and the Brazilian version of the scale. The construct validity and reliability were assessed using Cronbach’s Alpha, Pearson’s Correlation and Analysis of Variance. The discriminant validity was verified comparing groups of people with hypertension and without, using T test. Results: Cronbach’s Alpha was 0.74. The groups comparison showed that people with hypertension had better results (p<0,001). Pearson’s Correlation showed that the questions measure different aspects of the same construct, justifying its organization in subdimensions. Conclusion: The Brazilian version of Hypertension Knowledge-Level Scale is a reliable instrument, which had its construct and criterion validated to measure knowledge about hypertension among Brazilian people. It can help health professionals with planning educative actions.


Author(s):  
Ilse Seubert Coelho Vieira ◽  
Nathália Irffi Carvalho ◽  
Antonio Carlos de Castro Toledo Júnior ◽  
Eliane Perlatto Moura

Abstract: Introduction: The humanities are associated with the improvement of medical students’ personal qualities. To date, there are no research instruments that quantify the exposure of medical students have to the humanities. Hence, the availability of a questionnaire with such characteristics in Brazilian Portuguese sets a precedent for the planning and implementation of educational strategies and policies addressing this topic. Objective: to translate and transculturally adapt the “HUMANITIES SCORE (LIFE EXPERIENCES + ATTITUDES) questionnaire, determine its validity and reliability, as well as identify the type of exposure to the humanities of the assessed population. Method: The original version of the questionnaire, written in English, was translated according to what is recommended by the specialized literature, with the addition of some activities in the humanities field, as per the original authors’ suggestion. The translated instrument underwent a pre-test with 31 medical students for semantic validation, followed by the application of its final version to 258 students. The exploratory and the confirmatory factorial analyses were applied to assess the instrument with its internal consistency was checked with Cronbach’s Alpha coefficient. Result: The final questionnaire was administered to the students to verify their type of exposure to the humanities. After the statistical tests were carried out, the final version of the instrument, named “Escala de Exposição às Humanidades” (EEH), included 17 items with Likert-scale responses with five options each, and obtained a Cronbach’s alpha of 0.689. The mean score of the students’ exposure was 1.72 ± 0.37, being influenced by the period at medical school, the number of volunteer social activity experiences, the participation in religious groups, the practice of meditation, and the involvement in political activities. Variables such as female gender, engagement in previous actions related to the humanities before starting medical school and in religious ceremonies positively influenced the students’ opinion about the importance of the humanities for the medical curriculum. Conclusion: The EEH demonstrated reliability in its structure and content, allowing correlations between the students’ exposure to humanities and their opinion about the importance of human sciences in the medical curriculum. It constitutes the first instrument that aims at measuring the humanities exposure rate in Brazil; however, further studies must be carried out, to better validate the instrument.


2021 ◽  
Vol 104 (8) ◽  
pp. 1317-1325

Background: Kinesiophobia is described as fear of physical movement resulting in painful injury. Older adults with knee osteoarthritis usually suffer from joint pain. Assessment of kinesiophobia is beneficial for prevention of further deterioration in performing activity. Even though, the Tampa Scale of Kinesiophobia (TSK-11) has been developed to briefly examine pain related to fear of movement in patients with chronic pain, the TSK-11 Thai version has not been examined for its validity and reliability yet. Objective: To examine psychometric properties of the TSK-11 Thai version. Materials and Methods: A cross-sectional study with 200 older people with knee osteoarthritis living in the northeastern part of Thailand was used in the present study. Participants were asked to complete the demographic questionnaire, the TSK-11-Thai version, the numeric rating scale (NRS), and the Pain Catastrophizing Scale (PCS) Thai version. To confirm the TSK-11 Thai version validity, construct validity was examined using confirmatory factor analysis. Pearson correlation coefficients were used to confirm the TSK-11-Thai version’s convergent validities. For internal consistency reliability, Cronbach’s alpha coefficients were also assessed. Results: The results of confirmatory factor analysis indicated that a two-factor model, including somatic factor and activity avoidance, fitted with the data. The TSK11-Thai version was positively correlated with pain catastrophizing. Cronbach’s alpha coefficients of the total TSK11-Thai version was at 0.77. For subscale, Cronbach’s alpha coefficients of the TSK somatic factor and activity avoidance were 0.61 and 0.69, respectively. Conclusion: The Thai version of TSK-11 has acceptable validity and reliability. The TSK-11-Thai version is suitable to use to examine pain-related fear of movement in patients with knee osteoarthritis for clinical and research purposes. Keywords: Instrument; Knee osteoarthritis; Older people; Pain-related fear of movement; Tampa Scale of Kinesiophobia-Thai version; Psychometric properties; Validation


2019 ◽  
Vol 26 (7-8) ◽  
pp. 2482-2493 ◽  
Author(s):  
Catarina Fischer Grönlund ◽  
Anna Söderberg ◽  
Vera Dahlqvist ◽  
Lars Andersson ◽  
Ulf Isaksson

Background: An ethical climate has been described as a working climate embracing shared perceptions about morally correct behaviour concerning ethical issues. Various ethical climate questionnaires have been developed and validated for different contexts, but no questionnaire has been found concerning the ethical climate from an inter-professional perspective in a healthcare context. The Swedish Ethical Climate Questionnaire, based on Habermas’ four requirements for a democratic dialogue, attempts to assess and measure the ethical climate at various inter-professional workplaces. This study aimed to present the construction of and to test the psychometric properties of the Swedish Ethical Climate Questionnaire. Method: An expert group of six researchers, skilled in ethics, evaluated the content validity. The questionnaire was tested among 355 healthcare workers at three hospitals in Sweden. A parallel analysis (PA), an exploratory factor analysis and confirmatory factor analysis were performed. Ethical considerations: The participants included in the psychometric analysis were informed about the study, asked to participate in person and informed that they could withdraw at any time without giving any reason. They were also assured of confidentiality in the reporting of the results. Findings: The parallel analysis (PA) recommended one factor as a solution. The initial exploratory factor analysis with a four-factor solution showed low concordance with a four-factor model. Cronbach’s alpha varied from 0.75 to 0.82; however, since two factors only consisted of one item, alpha could not be reported. Cronbach’s alpha for the entire scale showed good homogeneity (α = 0.86). A confirmatory factory analysis was carried out based on the four requirements and showed a goodness-of-fit after deleting two items. After deletion of these items, Cronbach’s alpha was 0.82. Discussion: Based on the exploratory factor analysis, we suggest that the scale should be treated as a one-factor model. The result indicates that the instrument is unidimensional and assesses ethical climate as a whole. Conclusion: After testing the Swedish Ethical Climate Questionnaire, we found support for the validity and reliability of the instrument. We found the 10-item version of Swedish Ethical Climate Questionnaire satisfactory. However, we found no support for measuring different dimensions and, therefore, this instrument should be seen as assessing ethical climate as of whole.


2020 ◽  
Vol 2020 ◽  
pp. 1-7 ◽  
Author(s):  
Adel Bashatah ◽  
Khalid A. Alahmary

Background and Objective. The Moore Index of Nutrition Self-Care (MIN-SC) questionnaire has been used widely in both English and Spanish languages. The purpose of this study is to convert MIN-SC into the Arabic language and to test the translated tool for validity and reliability among adolescents in Saudi Arabia. Method. The psychometric characteristics of MIN-SC were assessed using college freshman students at King Saud University in Riyadh, Saudi Arabia. The validity and reliability were examined using Cronbach’s alpha coefficient. The construct validity was examined through principal component analysis. Results. The MIN-SC instrument was shown to be internally consistent with reliable scoring (Cronbach’s alpha = 0.910). Exploratory factor analysis resulted in 42 items loading on three main components: estimative, production, and transitional, with a factor loading of eigenvalues >2. The final model explained 38% of the variance. Conclusion. The Arabic version of MIN-SC was shown to be a valid and reliable tool for assessing attitude toward nutrition among adolescent students.


2018 ◽  
Vol 6 (8) ◽  
pp. 1512-1516 ◽  
Author(s):  
Nahid Ardian ◽  
Seyed Alireza Afshani ◽  
Mohammad Ali Morowatisharifabad ◽  
Seyed Saeid Mazloomi Mahmoodabad ◽  
Ali Akbar Vaezi ◽  
...  

BACKGROUND: Given the increased rate of divorce, it is important to analyse the characteristics of divorce applicants. The theory of planned behaviour (TPB) can provide a suitable framework to predict, explain, and/or change the behaviours. In Iran, no instrument can be found, based on health education models, to investigate divorce petition filing as a behaviour.AIM: This study was conducted to design a questionnaire on withdrawal of divorce petition based on the TPB and estimate its validity and reliability.MATERIAL AND METHODS: A qualitative study was conducted in 27 participants involved in the divorce process using directed content analysis. The face and content validity of 58 items, drawn from the qualitative study, were evaluated by 10 experts. The reliability was estimated using Cronbach’s alpha coefficient. The SPSS version 16 was used to analyse data.RESULTS: Estimates of the face and content validity (quantitative and qualitative), revealed that of the 58 items, 48 were valid based on four of the constructs of the TPB. Cronbach’s alpha coefficient was also derived greater than 0.6.CONCLUSION: The designed questionnaire, whose validity and reliability was confirmed in this study, can be used in similar studies. However, the social and cultural differences and their related effects should be considered.


2020 ◽  
Vol 10 (8) ◽  
pp. 47
Author(s):  
Baljit Kaur Gill

Background and objective: Globally, the use of clinical simulation has been incorporated in different nursing programs. It is important to evaluate simulation using reliable and valid instruments. Using the same instrument helps to evaluate simulation under the same criteria both nationally and internationally. The National League of Nursing developed three simulation scales which is widely used in different countries and demonstrates a good reliability and validity. Nevertheless, it is only available in English. The aim of the study was to translate the original NLN simulation evaluation scales into Traditional Chinese and evaluate its psychometric properties.Methods: Beaton and colleague’s (2000) cross-cultural adaptation guidelines was adopted. Cronbach’s alpha coefficient (α) and Corrected item-total correlation was used to determine the internal reliability. Haccoun’s single group technique was used to assess the equivalent of the scale in the original and the translated version. Lastly, Exploratory Factor Analysis (EFA) was used to determine the factor structure and Intra-Class Correlation Coefficient (ICC) to test the stability of translated scale.Results: Nine simulation experts from Hong Kong, Mainland China, Singapore and Taiwan confirmed translation of the NLN scales (EPQ-C, SDS-C, SSCL-C). Cronbach’s alpha of all subscales and overall scales were acceptable (0.72-0.89). The intra-language, inter-language and temporal inter-language cross correlations between the original and translated scales were correlated (p < 0.01). ICC of the translated scales ranges from good to excellent (0.78-0.91). Lastly, EFA also demonstrated the items were theoretically coherent (≥ 0.40) and have the same factor structure as the original English version.Conclusions: Traditional Chinese NLN simulation evaluation scales demonstrated strong validity and reliability.


Sign in / Sign up

Export Citation Format

Share Document