scholarly journals Validity and Reliability of Scores Obtained on Multiple-Choice Questions: Why Functioning Distractors Matter

2016 ◽  
Vol 16 (1) ◽  
pp. 1-14 ◽  
Author(s):  
Syed Haris Ali ◽  
Patrick A. Carr ◽  
Kenneth G. Ruit
Keyword(s):  
Multiple Choice ◽  
Validity And Reliability ◽  
Multiple Choice Questions ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Post Intervention ◽  
Free Response ◽  
Cronbach's Alpha ◽  
The Difference ◽  
The Impact

Purpose Plausible distractors are important for accurate measurement of knowledge via multiple-choice questions (MCQs). This study demonstrates the impact of higher distractor functioning on validity and reliability of scores obtained on MCQs. Methods Free-response (FR) and MCQ versions of a neurohistology practice exam were given to four cohorts of Year 1 medical students. Consistently non-functioning multiple-choice distractors (<5% selection frequency) were replaced with those developed from incorrect responses on FR version of the items, followed by administration of the revised MCQ version to subsequent two cohorts. Validity was assessed by comparing an index of expected MCQ difficulty with an index of observed MCQ difficulty, while reliability was assessed via Cronbach’s alpha coefficient before and after replacement of consistently non-functioning distractors. Result Pre-intervention, effect size (Cohen’s d) of the difference between mean expected and observed MCQ difficulty indices was noted to be 0.4 – 0.59. Post-intervention, this difference reduced to 0.15 along with an increase in Cronbach’s alpha coefficient of scores obtained on MCQ version of the exam. Conclusion Multiple-choice distractors developed from incorrect responses on free-response version of the items enhance the validity and reliability of scores obtained on MCQs.

scholarly journals Polish adaptation of the Iowa Satisfaction with Anaesthesia Scale

2016 ◽  
Vol 15 (4) ◽  
pp. 28-34 ◽  
Author(s):  
Danuta Dyk ◽  
Dorota Ozga ◽  
Aleksandra Gutysz-Wojnicka ◽  
Bogumił Lewandowski ◽  
Marek Wojtaszek
Keyword(s):  
Maxillofacial Surgery ◽  
Multiple Choice Questions ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Clinical Ward ◽  
Polish Version ◽  
Continue Research ◽  
Three Stages ◽  
Polish Adaptation

Abstract Introduction. The paper presents the adaptation of the Iowa Satisfaction with Anesthesia Scale to the conditions in Polish hospitals.Methods. The process of cultural adaptation of the Iowa Satisfaction with Anesthesia Scale was divided into three stages. The first stage was to formulate the Polish version of the ISAS. Secondly, the scale was used in the group of patients who were diagnosed with a maxillofacial injury and underwent surgical procedure. The final stage evaluated the psychometric features of the Polish version of the ISAS.Results. 195 questionnaires were completed correctly and they were subject to further analysis. The questionnaires were collected from patients residing at the Maxillofacial Surgery Clinical Ward who were operated under a general anaesthesia due to a maxillofacial trauma. The average result of the satisfaction with anaesthesia in a studied group was 0.77 (scale from -3 to +3) M=2, SD=2.41. The Cronbach’s alpha coefficient calculated for 11 multiple choice questions was 0.598. It would be possible to increase the Cronbach’s alpha coefficient if question no. 1 (I vomited or felt nauseous) was eliminated from the test (maximum 0.601). Every item on the scale had significant influence on the general result (p=0.0001).Conclusions. Polish version of the Iowa Satisfaction with Anesthesia Scale meets the criteria of the psychometric equivalence with the original version. It is necessary to continue research using Polish version of the ISAS to provide a constant verification of reliability and accuracy of the research tool.

scholarly journals Evaluating Reliability of Theory of Planned Behaviour Questionnaire for Withdrawal of Divorce Petition

2018 ◽  
Vol 6 (8) ◽  
pp. 1512-1516 ◽  
Author(s):  
Nahid Ardian ◽  
Seyed Alireza Afshani ◽  
Mohammad Ali Morowatisharifabad ◽  
Seyed Saeid Mazloomi Mahmoodabad ◽  
Ali Akbar Vaezi ◽  
...  
Keyword(s):  
Qualitative Study ◽  
Content Validity ◽  
Theory Of Planned Behaviour ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Planned Behaviour ◽  
Cronbach's Alpha ◽  
The Face ◽  
Suitable Framework

BACKGROUND: Given the increased rate of divorce, it is important to analyse the characteristics of divorce applicants. The theory of planned behaviour (TPB) can provide a suitable framework to predict, explain, and/or change the behaviours. In Iran, no instrument can be found, based on health education models, to investigate divorce petition filing as a behaviour.AIM: This study was conducted to design a questionnaire on withdrawal of divorce petition based on the TPB and estimate its validity and reliability.MATERIAL AND METHODS: A qualitative study was conducted in 27 participants involved in the divorce process using directed content analysis. The face and content validity of 58 items, drawn from the qualitative study, were evaluated by 10 experts. The reliability was estimated using Cronbach’s alpha coefficient. The SPSS version 16 was used to analyse data.RESULTS: Estimates of the face and content validity (quantitative and qualitative), revealed that of the 58 items, 48 were valid based on four of the constructs of the TPB. Cronbach’s alpha coefficient was also derived greater than 0.6.CONCLUSION: The designed questionnaire, whose validity and reliability was confirmed in this study, can be used in similar studies. However, the social and cultural differences and their related effects should be considered.

scholarly journals Empathy in Undergraduate Medical Students of Bangladesh: Psychometric Analysis and Differences by Gender, Academic Year, and Specialty Preferences

2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Asma Mostafa ◽  
Rozina Hoque ◽  
Mohammad Mostafa ◽  
Md. Mashud Rana ◽  
Faisal Mostafa
Keyword(s):  
Medical Students ◽  
Clinical Training ◽  
Medical Curriculum ◽  
Principal Component Factor Analysis ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Undergraduate Medical Students ◽  
Cronbach’S Alpha ◽  
Medical College ◽  
Cronbach's Alpha

Empathy is considered to be associated with better patient compliance, satisfaction, and clinical outcomes. The aim of the study is to measure and examine empathy among a sample of undergraduate medical students of Bangladesh. It was a cross-sectional study and all the medical students of first through fifth year enrolled at Chattagram Maa-O-Shishu Hospital Medical College during the study period of 2014 were surveyed. Participants anonymously completed the Jefferson Scale of Empathy Medical Student version translated into Bengali language, a valid and reliable 20-item self-administered questionnaire. Principal component factor analysis with varimax rotation and Cronbach’s alpha coefficient were calculated to check validity and reliability of the scale. ANOVA was used to examine the differences in empathy between gender, academic years, and specialty preferences. The mean empathy score was 110.41 ± 13.59. Cronbach’s alpha coefficient was 0.88. There were significant associations between gender and empathy scores. The level of empathy in medical students gradually increases after clinical training in medical college. A nonsignificant difference was found between empathy scores and specialty preferences. It is suggested that the medical curriculum in Bangladesh should include more extensive program to promote empathy and other humanistic values among the medical students.

The Validation of the Coping and Adaptation Processing Scale Based on the Roy Adaptation Model

2014 ◽  
Vol 22 (3) ◽  
pp. 368-380 ◽  
Author(s):  
Muder Alkrisat ◽  
Vivien Dee
Keyword(s):  
Health Care Facilities ◽  
Roy Adaptation Model ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Cross Sectional Survey ◽  
Convenience Sample ◽  
Cronbach's Alpha ◽  
Confirmatory Factor ◽  
Adaptation Model

Background and Purpose: To establish the psychometric soundness for Coping and Adaptation Processing Scale (CAPS) using the Roy adaptation model as theoretical framework. Method: A descriptive, cross-sectional survey of a convenience sample of 199 nurses working in different acute health care facilities in California. The internal consistency of the multifactor CAPS questionnaire was explored using Cronbach’s alpha coefficient. Factors correlation was examined using Pearson product moment correlation. The factor structure was studied using confirmatory factor analyses. Results: In the confirmatory factor analysis, the indices of fitness highly supported these results. The Cronbach’s alpha coefficient for the total score was .81 and varied between .31 and .78 in the 5 domains. A positive and significant correlation emerged between CAPS factors and total scores (r = .91, p < .01) ranging from .17 to .81. CAPS showed acceptable validity and reliability for measuring the coping of nurses in acute setting. Future studies using the scale might lead to the improvement of the subscales measurement. Conclusion: The psychometric data suggests that CAPS is a highly suitable instrument to measure coping processes.

scholarly journals Development and validation of an instrument to evaluate medical students' lifestyle

Medwave ◽  
2021 ◽  
Vol 21 (07) ◽  
pp. e8434-e8434
Author(s):  
Jhony de la Cruz Vargas ◽  
Daniel Orejón ◽  
Luis Roldan ◽  
Lucy Correa-López ◽  
Alonso Soto
Keyword(s):  
Factor Analysis ◽  
Medical Students ◽  
Construct Validity ◽  
Health Science ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Sphericity Test ◽  
Final Questionnaire ◽  
The Impact

Introduction It is required to have validated instruments in health science students that identify unhealthy habits and assess the impact of educational interventions and programs aimed at promoting a healthy lifestyle. Objective To evaluate the validity and reliability of an instrument to measure medical students' lifestyles. Methods A lifestyle questionnaire was developed using the Delphi technique by a group of experts. The final questionnaire was applied to 332 students of the School of Medicine of the Ricardo Palma University in 2017. A preliminary examination was carried out to assess preconditions for construct validity—including the correlation matrix, the Kaiser Meyer Olkin statistic, and the Bartlett sphericity test. Factor analysis was used for construct validity, and the possible resulting factors were extracted through the principal component analysis. Cronbach's alpha coefficient was calculated to assess the instrument reliability. Results In this study, 41.6% of participants were men with a mean age of 20 years (standard deviation = 3). The preconditions for the factor analysis were a Kaiser Meyer Olkin coefficient = 0.773 and a significant Bartlett sphericity test. For the 47 items of the final questionnaire, the factor analysis showed an explained variance of 56.7% with eigenvalues greater than one. Cronbach's alpha was 0.78. The final questionnaire could assume values between -23 to 151 points. Based on a cut point of 71 points, the prevalence of students with an unhealthy lifestyle was 73.6%. Conclusion The developed instrument has acceptable validity and reliability to measure lifestyle in medical students. For external validation, studies in other university populations are suggested.

scholarly journals Validade de construto e fidedignidade de uma lista de checagem para análise do saque do voleibol

2018 ◽  
Vol 20 (1) ◽  
pp. 95-101
Author(s):  
Cicero Luciano Alves Costa ◽  
Paulo Felipe Ribeiro Bandeira ◽  
Cintia De Oliveira Matos ◽  
Madson Pereira Cruz ◽  
Herbert Ugrinowitsch
Keyword(s):  
Construct Validity ◽  
Qualitative Analysis ◽  
Initial Position ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Confirmatory Factor ◽  
Sports Sciences ◽  
Male Subjects

This study aims to investigate the construct validity and reliability of the checklist for qualitative analysis of the overhand serve in Volleyball. Fifty-five male subjects aged 13-17 years participated in the study. The overhand serve was analyzed using the checklist proposed by Meira Junior (2003), which analyzes the pattern of serve movement in four phases: (I) initial position, (II) ball lifting, (III) ball attacking, and (IV) finalization. Construct validity was analyzed using confirmatory factorial analysis and reliability through the Cronbach’s alpha coefficient. The construct validity was supported by confirmatory factor analysis with the RMSEA results (0.037 [confidence interval 90% = 0.020-0.040]), CFI (0.970) and TLI (0.950) indicating good fit of the model. In relation to reliability, Cronbach’s alpha coefficient was 0.661, being this value considered acceptable. Among the items on the checklist, ball lifting and attacking showed higher factor loadings, 0.69 and 0.99, respectively. In summary, the checklist for the qualitative analysis of the overhand serve of Meira Junior (2003) can be considered a valid and reliable instrument for use in research in the field of Sports Sciences.

scholarly journals Translation, Cultural Adaptation, and Psychometric Features of the Persian Version of the Copenhagen Multi-Centre Psychological Infertility-Fertility Problem Stress Scales (COMPI-FPSS)

2021 ◽  
pp. 41-50
Author(s):  
Ladan Ahmad-Amraji ◽  
Fatemeh Jafarzadeh-Kenarsari ◽  
Kobra Abouzari-Gazafroodi ◽  
Ehsan Kazemnezhad Leyli ◽  
Robabeh Soleimani
Keyword(s):  
Cultural Adaptation ◽  
Psychometric Testing ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Fertility Problem ◽  
Cronbach's Alpha ◽  
Persian Version ◽  
North Of Iran ◽  
Coefficient Omega

Aims: This study was conducted for translation, cultural adaptation, and validation of the Persian version of the Copenhagen multi-centre psychological infertility-fertility problem stress scales (COMPI-FPSS). Study Design: This study was a methodological study. Place and Duration of Study: This research was done in an infertility clinic of an educational hospital in Rasht (north of Iran), from November 2019 to January 2020. Methodology: This study was performed in two phases including tool translation and psychometric testing. Totally, 200 infertile people selected through convenience sampling among subjects met inclusion criteria were included in the study. After obtaining permission from the original tool designer, the COMPI-FPSS (14 items) was translated into Persian using the forward-backward method. Face, content, and construct validity, as well as internal consistency (Cronbach's alpha coefficient and McDonald's coefficient omega) were evaluated, and test-retest was conducted. The data were analyzed using exploratory factor analysis (EFA) by SPSS software Ver. 16. Results: EFA led to retaining of 11 items with 3 factors of “personal domain”, “marital domain”, and “social domain”, which explained 54.42% of the total variance. Cronbach's alpha coefficient for the whole questionnaire was calculated as 0.89; also the overall McDonald's coefficient omega of the questionnaire was equal to 0.82. The correlation between the two test administrations with a 14-day interval was estimated as 0.93. Conclusion: The Persian version of the COMPI-FPSS with 11 items and 3 factors had the desired cultural adaptation, validity, and reliability and it is recommended to use it in the future studies and infertility treatment centers.

scholarly journals Psychometric Properties of the Impact of Events Scale-Revised (IES-R) Among General Iranian Population During the COVID-19 Pandemic

2021 ◽  
Vol 12 ◽  
Author(s):  
Hamid Sharif Nia ◽  
Harpaljit Kaur ◽  
Fatemeh Khoshnavay Fomani ◽  
Pardis Rahmatpour ◽  
Omolhoda Kaveh ◽  
...  
Keyword(s):  
Factor Analysis ◽  
General Population ◽  
Convergent Validity ◽  
Goodness Of Fit ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Persian Version ◽  
Impact Of Events Scale ◽  
The Impact

Objective: The aim of this study was to translate and evaluate the validity and reliability of the Impact of Events Scale-Revised (IES-R) among the Iranian general population during the coronavirus disease 2019 (COVID-19) pandemic.Method: This study was methodological cross-sectional. It was conducted on an Iranian public population from April to July 2020 which was during the COVID-19 pandemic. Construct validity was determined through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) with a total of 500 adults recruited via online data gathering. Reliability was checked through the average inter-item correlation (AIC), Cronbach's alpha, and McDonald's omega. Convergent and divergent validity was determined using Fornell and Larcker's approach.Results: The results showed that the Persian version of IES-R had three factors, including intrusion (six items), avoidance (seven items), and hyperarousal (five items), that explained 59.22% of the total variance of the IES-R. The CFA findings indicated that all goodness-of-fit indices confirmed the model fit. The Cronbach's alpha, McDonald's omega, composite reliability (CR), and maximal reliability were excellent, and the three factors have good convergent validity.Conclusion: The findings of this study indicated that the Persian version of the IES-R scale is efficient and useful to assess post-traumatic stress disorder among Iran general population in the COVID-19 outbreak.

scholarly journals The Validity and Reliability of the Persian Version of the Family Health Climate Scale (FHC-Scale) in Female Students and Their Mothers in Iran 2019

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Jeyran Ostovarfar ◽  
Mohammad Hossein Kaveh ◽  
Leila Ghahramani ◽  
Masoud Karimi ◽  
Abdolrahim Asadollahi ◽  
...  
Keyword(s):  
Family Health ◽  
Female Students ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Persian Version ◽  
The Family ◽  
Back Translation ◽  
Climate Scale

Objectives. This study examined the validity and reliability of the Family Health Climate Scale (FHC-Scale) among Iranian families. Second, can it be attributed to other family members by measuring the health climate in one person? Method. In total, 261 female students and 196 mothers completed the FHC-Scale. The study instrument was a Persian version of the FHC-Scale prepared through a translation and back-translation process. Results. The results showed that the Persian version of the FHC-Scale is acceptable. Cronbach’s alpha coefficient for FHC-PA in female students and their mothers, respectively, was 0.88 and 0.86 for the whole scale. Cronbach’s alpha coefficient for FHC-NU in female students and their mothers, respectively, was 0.83 and 0.92 for the whole scale. The CVI values for all the items were equal to or above 0.8, and the CVR value for the total scale was 0.90. Conclusion. The Persian version of the FHC-Scale is therefore an effective tool for evaluating the different dimensions of family health climate in the Iranian population.

scholarly journals Adaptation of Gratitude Questionnaire-6 (GQ–6) in Indonesian Context

2020 ◽  
Vol 47 (1) ◽  
pp. 18
Author(s):  
Dhanifa Veda Grimaldy ◽  
Handrix Chris Haryanto
Keyword(s):  
Undergraduate Students ◽  
Cultural Difference ◽  
Group Discussion ◽  
Reliability Test ◽  
Validity And Reliability ◽  
Alpha Coefficient ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Two Factors ◽  
Back Translation

Adaptation of a psychological instrument is essential due to cultural difference and context. This study aimed to adapt the Gratitude Questionnaire-6 (GQ-6) in an Indonesian context. The initial steps included back-to-back translation, focus group discussion, expert judgements, and pilot study. From this procedure, five additional items were added to the original GC-6. The eleven final items were tested to 404 undergraduate students aged 18-24 years-old from several universities in Jakarta. The reliability test, the internal consistency, was examined by the Cronbach’s alpha coefficient, while the validity test, construct validity, was examined using exploratory factor analysis (EFA).  The result of analysis showed good validity and reliability (Cronbach’s alpha: 0.789). This study concluded that 11-item gratitude questionnaire consistently measured gratitude in adolescents based on two factors: appreciation to the constant  experience of life and appreciation towards individuals that take part in one’s life.

Sign in / Sign up

Export Citation Format

Share Document