scholarly journals Psychometric assessment of the Instructional Materials Motivation Survey (IMMS) instrument in a remote learning environment

Author(s):  
Aloísio Cardoso-Júnior ◽  
Rosa Malena Delbone de Faria

Abstract: Introduction: Motivation contributes greatly to learning, being a predictor of student performance. Thus, instruments that assess motivation after exposure to different teaching strategies and materials can contribute to the analysis and decision on its effectiveness. In this sense, the Instructional Materials Motivation Survey (IMMS) instrument measures students’ motivation after instructional activities. Objective: This study aimed to evaluate the evidence of validity of the IMMS, previously translated and cross-culturally adapted to Brazilian Portuguese. Method: Cross-sectional study used to evaluate the psychometric properties of the IMMS questionnaire, applied to 211 students from the first, third and fourth semesters of the medical course at José do Rosário Vellano University (Unifenas - Campus Belo Horizonte). The principal component analysis (PCA) with Varimax rotation and Cronbach’s alpha coefficient were used to assess the validity and reliability of the instrument. Results: The PCA reduced the instrument’s items from 36 to 25 items, distributed in four dimensions. The saturation of the items in the dimensions ranged from 0.529 to 0.790 and the total explained variance was 63.12%. The reliability of the modified IMMS (IMMS-BRV), measured by Cronbach’s alpha, ranged from 0.76 (Attention dimension) to 0.93 (Interest dimension). Conclusion: The IMMS application in the remote education scenario, through asynchronous video lectures of human anatomy, resulted in an alternative instrument (IMMS-BRV), with fewer items (more parsimonious) and good internal consistency, demonstrating preliminary evidence of its validity and reliability adequacy.

Author(s):  
Aloísio Cardoso-Júnior ◽  
Rosa Malena Delbone de Faria

Abstract: Introduction: Motivation contributes greatly to learning, being a predictor of student performance. Thus, instruments that assess motivation after exposure to different teaching strategies and materials can contribute to the analysis and decision on its effectiveness. In this sense, the Instructional Materials Motivation Survey (IMMS) instrument measures students’ motivation after instructional activities. Objective: This study aimed to evaluate the evidence of validity of the IMMS, previously translated and cross-culturally adapted to Brazilian Portuguese. Method: Cross-sectional study used to evaluate the psychometric properties of the IMMS questionnaire, applied to 211 students from the first, third and fourth semesters of the medical course at José do Rosário Vellano University (Unifenas - Campus Belo Horizonte). The principal component analysis (PCA) with Varimax rotation and Cronbach’s alpha coefficient were used to assess the validity and reliability of the instrument. Results: The PCA reduced the instrument’s items from 36 to 25 items, distributed in four dimensions. The saturation of the items in the dimensions ranged from 0.529 to 0.790 and the total explained variance was 63.12%. The reliability of the modified IMMS (IMMS-BRV), measured by Cronbach’s alpha, ranged from 0.76 (Attention dimension) to 0.93 (Interest dimension). Conclusion: The IMMS application in the remote education scenario, through asynchronous video lectures of human anatomy, resulted in an alternative instrument (IMMS-BRV), with fewer items (more parsimonious) and good internal consistency, demonstrating preliminary evidence of its validity and reliability adequacy.


PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0249660
Author(s):  
Mohd Noor Norhayati ◽  
Zanaridah Mat Nawi

Background Evidence-based medicine (EBM) is a widely accepted scientific advancement in clinical settings that helps achieve better, safer, and more cost-effective healthcare. However, presently, validated instruments to evaluate healthcare professionals’ attitude and practices toward implementing EBM are not widely available. Therefore, the present study aimed to determine the validity and reliability of a newly developed knowledge, attitude, and practice (KAP) questionnaire on EBM for use among healthcare professionals. Methods The Noor Evidence-Based Medicine Questionnaire was tested among physicians in a government hospital between July and August 2018. Exploratory factor analysis and internal consistency reliability-based Cronbach’s alpha statistic were conducted. Results The questionnaire was distributed among 94 physicians, and 90 responded (response rate of 95.7%). The initial number of items in the KAP domains of the Noor Evidence-Based Medicine Questionnaire were 15, 17, and 13, respectively; however, two items in the practice domain with communalities <0.25 and factor loadings <0.4 were removed. The factor structure accounted for 52.33%, 66.29%, and 55.39% of data variance in the KAP domains, respectively. Cronbach’s alpha values were 0.81, 0.81, and 0.84 for KAP domains, respectively, indicating high reliability. Conclusions This questionnaire can be used to evaluate the knowledge, attitudes, and behaviour of healthcare professionals toward EBM. Future testing of this questionnaire among other medical personnel groups will help expand the scope of this tool.


2020 ◽  
Vol 2020 ◽  
pp. 1-7 ◽  
Author(s):  
Adel Bashatah ◽  
Khalid A. Alahmary

Background and Objective. The Moore Index of Nutrition Self-Care (MIN-SC) questionnaire has been used widely in both English and Spanish languages. The purpose of this study is to convert MIN-SC into the Arabic language and to test the translated tool for validity and reliability among adolescents in Saudi Arabia. Method. The psychometric characteristics of MIN-SC were assessed using college freshman students at King Saud University in Riyadh, Saudi Arabia. The validity and reliability were examined using Cronbach’s alpha coefficient. The construct validity was examined through principal component analysis. Results. The MIN-SC instrument was shown to be internally consistent with reliable scoring (Cronbach’s alpha = 0.910). Exploratory factor analysis resulted in 42 items loading on three main components: estimative, production, and transitional, with a factor loading of eigenvalues >2. The final model explained 38% of the variance. Conclusion. The Arabic version of MIN-SC was shown to be a valid and reliable tool for assessing attitude toward nutrition among adolescent students.


2020 ◽  
Vol 28 (2) ◽  
pp. E98-E138
Author(s):  
Enia Zigbuo-Wenzler ◽  
Gayenell S. Magwood ◽  
Martina Mueller ◽  
Angela Fraser

Background and PurposePoor dietary practices are linked to many chronic diseases. The purpose of this validation study was to develop a psychometrically sound instrument that can be administered by health practitioners to measure dietary barriers.MethodsThe Dietary Health Status (DHS) instrument, designed to measure dietary barriers is comprised of items in the National Health and Nutrition Examination Survey-What We Eat in America datasets. Content validity was established for DHS using an expert review process. Principal component analysis (PCA) was then used to assess validity and reliability as determined by Cronbach's alpha values.ResultsThe PCA supported a 10-component solution, explaining 61% of the total variance. Cronbach's alpha was .67 for the entire instrument, ranging from .55 to .87 for the 10 subscales.ConclusionResults suggest the instrument had sufficient construct and internal validity. This exploratory study is an important first step in validating the DHS instrument.


2021 ◽  
Vol 6 (3) ◽  
pp. 19
Author(s):  
Aric Vranada ◽  
Chiou-Fen Lin ◽  
Chia-Jung Hsieh ◽  
Tsae-Jyy Wang

Background: Nursing shortages are a significant problem experienced by medical institutions worldwide as well as Indonesia. Understanding nurses’ work environment is a proper strategy for enhancing the retention and overcoming shortages of nurses. The Quality Nursing Work Environment (QNWE) is a well-known tool that has been commonly used to evaluate the working atmosphere of nurses. However, the availability and validated version of the instrument for hospital nurses in Indonesia is not confirmed.Purpose: This study aims to confirm the psychometric evaluation of the Indonesian version of QNWE instruments in hospital settings.Methods: A cross-sectional study design and psychometric analyses were administered. The 65-item, eight-domain questionnaire was translated, adapted, and face-validated using content validity index (CVI) analysis. The construct validity and internal consistency of the translated version were tested using confirmatory factor analysis (CFA) and Cronbach's Alpha to 334 hospital nurses. The intraclass correlation coefficient (ICC) was employed to determine test-retest and interrater reliability analysis to 33 nurses and 10 ratters in the pilot testing.Results: The CVI of the QNWE-I scale ranged from 0.86 to 1.00. The CFA determined an adequate model fit of the instrument. As to overall reliability, test-retest reliability of 0.90, ICC analysis of 0.82, and Cronbach's alpha of 0.96; was confirmed.Conclusions: The psychometric evaluation of the QNWE-I showed excellent acceptability, validity, and reliability. Therefore, the QNWE-I can serve as a comprehensive instrument for assessing the quality of nurses' work environments in Indonesia.


2021 ◽  
pp. JNM-D-20-00028
Author(s):  
Hakime Aslan ◽  
Ümmühan Aktürk

Background/aimThis study was conducted to determine the validity and reliability of the Breast Cancer Cultural Beliefs Scale for women with breast cancer in Turkish society.Materials and methodsThe population of this study was composed of patients diagnosed with breast cancer who were treated for cancer in the Adult Chemotherapy Unit. A total of 178 women with breast cancer participated in this study.ResultsIn order to determine the factor structure of the scale, principal component analysis was performed. Cronbach's alpha was used to determine the reliability of the scale scores. The results explained 62.93% of the total variance of the scale. The result of the Kaiser–Meyer–Olkin test was determined to be 0.813, and that of Bartlett's test was 723.56. Cronbach's alpha coefficient of the scale was .74.ConclusionIt was determined that the Breast Cancer Cultural Beliefs Scale was a valid and reliable tool for assessing the cultural beliefs of women in Turkey.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Mehri Ansariniaki ◽  
Minoor Lamyian ◽  
Fazlollah Ahmadi ◽  
Abbas Rahimi Foroushani ◽  
Carolann L. Curry ◽  
...  

Abstract Background Postpartum maternal functioning has the potential to affect the quality of interaction between mother and child. A proper assessment of maternal functioning requires a comprehensive and accurate tool. The objective of this study was to prepare a Persian version of the Barkin Index of Maternal Functioning (BIMF) and evaluate its psychometric properties in order to determine its applicability in Iranian mothers. Methods The BIMF was translated into Persian and then culturally adapted for Iranian women. After evaluating face and content validity, to perform factor analysis, a cross-sectional study was conducted using the Persian version of BIMF. The data was collected from two unique groups of 250 mothers (in all 500 mothers) who had infants 2 to 12-months old and who were selected using a two-stage cluster sampling method. Factor analysis, Pearson’s correlation, intra-class correlation coefficients (ICC), composite reliability (CR) and Cronbach’s alpha were employed in order to evaluate structural validity and reliability. Results Exploratory factor analysis resulted in a five-factor structure consisting of 20 items. Subsequently, confirmatory factor analysis (X 2/ df = 1.61, RMSEA = 0.050, GFI = 0.91, CFI = 0.91) confirmed that the Persian version had satisfactory goodness of fit. Reliability and internal consistency were confirmed with a CR of 0.77, an ICC of 0.87 and a Cronbach’s alpha of 0.81. Conclusions The findings indicated that the Persian version of the BIMF is a valid and reliable instrument for assessing maternal functioning among Iranian mothers.


2021 ◽  
Vol 27 (1) ◽  
pp. 146045822097546
Author(s):  
Maria Cellina Wijaya ◽  
Yudhistira Pradnyan Kloping

Nowadays, it is common for people to look for health care information on the internet. The eHealth Literacy Scale (eHEALS) is commonly used to measure eHealth literacy. As of the publication of this study, the Indonesian version for eHEALS has not been published even though eHealth literacy is necessary, especially in the current COVID-19 pandemic. We aimed to evaluate the validity and reliability of the Indonesian version of eHEALS (I-eHEALS). A total of 100 respondents in East Java were involved in this cross-sectional study. Pearson-product moment correlation method and construct validity were used to validate the results. The reliability was determined based on the Cronbach’s alpha internal consistency measurement and intraclass correlation coefficient (ICC). The Pearson correlation analysis results are significantly higher ( r > 0.254, p < 0.01) compared to the critical value table. Single factors accounting for 57.66% variance in the scales exhibit a unidimensional latent structure. The internal consistency between items is excellent as shown by the Cronbach’s alpha coefficient (0.91). The ICC analysis shows an acceptable result (0.552, p < 0.01). The I-eHEALS is valid and reliable to be used for evaluating the eHealth literacy of the Indonesian population.


2020 ◽  
Vol 19 (3) ◽  
pp. 241-250
Author(s):  
Fatemeh Sadat Mirzadeh ◽  
Mahtab Alizadeh-Khoei ◽  
Farshad Sharifi ◽  
Reyhaneh Aminaloroaya ◽  
Sakar Hormozi ◽  
...  

Purpose Normal aging changes, acute and chronic illness, and the long stay in the hospital made the decline in elderly physical and mental abilities in non-instrumental and Instrumental Activities Daily Livings (IADL). This paper aims to determine the validity and reliability of Lawton IADL in the Iranian elderly community relevancy to physical, mental and cognitive measurements. Design/methodology/approach A cross-sectional study with 422 participants, age 60 years old and over selected by face-to-face interviewing from the geriatric clinic, Tehran medical university from January to June 2019. Findings Of 422 participants referring to outpatient clinics the majority were male (62.8%); with an average of 66.9 ± 5.95 years old. Reliability was significantly high (Cronbach’s alpha = 0.96, p < 0.001). There was a significant relationship between IADL with Short-Form Health Survey36-Mental Component Score (SF36-MCS), with p < 0.01. Reliability was significantly high (Cronbach’s alpha = 0.96, p < 0.001). In the factor analysis with eigenvalues more than one, two components were found; that the first factor named as observational daily activities, whereas the second factor named “advanced daily activities”. Research limitations/implications The limitation of this study was the low number of similar studies to compare the results and the stronger discussion. Originality/value Determining IADL's dependency in the community elderly is important to maintain their self-care manages. More studies are needed to manifest the relationship between mental health and IADL's independence. Therefore, validation in different settings is important in planning for the geriatrics team.


2021 ◽  
Vol 15 (1) ◽  
pp. 179-185
Author(s):  
Kelly Jaqueline da Costa Galinari Tomazin ◽  
Hélio Amante Miot ◽  
Kathrin Stoll ◽  
Ivana Regina Gonçalves ◽  
Wilza Carla Spiri ◽  
...  

Background: The fear of childbirth can range from apprehension to intense fear (tokophobia), with serious consequences for maternal health. Therefore, a standardized scale is needed to measure the fear of childbirth before pregnancy. Objective: This study aimed to adapt the Childbirth Fear Prior to Pregnancy (CFPP) scale to the Brazilian context and analyse its validity and reliability. Methods: A cross-sectional survey was completed by 146 nursing students at two Brazilian universities. A committee of experts evaluated the cross-cultural adaptation of the CFPP scale. Construct validity was verified using item-total correlations and Exploratory Factor Analysis (EFA). The validity of divergent concurrent criteria was evaluated by associating the score obtained using the Brazilian CFPP with the Depression, Anxiety, and Stress Scale (DASS-21). Reliability was analysed using Cronbach’s alpha coefficient and test-retest. Results: Correlation analysis revealed a predominance of moderate inter-item correlation and strong item-total correlation (>0.62). The EFA indicated that all items related to a single factor, with factor loadings and communalities >0.5. These results reinforced the one-dimensionality of the Brazilian CFPP. The validity of divergent concurrent criteria was confirmed via weak correlations with DASS-21 scores (r = 0.32, p < 0.001). The Cronbach’s alpha (0.86) and the intra-class correlation coefficient (0.99) indicated reliability and strong temporal stability, respectively. Conclusion: The Brazilian version of the CFPP provides evidence of validity and reliability to measure fear of childbirth before pregnancy in young adults in Brazil.


Sign in / Sign up

Export Citation Format

Share Document