scholarly journals Development of PATS: A tool to assess professionalism

2019 ◽  
Author(s):  
humaira Fayyaz Khan ◽  
raheela Yasmeen ◽  
Shabana Ali ◽  
Tahira sadiq

Abstract Background: Professionalism has become a specific requirement for medical graduates because of dissatisfaction regarding their preparedness to adequately deal with the challenges of the medical world. It should be assessed as a competency in the final year of study using a valid and reliable instrument. The purpose was to develop and validate a tool to assess the development of professionalism in final year medical students in the local context to assess the readiness of medical graduates. Method: This was a mixed method study. Micro scenarios for the preliminary instrument were developed after a focus group meeting. These were validated using a 3-round modified Delphi technique by email. Twenty-four participants responded in the first round, and 15 in the second and third rounds. After the first round, relevance of the item was obtained. The content validity ratio was calculated after second round. Cut off value for items were approximated to be 0.6 and 0.73 for modification and 0.8 for item retention. The second round revised analysis was sent to participants for the third round and the content validity index average and universal agreement were calculated. Cognitive pretesting was performed. Cronbach’s Alpha for reliability and Confirmatory factor analysis were carried out. Results: The focus group produced 46 micro-scenarios using a manual qualitative analysis. The first round of Delphi produced 35 items. On calculation of Content validity ratio 12 items were retained, 18 were revised and 5 were removed. Content validity index (I-CVI) and content validity scale (S-CVI) were 0.94 and 0.64 respectively. Pre-cognitive testing resulted in the modification of 4 items. The Confirmatory factor analysis was 4.1. Cronbach’s Alpha was 0.96. Conclusion: The final instrument developed has a 27 item 5-point Likert scale. It has good content validity, reliability and acceptable construct validity. The strength of the instrument is in its process of development i.e. focus group discussion, the iterative Delphi rounds, cognitive pre-testing and piloting. It can be used to assess the development of professionalism in final year medical students. Keywords: Professionalism, respect, altruism, honor and integrity, accountability, content validity, construct validity, cognitive pre-testing, and confirmatory factor analysis

2019 ◽  
Author(s):  
Humaira Fayyaz Khan ◽  
Raheela Yasmeen ◽  
Shabana Ali ◽  
Tahira Sadiq

Abstract Background: Professionalism has become a specific requirement for the medical graduates because of dissatisfaction regarding their preparedness to adequately deal with the challenges of the medical world. It should be assessed as a competency in the final year of medical students through a valid and reliable instrument. The purpose of the study was to develop and validate an instrument to assess the development of professionalism in final year medical students in the local context to assess the readiness off medical graduates. Method: This was a mixed method study with sequential qualitative and quantitative components.Micro scenarios for the preliminary instrument were developed after focus group. These were validated through 3 round modified Delphi technique by emails. A total of 24 participants responded for the first round, 15 for the 2nd and 3 rd rounds. After first round relevance of the item was obtained. Content validity ratio was calculated after second round. Cut off value for items was appropriated to be 0.6, 0.73 for modification and 0.8 for item retention. Second round analysis for revision of the opinions were send to participants for third round and content validity index average and universal agreement were performed. Cognitive pretesting was done. Cronbach’s Alpha for reliability and Confirmatory factor analysis was carried out after piloting. Results: Focus group resulted in 46 micro scenarios through manual qualitative analysis. Modified Delphi technique was used for content validation. First round of Delphi resulted in 35 items. After second round Content validity ratio was calculated. Twelve items were retained, 18 revised and 5 were removed. Content validity index (I-CVI) and content validity scale (S-CVI) was 0.94 and 0.64 respectively. Pre-cognitive testing resulted in modification of 4 items. Confirmatory factor analysis was 4.1. Cronbach’s Alpha was 0.96. Conclusion: The final instrument developed is a 27 item 5-point Likert scale. It has good content validity, reliability and acceptable construct validity. The strength of the instrument was in its process of development, which was focus group discussion, the iterative Delphi rounds, cognitive pre-testing and piloting. It can be used to assess the development of professionalism in the students of final year medical students.


Author(s):  
Utku Durgut ◽  
Tulin Yildiz

Abstract Objective: This study aimed to carry out the validity and reliability study for the adaptation of the Competencies for Disaster Nursing Management Questionnaire (CDNMQ), which was developed by Al Thobaity and others in 2016, (https://pubmed.ncbi.nlm.nih.gov/26778698/) to Turkish, and to be able to use in the nursing literature. Method: This study was conducted in a methodological approach. The scale used in this study was a 10-point Likert scale with 43 items and 3 subfactors. The questionnaire was applied to 450 nurses. The validity and reliability of the scale were evaluated using the exploratory and confirmatory factor analysis. The content validity index was measured within the scope of the internal consistency measurements, and the Pearson’s product-moment correlation coefficient was examined for the test-retest. Results: The content validity index score was found to be 0.98. As a result of the confirmatory factor analysis of the CDNMQ, it was found that the 3-factor structure of the scale was valid and the goodness of fit tests was appropriate. Conclusion: The findings have shown that the CDNMQ study is similar to the original scale and an adequate measurement tool in determining competencies in disaster nursing management.


2020 ◽  
Author(s):  
Jun-Yao Fan ◽  
Hui-Min Zhao ◽  
Yue-Ting Liu ◽  
Ling-Lin Kong ◽  
Jing Mao ◽  
...  

Abstract Background The increasing of older adults has led to enormous demand for medical care. However, as a group with unique needs and characteristics, older adults are often discriminated against in the medical field. In this paper, we aimed to translate the Fraboni Scale of Ageism (FSA) into Chinese and examine its construct validity, content validity, and reliability in Chinese mainland medical students. In order to evaluate the prevalence of ageism in Chinese medical students and prompt medical college to adopt necessary teaching methods to mitigate ageism in medical students. Methods By Brislin's translation guidelines, FSA was translated to Chinese. The convenient sampling method was used to select samples for this survey, including 1,974 students from two medical schools in central and north China. Construct validity was verified by the exploratory and confirmatory factor analysis. The content validity index (CVI) was used to assess content validity. The Cronbach's alpha coefficients and intraclass correlation coefficient (ICC) were used to estimate reliability. Results The alpha coefficients for FSA (Chinese version) was 0.81 and ICC was 0.87. The CVI was 0.93. Three factors were identified by exploratory factor analysis explaining 34.84% of the total variance and a three-factor model was confirmed to fit by confirmatory factor analysis. Conclusions FSA (Chinese version) is a reliable and valid scale for measuring discrimination degree against the older adults in Chinese medical students.


BMC Nursing ◽  
2021 ◽  
Vol 20 (1) ◽  
Author(s):  
Zhen Yang ◽  
Fengmin Chen ◽  
Yingying Lu ◽  
Huijun Zhang

Abstract Background Nurses are the most important members of the health care system for medication safety, there are few tools to evaluate their medication safety competence. This study aimed to translate the Medication Safety Competence Scale into Chinese and validate its reliability and validity among clinical nurses. Methods A total of 894 clinical nurses were recruited from three cities in China. The original version of the Medication Safety Competence Scale was translated into Chinese using the backward and forward translation procedure. The reliability of the scale was measured by internal consistency, split-half reliability, and stability. The validity of the scale was assessed by the content validity index, exploratory factor analysis and confirmatory factor analysis. Results The Cronbach’s coefficient of the scale was 0.940, and the coefficient values for the six domains ranged between 0.843 and 0.948. The split-half reliability and stability were 0.671 and 0.703, respectively. The content validity index of the scale was 0.952. The 6-factor structure, supported by the eigenvalues, total variance explained, and scree plot accounted for 71.485 % of the total variance. Moreover, as a result of the confirmatory factor analysis, the average variance extracted values were 0.55 to 0.70, and the model fitting indexes were all in the acceptable range. Conclusions The Chinese version of the Medication Safety Competence Scale had ideal reliability and validity among clinical nurses. The evaluation results of the scale can provide a reference for nursing managers to formulate education plans and intervention measures to improve clinical nurses’ safe medication competence.


2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Qiqi Zhuo ◽  
Changsheng Cui ◽  
Hongmin Liang ◽  
Yangjuan Bai ◽  
Qiulan Hu ◽  
...  

Abstract Background Health education basing on patients’ information-seeking styles can improve the effectiveness of health education and patients’ health outcomes. The Miller Behavioral Style Scale (MBSS) is widely used to identify individual’s information-seeking styles, but the Chinese version is lacking. The study aim was to translate and culturally adapt the MBSS into Chinese version and test the content validity, construct validity and internal consistency reliability of the Chinese version of MBSS (C-MBSS). Methods The forward-back-translation procedure was adopted in the translation of the MBSS. Content validity was assessed in a panel of experts. In a sample of 1343 individuals including patients, patients’ caregivers, university students, and medical staff, reliability and construct validity were assessed using Cronbach’s alpha coefficient and factor analysis. The measurement invariance across samples was tested using multigroup confirmatory factor analysis (MGCFA). Floor and ceiling effects were checked. Results The C-MBSS achieved conceptual and semantic equivalence with the original scale. The item-level content validity index (I-CVI) of each item ranged from 0.78 to 1, and the averaging scale-level content validity index (S-CVI/ Ave) was 0.95. The exploratory factor analysis resulted in 2-factor assumption for each hypothetical threat-evoking scenario. Confirmatory factor analysis demonstrated a good fit between theoretical model and data, which provided confirmatory evidence for the second-order factor structure of 2-factor solution (Monitoring and Blunting). The Cronbach's alpha coefficients for the Monitoring and Blunting sub-scales of the C-MBSS were 0.75 and 0.62 respectively. MGCFA results supported the measurement invariance for the Monitoring sub-scale of the C-MBSS across samples. No floor or ceiling effects occurred. Conclusions This study indicates that the C-MBSS has good content and construct validity. The Monitoring sub-scale of the C-MBSS had acceptable internal consistency reliability while the Blunting sub-scale had unsatisfactory one, which suggest that the Monitoring sub-scale of the C-MBSS can be used to identify individuals’ information-seeking styles in Chinese contexts across different populations.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Güven Özkaya ◽  
Mevlüt Okan Aydin ◽  
Züleyha Alper

Abstract Background There are major changes in education strategies as higher education institutions urgently need to adopt distance education tools and practices due to the Covid-19 pandemic. Medical education is also trying to get out of this emergency using distance education. In this study, we aimed to develop a reliable and valid scale in order to evaluate the perceptions of medical students towards distance education. Methods The students taking part in the study were in the first five academic years of the medical faculty in Bursa in Turkey. At first, 57 items were determined to evaluate students’ perceptions. Content validity was examined according to the assessment of the expert team. Construct validity of these items was examined by exploratory and confirmatory factor analysis. Also, Cronbach’s alpha coefficients were calculated for reliability analysis. The medical students’ responses were scored using a five-point Likert scale. Results When the content validity was examined, the number of items was determined to be 38 items. Construct validity of these items was examined by exploratory and confirmatory factor analysis. Because of the exploratory factor analysis performed on the responses of 429 medical students, 22 items were included in four factors. This four-factor model was applied to 286 medical students and validated by confirmatory factor analysis. Also, Cronbach’s alpha coefficients were calculated for reliability analysis and values were between 0.713 and 0.930. Conclusions This study demonstrated validation and reliability of perceptions of distance education for medical students. We suggest a 22-item model with a four-factorial scale.


2021 ◽  
Author(s):  
Qiqi Zhuo ◽  
Changsheng Cui ◽  
Hongmin Liang ◽  
Yangjuan Bai ◽  
Qiulan Hu ◽  
...  

Abstract Background: Health education basing on patients’ information-seeking styles can improve the effectiveness of health education and patients’ health outcomes. The Miller Behavioral Style Scale (MBSS) is widely used to identify individual’s information-seeking styles, but the Chinese version is lacking. The study aim was to translate and culturally adapt the MBSS into Chinese version and test the content validity, construct validity and internal consistency reliability of the Chinese version of MBSS (C-MBSS).Methods: The forward-back-translation procedure was adopted in the translation of the MBSS. Content validity was assessed in a panel of experts. In a sample of 1343 individuals including patients, patients’ caregivers, university students, and medical staff, reliability and construct validity were assessed using Cronbach’s alpha coefficient and factor analysis. The measurement invariance across samples was tested using multigroup confirmatory factor analysis (MGCFA). Floor and ceiling effects were checked.Results: The C-MBSS achieved conceptual and semantic equivalence with the original scale. The item-level content validity index (I-CVI) of each item ranged from 0.78 to 1, and the averaging scale-level content validity index (S-CVI/ Ave) was 0.95. The exploratory factor analysis resulted in 2-factor assumption for each hypothetical threat-evoking scenario. Confirmatory factor analysis demonstrated a good fit between theoretical model and data, which provided confirmatory evidence for the second-order factor structure of 2-factor solution (Monitoring and Blunting). The Cronbach's alpha coefficients for the Monitoring and Blunting sub-scales of the C-MBSS were 0.75 and 0.62 respectively. MGCFA results supported the measurement invariance for the Monitoring sub-scale of the C-MBSS across samples. No floor or ceiling effects occurred. Conclusions: This study indicates that the C-MBSS has good content and construct validity. The Monitoring sub-scale of the C-MBSS had acceptable internal consistency reliability while the Blunting sub-scale had unsatisfactory one, which suggest that the Monitoring sub-scale of the C-MBSS can be used to identify individuals’ information-seeking styles in Chinese contexts across different populations.


2018 ◽  
Vol 17 (03) ◽  
pp. 314-321
Author(s):  
José Manuel Hernández-Padilla ◽  
Matías Correa-Casado ◽  
José Granero-Molina ◽  
Alda Elena Cortés-Rodríguez ◽  
Tamara María Matarín-Jiménez ◽  
...  

AbstractObjectiveTo translate, culturally adapt, and psychometrically evaluate the Spanish version of the “Scale for End-of Life Caregiving Appraisal” (SEOLCAS).MethodObservational cross-sectional study. Convenience sample of 201 informal end-of-life caregivers recruited in a southern Spanish hospital. The reliability of the questionnaire was assessed through its internal consistency (Cronbach's α) and temporal stability (Pearson's correlation coefficient [r] between test-retest). The content validity index of the items and the scale was calculated. Criterion validity was explored through performing a linear regression analysis to evaluate the SEOLCAS’ predictive validity. Exploratory factor analysis was used to examine its construct validity.ResultsThe SEOLCAS’ reliability was very high (Cronbach's α = 0.92). Its content validity was excellent (all items’ content validity index = 0.8–1; scale's validity index = 0.88). Evidence of the SEOLCAS’ criterion validity showed that the participants’ scores on the SEOLCAS explained approximately 79.3% of the between-subject variation of their results on the Zarit Burden Interview. Exploratory factor analysis provided evidence of the SEOLCAS’ construct validity. This analysis revealed that two factors (“internal contingencies” and “external contingencies”) explained 53.77% of the total variance found and reflected the stoic Hispanic attitude toward adversity.Significance of resultsThe Spanish version of the SEOLCAS has shown to be an easily applicable, valid, reliable, and culturally appropriate tool to measure the impact of end-of-life care provision on Hispanic informal caregivers. This tool offers healthcare professionals the opportunity to easily explore Hispanic informal end-of-life caregivers’ experiences and discover the type of support they may need (instrumental or emotional) even when there are communicational and organizational constraints.


2020 ◽  
Vol 6 (5) ◽  
pp. 177-181
Author(s):  
Gil P Soriano

Background: Breast cancer patients need to be treated not only physically and emotionally but also spiritually. Hence, the assessment of the spirituality of patients is essential to provide holistic nursing care. However, there was no culturally valid and reliable instrument that measures spirituality among Filipino women with breast cancer.Objective: The study was conducted to determine the psychometric properties of the spiritual index of well-being among Filipino women with breast cancer.Methods: A descriptive cross-sectional design was utilized in the study, and a sample of 170 Filipino women with breast cancer were included. The World Health Organization guidelines were used to translate the original instrument to Filipino, and content validity was computed using the Davis technique. Also, confirmatory factor analysis with maximum likelihood estimation was performed to assess the construct validity of the instrument. Cronbach’s α and item-total correlations were done to assess the internal consistency of the Filipino version of the spiritual index of well-being.Results: The Filipino version of the spiritual index of well-being had an item content validity index (I-CVI) ranging from 0.86 to 0.92 and a scale content validity index (S-CVI) of 0.95. The confirmatory factor analysis (CFA) showed factor loadings of 0.42 to 0.72. Also, the CFA model revealed a 𝜒2/df = 2.51, root mean square error of approximation= 0.074, comparative fit index= 0.091, goodness of fit index=0.98, Tucker-Lewis index= 0.93, incremental fit index= 0.91, and standard root mean square residual== 0.072.Conclusion: The Filipino version of the spiritual index of well-being was cross-culturally valid and reliable in measuring the spiritual index of well-being among Filipino women with breast cancer.


Author(s):  
Alina Alwast ◽  
Katrin Vorhölter

AbstractTeaching mathematical modeling is a demanding task. Thus, fostering teachers’ competencies in this regard is an essential component of teacher education. Recent conceptualizations of teachers’ competencies include situation-specific skills based on the concept of noticing, which is of particular interest for the spontaneous reactions needed when teaching mathematical modeling. The study described in this paper aims to analyze the development of a video-based instrument for measuring teachers’ noticing competencies within a mathematical modeling context and obtain evidence for the validity of the instrument. Three kinds of validity are examined in three different studies: content validity, elemental validity and construct validity. Indicators for content validity could be found through different expert ratings and implementation with the target group, where participants were able to perceive all relevant aspects. The qualitative analysis of participants’ reasoning, which is consistent with the coded level, indicates elemental validity. Moreover, the results of the confirmatory factor analysis suggest construct validity with one overall factor of noticing competence within a mathematical modeling context. Taken together, these studies imply a satisfactory validity of the video-based instrument.


Sign in / Sign up

Export Citation Format

Share Document