scholarly journals Psychometrics of Assessment Tools to Examine the Challenges of Physicians' Participation in Accreditation Programs

Author(s):  
Hosein Ebrahimipour ◽  
Elahe Hooshmand ◽  
Mehdi Varmaghani ◽  
Seyyed Morteza Mojtabaeian

Background: Many organizations believe that physician involvement is important in quality and safety of health services, but they did not properly define, measure, and improve it, so because of the importance of the quality of health care and increasing the involvement of physician this study was conducted to evaluate the validity and reliability of a questionnaire on the challenges of physicians' participation in quality improvement programs. Methods: In this cross-sectional study conducted in the hospitals of Mashhad University of Medical Sciences, a researcher-made questionnaire about challenges of physicians' participation in accreditation activities used for data gathering. The content validity ratio index and content validity index were also calculated. To measure the internal consistency of the instrument, the questionnaire was distributed among 14 physicians, Cronbach's alpha coefficient was determined. For stability or reproducibility of the instrument, test - retest and correlation coefficient were calculated. By distributing questionnaires among 14 people those meeting inclusion criteria, the correlation coefficient was measured twice and at intervals of 2 weeks. SPSS 21 software was used for data analysis Results: The initial questionnaire was consisted of 61 items, which were reduced to 38 items after face and content psychometrics. The questionnaire has 12 sub-concepts. Cronbach's alpha coefficient of the questionnaire was 0.83 and the intragroup correlation coefficient in 2 measurements 2 weeks apart was 0.94. Conclusion: This questionnaire is the first and only valid and reliable dedicated tool in the field of challenges of physicians' participation in accreditation activities in Iran, which can measure and prioritize the challenges in each health center and it can be used to improve health care quality services that are performed by doctors.

2018 ◽  
Vol 6 (8) ◽  
pp. 1512-1516 ◽  
Author(s):  
Nahid Ardian ◽  
Seyed Alireza Afshani ◽  
Mohammad Ali Morowatisharifabad ◽  
Seyed Saeid Mazloomi Mahmoodabad ◽  
Ali Akbar Vaezi ◽  
...  

BACKGROUND: Given the increased rate of divorce, it is important to analyse the characteristics of divorce applicants. The theory of planned behaviour (TPB) can provide a suitable framework to predict, explain, and/or change the behaviours. In Iran, no instrument can be found, based on health education models, to investigate divorce petition filing as a behaviour.AIM: This study was conducted to design a questionnaire on withdrawal of divorce petition based on the TPB and estimate its validity and reliability.MATERIAL AND METHODS: A qualitative study was conducted in 27 participants involved in the divorce process using directed content analysis. The face and content validity of 58 items, drawn from the qualitative study, were evaluated by 10 experts. The reliability was estimated using Cronbach’s alpha coefficient. The SPSS version 16 was used to analyse data.RESULTS: Estimates of the face and content validity (quantitative and qualitative), revealed that of the 58 items, 48 were valid based on four of the constructs of the TPB. Cronbach’s alpha coefficient was also derived greater than 0.6.CONCLUSION: The designed questionnaire, whose validity and reliability was confirmed in this study, can be used in similar studies. However, the social and cultural differences and their related effects should be considered.


2020 ◽  
Vol 60 (1) ◽  
pp. 55-64
Author(s):  
Asja Čelebić ◽  
Ivica Stančić ◽  
Ines Kovačić ◽  
Aleksandra Popovac ◽  
Jolanda Topić ◽  
...  

AbstractIntroductionThe aim was to adapt the Croatian and the Serbian versions of the Oral Health Impact Profile for the edentulous population (OHIP-EDENT-CRO and OHIP-EDENT-SRB).MethodsThe translation and cross-cultural adaptation were carried out in accordance with accepted international standards. A total of 95 and 177 removable denture wearers were recruited in Croatia and Serbia respectively. The reliability was evaluated by calculating Cronbach’s alpha coefficient and by test-retest (30 participants in each country). The concurrent validity was determined by calculating the Spearman’s rank coefficient between the OHIP-EDENT summary scores and one question related to removable denture satisfaction. Construct validity was determined by exploratory factor analysis (EFA). Responsiveness was determined by comparison of the OHIP-EDENT summary scores before and after dental implant placement to support mandibular overdentures (23 patients in Croatia, 21 in Serbia).ResultsCronbach’s alpha coefficient was 0.92 in Croatia and 0.87 in Serbia. The intraclass correlation coefficient was 0.98 in Croatia and 0.94 in Serbia. In Croatia the Spearman’s correlation coefficient was -0.71 (p<0.001) and in Serbia -0.74 (p<0.001). Both confirmed concurrent validity. Construct validity was tested by EFA, which extracted four factors in each country, accounting for 66.59% of the variance in Croatia and 59.33% in Serbia. Responsiveness was confirmed in both countries by a significant OHIP-EDENT summary score reduction and a high standardised effect size (3.9 in Croatia, 1.53 in Serbia).ConclusionThe results prove that both instruments, the OHIP-EDENT-CRO and the OHIP-EDENT-SRB, have very good psychometric properties for assessing OHRQoL in the edentulous population.


2019 ◽  
Vol 5 ◽  
pp. 205520761983894
Author(s):  
Ahmadreza Shamsabadi ◽  
Ahmad Delbari ◽  
Ahmad Siar Sadr ◽  
Esmaeil Mehraeen ◽  
Niloofar Mohammadzadeh ◽  
...  

Background Advancements in information technology have been instrumental in successful recent developments in telemonitoring systems. In this regard, there is a lack of development of valid and reliable tools to determine the requirements and applications of telemonitoring systems used to provide health care for frail elderly people living at home, specifically in a national setting. Method A cross-sectional study was carried out in 2018. The statistical population was 15 geriatric and gerontology professionals and 15 health information management experts. Then, content validity ratio (CVR), Cronbach's alpha, and correlation coefficient were calculated for measuring content validity, internal consistency and external reliability (through the test–retest method) respectively. SPSS software was used to analyze the collected data. Results Based on the identified items, a draft questionnaire was developed. Using the validity analysis in two stages, 37 items were removed, and 60 items were approved as the essential system requirements. The final questionnaire was organized into five sections with content validity index 99% and internal reliability (Cronbach's alpha coefficient 0.9). Furthermore, the external reliability results of the questionnaire showed that this instrument has a desirable correlation coefficient ( r = 0.85, p-value<0.05). Conclusion Considering the desirable validity and reliability of the questionnaire developed, it is recommended to telemonitoring system designers to determine the usages and requirements of health monitoring systems for frail elderly people living at home. The verified instrument is suitable for use in countries with the same living conditions and level of development as Iran.


2018 ◽  
Vol 6 (5) ◽  
pp. 925-930 ◽  
Author(s):  
Rumyana Stoyanova ◽  
Rositsa Dimova ◽  
Miglena Tarnovska ◽  
Tatyana Boeva

BACKGROUND: Patient safety (PS) is one of the essential elements of health care quality and a priority of healthcare systems in most countries. Thus the creation of validated instruments and the implementation of systems that measure patient safety are considered to be of great importance worldwide.AIM: The present paper aims to illustrate the process of linguistic validation, cross-cultural verification and adaptation of the Bulgarian version of the Hospital Survey on Patient Safety Culture (B-HSOPSC) and its test-retest reliability.METHODS: The study design is cross-sectional. The HSOPSC questionnaire consists of 42 questions, grouped in 12 different subscales that measure patient safety culture. Internal con­sistency was assessed using Cronbach’s alpha. The Wilcoxon signed-rank test and the split-half method were used; the Spear­man-Brown coefficient was calculated.RESULTS: The overall Cronbach’s alpha for B-HSOPSC is 0.918. Subscales 7 Staffing and 12 Overall perceptions of safety had the lowest coefficients. The high reliability of the instrument was confirmed by the Split-half method (0.97) and ICC-coefficient (0.95).  The lowest values of Spearmen-Broun coefficients were found in items A13 and A14.CONCLUSION: The study offers an analysis of the results of the linguistic validation of the B-HSOPSC and its test-retest reliability. The psychometric characteristics of the questions revealed good validity and reliability, except two questions. In the future, the instrument will be administered to the target population in the main study so that the psychometric properties of the instrument can be verified.


2019 ◽  
Vol 5 (6) ◽  

Objectives: The aim of this study was to develop and validate a DCG assessment framework for use in local dental schools in Iran. Methods: A mixed method (qualitative and quantitative) was used in the present investigation. The study was performed in 3 steps, including: a) thorough literature review, b) focused group discussion and c) Application of validated instrument. The content validity index (CVI) and content validity ratio (CVR) were calculated for each question. The Cronbach's alpha coefficient was calculated to evaluate the internal consistency and reliability for this questionnaire. The Smart PLS software was used for calculation of Goodness of Fit (GOF) for confirmatory factorial analysis to determine construct validity of this questionnaire. Results: Initially, 140 items covering 7 DCG domains were identified after comprehensive literature review. Ten specialists participated in the expert panel, rating independently on the necessity, relevancy, simplicity and clarity of each question. Expert’s ratings were used to calculate the validity for each question. The questions with CVI lower than 0.79 and the CVR less than 0.62 were excluded. Reliability analysis was conducted by calculating intra class coefficient (ICC) and Cronbach's alpha coefficient which were 0.88 and 0.92 respectively. This shows good reliability and internal consistency of the questionnaire. Construct validity determined by computing Goodness of Fit index. The result was 0.622, which indicates a good level of construct validity. After validation process, 124 out of 140 questions left to cover the 7 domains of DCG in our newly developed and validated framework. Conclusions: The newly developed and standardized DCG framework can be used for assessment of compliance level among Iranian dental schools at the national level.


2019 ◽  
Vol 7 (9) ◽  
pp. 1407-1414 ◽  
Author(s):  
Zahra Ebnehoseini ◽  
Hamed Tabesh ◽  
Kolsoum Deldar ◽  
Seyed Mostafa Mostafavi ◽  
Mahmood Tara

BACKGROUND: Hospital Information System (HIS) is a type of health information system which is widely used in clinical settings. Determining the success rate of HISs is an ongoing area of research since its implications are of interest for researchers, physicians and managers. AIM: In the present study, we develop a novel instrument to measure HIS success rate based on users’ viewpoints in a teaching hospital. METHODS: The study was conducted in Ebnesina and Dr Hejazi Psychiatric Hospital and education centre in Mashhad, Iran. The instrument for data collection was a self-administered structured questionnaire based on ISSM, covering seven dimensions, which includes system quality, information quality, service quality, system use, usefulness, satisfaction, and net benefits. The verification of content validity was carried out by an expert panel. The internal consistency of dimensions was measured by Cronbach’s alpha. Pearson’s correlation coefficient was calculated to evaluate the significance of associations between dimensions. The HIS success rate on users’ viewpoints was determined. RESULTS: A total of 125 users participated in the study. The instrument was validated by an expert panel with the Content Validity Index (CVI): 0.85 and Content Validity Ratio (CVR): 0.86. The overall Cronbach’s alpha value of the instrument was 0.93. The Pearson correlation coefficient showed significant positive relationships among the investigated dimensions. On average, HIS success rate in the hospital under study was 65% (CI: 64%, 67%). The dimensions of “usefulness”, “system quality”, and “net benefits” showed the highest rates of success, respectively. CONCLUSION: The instrument used in this study can be adopted for HIS evaluation in future studies. In the current study, a method was developed to determine the HIS success rate based on users’ viewpoints. This method allows for the comparison of HIS success rates in various hospitals. As well, our findings underscore the viewpoints of HIS users in a developing country.


Author(s):  
M Firoozeh ◽  
A Kavousi ◽  
S Hassanzadeh

Introduction: Modified Euro Quest questionnaire to assess neurological and psychiatric effects caused by exposure to organic solvents is used. This study investigates the validity, reliability, and usability of the modified Euro Quest questionnaire in Iran. Materials and Methods: This cross-sectional descriptive study was conducted on 206 workers of color and textile industries. Modified Euro Quest questionnaire was translated into Persian by using the forward-backward translation standard method. To evaluate the content validity, convergent validity, internal consistency, and reliability of the questionnaire were used the index CVI, Pearson correlation coefficient, Cronbach's alpha, and test-retest. The convergent validity was compared, results of the questionnaire, with results of mini-mental state examination (MMSE) and Multidimensional Fatigue Inventory (MFI). Results: The relationship between the modified Euroquest questionnaire was compare with the MMSE test and the MFI's questionnaire, Pearson correlation coefficients, and the results showed in order - 0.86 and 0.65, which represents a significant inverse correlation between this questionnaire with MMSE test(p>0.001) And a moderate correlation with the MFI's questionnaire(p>0.001). Content validity index (CVI) and intraclass correlation coefficient (ICC) were obtained in order amounts of ≤0.79 and 0.92, which was acceptable. The final questionnaire, Cronbach's alpha coefficient, was calculated (α =0.84).  Conclusion: The modified Euroquest Persian version is a valuable tool to assess the neurological and psychological effects caused by exposure to organic solvents in Iranian workers. 


2018 ◽  
Author(s):  
A. Paykari ◽  
A. Mazloumi ◽  
G. H. Halvani ◽  
S. Ghaneh ◽  
Musa Mashayekhi

Background: Usability is an index to assess a product from the viewpoint of users satisfaction, efficiency and productivity improvement. The main attributes of usability that are derived from the human factors are  and used  in usability design of the interfaces Include: compatibility, consistency, flexibility, minimal action, perceptual limitation, usefulness, learnability, ease of use, minimal memory load, user guidance, satisfaction and errors. The main aim of this study was to assess the usability of interface design tool for a ventilator utilized in the hospitals of Arak city, Iran; and study its validation and reliability. Methods and Materials After constructing the initial questionnaire from the standard sources, specific techniques to determine the validity,  and Cronbach's alpha coefficient were used for the validity and reliability study. The study procedure was: determining the scope and dimensions of the questions, drafting questionnaire, assigning members of the expert panel, study, questionnaire data acquisition  and analysis methods, determining acceptance criteria of the questions and the content validity and reliability index. Results Final tool was a 42-items questionnaire. The content validity index (CVI) of questionnaire was 0.86. The results showed that the total Cronbach's alpha coefficient was 0.89 as an acceptable value for the reliability of questionnaire. Conclusion After the final questionnaire design and the appropriate validity and reliability of it, adopting this tool to assess the usability of breathing apparatus (ventilator) is recommended. With usability assessment of such vital instruments, quality improvement, higher efficiency and productivity as well as errors reduction and good design user interface will be achieved. Keywords: usability, ventilator, evaluation questionnaire, content validity, reliability


Author(s):  
Esmail AHMADIAN ◽  
Hamidreza MEHRI ◽  
Faeze SEPAHI-ZOERAM ◽  
Hamed MOHAMMADI

Introduction: Due to occurrence of fires in process industries, it is vital to implement crisis management systems in these industries and keep the readiness of these systems high. The purpose of this study is to evaluate the readiness of emergency response teams to deal with a possible fire in a process industry. Methods: This descriptive-analytical study was performed in 2019 in a gas refinery with a statistical population of 200 people. A questionnaire with Likert scale was designed through library and field studies for all teams participating in the firefighting process. Content Validity Ratio (CVR) and Content Validity Index (CVI) were used to measure validity and Cronbach's alpha coefficient was used to measure the reliability of the questionnaires. The collected data were entered into SPSS software version 24 and statistical analysis was performed at 95% significance level using One Way ANOWA test. Results: The results showed that the readiness of this refinery to deal with a possible fire was 68.3%, which among the 11 teams participating in this process, the security team with 53.48% had the lowest and the logistics team with 77.5% had the highest preparedness (P-value = 0.028). The highest CVR was for the safety team questionnaire (0.77) and the highest Cronbach's alpha coefficient was for the liaison team (0.92).  Conclusion: The results of this study showed that the readiness of this gas refinery in the firefighting process is satisfactory, although some teams, including the security team, are less prepared than other teams. Therefore, it is better to take intervention measures as soon as possible, including providing the necessary equipment and providing various trainings and maneuvers in order to increase the readiness of the teams.  


Sign in / Sign up

Export Citation Format

Share Document