Adaptation and validation of a Korean-language version of the revised hospital survey on patient safety culture (K-HSOPSC 2.0)

Abstract Background To date, there has been no universal and validated tool for measuring safety culture in Korea. The Hospital Survey on Patient Safety Culture (HSOPSC), version 2.0 was released by the Agency for Healthcare Research and Quality in 2019, but it had not yet been translated and assessed for use in Korea. The aim of this study was to assess the content validity and other psychometric properties of the Korean-language version of the HSOPSC 2.0. Methods Instrument adaptation was performed using a committee-based translation, cognitive interviews, and expert panel reviews. Confirmatory factor analysis was conducted on data obtained through an online survey from 526 registered nurses who worked on medical-surgical units in three teaching hospitals in South Korea. Results One item was dropped during the translation and adaption phase of the study as being a poor fit for the Korean healthcare context, resulting in excellent content validity. Confirmatory factor analysis supported the factorial structure of the K-HSOPSC 2.0. Correlations with an overall measure of patient safety provided further evidence of construct validity. Additionally, in comparing the results of this current study to those from U.S. research using the HSOPSC 2.0, it was found that Korean nurses assigned less positive scores to all dimensions of patient safety culture. Conclusion Our findings provide evidence of the content validity, reliability, and construct validity of the K-HOSPSC 2.0 for measuring patient safety culture in South Korean hospitals. Hospital administrators can use this tool to assess safety culture and identify areas for improvement to enhance patient safety and quality of care.

Download Full-text

Development of a patient safety culture scale for maternal and child health institutions in China: a cross-sectional validation study

BMJ Open ◽

10.1136/bmjopen-2018-025607 ◽

2019 ◽

Vol 9 (9) ◽

pp. e025607

Author(s):

Yuanyuan Wang ◽

Hui Han ◽

Liqian Qiu ◽

Chaojie Liu ◽

Yan Wang ◽

...

Keyword(s):

Factor Analysis ◽

Patient Safety ◽

Safety Culture ◽

Health Workers ◽

Reliability And Validity ◽

Patient Safety Culture ◽

Cross Sectional ◽

Retest Reliability ◽

Confirmatory Factor ◽

Test Retest Reliability

ObjectiveThis study aimed to develop a patient safety culture (PSC) scale for maternal and child healthcare (MCH) institutions in China.MethodsA theoretical framework of PSC for MCH institutions was proposed through in-depth interviews with MCH workers and patients and Delphi expert consultations. The reliability and validity of the PSC scale were tested in a cross-sectional survey of 1256 MCH workers from 14 MCH institutions in Zhejiang province of China. The study sample was randomly split into half for exploratory and confirmatory factor analyses, respectively. Test–retest reliability was assessed through a repeated survey of 63 voluntary participants 2 weeks apart.ResultsThe exploratory factor analysis extracted 10 components: patient engagement in patient safety (six items), managerial response to patient safety risks (four items), perceived management support (five items), staff empowerment (four items), staffing and workloads (four items), reporting of adverse events (three items), defensive medical practice (three items), work commitment (three items), training (two items) and transfer and handoff (three items). A good model fit was found in the confirmatory factor analysis: χ2/df=1.822, standardised root mean residual=0.048, root mean square error of approximation=0.038, comparative fit index=0.921, Tucker-Lewis index=0.907. The PSC scale had a Cronbach’s α coefficient of 0.89 (0.59–0.90 for dimensional scales) and a test–retest reliability of 0.81 (0.63–0.87 for dimensional reliability), respectively. The intracluster correlation coefficients confirmed a hierarchical nature of the data: individual health workers nested within MCH institutions.ConclusionThe PSC scale for MCH institutions has acceptable reliability and validity. Further studies are needed to establish benchmarking in a national representative sample through a multilevel modelling approach.

Download Full-text

Measuring pre-service teachers’ noticing competencies within a mathematical modeling context – an analysis of an instrument

Educational Studies in Mathematics ◽

10.1007/s10649-021-10102-8 ◽

2021 ◽

Author(s):

Alina Alwast ◽

Katrin Vorhölter

Keyword(s):

Mathematical Modeling ◽

Teacher Education ◽

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Construct Validity ◽

Qualitative Analysis ◽

Content Validity ◽

Confirmatory Factor ◽

Validity Indicators ◽

Expert Ratings

AbstractTeaching mathematical modeling is a demanding task. Thus, fostering teachers’ competencies in this regard is an essential component of teacher education. Recent conceptualizations of teachers’ competencies include situation-specific skills based on the concept of noticing, which is of particular interest for the spontaneous reactions needed when teaching mathematical modeling. The study described in this paper aims to analyze the development of a video-based instrument for measuring teachers’ noticing competencies within a mathematical modeling context and obtain evidence for the validity of the instrument. Three kinds of validity are examined in three different studies: content validity, elemental validity and construct validity. Indicators for content validity could be found through different expert ratings and implementation with the target group, where participants were able to perceive all relevant aspects. The qualitative analysis of participants’ reasoning, which is consistent with the coded level, indicates elemental validity. Moreover, the results of the confirmatory factor analysis suggest construct validity with one overall factor of noticing competence within a mathematical modeling context. Taken together, these studies imply a satisfactory validity of the video-based instrument.

Download Full-text

Psychometric properties of a Chinese version of the Fraboni Scale of Ageism: evidence from medical students sample

10.21203/rs.2.20483/v2 ◽

2020 ◽

Author(s):

Jun-Yao Fan ◽

Hui-Min Zhao ◽

Yue-Ting Liu ◽

Ling-Lin Kong ◽

Jing Mao ◽

...

Keyword(s):

Older Adults ◽

Factor Analysis ◽

Medical Students ◽

Confirmatory Factor Analysis ◽

Construct Validity ◽

Content Validity ◽

Intraclass Correlation ◽

Chinese Version ◽

Confirmatory Factor ◽

Chinese Medical Students

Abstract Background The increasing of older adults has led to enormous demand for medical care. However, as a group with unique needs and characteristics, older adults are often discriminated against in the medical field. In this paper, we aimed to translate the Fraboni Scale of Ageism (FSA) into Chinese and examine its construct validity, content validity, and reliability in Chinese mainland medical students. In order to evaluate the prevalence of ageism in Chinese medical students and prompt medical college to adopt necessary teaching methods to mitigate ageism in medical students. Methods By Brislin's translation guidelines, FSA was translated to Chinese. The convenient sampling method was used to select samples for this survey, including 1,974 students from two medical schools in central and north China. Construct validity was verified by the exploratory and confirmatory factor analysis. The content validity index (CVI) was used to assess content validity. The Cronbach's alpha coefficients and intraclass correlation coefficient (ICC) were used to estimate reliability. Results The alpha coefficients for FSA (Chinese version) was 0.81 and ICC was 0.87. The CVI was 0.93. Three factors were identified by exploratory factor analysis explaining 34.84% of the total variance and a three-factor model was confirmed to fit by confirmatory factor analysis. Conclusions FSA (Chinese version) is a reliable and valid scale for measuring discrimination degree against the older adults in Chinese medical students.

Download Full-text

Observation instrument for student social attitude in primary schools: Validity and reliability

Jurnal Penelitian dan Evaluasi Pendidikan ◽

10.21831/pep.v24i1.31868 ◽

2020 ◽

Vol 24 (1) ◽

Author(s):

Ari Setiawan ◽

Widowati Pusporini ◽

Hanandyo Dardjito

Keyword(s):

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Construct Validity ◽

Content Validity ◽

Primary Schools ◽

Rating Scale ◽

Social Attitudes ◽

Scale Model ◽

Confirmatory Factor ◽

Observation Instruments

This study aims to 1) identify the content validity of observations of students' social attitudes, 2) identify the construct validity of the observation instruments of students 'social attitudes, and 3) identify the reliability of observations of students' social attitudes. The subjects of this study were grades IV, and V of elementary school students in Yogyakarta province selected using cluster random sampling. Observation guidelines were used to collect the data using a summative rating scale model. The content validity was analyzed by applying Aiken assisted by Microsoft Excel, the construct validity by using second-order Confirmatory Factor Analysis assisted by Lisrel, and the reliability by using the Omega reliability approach. The results indicated that all items were valid by which the content validity. The construct validity with the Confirmatory Factor Analysis is high. The reliability values of the observation instruments were reliable.

Download Full-text

Scale Development Study for Academic Title Perception

Journal of Education and Training Studies ◽

10.11114/jets.v7i1.3919 ◽

2018 ◽

Vol 7 (1) ◽

pp. 172

Author(s):

Sevim Öztürk ◽

Celalettin Korkmaz

Keyword(s):

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Scale Development ◽

Construct Validity ◽

Content Validity ◽

Faculty Members ◽

Test Reliability ◽

Development Study ◽

Confirmatory Factor ◽

Alpha Reliability

In this study, it is aimed to develop a scale tool (validity and reliability were tested) in order to determine the faculty members’ perceptions on their academic titles. The scale development study was started with a literature review, thus a draft form was developed. The draft form which consists of 42 articles were presented to the specialists to receive their opinions. In line with the feedbacks from the specialists, the content validity rates of items were determined. The items which had value under .80 content validity rate were excluded from the content of the study. Therefore, remaining 30 items trial form were applied to 195 faculty members who are working in the İnönü and Hatay Mustafa Kemal Universities. In the analysis of the research data, descriptive and predictive statistical methods were used. In the process of developing the scale; construct validity, content validity, scale validity, retest-test reliability, two-half reliability and Cronbach’s alpha reliability were tested. For the construct validity of the scale, exploratory and confirmatory factor analysis were used. Based on the principal components analysis, it is seen that the articles of the scale can be gathered in a single factor or in five factors according to goodness of fit indicators in confirmatory factor analysis. In the confirmatory factor analysis, when the scale is considered as 5 dimensional, the standard fit indices are acceptable. Cronbach’s alpha reliability, retest-test reliability and two half reliability coefficients have also the values that show the scale is reliable. The findings that obtained as a result of the study show that the Academic Title Perception Scale can be used as a valid and reliable scale tool which can determine the perceptions of the faculty members about their academic titles.

Download Full-text

Development of PATS: A tool to assess professionalism

10.21203/rs.2.14822/v2 ◽

2019 ◽

Author(s):

humaira Fayyaz Khan ◽

raheela Yasmeen ◽

Shabana Ali ◽

Tahira sadiq

Keyword(s):

Factor Analysis ◽

Medical Students ◽

Focus Group ◽

Confirmatory Factor Analysis ◽

Construct Validity ◽

Content Validity ◽

Validity Index ◽

Content Validity Index ◽

Medical Graduates ◽

Confirmatory Factor

Abstract Background: Professionalism has become a specific requirement for medical graduates because of dissatisfaction regarding their preparedness to adequately deal with the challenges of the medical world. It should be assessed as a competency in the final year of study using a valid and reliable instrument. The purpose was to develop and validate a tool to assess the development of professionalism in final year medical students in the local context to assess the readiness of medical graduates. Method: This was a mixed method study. Micro scenarios for the preliminary instrument were developed after a focus group meeting. These were validated using a 3-round modified Delphi technique by email. Twenty-four participants responded in the first round, and 15 in the second and third rounds. After the first round, relevance of the item was obtained. The content validity ratio was calculated after second round. Cut off value for items were approximated to be 0.6 and 0.73 for modification and 0.8 for item retention. The second round revised analysis was sent to participants for the third round and the content validity index average and universal agreement were calculated. Cognitive pretesting was performed. Cronbach’s Alpha for reliability and Confirmatory factor analysis were carried out. Results: The focus group produced 46 micro-scenarios using a manual qualitative analysis. The first round of Delphi produced 35 items. On calculation of Content validity ratio 12 items were retained, 18 were revised and 5 were removed. Content validity index (I-CVI) and content validity scale (S-CVI) were 0.94 and 0.64 respectively. Pre-cognitive testing resulted in the modification of 4 items. The Confirmatory factor analysis was 4.1. Cronbach’s Alpha was 0.96. Conclusion: The final instrument developed has a 27 item 5-point Likert scale. It has good content validity, reliability and acceptable construct validity. The strength of the instrument is in its process of development i.e. focus group discussion, the iterative Delphi rounds, cognitive pre-testing and piloting. It can be used to assess the development of professionalism in final year medical students. Keywords: Professionalism, respect, altruism, honor and integrity, accountability, content validity, construct validity, cognitive pre-testing, and confirmatory factor analysis

Download Full-text

Reliability and validity of the Brazilian version of the Hospital Survey on Patient Safety Culture (HSOPSC): a pilot study

Cadernos de Saúde Pública ◽

10.1590/0102-311x00115614 ◽

2016 ◽

Vol 32 (11) ◽

Cited By ~ 7

Author(s):

Cláudia Tartaglia Reis ◽

Josué Laguardia ◽

Ana Glória Godoi Vasconcelos ◽

Mônica Martins

Keyword(s):

Factor Analysis ◽

Patient Safety ◽

Safety Culture ◽

Factor Model ◽

Reliability And Validity ◽

Patient Safety Culture ◽

Hospital Staff ◽

Brazilian Version ◽

Confirmatory Factor ◽

Different Dimensions

Abstract: The evaluation of the culture of patient safety in hospitals is nowadays considered as a management too, since it helps to identify problem areas and provide valuable information for planning improvements. This study explored the reliability and validity of the Brazilian version of the Hospital Survey on Patient Safety Culture, an instrument that evaluates characteristics of patient safety culture among hospital staff. The reliability of the instrument was evaluated by analyzing the internal consistency of each dimension. The validity of the tool was carried out by means of exploratory and confirmatory factor analysis. The sample was made up of 322 questionnaires that were collected in two Brazilian hospitals in 2012. Cronbach's alpha ranged from 0.52 to 0.91 for the different dimensions, with the exception of two, for which it was much lower. After excluding four items, the exploratory factor analysis presented adjusted indices that were appropriate for a 10 factor model.

Download Full-text

Penyusunan dan Pengembangan Alat Ukur Employee Engagement

Psikohumaniora Jurnal Penelitian Psikologi ◽

10.21580/pjpp.v1i1.958 ◽

2017 ◽

Vol 1 (1) ◽

pp. 113

Author(s):

Titien Titien

Keyword(s):

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Construct Validity ◽

Employee Engagement ◽

Work Engagement ◽

Content Validity ◽

Confirmatory Factor Analyses ◽

Validity Test ◽

Confirmatory Factor ◽

Engagement Scale

<div class="WordSection1">Abstract: This research was aimed to develop an instrument which can measure employee engagement score, which is based on Schaufeli’s theoretical framework. The previous instrument which was called Utretch Work Engagement Scale (UWES) was developed using content and construct validity. The content validity test was done by assessing some experts and using Aiken’s V, while construct validity was proved by item total correlation and factor analysis. Content validity test was conducted by getting input from fifteen experts in Psychology to evaluate the contents of 32 items. The Aiken’s V was used to evaluate the coefficient of each items (in which good range was from 0,645 to 0,98). The overall internal consistency was assessed using Cronbach alpha which showed the coefficient of reliability of 0,934 after deleting the items below 0,4, whereby leaving only 22 items for conducting the construct validity. Confirmatory factor analysis was done using factor analysis. 135 staffs in one of Plantation Company in Balikpapan were participated in this study. The confirmatory factor analyses produced a cross loading factors between three aspects of employee engagement which after confirming back to blueprint remaining only 8 items, which is distributed into 4 items for vigor, 2 items each for dedication and absorption.Abstrak: Penelitian ini bertujuan untuk mengembangkan instrumen yang dapat mengukur skor employee engagement yang didasarkan pada kerangka teoritis yang dikemukakan oleh Schaufeli. Instrumen sebelumnya dikenal dengan Utretch Work Engagement Scale (UWES) yang dikembangkan dengan menggunakan validitas isi dan konstrak. Validitas isi diuji melalui judgment dari para ahli di bidang Psikologi dan menggunakan Aiken’s V, sedangkan validitas konstrak dibuktikan dengan korelasi item-total dan analisis faktor. Validitas isi diperoleh dari 15 orang yang ahli di bidang Psikologi untuk mengevaluasi isi dari 32 item. Aiken’s V digunakan untuk mengevaluasi koefisien dari setiap item (range yang baik berada di rentang 0,645 sampai 0,98). Konsistensi internal diperoleh melalui alpha Cronbach dengan koefisien reliabilitas sebesar 0,934 setelah item-item yang memiliki nilai di bawah 0,4 dikeluarkan. Total item yang tersisa berjumlah 22 item untuk kemudian dilakukan uji validitas konstrak. Confirmatory factor analysis dilakukan melalui analisis factor. Sebanyak 135 staf di salah satu Perusahaan Plantation di Balikpapan berpartisipasi dalam penelitian ini. Hasil analisis factor menunjukkan adanya factor yang saling tumpang tindih antara ketiga aspek dari employee engagement, yang setelah dikonfirmasi kembali ke blueprint menyisakan sebanyak 8 item, 4 item untuk aspek vigor, 2 item masing-masing untuk aspek dedication dan absorption.</div>

Download Full-text

Psychometric Properties of the Greek Version of the Medical Office on Patient Safety Culture in Primary Care Settings

Medicines ◽

10.3390/medicines8080042 ◽

2021 ◽

Vol 8 (8) ◽

pp. 42

Author(s):

Ioannis Antonakos ◽

Kyriakos Souliotis ◽

Theodora Psaltopoulou ◽

Yannis Tountas ◽

Athanasios Papaefstathiou ◽

...

Keyword(s):

Primary Care ◽

Factor Analysis ◽

Patient Safety ◽

Construct Validity ◽

Safety Culture ◽

Patient Safety Culture ◽

Primary Health Care System ◽

Efficient Operation ◽

Primary Care Settings ◽

Medical Office

Background: Safety culture is considered one of the most crucial premises for further development of patient care in healthcare. During the eight-year economic crisis (2010–2018), Greece made significant reforms in the way the primary health care system operates, aiming at the more efficient operation of the system without degrading issues of safety and quality of the provided health services. In this context, this study aims to validate a specialized tool—the Medical Office Survey on Patient Safety Culture (MOSPSC)—developed by the Agency for Healthcare Research and Quality (AHRQ) to evaluate primary care settings in terms of safety culture and quality. Methods: Factor analysis determined the correlation of the factor structure in Greek data with the original questionnaire. The relation of the factor analysis with the Cronbach’s coefficient alpha was also determined, including the construct validity. Results: Eight composites with 34 items were extracted by exploratory factor analysis, with acceptable Cronbach’s alpha coefficients and good construct validity. Consequently, the composites jointly explained 62% of the variance in the responses. Five items were removed from the original version of the questionnaire. As a result, three out of the eight composites were a mixture of items from different compounds of the original tool. The composition of the five factors was similar to that in the original questionnaire. Conclusions: The MOSPSC tool in Greek primary healthcare settings can be used to assess patient safety culture in facilities across the country. From the study, the patient safety culture in Greece was positive, although few composites showed a negative correlation and needed improvement.

Download Full-text

Cross-cultural adaptation, validity and reliability of the Chinese Version of Miller Behavioral Style Scale

Health and Quality of Life Outcomes ◽

10.1186/s12955-021-01717-9 ◽

2021 ◽

Vol 19 (1) ◽

Author(s):

Qiqi Zhuo ◽

Changsheng Cui ◽

Hongmin Liang ◽

Yangjuan Bai ◽

Qiulan Hu ◽

...

Keyword(s):

Factor Analysis ◽

Confirmatory Factor Analysis ◽

Construct Validity ◽

Content Validity ◽

Information Seeking ◽

Internal Consistency Reliability ◽

Chinese Version ◽

Validity Index ◽

Behavioral Style ◽

Confirmatory Factor

Abstract Background Health education basing on patients’ information-seeking styles can improve the effectiveness of health education and patients’ health outcomes. The Miller Behavioral Style Scale (MBSS) is widely used to identify individual’s information-seeking styles, but the Chinese version is lacking. The study aim was to translate and culturally adapt the MBSS into Chinese version and test the content validity, construct validity and internal consistency reliability of the Chinese version of MBSS (C-MBSS). Methods The forward-back-translation procedure was adopted in the translation of the MBSS. Content validity was assessed in a panel of experts. In a sample of 1343 individuals including patients, patients’ caregivers, university students, and medical staff, reliability and construct validity were assessed using Cronbach’s alpha coefficient and factor analysis. The measurement invariance across samples was tested using multigroup confirmatory factor analysis (MGCFA). Floor and ceiling effects were checked. Results The C-MBSS achieved conceptual and semantic equivalence with the original scale. The item-level content validity index (I-CVI) of each item ranged from 0.78 to 1, and the averaging scale-level content validity index (S-CVI/ Ave) was 0.95. The exploratory factor analysis resulted in 2-factor assumption for each hypothetical threat-evoking scenario. Confirmatory factor analysis demonstrated a good fit between theoretical model and data, which provided confirmatory evidence for the second-order factor structure of 2-factor solution (Monitoring and Blunting). The Cronbach's alpha coefficients for the Monitoring and Blunting sub-scales of the C-MBSS were 0.75 and 0.62 respectively. MGCFA results supported the measurement invariance for the Monitoring sub-scale of the C-MBSS across samples. No floor or ceiling effects occurred. Conclusions This study indicates that the C-MBSS has good content and construct validity. The Monitoring sub-scale of the C-MBSS had acceptable internal consistency reliability while the Blunting sub-scale had unsatisfactory one, which suggest that the Monitoring sub-scale of the C-MBSS can be used to identify individuals’ information-seeking styles in Chinese contexts across different populations.

Download Full-text