scholarly journals Measuring pre-service teachers’ noticing competencies within a mathematical modeling context – an analysis of an instrument

2021 ◽  
Author(s):  
Alina Alwast ◽  
Katrin Vorhölter
Keyword(s):  
Mathematical Modeling ◽  
Teacher Education ◽  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Qualitative Analysis ◽  
Content Validity ◽  
Confirmatory Factor ◽  
Validity Indicators ◽  
Expert Ratings

AbstractTeaching mathematical modeling is a demanding task. Thus, fostering teachers’ competencies in this regard is an essential component of teacher education. Recent conceptualizations of teachers’ competencies include situation-specific skills based on the concept of noticing, which is of particular interest for the spontaneous reactions needed when teaching mathematical modeling. The study described in this paper aims to analyze the development of a video-based instrument for measuring teachers’ noticing competencies within a mathematical modeling context and obtain evidence for the validity of the instrument. Three kinds of validity are examined in three different studies: content validity, elemental validity and construct validity. Indicators for content validity could be found through different expert ratings and implementation with the target group, where participants were able to perceive all relevant aspects. The qualitative analysis of participants’ reasoning, which is consistent with the coded level, indicates elemental validity. Moreover, the results of the confirmatory factor analysis suggest construct validity with one overall factor of noticing competence within a mathematical modeling context. Taken together, these studies imply a satisfactory validity of the video-based instrument.

scholarly journals Adaptation and validation of a Korean-language version of the revised hospital survey on patient safety culture (K-HSOPSC 2.0)

BMC Nursing ◽  
2021 ◽  
Vol 20 (1) ◽  
Author(s):  
Seung Eun Lee ◽  
V. Susan Dahinten
Keyword(s):  
Factor Analysis ◽  
Patient Safety ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Safety Culture ◽  
Content Validity ◽  
Patient Safety Culture ◽  
Korean Language ◽  
Language Version ◽  
Confirmatory Factor

Abstract Background To date, there has been no universal and validated tool for measuring safety culture in Korea. The Hospital Survey on Patient Safety Culture (HSOPSC), version 2.0 was released by the Agency for Healthcare Research and Quality in 2019, but it had not yet been translated and assessed for use in Korea. The aim of this study was to assess the content validity and other psychometric properties of the Korean-language version of the HSOPSC 2.0. Methods Instrument adaptation was performed using a committee-based translation, cognitive interviews, and expert panel reviews. Confirmatory factor analysis was conducted on data obtained through an online survey from 526 registered nurses who worked on medical-surgical units in three teaching hospitals in South Korea. Results One item was dropped during the translation and adaption phase of the study as being a poor fit for the Korean healthcare context, resulting in excellent content validity. Confirmatory factor analysis supported the factorial structure of the K-HSOPSC 2.0. Correlations with an overall measure of patient safety provided further evidence of construct validity. Additionally, in comparing the results of this current study to those from U.S. research using the HSOPSC 2.0, it was found that Korean nurses assigned less positive scores to all dimensions of patient safety culture. Conclusion Our findings provide evidence of the content validity, reliability, and construct validity of the K-HOSPSC 2.0 for measuring patient safety culture in South Korean hospitals. Hospital administrators can use this tool to assess safety culture and identify areas for improvement to enhance patient safety and quality of care.

scholarly journals Psychometric properties of a Chinese version of the Fraboni Scale of Ageism: evidence from medical students sample

2020 ◽  
Author(s):  
Jun-Yao Fan ◽  
Hui-Min Zhao ◽  
Yue-Ting Liu ◽  
Ling-Lin Kong ◽  
Jing Mao ◽  
...  
Keyword(s):  
Older Adults ◽  
Factor Analysis ◽  
Medical Students ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Intraclass Correlation ◽  
Chinese Version ◽  
Confirmatory Factor ◽  
Chinese Medical Students

Abstract Background The increasing of older adults has led to enormous demand for medical care. However, as a group with unique needs and characteristics, older adults are often discriminated against in the medical field. In this paper, we aimed to translate the Fraboni Scale of Ageism (FSA) into Chinese and examine its construct validity, content validity, and reliability in Chinese mainland medical students. In order to evaluate the prevalence of ageism in Chinese medical students and prompt medical college to adopt necessary teaching methods to mitigate ageism in medical students. Methods By Brislin's translation guidelines, FSA was translated to Chinese. The convenient sampling method was used to select samples for this survey, including 1,974 students from two medical schools in central and north China. Construct validity was verified by the exploratory and confirmatory factor analysis. The content validity index (CVI) was used to assess content validity. The Cronbach's alpha coefficients and intraclass correlation coefficient (ICC) were used to estimate reliability. Results The alpha coefficients for FSA (Chinese version) was 0.81 and ICC was 0.87. The CVI was 0.93. Three factors were identified by exploratory factor analysis explaining 34.84% of the total variance and a three-factor model was confirmed to fit by confirmatory factor analysis. Conclusions FSA (Chinese version) is a reliable and valid scale for measuring discrimination degree against the older adults in Chinese medical students.

scholarly journals Observation instrument for student social attitude in primary schools: Validity and reliability

2020 ◽  
Vol 24 (1) ◽  
Author(s):  
Ari Setiawan ◽  
Widowati Pusporini ◽  
Hanandyo Dardjito
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Primary Schools ◽  
Rating Scale ◽  
Social Attitudes ◽  
Scale Model ◽  
Confirmatory Factor ◽  
Observation Instruments

This study aims to 1) identify the content validity of observations of students' social attitudes, 2) identify the construct validity of the observation instruments of students 'social attitudes, and 3) identify the reliability of observations of students' social attitudes. The subjects of this study were grades IV, and V of elementary school students in Yogyakarta province selected using cluster random sampling. Observation guidelines were used to collect the data using a summative rating scale model. The content validity was analyzed by applying Aiken assisted by Microsoft Excel, the construct validity by using second-order Confirmatory Factor Analysis assisted by Lisrel, and the reliability by using the Omega reliability approach. The results indicated that all items were valid by which the content validity. The construct validity with the Confirmatory Factor Analysis is high. The reliability values of the observation instruments were reliable. 

scholarly journals Scale Development Study for Academic Title Perception

2018 ◽  
Vol 7 (1) ◽  
pp. 172
Author(s):  
Sevim Öztürk ◽  
Celalettin Korkmaz
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Scale Development ◽  
Construct Validity ◽  
Content Validity ◽  
Faculty Members ◽  
Test Reliability ◽  
Development Study ◽  
Confirmatory Factor ◽  
Alpha Reliability

In this study, it is aimed to develop a scale tool (validity and reliability were tested) in order to determine the faculty members’ perceptions on their academic titles. The scale development study was started with a literature review, thus a draft form was developed. The draft form which consists of 42 articles were presented to the specialists to receive their opinions. In line with the feedbacks from the specialists, the content validity rates of items were determined. The items which had value under .80 content validity rate were excluded from the content of the study. Therefore, remaining 30 items trial form were applied to 195 faculty members who are working in the İnönü and Hatay Mustafa Kemal Universities. In the analysis of the research data, descriptive and predictive statistical methods were used. In the process of developing the scale; construct validity, content validity, scale validity, retest-test reliability, two-half reliability and Cronbach’s alpha reliability were tested. For the construct validity of the scale, exploratory and confirmatory factor analysis were used. Based on the principal components analysis, it is seen that the articles of the scale can be gathered in a single factor or in five factors according to goodness of fit indicators in confirmatory factor analysis. In the confirmatory factor analysis, when the scale is considered as 5 dimensional, the standard fit indices are acceptable. Cronbach’s alpha reliability, retest-test reliability and two half reliability coefficients have also the values that show the scale is reliable. The findings that obtained as a result of the study show that the Academic Title Perception Scale can be used as a valid and reliable scale tool which can determine the perceptions of the faculty members about their academic titles.

scholarly journals Development of PATS: A tool to assess professionalism

2019 ◽  
Author(s):  
humaira Fayyaz Khan ◽  
raheela Yasmeen ◽  
Shabana Ali ◽  
Tahira sadiq
Keyword(s):  
Factor Analysis ◽  
Medical Students ◽  
Focus Group ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Validity Index ◽  
Content Validity Index ◽  
Medical Graduates ◽  
Confirmatory Factor

Abstract Background: Professionalism has become a specific requirement for medical graduates because of dissatisfaction regarding their preparedness to adequately deal with the challenges of the medical world. It should be assessed as a competency in the final year of study using a valid and reliable instrument. The purpose was to develop and validate a tool to assess the development of professionalism in final year medical students in the local context to assess the readiness of medical graduates. Method: This was a mixed method study. Micro scenarios for the preliminary instrument were developed after a focus group meeting. These were validated using a 3-round modified Delphi technique by email. Twenty-four participants responded in the first round, and 15 in the second and third rounds. After the first round, relevance of the item was obtained. The content validity ratio was calculated after second round. Cut off value for items were approximated to be 0.6 and 0.73 for modification and 0.8 for item retention. The second round revised analysis was sent to participants for the third round and the content validity index average and universal agreement were calculated. Cognitive pretesting was performed. Cronbach’s Alpha for reliability and Confirmatory factor analysis were carried out. Results: The focus group produced 46 micro-scenarios using a manual qualitative analysis. The first round of Delphi produced 35 items. On calculation of Content validity ratio 12 items were retained, 18 were revised and 5 were removed. Content validity index (I-CVI) and content validity scale (S-CVI) were 0.94 and 0.64 respectively. Pre-cognitive testing resulted in the modification of 4 items. The Confirmatory factor analysis was 4.1. Cronbach’s Alpha was 0.96. Conclusion: The final instrument developed has a 27 item 5-point Likert scale. It has good content validity, reliability and acceptable construct validity. The strength of the instrument is in its process of development i.e. focus group discussion, the iterative Delphi rounds, cognitive pre-testing and piloting. It can be used to assess the development of professionalism in final year medical students. Keywords: Professionalism, respect, altruism, honor and integrity, accountability, content validity, construct validity, cognitive pre-testing, and confirmatory factor analysis

scholarly journals Penyusunan dan Pengembangan Alat Ukur Employee Engagement

2017 ◽  
Vol 1 (1) ◽  
pp. 113
Author(s):  
Titien Titien
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Employee Engagement ◽  
Work Engagement ◽  
Content Validity ◽  
Confirmatory Factor Analyses ◽  
Validity Test ◽  
Confirmatory Factor ◽  
Engagement Scale

<div class="WordSection1"><p class="IABSTRAK"><strong>Abstract: </strong>This research was aimed to develop an instrument which can measure employee engagement score, which is based on Schaufeli’s theoretical framework. The previous instrument which was called Utretch Work Engagement Scale (UWES) was developed using content and construct validity. The content validity test was done by assessing some experts and using Aiken’s V, while construct validity was proved by item total correlation and factor analysis. Content validity test was conducted by getting input from fifteen experts in Psychology to evaluate the contents of 32 items. The Aiken’s V was used to evaluate the coefficient of each items (in which good range was from 0,645 to 0,98). The overall internal consistency was assessed using Cronbach alpha which showed the coefficient of reliability of 0,934 after deleting the items below 0,4, whereby leaving only 22 items for conducting the construct validity. Confirmatory factor analysis was done using factor analysis. 135 staffs in one of Plantation Company in Balikpapan were participated in this study. The confirmatory factor analyses produced a cross loading factors between three aspects of employee engagement which after confirming back to blueprint remaining only 8 items, which is distributed into 4 items for vigor, 2 items each for dedication and absorption.</p><p class="IABSTRAK"><strong>Abstrak: </strong>Penelitian ini bertujuan untuk mengembangkan instrumen yang dapat mengukur skor <em>employee engagement</em> yang didasarkan pada kerangka teoritis yang dikemukakan oleh Schaufeli. Instrumen sebelumnya dikenal dengan <em>Utretch Work Engagement Scale</em> (UWES) yang dikembangkan dengan menggunakan validitas isi dan konstrak. Validitas isi diuji melalui judgment dari para ahli di bidang Psikologi dan menggunakan <em>Aiken’s V</em>, sedangkan validitas konstrak dibuktikan dengan korelasi item-total dan analisis faktor. Validitas isi diperoleh dari 15 orang yang<strong> </strong>ahli di bidang Psikologi untuk mengevaluasi isi dari 32 item. <em>Aiken’s V</em> digunakan untuk mengevaluasi koefisien dari<strong> </strong>setiap item (range yang baik berada di rentang 0,645 sampai 0,98). Konsistensi internal diperoleh melalui <em>alpha Cronbach</em> dengan koefisien reliabilitas sebesar 0,934 setelah item-item yang memiliki nilai di bawah 0,4 dikeluarkan. Total item yang tersisa berjumlah 22 item untuk kemudian dilakukan uji validitas konstrak. <em>Confirmatory factor analysis</em> dilakukan melalui analisis factor. Sebanyak 135 staf di salah satu Perusahaan <em>Plantation</em> di Balikpapan berpartisipasi dalam penelitian ini. Hasil analisis factor menunjukkan adanya factor yang saling tumpang tindih antara ketiga aspek dari <em>employee</em> <em>engagement</em>, yang setelah dikonfirmasi kembali ke blueprint menyisakan sebanyak 8 item, 4 item untuk aspek <em>vigor</em>, 2 item masing-masing untuk aspek <em>dedication</em> dan <em>absorption</em>.</p></div>

scholarly journals Cross-cultural adaptation, validity and reliability of the Chinese Version of Miller Behavioral Style Scale

2021 ◽  
Vol 19 (1) ◽  
Author(s):  
Qiqi Zhuo ◽  
Changsheng Cui ◽  
Hongmin Liang ◽  
Yangjuan Bai ◽  
Qiulan Hu ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Information Seeking ◽  
Internal Consistency Reliability ◽  
Chinese Version ◽  
Validity Index ◽  
Behavioral Style ◽  
Confirmatory Factor

Abstract Background Health education basing on patients’ information-seeking styles can improve the effectiveness of health education and patients’ health outcomes. The Miller Behavioral Style Scale (MBSS) is widely used to identify individual’s information-seeking styles, but the Chinese version is lacking. The study aim was to translate and culturally adapt the MBSS into Chinese version and test the content validity, construct validity and internal consistency reliability of the Chinese version of MBSS (C-MBSS). Methods The forward-back-translation procedure was adopted in the translation of the MBSS. Content validity was assessed in a panel of experts. In a sample of 1343 individuals including patients, patients’ caregivers, university students, and medical staff, reliability and construct validity were assessed using Cronbach’s alpha coefficient and factor analysis. The measurement invariance across samples was tested using multigroup confirmatory factor analysis (MGCFA). Floor and ceiling effects were checked. Results The C-MBSS achieved conceptual and semantic equivalence with the original scale. The item-level content validity index (I-CVI) of each item ranged from 0.78 to 1, and the averaging scale-level content validity index (S-CVI/ Ave) was 0.95. The exploratory factor analysis resulted in 2-factor assumption for each hypothetical threat-evoking scenario. Confirmatory factor analysis demonstrated a good fit between theoretical model and data, which provided confirmatory evidence for the second-order factor structure of 2-factor solution (Monitoring and Blunting). The Cronbach's alpha coefficients for the Monitoring and Blunting sub-scales of the C-MBSS were 0.75 and 0.62 respectively. MGCFA results supported the measurement invariance for the Monitoring sub-scale of the C-MBSS across samples. No floor or ceiling effects occurred. Conclusions This study indicates that the C-MBSS has good content and construct validity. The Monitoring sub-scale of the C-MBSS had acceptable internal consistency reliability while the Blunting sub-scale had unsatisfactory one, which suggest that the Monitoring sub-scale of the C-MBSS can be used to identify individuals’ information-seeking styles in Chinese contexts across different populations.

scholarly journals Distance education perception scale for medical students: a validity and reliability study

2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Güven Özkaya ◽  
Mevlüt Okan Aydin ◽  
Züleyha Alper
Keyword(s):  
Distance Education ◽  
Factor Analysis ◽  
Medical Students ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Reliability Analysis ◽  
Content Validity ◽  
Cronbach’S Alpha ◽  
Cronbach's Alpha ◽  
Confirmatory Factor

Abstract Background There are major changes in education strategies as higher education institutions urgently need to adopt distance education tools and practices due to the Covid-19 pandemic. Medical education is also trying to get out of this emergency using distance education. In this study, we aimed to develop a reliable and valid scale in order to evaluate the perceptions of medical students towards distance education. Methods The students taking part in the study were in the first five academic years of the medical faculty in Bursa in Turkey. At first, 57 items were determined to evaluate students’ perceptions. Content validity was examined according to the assessment of the expert team. Construct validity of these items was examined by exploratory and confirmatory factor analysis. Also, Cronbach’s alpha coefficients were calculated for reliability analysis. The medical students’ responses were scored using a five-point Likert scale. Results When the content validity was examined, the number of items was determined to be 38 items. Construct validity of these items was examined by exploratory and confirmatory factor analysis. Because of the exploratory factor analysis performed on the responses of 429 medical students, 22 items were included in four factors. This four-factor model was applied to 286 medical students and validated by confirmatory factor analysis. Also, Cronbach’s alpha coefficients were calculated for reliability analysis and values were between 0.713 and 0.930. Conclusions This study demonstrated validation and reliability of perceptions of distance education for medical students. We suggest a 22-item model with a four-factorial scale.

scholarly journals Cross-cultural Adaptation, Validity and Reliability of the Chinese Version of Miller Behavioral Style Scale

2021 ◽  
Author(s):  
Qiqi Zhuo ◽  
Changsheng Cui ◽  
Hongmin Liang ◽  
Yangjuan Bai ◽  
Qiulan Hu ◽  
...  
Keyword(s):  
Factor Analysis ◽  
Confirmatory Factor Analysis ◽  
Construct Validity ◽  
Content Validity ◽  
Information Seeking ◽  
Internal Consistency Reliability ◽  
Chinese Version ◽  
Validity Index ◽  
Behavioral Style ◽  
Confirmatory Factor

Abstract Background: Health education basing on patients’ information-seeking styles can improve the effectiveness of health education and patients’ health outcomes. The Miller Behavioral Style Scale (MBSS) is widely used to identify individual’s information-seeking styles, but the Chinese version is lacking. The study aim was to translate and culturally adapt the MBSS into Chinese version and test the content validity, construct validity and internal consistency reliability of the Chinese version of MBSS (C-MBSS).Methods: The forward-back-translation procedure was adopted in the translation of the MBSS. Content validity was assessed in a panel of experts. In a sample of 1343 individuals including patients, patients’ caregivers, university students, and medical staff, reliability and construct validity were assessed using Cronbach’s alpha coefficient and factor analysis. The measurement invariance across samples was tested using multigroup confirmatory factor analysis (MGCFA). Floor and ceiling effects were checked.Results: The C-MBSS achieved conceptual and semantic equivalence with the original scale. The item-level content validity index (I-CVI) of each item ranged from 0.78 to 1, and the averaging scale-level content validity index (S-CVI/ Ave) was 0.95. The exploratory factor analysis resulted in 2-factor assumption for each hypothetical threat-evoking scenario. Confirmatory factor analysis demonstrated a good fit between theoretical model and data, which provided confirmatory evidence for the second-order factor structure of 2-factor solution (Monitoring and Blunting). The Cronbach's alpha coefficients for the Monitoring and Blunting sub-scales of the C-MBSS were 0.75 and 0.62 respectively. MGCFA results supported the measurement invariance for the Monitoring sub-scale of the C-MBSS across samples. No floor or ceiling effects occurred. Conclusions: This study indicates that the C-MBSS has good content and construct validity. The Monitoring sub-scale of the C-MBSS had acceptable internal consistency reliability while the Blunting sub-scale had unsatisfactory one, which suggest that the Monitoring sub-scale of the C-MBSS can be used to identify individuals’ information-seeking styles in Chinese contexts across different populations.

Sign in / Sign up

Export Citation Format

Share Document