scholarly journals Psychometric Properties of Student Evaluation of Teachers’ Performance Scale: Evidence from Debre Markos University Students’ Evaluation Dataset

2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Muluye Getie Ayaneh ◽  
Askalemariam Adamu Dessie ◽  
Dimetros Molla Fetene

Introduction. Student evaluation of teachers’ effectiveness is one of the most common tools used as a measure of teaching performance and accountability by various universities across the globe. The major purpose of this study was to evaluate the validity and underlying structure of students’ evaluation of the higher education teaching effectiveness scale used by all public universities in Ethiopia. Methodology. Data collected from 1397 students at Debe Markos University were used for this analysis. Cronbach’s alpha values and average interitem correlation were used to study the internal consistency reliability of the scale. Composite reliability, average variance extracted, hetero trait-mono-trait ratio, maximum shared variance, average shared variance, and interconstruct correlations were used to assess the construct validity of the scale, and exploratory factor analysis and confirmatory factor analysis were performed with 20 items to test the hypothesis which introduced a four-dimensional construct for teachers’ evaluation scale. We used different goodness-of-fit indices to measure the fit of the models. Results. The scale was shown to have good internal consistency and convergent validity but lacked discriminant validity. Furthermore, confirmatory factor analysis indicated that the four-factor model produced inadequate fit indices, revealing that the original factor structure of the scale changed. Conclusions. The results showed that Student Evaluation of Teaching Effectiveness did not measure what it was supposed to be measuring. Moreover, the exploratory factor analysis and confirmatory factor analysis results indicate that a two-dimensional model is better than the four-dimensional model to explain the data structure, which places limitations on its use.

2021 ◽  
Vol 29 (3) ◽  
pp. 781-796
Author(s):  
Christian Díaz de León ◽  
Ana Anguiano ◽  
Magdalena Lozano ◽  
Emma Flores

The objective of this work was to contribute to the study of the validity of the “Appraisal of Self-care Agency Scale” (ASA scale) in older adults and to analyze its association with health-related behaviors and conditions. A questionnaire was constructed and applied to 165 elderly residents of Michoacán, Mexico. A confirmatory factor analysis of the scale's one-dimensional model was carried out, and also an analysis of internal consistency, as well as an analysis of the relationship with other variables based on group comparisons, exploring the effect of the elimination of inverse items. Overall, the reduced scale performed better although the one-dimensional model maintained a limited fit in the confirmatory factor analysis. Internal consistency was satisfactory in both scales (α coefficient= .806 and .826, respectively). In addition, some important group comparisons were identified with anthropometric measurements. In conclusion, tests were found supporting the validity of the ASA scale in older adults, although more evidence is still needed regarding its construct and criterion validity.


Author(s):  
Tan Lay Khong

Most universities are using the Student Evaluation of Teaching (SET) as an instrument for students to assess a lecturer’s teaching performance. It is an essential instrument to reflect the feedback in enhancing the quality of teaching and learning. The purpose of this paper is to examine the validity and reliability of the SET as a valid instrument in evaluating teaching effectiveness in a private higher education institution in Malaysia. Exploratory Factor Analysis and Confirmatory Factor Analysis have validated all 10 items of SET whereby all items indicated high reliability and internal consistency. A Confirmatory Factor Analysis using AMOS software also confirmed that a single factor model was used to evaluate teaching effectiveness. The single factor model was further validated using 1000 repeated samples of Bootstrap method in AMOS.


2009 ◽  
Vol 25 (4) ◽  
pp. 239-243
Author(s):  
Roberto Nuevo ◽  
Andrés Losada ◽  
María Márquez-González ◽  
Cecilia Peñacoba

The Worry Domains Questionnaire was proposed as a measure of both pathological and nonpathological worry, and assesses the frequency of worrying about five different domains: relationships, lack of confidence, aimless future, work, and financial. The present study analyzed the factor structure of the long and short forms of the WDQ (WDQ and WDQ-SF, respectively) through confirmatory factor analysis in a sample of 262 students (M age = 21.8; SD = 2.6; 86.3% females). While the goodness-of-fit indices did not provide support for the WDQ, good fit indices were found for the WDQ-SF. Furthermore, no source of misspecification was identified, thus, supporting the factorial validity of the WDQ-SF scale. Significant positive correlations between the WDQ-SF and its subscales with worry (PSWQ), anxiety (STAI-T), and depression (BDI) were found. The internal consistency was good for the total scale and for the subscales. This work provides support for the use of the WDQ-SF, and potential uses for research and clinical purposes are discussed.


2020 ◽  
Vol 34 (4) ◽  
pp. 869-897
Author(s):  
Atiqa Rafeh ◽  
Rubina Hanif

The present study was intended to develop a scale to measure perceived weight stigmatization among people with obesity. The study was conducted in five steps. In first step, three focus group discussions were conducted with female obese university students to get the first-hand information related to weight stigmatization. Step two involved four interviews which were conducted with male obese university students to collect detailed information about weight stigmatization experiences of men. Step three included content analysis of qualitative data for item generation. In step four, judge’s opinion was taken, and a committee approach was carried out to select the items for the initial form of the scale. Items for final form of the scale were selected through exploratory factor analysis and confirmatory factor analysis in step five. For exploratory factor analysis, 150 university students (men = 61, women = 89) were included in the sample, whereas, for confirmatory factor analysis, another group of students (men = 78, women = 72) participated in the study. Principal Component Factor Analysis revealed three meaningful structures including Self-Perception, Perceived Social Rejection, and Perceived Impact containing 43 items. Confirmatory factor analysis confirmed this factor structure and all 43 items possessed factor loadings greater than .40. Moreover, results indicated that perceived weight stigmatization had high internal consistency (Cronbach’s alpha = .96) with three subscales having internal consistency .95, .83, and .92 respectively. Therefore, Perceived Weight Stigmatization Scale turned out to be a reliable and valid instrument for measuring perception of weight stigma in adults with obesity.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Janiny Lima e Silva ◽  
Matheus de Sousa Mata ◽  
Saionara Maria Aires Câmara ◽  
Íris do Céu Clara Costa ◽  
Kleyton Santos de Medeiros ◽  
...  

Abstract Background The Lederman Prenatal Self-Evaluation Questionnaire (PSEQ) is used to assess psychosocial adaptation to pregnancy, labor, childbirth, and maternity. The PSEQ is a tool used in various countries and has been translated into Portuguese; however, it needs to be validated in Brazil. This study aimed to analyze the validity and reliability of the PSEQ in Brazilian pregnant women. Method This methodological validity study investigated internal consistency and reliability using Cronbach’s alpha and intraclass correlation coefficients. Construct validity was assessed using Pearson’s correlation between domains and confirmatory factor analysis. To assess concurrent validity, Pearson’s correlation between the different domains of the PSEQ and Prenatal Psychosocial Profile-Portuguese Version (PPP-VP) was determined. The level of significance was set at 5%. Results This study included 399 pregnant women in the northeastern region of Brazil. The internal consistency and reliability of the total PSEQ score were high (Cronbach's alpha = 0.89; intraclass correlation coefficient = 0.95). Validity analysis showed positive and significant correlations between all PSEQ domains, ranging from 0.14 to 0.56. Confirmatory factor analysis demonstrated the following values of goodness of fit: RMSEA = 0.05, SRMR = 0.08, CFI = 0.61, χ2/df = 1.77. The discriminant and concurrent validities of the PSEQ were confirmed. Conclusions The Portuguese version of the PSEQ has adequate psychometric properties and is a valid and reliable tool to evaluate psychosocial adaptation to pregnancy in Brazilian pregnant women.


2021 ◽  
pp. 003022282110162
Author(s):  
Adalberto Campo-Arias ◽  
Andrés Felipe Tirado-Otálvaro ◽  
Isabel Álvarez-Solorza ◽  
Carlos Arturo Cassiani-Miranda

The study aimed to perform confirmatory factor analysis, internal consistency, gender differential item functioning, and discriminant validity of the Fear of COVID-5 Scale in emerging adult students of a university in Mexico. Confirmatory factor analysis, internal consistency (Cronbach's alpha and McDonald's omega), and gender differential item functioning were estimated (Kendall tau b correlation). The Fear of COVID-5 Scale showed a one-dimension structure (RMSEA = 0.07, CFI = 0.98, TLI = 0.96, and SRMR = 0.02), with high internal consistency (Cronbach's alpha of 0.78 and McDonald's omega of 0.81), non-gender differential item functioning (Kendall tau b between 0.07 and 0.10), and significant discriminant validity (Higher scores for fear of COVID-19 were observed in high clinical anxiety levels). In conclusion, the Fear of COVID-5 Scale presents a clear one-dimension structure similar to a previous study.


2021 ◽  
Vol In Press (In Press) ◽  
Author(s):  
Mahnaz Estaki ◽  
Ameneh Dehghan ◽  
Ebrahim Mahmoudi ◽  
Navid Mirzakhany

Background: Sensory integration is a necessary skill for acquiring reading skills because it strongly depends on the rapid and strong relation between written and verbal symbols. There is no standardized test for Iranian children with dyslexia to investigate their sensory processing problems. Therefore, understanding the validity and reliability of the child sensory profile 2 (CSP2) would be essential for a detailed assessment of sensory impairments in dyslexic children. Objectives: The current research aimed to establish the internal consistency, factor analysis, and convergent validity of the Persian version of CSP2 in children with dyslexia. Methods: The sample of this study included 200 dyslexic children aged 6 to 12 years who were referred to learning disabilities centers in Qom from September 2019 to February 2020 by using the multistage sampling method. To collect data, the CSP2 questionnaire and the dyslexia test (NEMA) were used. The factor structure was assessed by confirmatory factor analysis. The internal consistency of the CSP2 was examined by using Cronbach’s alpha. Convergent validity was assessed by examining the relationship between CSP2 and NEMA. Results: Internal consistency was obtained as 0.89, 0.92, 0.77, and 0.94 for the four subscales of sensory processing, namely registration, seeking, sensitivity, and avoiding, respectively. The result of confirmatory factor analysis gained support for Dunn's four-factor model. Total scores of NEMA were correlated with the scores of CSP2 subscales (seeking, avoiding, sensitivity, and registration). Conclusions: The Persian version of the Child Sensory Profile 2 is a valid (via confirmatory factor analysis and convergent validity) and reliable (via internal consistency) tool for assessing sensory processing in children with dyslexia.


2016 ◽  
Vol 10 (10) ◽  
pp. 99
Author(s):  
Sara Aghababaei ◽  
Mokhtar Malekpour ◽  
Bagher Kajbaf ◽  
Ahmad Abedi

The aim of this research is confirmatory factor analysis of Aurora-a Battery on Iranian children. Aurora-a Battery is a cognitive assessment according to Robert J. Sternberg’s theory of Successful Intelligence. 400 children 9-12 years old were selected through multi-steps sampling method and were tested with Aurora-a test. These children were from geographically diverse schools in Isfahan city, Iran. The factor analysis of data was performed through Amos software. Fit indices show that data fit with model. Moreover, the correlation between test total score and the analytical, creative and practical intelligences were 0.91, 0.94 and 0.84, respectively. Alpha for Aurora’s total score was equal to 0.92 as well. Aurora-a test can be an appropriate and valid instrument for identification gifted children aged 9-12 according to Sternberg’s theory of successful intelligence. This test allows many children to be identified as gifted which in turn provides the opportunity of further development of their potential.


2022 ◽  
pp. 003329412110636
Author(s):  
Bruno Faustino

The presence of dysfunctional cognitions about how individuals see themselves and others is a hallmark of psychopathology. The Brief Core Schemas Scale (BCSS) was developed to evaluate adaptive and dysfunctional beliefs about the self and others. This study describes the first psychometric analysis of the BCSS in the Portuguese population. Participants were recruited from community ( N = 320, Mage=27.31, DP = 12.75). Confirmatory factor analysis (CFA) was used to confirm the BCSS factorial structure. Four-factor model revealed moderate to adequate goodness-of-fit indices (χ2/df = 717.1, (246) p = .01; SRMR = .044; RMSEA = .077; CFI/TLI < .90). Negative views of the self and others correlated positively with early maladaptive schemas, distress, and symptomatology and correlated negatively with psychological well-being. An inversed correlational pattern was found with the positive views of the self and others. Despite the model's moderate adherence to the data, results suggest that the BCSS may be an asset in the assessment of dysfunctional and adaptive cognitions about the self and others. Further analysis is required to deepen the psychometric properties of the BCSS in the Portuguese population.


Sign in / Sign up

Export Citation Format

Share Document