scholarly journals Factors affecting the student evaluation of teaching scores: evidence from panel data estimation

2012 ◽  
Vol 42 (1) ◽  
pp. 129-150 ◽  
Author(s):  
Eduardo de Carvalho Andrade ◽  
Bruno de Paula Rocha

We use a random-effects model to find the factors that affect the student evaluation of teaching (SET) scores. Dataset covers 6 semesters, 496 undergraduate courses related to 101 instructors and 89 disciplines. Our empirical findings are: (i) the class size affects negatively the SET score; (ii) instructors with more experience are better evaluated, but these gains reduce over time; (iii) participating in training programs, designed to improve the quality of teaching, did not increase the SET scores; (iv) instructors seem to be able to marginally 'buy' a better evaluation by inflating students' grade. Finally, there are significant changes in the rankings when we adjust the SET score to eliminate the effects of variables beyond instructors' control. Despite these changes, they are not statistically significant.

2004 ◽  
Vol 1 (6) ◽  
Author(s):  
Kim L. Chuah ◽  
Cynthia Hill

The student evaluation, used to measure students’ perceptions of teacher performance, has been increasingly used as the predominant component in assessing teaching effectiveness (Waters et al. 1988), and the widespread movement of outcomes assessment across the country makes this trend likely to continue in the future (McCoy et al. 1994, AACSB 1994, SACS 1995).  Substantial research has been conducted with regard to the reliability and accuracy of student evaluation of teaching quality, and a considerable number of uncontrollable factors are found to bias the results of the evaluation rating.  This paper identifies one more factor.  Each student has an “evaluator profile”, which decreases the reliability of the student evaluation.  An “evaluator profile” is a persistent pattern of evaluating behavior that may or may not be consistent with the quality of the characteristic being evaluated.  Each class of students consists of a random sample of different evaluator profiles.  A student evaluation rating of a teacher’s performance is biased up or down depending on the concentration of high or low evaluator profiles present.  This paper further shows through simulation the degree to which student “evaluator profiles” impact the overall student evaluation rating of teacher performance. We find that there is evidence to support the “evaluator profile” conjecture, and that these “evaluator profiles” do in fact have the potential to change overall student evaluation ratings substantially.


2018 ◽  
Vol 12 (2) ◽  
pp. 63-84 ◽  
Author(s):  
Gregory Ching

PurposeCompetition among higher education institutions has pushed universities to expand their competitive advantages. Based on the assumption that the core functions of universities are academic, understanding the teaching–learning process with the help of student evaluation of teaching (SET) would seem to be a logical solution in increasing competitiveness. The paper aims to discuss these issues.Design/methodology/approachThe current paper presents a narrative literature review examining how SETs work within the concept of service marketing, focusing specifically on the search, experience, and credence qualities of the provider. A review of the various factors that affect the collection of SETs is also included.FindingsRelevant findings show the influence of students’ prior expectations on SET ratings. Therefore, teachers are advised to establish a psychological contract with the students at the start of the semester. Such an agreement should be negotiated, setting out the potential benefits of undertaking the course and a clear definition of acceptable performance within the class. Moreover, connections should be made between courses and subjects in order to provide an overall view of the entire program together with future career pathways.Originality/valueGiven the complex factors affecting SETs and the antecedents involved, there appears to be no single perfect tool to adequately reflect what is happening in the classroom. As different SETs may be needed for different courses and subjects, options such as faculty self-evaluation and peer-evaluation might be considered to augment current SETs.


2017 ◽  
Vol 11 (1) ◽  
pp. 100-117
Author(s):  
Vladimír Jůva ◽  
Eva Valkounová

Importance of student evaluation of teaching (SET) growing currently as a response to demands of improving the quality of university education. The paper deals with SET aimed specifically at sports university education. The introduction briefly describes the concept, function and significance of SET. It also identifies selected specifics of student evaluation of university sports teaching. The empirical part of this text describes the methodological aspects and selected results of the evaluation carried out investigation and research aimed at the creation and verification tools for student evaluation of sports university teaching. The following discussion analyses selected issues that accompany this particular SET. Conclusion presents suggestions and asks other questions related to SET focused on university sports teaching.


2021 ◽  
Vol 8 (1) ◽  
pp. 139-157
Author(s):  
Regina Thetsane

Many Higher Education Institutions use the Student Evaluation of Teaching (SET) scale to evaluate the quality of instructors’ teaching. It includes students’ evaluation of the teacher, the teaching process, teaching approaches and the learning outcomes. Due to its reported dubious reliability and validity, and inherent bias in measuring the quality of teaching, SET remains a hotly debated and controversial instrument. This study evaluated thereliability and validity of the SET scale adopted by the National University of Lesotho. Self-administered SET questionnaires were distributed to 104 third- and fourth-year Bachelor of Commerce students to evaluate ten lecturers, resulting in 751 assessment records. The data were analysed using the Statistical Package for the Social Sciences (SPSS) and Partial Least Squares Structural Equation Modelling (PLS-SEM). While the findings suggest that the SET instrument used at the university is reasonably reliable and valid, minor concerns were raised with regard to discriminant validity, and serious concerns in relation to content validity. Based on the existing literature and the psychometric properties of this SET instrument, it is recommended that university management exercise caution in using its results to make evaluative personnel decisions such as promotions, confirmations, and dismissals. It is also recommended that the SET instrument should be revised and validated and be primarily used for formative purposes such as obtaining feedback for the development of individual instructors. Key words: formative assessment, reliability, student evaluation of teaching, summative assessment, validity


Author(s):  
Yayan Sudrajat

Abstract The purpose of this article is to develop a learning module for the Evaluation of Teaching Indonesian at the Indraprasta University PGRI Jakarta using the Dick and Carey development model. The implementation of this instruction includes how a prospective teacher is good at evaluating teaching materials so that the lecturer feels the need to develop teaching materials to improve the quality of teaching materials using formative evaluation consisting of One-to-one evaluation by experts, One-to-one evaluation by Learners, Small Group Evaluation, and Field Trial by making a blue print of each formative evaluation activity. Keywords: Dick and Carey Development Model, Formative Evaluation, Blue Print, Summative evaluation


Sign in / Sign up

Export Citation Format

Share Document