scholarly journals Transition from Paper to Online Course Evaluation: Preliminary Trends in Student Response Rate and Overall Professor Evaluation

2015 ◽  
Author(s):  
Christopher R. Dennison ◽  
Cagri Ayranci ◽  
Pierre Mertiny ◽  
Jason P. Carey
Keyword(s):  
Response Rate ◽  
Student Evaluation ◽  
Course Evaluation ◽  
Student Response ◽  
Online Course ◽  
Quality Of Instruction ◽  
Evaluation Of Teaching ◽  
Instructor Effectiveness ◽  
First Time

Student evaluation of teaching (SET) hasbeen used as a metric to arguably evaluate instructoreffectiveness and quality of instruction since the 1920s.SET is used in decisions regarding annual evaluation (offaculty) and is one of the most researched topics inevaluation of instructor effectiveness. Central researchquestions associated with SET include whether SET is anappropriate measure of effectiveness and whether it leadsto improved teaching and quality of graduates.In the fall 2013, the Faculty of Engineering at theUniversity of Alberta for the first time administered SETonline. The transition from paper-based and in class SETto online and out of class SET provides a uniqueopportunity to investigate changes in SET response rateand ratings of overall instructor effectiveness that couldbe attributed to change in protocol and that wouldsuggest protocol-related bias. Our preliminary resultsshow lower response rates for online SET andeffectiveness scores that were outside one standarddeviation of the previous 5-year mean. These findingsshow the importance of continuing to monitor web-basedSET results and point to directions of further research. Atthis time, this will not be possible, as the Faculty ofEngineering has discontinued online SET testing after asingle term.

scholarly journals Sustainable Pharmacy: Piloting a Session on Pharmaceuticals, Climate Change, and Sustainability within a U.S. Pharmacy Curriculum

2017 ◽  
Vol 8 (4) ◽  
pp. 3 ◽  
Author(s):  
Katherine Gruenberg ◽  
Dorie Apollonio ◽  
Conan MacDougall ◽  
Tina Brock
Keyword(s):  
Climate Change ◽  
San Francisco ◽  
Response Rate ◽  
Student Evaluation ◽  
Course Evaluation ◽  
Student Response ◽  
Knowledge Gain ◽  
Student Groups ◽  
Post Test ◽  
Pharmacy Curriculum

Objective: To design and assess an innovative session for pharmacy students that addresses the role of pharmaceuticals with climate change and sustainability. Innovation: One hundred and sixteen third-year students at the University of California, San Francisco School of Pharmacy participated during their required Health Policy course. This 3-hour session included guided pre-course activities, an interactive lecture, a panel of healthcare professionals discussing complex decision-making and small group case-based learning. Curricular assessment was conducted through pre-/post-test measures of knowledge acquisition, student evaluations, and course projects. Critical Analysis: One hundred and two students (response rate 88%) completed the pre-test and 115 students (response rate 99%) completed the post-test assessment. We identified a significant increase in the proportion of correct answers on post-test questions addressing drug disposal legislation (75% pre-test vs 91% post-test, p=0.002) and the predicted effects of climate change on health (55% pre-test vs 90% post-test, p < 0.001). The session was also well received; average student evaluation scores were above 4 in all areas of course evaluation (where 5=ideal). In addition, 17% of student groups (relative to 0% in 2015) proposed a sustainability-related policy as their final coursework project. Next Steps: The development and implementation of this brief session resulted in knowledge gain and favorable student response. This project is feasible for other Schools of Pharmacy to adapt and implement. Conflict of Interest: None   Type: Note

scholarly journals Factors affecting the student evaluation of teaching scores: evidence from panel data estimation

2012 ◽  
Vol 42 (1) ◽  
pp. 129-150 ◽  
Author(s):  
Eduardo de Carvalho Andrade ◽  
Bruno de Paula Rocha
Keyword(s):  
Training Programs ◽  
Student Evaluation ◽  
Random Effects Model ◽  
Student Evaluation Of Teaching ◽  
Factors Affecting ◽  
Panel Data Estimation ◽  
Quality Of Teaching ◽  
Evaluation Of Teaching ◽  
Data Estimation

We use a random-effects model to find the factors that affect the student evaluation of teaching (SET) scores. Dataset covers 6 semesters, 496 undergraduate courses related to 101 instructors and 89 disciplines. Our empirical findings are: (i) the class size affects negatively the SET score; (ii) instructors with more experience are better evaluated, but these gains reduce over time; (iii) participating in training programs, designed to improve the quality of teaching, did not increase the SET scores; (iv) instructors seem to be able to marginally 'buy' a better evaluation by inflating students' grade. Finally, there are significant changes in the rankings when we adjust the SET score to eliminate the effects of variables beyond instructors' control. Despite these changes, they are not statistically significant.

scholarly journals Small samples, unreasonable generalizations, and outliers: Gender bias in student evaluation of teaching or three unhappy students?

2021 ◽  
Author(s):  
Bob Uttl ◽  
Victoria C. Violo
Keyword(s):  
Gender Bias ◽  
Student Evaluation ◽  
Real Life ◽  
Small Sample ◽  
Small Samples ◽  
Online Course ◽  
Evaluation Of Teaching ◽  
Opposite Gender ◽  
Male Instructor ◽  
Section Sample

In a widely cited and widely talked about study, MacNell et al. (2015) [1] examined SET ratings of one female and one male instructor, each teaching two sections of the same online course, one section under their true gender and the other section under false/opposite gender. MacNell et al. concluded that students rated perceived female instructors more harshly than perceived male instructors, demonstrating gender bias against perceived female instructors. Boring, Ottoboni, and Stark (2016) [2] re-analyzed MacNell et al.’s data and confirmed their conclusions. However, the design of MacNell et al. study is fundamentally flawed. First, MacNell et al.’ section sample sizes were extremely small, ranging from 8 to 12 students. Second, MacNell et al. included only one female and one male instructor. Third, MacNell et al.’s findings depend on three outliers – three unhappy students (all in perceived female conditions) who gave their instructors the lowest possible ratings on all or nearly all SET items. We re-analyzed MacNell et al.’s data with and without the three outliers. Our analyses showed that the gender bias against perceived female instructors disappeared. Instead, students rated the actual female vs. male instructor higher, regardless of perceived gender. MacNell et al.’s study is a real-life demonstration that conclusions based on extremely small sample-sized studies are unwarranted and uninterpretable.

scholarly journals Student Evaluation Of Teacher Performance: Random Pre-Destination

2004 ◽  
Vol 1 (6) ◽  
Author(s):  
Kim L. Chuah ◽  
Cynthia Hill
Keyword(s):  
Random Sample ◽  
Teaching Effectiveness ◽  
Student Evaluation ◽  
Teacher Performance ◽  
Teaching Quality ◽  
Student Evaluation Of Teaching ◽  
Predominant Component ◽  
Persistent Pattern ◽  
Evaluation Of Teaching

The student evaluation, used to measure students’ perceptions of teacher performance, has been increasingly used as the predominant component in assessing teaching effectiveness (Waters et al. 1988), and the widespread movement of outcomes assessment across the country makes this trend likely to continue in the future (McCoy et al. 1994, AACSB 1994, SACS 1995).  Substantial research has been conducted with regard to the reliability and accuracy of student evaluation of teaching quality, and a considerable number of uncontrollable factors are found to bias the results of the evaluation rating.  This paper identifies one more factor.  Each student has an “evaluator profile”, which decreases the reliability of the student evaluation.  An “evaluator profile” is a persistent pattern of evaluating behavior that may or may not be consistent with the quality of the characteristic being evaluated.  Each class of students consists of a random sample of different evaluator profiles.  A student evaluation rating of a teacher’s performance is biased up or down depending on the concentration of high or low evaluator profiles present.  This paper further shows through simulation the degree to which student “evaluator profiles” impact the overall student evaluation rating of teacher performance. We find that there is evidence to support the “evaluator profile” conjecture, and that these “evaluator profiles” do in fact have the potential to change overall student evaluation ratings substantially.

scholarly journals Sentiment Analysis of Online Course Evaluation Based on a New Ensemble Deep Learning Mode: Evidence from Chinese

2021 ◽  
Vol 11 (23) ◽  
pp. 11313
Author(s):  
Xiaomin Pu ◽  
Guangxi Yan ◽  
Chengqing Yu ◽  
Xiwei Mi ◽  
Chengming Yu
Keyword(s):  
Sentiment Analysis ◽  
Online Courses ◽  
Course Evaluation ◽  
Online Course ◽  
Gray Wolf ◽  
Ensemble Model ◽  
The Stability ◽  
Deep Feature Extraction ◽  
Short Time

In recent years, online course learning has gradually become the mainstream of learning. As the key data reflecting the quality of online courses, users’ comments are very important for improving the quality of online courses. The sentiment information contained in comments is the guide of course improvement. A new ensemble model is proposed for sentiment analysis. The model takes full advantage of Word2Vec and Glove in word vector representation, and utilizes the bidirectional long and short time network and convolutional neural network to achieve deep feature extraction. Moreover, the multi-objective gray wolf optimization (MOGWO) ensemble method is adopted to integrate the models mentioned above. The experimental results show that the sentiment recognition accuracy of the proposed model is higher than that of the other seven comparison models, with an F1score over 91%, and the recognition results of different emotion levels indicate the stability of the proposed ensemble model.

scholarly journals Student ‘voice’ and higher education assessment: Is it all about the money?

2021 ◽  
Vol 18 (1) ◽  
pp. 74-90
Author(s):  
Andrew Hemming ◽  
◽  
Margaret Power ◽  
Keyword(s):  
Higher Education ◽  
Student Evaluation ◽  
Student Choice ◽  
Assessment Practices ◽  
Education Assessment ◽  
Tertiary Institutions ◽  
Higher Education Assessment ◽  
Evaluation Of Teaching ◽  
Professional Degrees

University administered Student Evaluation of Teaching surveys, while used primarily by educators and their managers to review and improve the quality of courses and teaching, can also be used by universities’ marketing campaigns and websites as a means of stressing their institution’s student friendliness and responsiveness to students’ needs. Changes in assessment practices is one way that tertiary institutions are responding to students’ preferences. However, there is a lack of understanding of the underlying factors that moderate decisions about assessment changes. The purpose of this paper is to examine whether or not a meaningful body of research concerning student ‘choice’ in higher education assessment exists, and how the extent of student ‘choice’ may change in the future. Emphasis has been placed on the assessment methods adopted in law and professional degrees in Australia. However, a broad review of international research from other relevant higher education discipline areas has also been undertaken in this paper.

scholarly journals Studentské hodnocení sportovní výuky

2017 ◽  
Vol 11 (1) ◽  
pp. 100-117
Author(s):  
Vladimír Jůva ◽  
Eva Valkounová
Keyword(s):  
Student Evaluation ◽  
University Education ◽  
University Teaching ◽  
Student Evaluation Of Teaching ◽  
Verification Tools ◽  
Evaluation Of Teaching ◽  
The Creation ◽  
Methodological Aspects

Importance of student evaluation of teaching (SET) growing currently as a response to demands of improving the quality of university education. The paper deals with SET aimed specifically at sports university education. The introduction briefly describes the concept, function and significance of SET. It also identifies selected specifics of student evaluation of university sports teaching. The empirical part of this text describes the methodological aspects and selected results of the evaluation carried out investigation and research aimed at the creation and verification tools for student evaluation of sports university teaching. The following discussion analyses selected issues that accompany this particular SET. Conclusion presents suggestions and asks other questions related to SET focused on university sports teaching.

Sign in / Sign up

Export Citation Format

Share Document