scholarly journals Clinical educator self-efficacy, self-evaluation and its relationship with student evaluations of clinical teaching

2020 ◽  
Author(s):  
Brett Vaughan
Keyword(s):  
Self Efficacy ◽  
Clinical Teaching ◽  
Student Evaluation ◽  
Teaching Quality ◽  
Student Evaluations ◽  
Multiple Sources ◽  
Self Evaluation ◽  
Clinical Educator ◽  
Clinical Educators ◽  
Evaluation Of Teaching

Abstract Background In a whole-of-system approach to evaluation of teaching across any degree, multiple sources of information can help develop an educators’ understanding of their teaching quality. In the health professions, student evaluations of clinical teaching are commonplace however, self-evaluation of teaching is less common, and exploration of clinical educators’ self-efficacy even less so. The aim of the study was to evaluate how a clinical educator’s self-evaluation of teaching intersects with their self-efficacy, to ascertain if that matches student evaluation of their teaching. This information may assist in facilitating targeted professional development to improve teaching quality. Methods Clinical educators in the osteopathy program at Victoria University (VU) were invited to complete: a) self-evaluation version of the Osteopathy Clinical Teaching Questionnaire (OCTQ); and b) the Self-Efficacy in Clinical Teaching (SECT) questionnaire. Students in the VU program completed the OCTQ for each of the clinical educators they worked with during semester 2, 2017. Results Completed OCTQ and SECT were received from 37 clinical educators. These were matched with 308 student evaluations (mean of 6 student ratings per educator). Three possible educator cohorts were identified: a) high clinical eductor self-OCTQ with low student evaluation; b) low clinical educator self-evaluation and high student evaluations; and, c) no difference between self- and student evaulations. Clinical educators in the first cohort demonstrated significantly higher SECT subscale scores (effect size >0.42) than their colleagues. Age, gender, teaching qualification, and years practicing or years as a clinical educator were not associated with clinical educator OCTQ scores or the SECT subscales. Conclusions Targeted professional development directed towards fostering self-efficacy may provide an avenue for engaging those clinical educators whose self-efficacy is low and/or those who did not receive high student evaluations. Given there is no gold standard measure of clinical teaching quality, educators should engage with multiple sources of feedback to benchmark their current performance level, and identify opportunities to improve. Student and self-evaluations using the OCTQ and evaluation of self-efficacy using the SECT, are useful tools for inclusion in a whole-of-system approach to evaluation of the clinical learning environment.

scholarly journals Clinical Educator Self-Efficacy, Self-Evaluation and Its Relationship With Student Evaluations of Clinical Teaching

2020 ◽  
Author(s):  
Brett Vaughan
Keyword(s):  
Self Efficacy ◽  
Clinical Teaching ◽  
Student Evaluation ◽  
Teaching Quality ◽  
Student Evaluations ◽  
Multiple Sources ◽  
Self Evaluation ◽  
Clinical Educator ◽  
Clinical Educators ◽  
Evaluation Of Teaching

Abstract Background In a whole-of-system approach to evaluation of teaching across any degree, multiple sources of information can help develop an educators’ understanding of their teaching quality. In the health professions, student evaluations of clinical teaching are commonplace however, self-evaluation of teaching is less common, and exploration of clinical educators’ self-efficacy even less so. The aim of the study was to evaluate how a clinical educator’s self-evaluation of teaching intersects with their self-efficacy, to ascertain if that matches student evaluation of their teaching. This information may assist in facilitating targeted professional development to improve teaching quality. Methods Clinical educators in the osteopathy program at Victoria University (VU) were invited to complete: a) self-evaluation version of the Osteopathy Clinical Teaching Questionnaire (OCTQ); and b) the Self-Efficacy in Clinical Teaching (SECT) questionnaire. Students in the VU program completed the OCTQ for each of the clinical educators they worked with during semester 2, 2017. Results Completed OCTQ and SECT were received from 37 clinical educators. These were matched with 308 student evaluations (mean of 6 student ratings per educator). Three possible educator cohorts were identified: a) high clinical eductor self-OCTQ with low student evaluation; b) low clinical educator self-evaluation and high student evaluations; and, c) no difference between self- and student evaulations. Clinical educators in the first cohort demonstrated significantly higher SECT subscale scores (effect size >0.42) than their colleagues. Age, gender, teaching qualification, and years practicing or years as a clinical educator were not associated with clinical educator OCTQ scores or the SECT subscales. Conclusions Targeted professional development directed towards fostering self-efficacy may provide an avenue for engaging those clinical educators whose self-efficacy is low and/or those who did not receive high student evaluations. Given there is no gold standard measure of clinical teaching quality, educators should engage with multiple sources of feedback to benchmark their current performance level, and identify opportunities to improve. Student and self-evaluations using the OCTQ and evaluation of self-efficacy using the SECT, are useful tools for inclusion in a whole-of-system approach to evaluation of the clinical learning environment.

scholarly journals Clinical educator self-efficacy, self-evaluation and its relationship with student evaluations of clinical teaching

2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Brett Vaughan
Keyword(s):  
Self Efficacy ◽  
Clinical Teaching ◽  
Student Evaluation ◽  
Teaching Quality ◽  
Student Evaluations ◽  
Multiple Sources ◽  
Self Evaluation ◽  
Clinical Educator ◽  
Clinical Educators ◽  
Evaluation Of Teaching

Abstract Background In a whole-of-system approach to evaluation of teaching across any degree, multiple sources of information can help develop an educators’ understanding of their teaching quality. In the health professions, student evaluations of clinical teaching are commonplace. However, self-evaluation of teaching is less common, and exploration of clinical educators’ self-efficacy even less so. The aim of the study was to evaluate how a clinical educator’s self-evaluation of teaching intersects with their self-efficacy, to ascertain if that matches student evaluation of their teaching. This information may assist in facilitating targeted professional development to improve teaching quality. Methods Clinical educators in the osteopathy program at Victoria University (VU) were invited to complete: a) self-evaluation version of the Osteopathy Clinical Teaching Questionnaire (OCTQ); and b) the Self-Efficacy in Clinical Teaching (SECT) questionnaire. Students in the VU program completed the OCTQ for each of the clinical educators they worked with during semester 2, 2017. Results Completed OCTQ and SECT were received from 37 clinical educators. These were matched with 308 student evaluations (mean of 6 student ratings per educator). Three possible educator cohorts were identified: a) high clinical eductor self-OCTQ with low student evaluation; b) low clinical educator self-evaluation and high student evaluations; and, c) no difference between self- and student evaulations. Clinical educators in the first cohort demonstrated significantly higher SECT subscale scores (effect size > 0.42) than their colleagues. Age, gender, teaching qualification, and years practicing or years as a clinical educator were not associated with clinical educator OCTQ scores or the SECT subscales. Conclusions Targeted professional development directed towards fostering self-efficacy may provide an avenue for engaging those clinical educators whose self-efficacy is low and/or those who did not receive high student evaluations. Given there is no gold standard measure of clinical teaching quality, educators should engage with multiple sources of feedback to benchmark their current performance level, and identify opportunities to improve. Student and self-evaluations using the OCTQ and evaluation of self-efficacy using the SECT, are useful tools for inclusion in a whole-of-system approach to evaluation of the clinical learning environment.

Redesign of the System for Evaluation of Teaching Qualities in Anesthesiology Residency Training (SETQ Smart)

2016 ◽  
Vol 125 (5) ◽  
pp. 1056-1065 ◽  
Author(s):  
Kiki M. J. M. H. Lombarts ◽  
Andrew Ferguson ◽  
Markus W. Hollmann ◽  
Bente Malling ◽  
Onyebuchi A. Arah ◽  
...  
Keyword(s):  
Residency Training ◽  
Clinical Teaching ◽  
Teaching Performance ◽  
Self Evaluation ◽  
Faculty Teaching ◽  
Multicenter Survey ◽  
Scale Scores ◽  
Global Ratings ◽  
Evaluation Of Teaching ◽  
Generalizability Analysis

Abstract Background Given the increasing international recognition of clinical teaching as a competency and regulation of residency training, evaluation of anesthesiology faculty teaching is needed. The System for Evaluating Teaching Qualities (SETQ) Smart questionnaires were developed for assessing teaching performance of faculty in residency training programs in different countries. This study investigated (1) the structure, (2) the psychometric qualities of the new tools, and (3) the number of residents’ evaluations needed per anesthesiology faculty to use the instruments reliably. Methods Two SETQ Smart questionnaires—for faculty self-evaluation and for resident evaluation of faculty—were developed. A multicenter survey was conducted among 399 anesthesiology faculty and 430 residents in six countries. Statistical analyses included exploratory factor analysis, reliability analysis using Cronbach α, item-total scale correlations, interscale correlations, comparison of composite scales to global ratings, and generalizability analysis to assess residents’ evaluations needed per faculty. Results In total, 240 residents completed 1,622 evaluations of 247 faculty. The SETQ Smart questionnaires revealed six teaching qualities consisting of 25 items. Cronbach α’s were very high (greater than 0.95) for the overall SETQ Smart questionnaires and high (greater than 0.80) for the separate teaching qualities. Interscale correlations were all within the acceptable range of moderate correlation. Overall, questionnaire and scale scores correlated moderately to highly with the global ratings. For reliable feedback to individual faculty, three to five resident evaluations are needed. Conclusions The first internationally piloted questionnaires for evaluating individual anesthesiology faculty teaching performance can be reliably, validly, and feasibly used for formative purposes in residency training.

scholarly journals Construction practice of student evaluation system based on JFinal + webix integrated framework and Baidu AI platform

2021 ◽  
Vol 336 ◽  
pp. 05016
Author(s):  
Zhan Gao ◽  
Zhihai Suo ◽  
Jun Liu ◽  
Mo Xu ◽  
Dandan Hong ◽  
...  
Keyword(s):  
Evaluation System ◽  
Student Evaluation ◽  
Evaluation Model ◽  
Teaching Quality ◽  
Integration Framework ◽  
Online Student ◽  
Evaluation Of Teaching ◽  
Multi Level ◽  
Level Student ◽  
Construction Practice

Students' evaluation of teaching is a key link to realize teaching quality monitoring and promote teachers' teaching level. Based on the practice of student evaluation in our university, this paper constructs a multi-level student evaluation system, and develops an online student evaluation system by using JFinal+webix integration framework. The new Internet plus evaluation model is established to improve the efficiency of student evaluation and the enthusiasm of students to evaluate teaching. Meanwhile, based on the analysis of students' comments on teaching by Baidu AI platform, It provides data support for the improvement of learning level and the optimization of teaching evaluation.

The Use of Collaborative Midterm Student Evaluations to Provide Actionable Results

2016 ◽  
Vol 38 (3) ◽  
pp. 157-169 ◽  
Author(s):  
Ann Veeck ◽  
Kelley O’Reilly ◽  
Amy MacMillan ◽  
Hongyan Yu
Keyword(s):  
Student Learning ◽  
Student Evaluation ◽  
Student Evaluations ◽  
Formative Feedback ◽  
Student Evaluation Of Teaching ◽  
Improving Instruction ◽  
Evaluation Of Teaching ◽  
Individual Evaluation ◽  
Collaborative Evaluation ◽  
Improve Student Learning

Midterm student evaluations have been shown to be beneficial for providing formative feedback for course improvement. With the purpose of improving instruction in marketing courses, this research introduces and evaluates a novel form of midterm student evaluation of teaching: the online collaborative evaluation. Working in small teams, students comment on their course using an online collaborative document creation tool. Compared with a standard individual evaluation, the online collaborative evaluation was rated significantly higher by students in enjoyment, ease, and ability to provide useful feedback. In addition, comments yielded from the collaborative evaluation provided formative information that could be used to improve student learning. In a marketing class that emphasizes teamwork, the collaborative evaluation of teaching can reinforce the benefits of functioning well as a team, while providing useful information to the instructor to improve the course.

scholarly journals Student Evaluation Of Teacher Performance: Random Pre-Destination

2004 ◽  
Vol 1 (6) ◽  
Author(s):  
Kim L. Chuah ◽  
Cynthia Hill
Keyword(s):  
Random Sample ◽  
Teaching Effectiveness ◽  
Student Evaluation ◽  
Teacher Performance ◽  
Teaching Quality ◽  
Student Evaluation Of Teaching ◽  
Predominant Component ◽  
Persistent Pattern ◽  
Evaluation Of Teaching

The student evaluation, used to measure students’ perceptions of teacher performance, has been increasingly used as the predominant component in assessing teaching effectiveness (Waters et al. 1988), and the widespread movement of outcomes assessment across the country makes this trend likely to continue in the future (McCoy et al. 1994, AACSB 1994, SACS 1995).  Substantial research has been conducted with regard to the reliability and accuracy of student evaluation of teaching quality, and a considerable number of uncontrollable factors are found to bias the results of the evaluation rating.  This paper identifies one more factor.  Each student has an “evaluator profile”, which decreases the reliability of the student evaluation.  An “evaluator profile” is a persistent pattern of evaluating behavior that may or may not be consistent with the quality of the characteristic being evaluated.  Each class of students consists of a random sample of different evaluator profiles.  A student evaluation rating of a teacher’s performance is biased up or down depending on the concentration of high or low evaluator profiles present.  This paper further shows through simulation the degree to which student “evaluator profiles” impact the overall student evaluation rating of teacher performance. We find that there is evidence to support the “evaluator profile” conjecture, and that these “evaluator profiles” do in fact have the potential to change overall student evaluation ratings substantially.

scholarly journals Adverse Changes In Faculty Behavior Resulting From Use Of Student Evaluations Of Teaching: A Case Study

2011 ◽  
Vol 8 (1) ◽  
Author(s):  
Robert E. Pritchard ◽  
Gregory C. Potter
Keyword(s):  
Student Evaluation ◽  
Teaching Quality ◽  
Student Evaluations ◽  
Evaluation Instrument ◽  
Senior Year ◽  
Student Evaluations Of Teaching ◽  
Regional University ◽  
Underlying Causes ◽  
College Of Business

Based on a detailed literature review and longitudinal analysis, this paper explores the possible underlying causes of the decline in the number of hours per week graduating business seniors indicated they studied during their senior year. The study was conducted at an AACSB accredited college of business at a regional university.  The study indicates that the decline in hours studied was likely an unintended result of using a process designed to demonstrate continuous improvement in teaching. The process utilized the Educational Testing Service’s SIR II student evaluation instrument as the only measure of teaching quality/effectiveness. The study concludes that the process may have pressured some instructors to sacrifice teaching rigor in an attempt to obtain more favorable student evaluations, thereby precipitating the decline in hours studied.

scholarly journals Impact of a Dedicated Teaching Attending Experience on a Required Emergency Medicine Clerkship

2019 ◽  
Vol 21 (1) ◽  
pp. 58-64
Author(s):  
Todd Guth ◽  
Michael Overbeck ◽  
Kelley Roswell ◽  
Tien Vu ◽  
Kayla Williamson ◽  
...  
Keyword(s):  
Emergency Medicine ◽  
Clinical Teaching ◽  
Multinomial Logistic Regression ◽  
Educational Innovation ◽  
High Volume ◽  
Teaching Quality ◽  
Medicine Clerkship ◽  
Clinical Educator ◽  
Sample Proportion ◽  
Rapid Pace

Introduction: One published strategy for improving educational experiences for medical students in the emergency department (ED) while maintaining patient care has been the implementation of dedicated teaching attending shifts. To leverage the advantages of the ED as an exceptional clinical educational environment and to address the challenges posed by the rapid pace and high volume of the ED, our institution developed a clerkship curriculum that incorporates a dedicated clinical educator role – the teaching attending – to deliver quality bedside teaching experiences for students in a required third-year clerkship. The purpose of this educational innovation was to determine whether a dedicated teaching attending experience on a third-year required emergency medicine (EM) clerkship would improve student-reported clinical teaching evaluations and student-reported satisfaction with the overall quality of the EM clerkship. Methods: Using a five-point Likert-type scale (1 - poor to 5 - excellent), student-reported evaluation ratings and the numbers of graduating students matching into EM were trended for 10 years retrospectively from the inception of the clerkship for the graduating class of 2009 through and including the graduating class of 2019. We used multinomial logistic regression to evaluate whether the presence of a teaching attending during the EM clerkship improved student-reported evaluation ratings for the EM clerkship. We used sample proportion tests to assess the differences between top-box (4 or 5 rating) proportions between years when the teaching attending experience was present and when it was not. Results: For clinical teaching quality, when the teaching attending is present the estimated odds of receiving a rating of 5 is 77.2 times greater (p <0.001) than when the teaching attending is not present and a rating of 4 is 27.5 times greater (p =0.0017). For overall clerkship quality, when the teaching attending is present, the estimated odds of receiving a rating of 5 is 13 times greater (p <0.001) and a rating of 4 is 5.2 times greater (p=0.0086) than when the teaching attending is not present. Conclusion: The use of a dedicated teaching attending shift is a successful educational innovation for improving student self-reported evaluation items in a third-year required EM clerkship.

scholarly journals A literature review on the student evaluation of teaching

2018 ◽  
Vol 12 (2) ◽  
pp. 63-84 ◽  
Author(s):  
Gregory Ching
Keyword(s):  
Literature Review ◽  
Psychological Contract ◽  
Student Evaluation ◽  
Student Evaluation Of Teaching ◽  
Content Type ◽  
Factors Affecting ◽  
Self Evaluation ◽  
Evaluation Of Teaching ◽  
Narrative Literature Review ◽  
Teaching Learning

PurposeCompetition among higher education institutions has pushed universities to expand their competitive advantages. Based on the assumption that the core functions of universities are academic, understanding the teaching–learning process with the help of student evaluation of teaching (SET) would seem to be a logical solution in increasing competitiveness. The paper aims to discuss these issues.Design/methodology/approachThe current paper presents a narrative literature review examining how SETs work within the concept of service marketing, focusing specifically on the search, experience, and credence qualities of the provider. A review of the various factors that affect the collection of SETs is also included.FindingsRelevant findings show the influence of students’ prior expectations on SET ratings. Therefore, teachers are advised to establish a psychological contract with the students at the start of the semester. Such an agreement should be negotiated, setting out the potential benefits of undertaking the course and a clear definition of acceptable performance within the class. Moreover, connections should be made between courses and subjects in order to provide an overall view of the entire program together with future career pathways.Originality/valueGiven the complex factors affecting SETs and the antecedents involved, there appears to be no single perfect tool to adequately reflect what is happening in the classroom. As different SETs may be needed for different courses and subjects, options such as faculty self-evaluation and peer-evaluation might be considered to augment current SETs.

Sign in / Sign up

Export Citation Format

Share Document