scholarly journals Peer Review #2 of "Conflict of interest explains the size of student evaluation of teaching and learning correlations in multisection studies: a meta-analysis (v0.2)"

Author(s):  
W Stroebe
PeerJ ◽  
2019 ◽  
Vol 7 ◽  
pp. e7225 ◽  
Author(s):  
Bob Uttl ◽  
Kelsey Cnudde ◽  
Carmela A. White

We examined the associations between the size of student evaluation of teaching and learning (SET/learning) correlations and presence of several conflicts of interest (COIs) including corporate, administrative, evaluation unit, SET author, and funder interests. Our meta-analyses of SET/learning correlations reported by multisection studies show that researchers with a vested interest in finding large positive SET/learning correlations found, on average, large positive SET/learning correlations. In contrast, researchers with no identifiable COIs found that SET/learning correlations were zero or nearly zero. The largest SET/learning correlations were reported by authors with ties to SET selling corporations. Smaller but still substantial SET/learning correlations were reported by researchers with administrative assignments and by researchers in evaluation units/departments responsible for the administration of SET. Moreover, authors with the most significant COIs were publishing their studies primarily prior to 1981 whereas authors with no or less significant COIs were publishing their studies in 1981 or afterwards. Studies published prior to 1981 reported small but significant (r = .31) SET/learning correlations whereas studies published in 1981 and after reported near zero, non-significant SET/learning correlations (r = .06). The presence of COIs was associated with earlier publication date but also with smaller samples. Finally, whereas corporate, administrative, and evaluation unit authors nearly ceased publishing multisection studies on SET/learning correlations, authors from business and economics departments are now responsible for the substantial portion of newer, larger, and higher quality studies published in 1981 and after.


2019 ◽  
Vol 8 (5) ◽  
pp. 95
Author(s):  
Jang C. Jin

This paper examines empirically the determinants of student evaluation of teaching (SET).  An empirical model was specified and estimated using the SET data collected in Hong Kong over six academic years.  A key finding is that three different origins of students had a differentiated impact on teaching evaluation.  In particular, students from mainland China appreciated and rated teaching favorably, and hence the more mainland talents in the class, the higher the class-average SET scores.  However, local Hong Kong students valued teaching and learning effectiveness unfavorably.  Exchange students from abroad also dropped the class-average SET scores, as well as class-average exam scores.  The results suggest that raw SET scores should be used with care if classes are unbalanced with a large group of atypical students who work less but blame instructors for everything.


Sign in / Sign up

Export Citation Format

Share Document