scholarly journals ManyClasses 1: Assessing the Generalizable Effect of Immediate Feedback Versus Delayed Feedback Across Many College Classes

2021 ◽  
Vol 4 (3) ◽  
pp. 251524592110275
Author(s):  
Emily R. Fyfe ◽  
Joshua R. de Leeuw ◽  
Paulo F. Carvalho ◽  
Robert L. Goldstone ◽  
Janelle Sherman ◽  
...  
Keyword(s):  
Student Learning ◽  
Research Question ◽  
Delayed Feedback ◽  
Randomized Experiments ◽  
Immediate Feedback ◽  
Subsequent Performance ◽  
Feedback Timing ◽  
Class Level ◽  
College Classes ◽  
Highest Density Interval

Psychology researchers have long attempted to identify educational practices that improve student learning. However, experimental research on these practices is often conducted in laboratory contexts or in a single course, which threatens the external validity of the results. In this article, we establish an experimental paradigm for evaluating the benefits of recommended practices across a variety of authentic educational contexts—a model we call ManyClasses. The core feature is that researchers examine the same research question and measure the same experimental effect across many classes spanning a range of topics, institutions, teacher implementations, and student populations. We report the first ManyClasses study, in which we examined how the timing of feedback on class assignments, either immediate or delayed by a few days, affected subsequent performance on class assessments. Across 38 classes, the overall estimate for the effect of feedback timing was 0.002 (95% highest density interval = [−0.05, 0.05]), which indicates that there was no effect of immediate feedback compared with delayed feedback on student learning that generalizes across classes. Furthermore, there were no credibly nonzero effects for 40 preregistered moderators related to class-level and student-level characteristics. Yet our results provide hints that in certain kinds of classes, which were undersampled in the current study, there may be modest advantages for delayed feedback. More broadly, these findings provide insights regarding the feasibility of conducting within-class randomized experiments across a range of naturally occurring learning environments.

scholarly journals ManyClasses 1: Assessing the generalizable effect of immediate versus delayed feedback across many college classes

2019 ◽  
Author(s):  
Emily Fyfe ◽  
Joshua R de Leeuw ◽  
Paulo F. Carvalho ◽  
Robert Goldstone ◽  
Benjamin Motz
Keyword(s):  
Research Question ◽  
Randomized Experiments ◽  
Single Class ◽  
Subsequent Performance ◽  
Feedback Timing ◽  
Naturally Occurring ◽  
Experimental Effect ◽  
Core Feature ◽  
College Classes ◽  
Improve Student Learning

Psychology researchers have long attempted to identify educational practices that improve student learning. However, experimental research on these practices is often conducted in laboratory contexts or in a single class, threatening the external validity of the results. In this paper, we establish an experimental paradigm for evaluating the benefits of recommended practices across a variety of authentic educational contexts – a model we call ManyClasses. The core feature is that researchers examine the same research question and measure the same experimental effect across many classes spanning a range of topics, institutions, teacher implementations, and student populations. We report the first ManyClasses study, which examined how the timing of feedback on class assignments, either immediate or delayed by a few days, affected subsequent performance on class assessments. Across XX classes, [summarize effect of feedback timing, including key moderators]. More broadly, these findings provide evidence regarding the feasibility of conducting within-class randomized experiments across a range of naturally occurring learning environments.

scholarly journals Student Course Evaluations In Traditional And Blended Courses: A Case Study

2011 ◽  
Vol 4 (1) ◽  
Author(s):  
Gadis Nowell
Keyword(s):  
Blended Learning ◽  
Student Satisfaction ◽  
Student Learning ◽  
Cost Benefit Analysis ◽  
Research Question ◽  
Cost Benefit ◽  
Course Satisfaction ◽  
Future Research ◽  
Traditional Learning ◽  
Net Benefit

It is generally held that blended learning is gaining acceptance and being adopted at college campuses throughout the U.S.  Accompanying this trend has been an expansion of the research efforts in this area. These efforts have been guided mainly by the five pillars of the Sloan Consortium Quality Framework (Sloan-C) and two large questions.    One question is, “Is blended learning better than other learning environments?"   In this study, this question was examined from the perspective of the Sloan-C's student satisfaction pillar.  The research question was stated as follows:  “Is the level of student course satisfaction generated by blended learning higher than that which is generated by traditional face-to-face classroom learning?”  The results of this study revealed "no differences" between blended and traditional learning on the student course satisfaction variable.  In this regard, it is important to note that this finding of "no differences" is consistent with the existing research findings on student learning effectiveness as well.  Given this combined evidential pattern the following question is relevant and has implications for future research efforts in this area:  "Within the context of cost/benefit analysis, why should an institution invest the additional resources needed to effectively implement a blended format when, in accordance with the existing research evidence, there is little or no net benefit in terms of its impact on students; i.e., either in terms of student satisfaction or student learning?".

Utilizing Twitter and #Hashtags Toward Enhancing Student Learning in an Online Course Environment

2018 ◽  
pp. 1217-1226 ◽  
Author(s):  
T. Scott Bledsoe ◽  
Dave Harmeyer ◽  
Shuang Frances Wu
Keyword(s):  
Student Engagement ◽  
Student Learning ◽  
Research Methodology ◽  
Research Question ◽  
Online Course ◽  
Online Research ◽  
Theory Approach ◽  
Information Communication ◽  
Educational Environments ◽  
Grounded Theory Approach

The authors offer an answer to the research question, To what extent and in what ways is Twitter helpful to student learning when group hashtags are created and used in collaborative educational environments? Sixty-two students in a spring 2012 graduate online Research Methodology course worked individually and in groups to create discussions on topics of interest through Twitter posts and student-created hashtags. Student participants answered nine qualitative and quantitative questions concerning the Twitter/hashtag exercise and used collaborative blog pages to reflect on their experiences. A grounded theory approach was applied to classify data generated from the nine questions and blog postings. An analysis of the study's data resulted in the discovery of the following four themes: access to information, communication, class engagement, and general feedback. Based on these themes, nine recommendations are offered for maximizing the use of Twitter in an online environment for increased student engagement and learning.

Enhance Student Learning with PowerPoint Games

2011 ◽  
Vol 7 (2) ◽  
pp. 13-20 ◽  
Author(s):  
Victoria A. Fratto
Keyword(s):  
Active Learning ◽  
Student Learning ◽  
Teaching Practice ◽  
Learning By Doing ◽  
Academic Disciplines ◽  
Time On Task ◽  
Managerial Accounting ◽  
Immediate Feedback ◽  
Use Of Technology ◽  
Good Teaching Practice

Stakeholders encourage accounting educators to provide active learning opportunities, to integrate the creative use of technology into the curriculum, and to emphasize learning by doing. The principles of good teaching practice can use technology to promote active learning, to provide prompt feedback to students, to increase student time on task, and to make learning more effective and efficient for the student. Technological tools can permit students to become active participants and can improve student learning by giving students convenient access to review material with immediate feedback. This article describes the use and development of a PowerPoint game in an introductory accounting course (managerial accounting) that provides the student with immediate feedback and is designed to be accessed by the student outside of the classroom. This technological tool can be used in other undergraduate academic disciplines.

A Comparison of Two Different Strategies for Undergraduate Research Within the Framework of a Rotor Dynamics Laboratory

2007 ◽  
Author(s):  
Jim Meagher ◽  
Xi Wu
Keyword(s):  
Student Learning ◽  
Undergraduate Students ◽  
Undergraduate Research ◽  
Research Question ◽  
Rotor Dynamics ◽  
Research Project ◽  
Literature Searches ◽  
Research Findings ◽  
Conducting Research ◽  
Directed Research

Introductory graduate level courses and upper division technical electives often present a student with his or her first research project. Time limitations of a course require a balance between open ended discovery, development of specialized technical knowledge, and teaching the mechanics of research methodology. The case study presented in this paper is an outline of two different strategies to introduce research to undergraduate students within the framework of a rotor dynamics laboratory. The laboratory had historically been designed to demonstrate machinery malfunctions in a series of short exercises. The laboratory was changed to have several introductory labs designed to prepare students for an extended self-directed research project that included literature searches, paper reviews, design of experiments, and presentation of research findings to the class. In one strategy the students were expected to practice discovery primarily through experimentation with specific, restricted goals. In the other strategy the students were given more flexibility defining the research question and in establishing priorities. Both projects had students design an experiment whose results were compared to mathematical simulations and each led to research that was presented at a conference. Although both were considered successful in terms of student learning and research outcomes, a balance biased toward experimentation and restricted student options for discovery actually led to broader research findings and more in-depth student research but with less student appreciation for and practice with the necessary preliminary stages of conducting research. The student learning experiences and methodologies for each scenario are presented and compared in this paper.

The Effects of Mental Practice on Motor Skill Learning and Performance: A Meta-analysis

1983 ◽  
Vol 5 (1) ◽  
pp. 25-57 ◽  
Author(s):  
Deborah L. Feltz ◽  
Daniel M. Landers
Keyword(s):  
Motor Skill ◽  
Meta Analysis ◽  
Research Question ◽  
Research Literature ◽  
Mental Practice ◽  
Skill Learning ◽  
Effect Sizes ◽  
Average Effect ◽  
Subsequent Performance ◽  
Clear Cut

A longstanding research question in the sport psychology literature has been whether a given amount of mental practice prior to performing a motor skill will enhance one's subsequent performance. The research literature, however, has not provided any clear-cut answers to this question and this has prompted the present, more comprehensive review of existing research using the meta-analytic strategy proposed by Glass (1977). From the 60 studies yielding 146 effect sizes the overall average effect size was .48, which suggests, as did Richardson (1967a), that mentally practicing a motor skill influences performance somewhat better than no practice at all. Effect sizes were also compared on a number of variables thought to moderate the effects of mental practice. Results from these comparisons indicated that studies employing cognitive tasks had larger average effect sizes than motor or strength tasks and that published studies had larger average effect sizes than unpublished studies. These findings are discussed in relation to several existing explanations for mental practice and four theoretical propositions are advanced.

A Web-Based Tutorial to Enhance Student Learning of Activity Analysis

2005 ◽  
Vol 72 (3) ◽  
pp. 153-163 ◽  
Author(s):  
Cynthia Perlman ◽  
Cynthia Weston ◽  
Erika Gisel
Keyword(s):  
Student Learning ◽  
Instructional Strategies ◽  
Performance Outcomes ◽  
Activity Analysis ◽  
Immediate Feedback ◽  
Web Based ◽  
Occupational Therapy Students ◽  
Before And After ◽  
Based Instruction ◽  
The Impact

Background. This paper describes the impact on learning of a web-based tutorial for the application of activity analysis, with occupational therapy students, at McGill University, Montreal, Quebec. This tutorial offers unique, interactive instructional strategies allowing for self-directed higher cognitive and reflective learning, which has not been possible, to date, in current web-based technology. Scope. Through repeated practice, students collaboratively (in dyads) apply concepts of activity analysis, and receive immediate feedback by comparing their answers to a standard. Methods and Results. Comparisons of performance outcomes on summative exams before and after implementation of the tutorial are made, suggesting a decrease in variance scores indicating fewer students are falling below the class average. These results are attributed to opportunities to practice activity analysis and to receive immediate feedback. Practice Implications. Web-based instruction can impact student learning if the instructional strategies ensure coherence with all other instructional components, match the learning outcomes, facilitate self-directed and collaborative learning, and allow for practice and feedback.

scholarly journals EFEKTIVITAS STRATEGI PEMBERIAN UMPAN BALIK TERHADAP KINERJA PRAKTIKUM MAHASISWA D-3 JURUSAN TEKNIK ELEKTRONIKA

2015 ◽  
Vol 1 (1) ◽  
Author(s):  
Sapto Haryoko
Keyword(s):  
Performance Assessment ◽  
Delayed Feedback ◽  
T Test ◽  
Control Group ◽  
Immediate Feedback ◽  
Control Group Design ◽  
Treatment Groups ◽  
Group Design ◽  
Group A ◽  
Better Than

Abstract: Effectiveness of the Feedback Providing Strategies on the PracticumPerformance of the Students of the Diploma Three (D-3) of the ElectronicEngineering Department. This study aims to investigate the effectiveness of thefeedback providing strategies (immediate feedback and delayed feedback) onstudents’ performance in the Electronics lab course. This study was anexperiment employed a posttest-only control group design. The subjects werestudents of the Diploma Three (D-3) Program of the Electronic EngineeringDepartment of FT UNM, divided into two treatment groups. Group A,consisting of 20 students, received the treatment of the immediate feedback andGroup B, consisting of 19 students, received the treatment of delayed feedback.The data on the students’ mastery of lab materials were collected throughobservations using a performance assessment form. The data were analyzedusing the t-test. The results showed that the practicum performance of thestudents receiving immediate feedback was better than that of the studentsreceiving delayed feedback. Keywords: immediate feedback, delayed feedback, students’ practicum performance

Evidence: From Surveys

2018 ◽  
Author(s):  
Jacqueline M. Dewar
Keyword(s):  
Student Learning ◽  
Teaching And Learning ◽  
Research Question ◽  
Reliability And Validity ◽  
Scholarship Of Teaching ◽  
What Works ◽  
Science Technology ◽  
Course Material ◽  
And Mathematics ◽  
Knowledge Survey

Chapter 5 describes the use of surveys in scholarship of teaching and learning (SoTL) studies. Topics include how to design a survey, the reliability and validity of surveys, and response rates and how to improve them. The chapter also includes a detailed discussion of a special type of survey called a knowledge survey that is used to measure students’ confidence in their knowledge of disciplinary content. Multiple uses for knowledge surveys are described: a means to assess changes in student learning, a way to improve course organization and coordination across multiple sections, and as guide through the course material for students. The importance of a survey being a good match for the type of research question—What works? What is? What could be?—is emphasized. Many examples are given of studies of student learning in science, technology, engineering, and mathematics (STEM) fields that employed surveys.

Sign in / Sign up

Export Citation Format

Share Document