scholarly journals Assessment that matters: Balancing reliability and learner-centered pedagogy in MOOC assessment

2019 ◽  
Author(s):  
Giora Alexandron ◽  
Mary Ellen Wiltrout ◽  
Aviram Berg ◽  
José A. Ruipérez-Valiente

Learner-centered pedagogy highlights active learning and formative feedback. Instructors often incentivize learners to engage in such formative assessment activities by crediting their completion and score in the final grade, a pedagogical practice that is very relevant to MOOCs as well. However, previous studies have shown that too many MOOC learners exploit the anonymity to abuse the formative feedback, which is critical in the learning process, to earn points without effort. Unfortunately, limiting feedback and access to decrease cheating is counter-pedagogic and reduces the openness of MOOCs. We aimed to identify and analyze a MOOC assessment strategy that balances this tension between learner-centered pedagogy, incentive design, and reliability of the assessment. In this study, we evaluated an assessment model that MITx Biology introduced in a MOOC to reduce cheating with respect to its effect on two aspects of learner behavior – the amount of cheating and learners’ engagement in formative course activities. The contribution of the paper is twofold. First, this work provides MOOC designers with an ‘analytically-verified’ MOOC assessment model to reduce cheating without compromising learner engagement in formative assessments. Second, this study provides a learning analytics methodology to approximate the effect of such an intervention.

2020 ◽  
Vol 9 (2) ◽  
pp. 115
Author(s):  
Wiyaka Wiyaka ◽  
Entika Fani Prastikawati ◽  
AB Prabowo Kusumo Adi

<div><p class="StyleABSTRAKenCambria">The integration of higher-order thinking skills (HOTS) in language learning assessments has become a crucial issue in 21st-century learning. However, not many teachers are aware of the need to incorporate HOTS in assessments due to their insufficient knowledge and the absence of good examples. Further, there is not much research and literature on HOTS-based formative assessment that can be used as references. This research aims to fill the existing gap by providing a model of higher-order thinking skills (HOTS)-based formative assessments for English learning, especially in junior high schools. By employing research and development design, this research describes the validation of the assessment model. The proposed model of assessment may be used as a prototype for assessing language learning.</p></div><p> </p>


2021 ◽  
pp. 000-000
Author(s):  
Nozomi Sakata ◽  
Moses Oketch ◽  
Mano Candappa

2019 ◽  
Vol 23 (3) ◽  
Author(s):  
Priya Harindranathan ◽  
James Folkestad

Instructors may design and implement formative assessments on technology-enhanced platforms (e.g., online quizzes) with the intention of encouraging the use of effective learning strategies like active retrieval of information and spaced practice among their students. However, when students interact with unsupervised technology-enhanced learning platforms, instructors are often unaware of students’ actual use of the learning tools with respect to the pedagogical design. In this study, we designed and extracted five variables from the Canvas quiz-log data, which can provide insights into students’ learning behaviors. Anchoring our conceptual basis on the ‘influential conversational framework’, we find that learning analytics (LA) can provide instructors with critical information related to students’ learning behaviors, thereby supporting instructors’ inquiry into student learning in unsupervised technology-enhanced platforms. Our findings suggest that the information that LA provides may enable instructors to provide meaningful feedback to learners and improve the existing learning designs.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Zamzami Zainuddin ◽  
Ratna Farida ◽  
Cut Muftia Keumala ◽  
Rudi Kurniawan ◽  
Hadi Iskandar

Purpose This study aims to present research evidence on the relevance of online gamification flip learning as a pedagogical instruction in promoting learning engagement when college students are impacted by the coronavirus pandemic. In this study, a gamified formative assessment was used to examine learner engagement and to evaluate the effectiveness of gamification within a synchronous online flipped instruction. Design/methodology/approach A multiphase mixed methods research design was used for this study. The evaluation relied on triangulated evidence gathered through questionnaire surveys and semi-structured interviews administered at an Indonesian college setting. Findings Based on the findings, gamified learning and formative assessments that adopt online flipped approaches have shown a positive bearing on learner engagement, despite the challenges learners face while harrowing through times of calamity. The results of this study provide prima facie support for the claim that the use of interactive gamified e-quizzes proves to be an innovative means of stimulating student engagement during the online class. Originality/value The results further suggest that a learning framework that incorporates both online flipped and gamification techniques provide the stimulus that is likely to forge an emotional connection that can inspire learner engagement, much needed when learners rally through calamitous events. This study has established evidential links between gamification and flipped classroom instructional delivery, particularly for online class settings. It is well-anticipated that gamification flip learning can continue to be implemented either in online, blended or face-to-face class instruction and particularly after the time of the pandemic.


Gamification ◽  
2015 ◽  
pp. 970-982
Author(s):  
Michael D. Kickmeier-Rust ◽  
Eva C. Hillemann ◽  
Dietrich Albert

Gamification is a recent trend in the field of game-based learning that accounts for development effort, costs, and effectiveness concerns of games. Another trend in educational technology is learning analytics and formative feedback. In the context of a European project the developed a light weight tool for learning and practicing divisions named Sonic Divider. This simple app is based on features of gamification. More importantly, it features formative assessment and feedback functions based on Competence-based Knowledge Space Theory. The authors applied and evaluated the tool in Austrian classrooms and found some evidence for the motivational aspect of the gamification elements, in particular scoring. They also found positive effects of an individualized and meaningful feedback about errors. Finally, there occurred certain gender difference, for example, girls were much less attracted by competition elements (e.g., by comparing high scores) then boys, however, more attentive towards feedback coming from the tool.


Author(s):  
Harriette Thurber Rasmussen ◽  
Amy Baeder ◽  
Margaret A. Hunter ◽  
Jane Chadsey

Learner engagement in online learning environments tends to be erratic and dependent upon the learners themselves, not necessarily fostered by the macrostructures that house the virtual classroom. Protocols—which the authors term microstructures—can bring engagement strategies traditionally seen in face-to-face classrooms to the virtual world of online adult learning. This chapter explores how the use of microstructures supports learner-centered engagement, illustrated through a case study of a successful virtual professional learning network. This chapter also introduces the concept of accountability for participation, its role in creating engaged learners, and how microstructures can foster the psychological safety required for high levels of engagement and performance in the virtual classroom.


Author(s):  
John Ewing ◽  
Doug Reid

The study focuses on guiding students through an exploration of social constructivism model as it relates to the roles of instructor and learner. It explores the use of a metaphor, the dot, to demonstrate that metaphors can support deeper understanding of difficult concepts inherent in learner-centered and constructivist pedagogies. This research was conducted to ascertain whether metaphors provide common reference points for learners that can be used to build and test new assumptions of knowledge. Additionally, the study highlights challenges that learner-centered pedagogy face when identifying preconceived constructs and moving towards the adoption of new thoughts, perspectives, and reasoning. In theory, this study identified the continuing role that metaphors play in the learning theory and how the literature can be explored further. In practice, the study identified student-centered activities, which include the learner as a contributor to knowledge, learning in a community of learners, and empowering the learner to change.


SAGE Open ◽  
2019 ◽  
Vol 9 (1) ◽  
pp. 215824401882346
Author(s):  
Alfred Otara ◽  
Alphonse Uworwabayeho ◽  
Wenceslas Nzabalirwa ◽  
Beata Kayisenga

Learner-centered pedagogy (LCP) is one of the best approaches in developing knowledge, skills, and attitudes of learners to cope with the changing world. Implementation of LCP practices tend to vary from one context to another. It is within this perspective that this study was conducted with the aim of investigating the teachers’ attitudes toward LCP in public primary schools located in Nyarugenge District. A sample size of 165 teachers was selected from 13 public and government-aided primary schools. Simple percentages, and chi-square analysis were used to analyze data, and the findings were triangulated with questionnaire and interview responses. Results show that primary school teachers manifested negative attitude toward LCP. The study also indicates that both institutional and individual factors, such as insufficient and inadequate trainings, lack of clear indicators on LCP, and lack of prior experience on LCP among colleges and university tutors during preservice training, affect the attitude of teachers. It is further revealed that gender does not influence the attitude of teachers; however, training was found to be significant at .05 level. It is therefore important that authorities ensure proper training to head teacher, school subject leaders, and teachers on LCP and avail clear indicators on those methods.


Sign in / Sign up

Export Citation Format

Share Document