Collaborative Calibrated Peer Assessment in Massive Open Online Courses

Author(s):  
Asma Boudria ◽  
Yacine Lafifi ◽  
Yamina Bordjiba

The free nature and open access courses in the Massive Open Online Courses (MOOC) allow the facilities of disseminating information for a large number of participants. However, the “massive” propriety can generate many pedagogical problems, such as the assessment of learners, which is considered as the major difficulty facing in the MOOC. In fact, the immense number of learners who exceeded in some MOOC the hundreds of thousands make the instructors' evaluation of students' production quite impossible. In this work, the authors present a new approach for assessing the learners' production in MOOC. This approach combines the peer assessment with the collaborative learning and the calibrated method. It aims at increasing the degree of trust in peer-assessment. For evaluating the proposed approach, the authors implemented a MOOC dedicated for learning algorithms. In addition, an experiment was conducted during two months for knowing the effects of the proposed approach. The obtained results are presented in this paper. They are judged as very interesting and encouraging.

2018 ◽  
Vol 16 (1) ◽  
pp. 76-102
Author(s):  
Asma Boudria ◽  
Yacine Lafifi ◽  
Yamina Bordjiba

The free nature and open access courses in the Massive Open Online Courses (MOOC) allow the facilities of disseminating information for a large number of participants. However, the “massive” propriety can generate many pedagogical problems, such as the assessment of learners, which is considered as the major difficulty facing in the MOOC. In fact, the immense number of learners who exceeded in some MOOC the hundreds of thousands make the instructors' evaluation of students' production quite impossible. In this work, the authors present a new approach for assessing the learners' production in MOOC. This approach combines the peer assessment with the collaborative learning and the calibrated method. It aims at increasing the degree of trust in peer-assessment. For evaluating the proposed approach, the authors implemented a MOOC dedicated for learning algorithms. In addition, an experiment was conducted during two months for knowing the effects of the proposed approach. The obtained results are presented in this paper. They are judged as very interesting and encouraging.


2016 ◽  
Author(s):  
Brandon Collins Butler

Massive Open Online Courses (MOOCs) raise significant legal and policy questions for research libraries, which are often asked to support the development of MOOC courses. These questions involve information policy concerns that are central to research libraries, including the proper application of fair use, the transition to open access as the default mode of scholarly publishing, and the provision of equal access to learning materials for students with and without disabilities. Where possible, research libraries should engage in conversations around MOOCs and promote their core values. By doing so, they will also promote the continuing vitality of libraries as partners in the educational mission.


The diffusion of Massive Open Online Courses (MOOCs) is significantly changing the way people learn and update their knowledge and competencies. Although the benefits characterizing MOOCs, which leverage on free and open access to know-how and digitized materials, there are some challenges which call for improving and enhancing the existing methods and approaches for MOOCs design. By combining theory and practice, this paper presents a process of MOOCs design based on a double-loop phase of evaluation. Specifically, the paper provides evidences on how to take advantage of the learners’ and teachers’ feedback to redesign or rethink the course’s architecture, and especially the storyboard and blueprint. A pilot application of the proposed approach has been made to design a course dealing with entrepreneurship domain, and in particular with crowdfunding. The results of the application are presented to validate the approach and provide teachers and course’s designers with some recommendations.


Author(s):  
Hoi K. Suen

<p>The teach-learn-assess cycle in education is broken in a typical massive open online course (MOOC). Without formative assessment and feedback, MOOCs amount to information dump or broadcasting shows, not educational experiences. A number of remedies have been attempted to bring formative assessment back into MOOCs, each with its own limits and problems. The most widely applicable approach for all MOOCs to date is to use peer assessment to provide the necessary feedback. However, unmoderated peer assessment results suffer from a lack of credibility. Several methods are available today to improve on the accuracy of peer assessment results. Some combination of these methods may be necessary to make peer assessment results sufficiently accurate to be useful for formative assessment. Such results can also help to facilitate peer learning, online discussion forums, and may possibly augment summative evaluation for credentialing.</p>


2016 ◽  
Vol 3 (2) ◽  
pp. 322-324 ◽  
Author(s):  
Andrii Vozniuk ◽  
Adrian Holzer ◽  
Denis Gillet

Peer assessment is seen as a powerful supporting tool to achieve scalability in the evaluation of complex assignments in large courses, possibly virtual ones, as in the context of massive open online courses (MOOCs). However, the adoption of peer assessment is slow due in part to the lack of ready-to-use systems. Furthermore, the validity of peer assessment is still under discussion. In this paper, in order to tackle some of these issues, we present a dataset containing assessment of student submissions by peer students and by instructors during our Social Media course with 60 master's level university students. The dataset allows to train and test algorithms predicting grades of instructors based on grades of peer students.


Author(s):  
Misrah Hamisah Mohamed ◽  
Michael Hammond

Purpose Massive open online courses (MOOCs) have often been divided between connectivist MOOCs and extended MOOCs (xMOOCs). Each form of MOOC proposes a distinctive view about knowledge acquisition. However, the breakdown between the two MOOCs is too broad in practice, and a more fine-grained approach is needed. Thus, the purpose of this paper is to describe the organisational features of exemplar MOOCs and their differences. Design/methodology/approach The study observed the ten newly available MOOCs aimed at teachers of English as a second language and included examples from existing providers: NovoEd, Coursera, FutureLearn and Canvas. These MOOCs were analysed and compared using a matrix with three main focuses: pedagogical assumptions, content materials and assessment. Findings The findings revealed that all courses corresponded to the idea of an xMOOC in that they were run on a model of instructional design. However, the course materials varied in respect to media used, use of networking, discussion forums and degree of openness. In terms of assessment, all MOOCs used formative approaches, all had automated responses but only some had summative and peer assessment. Originality/value The study succeeded in showing the variation in courses, thus enabling the range of possibilities open to course designers and providers.


2017 ◽  
Author(s):  
Kyle K. Courtney

For this article I focus on strategies to deal with the copyright and access problems associated with Massive Open Online Courses (MOOCs) syllabus materials, and the opportunities they create for faculty, students, and staff to learn about copyright, open access (OA), and publication.


Author(s):  
Maurice Dawson ◽  
Sharon L. Burton ◽  
Dustin Bessette ◽  
Jorja Wright

Massive Open Online Courses (MOOCs) are a new phenomenon of course delivery for students, faculty, and administrators to use. As this technology continues to grow in the short term it is essential to develop a method in which Open Source Software (OSS), open source technologies, and open access literature can be incorporated to strengthen the MOOC environment. Strengthening the MOOC environment can be used as a method to increase retention as well as increase enrollment in higher education. As Science, Technology, Engineering, and Mathematics (STEM) programs are going online it is imperative that the tools meet the demands of today's marketplace. This chapter provides insights on these open technology solutions so that current and future MOOCs can be enhanced with little to no cost added.


Author(s):  
Natalia Spyropoulou ◽  
Christos J. Pierrakeas ◽  
Achilles Kameas

Massive open online courses (MOOC) constitute an emerging technology for distance and open education while interest in incorporating them in higher education is constantly growing. Due to the free and open access learning opportunities that they offer, they attract an immense number of learners from all over the world. Additionally, because of their openness, they present major challenges, including network co-creation within communities and new forms of communication and collaboration for both students and educators. In this article, the authors present a methodology for a team-based development of MOOCs with the use of a recognized design model that they applied in Hellenic Open University. The main objective is to illustrate the lessons learnt during this MOOC development.


Sign in / Sign up

Export Citation Format

Share Document