scholarly journals Massive Open Online Courses (MOOC) Evaluation Methods: Protocol for a Systematic Review (Preprint)

2018 ◽  
Author(s):  
Kimberley Foley ◽  
Abrar Alturkistani ◽  
Alison Carter ◽  
Terese Stenfors ◽  
Elizabeth Blum ◽  
...  
Keyword(s):  
Systematic Review ◽  
Online Courses ◽  
Data Extraction ◽  
Evaluation Methods ◽  
Massive Open Online Courses ◽  
Completion Rates ◽  
Massive Open Online ◽  
Data Synthesis ◽  
Meta Analyses ◽  
Future Work

BACKGROUND Massive open online courses (MOOCs) have increased in popularity in recent years. They target a wide variety of learners and use novel teaching approaches, yet often exhibit low completion rates (10%). It is important to evaluate MOOCs to determine their impact and effectiveness, but little is known at this point about the methodologies that should be used for evaluation. OBJECTIVE The purpose of this paper is to provide a protocol for a systematic review on MOOC evaluation methods. METHODS We will use the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols (PRISMA-P) guidelines for reporting this protocol. We developed a population, intervention, comparator, and outcome (PICO) framework to guide the search strategy, based on the overarching question, “What methods have been used to evaluate MOOCs?” The review will follow six stages: 1) literature search, 2) article selection, 3) data extraction, 4) quality appraisal, 5) data analysis, and 6) data synthesis. RESULTS The systematic review is ongoing. We completed the data searches and data abstraction in October and November 2018. We are now analyzing the data and expect to complete the systematic review by March 2019. CONCLUSIONS This systematic review will provide a useful summary of the methods used for evaluation of MOOCs and the strengths and limitations of each approach. It will also identify gaps in the literature and areas for future work. INTERNATIONAL REGISTERED REPOR DERR1-10.2196/12087

scholarly journals Massive Open Online Courses (MOOC) Evaluation Methods: Protocol for a Systematic Review

10.2196/12087 ◽  
2019 ◽  
Vol 8 (3) ◽  
pp. e12087 ◽  
Author(s):  
Kimberley Foley ◽  
Abrar Alturkistani ◽  
Alison Carter ◽  
Terese Stenfors ◽  
Elizabeth Blum ◽  
...  
Keyword(s):  
Systematic Review ◽  
Online Courses ◽  
Evaluation Methods ◽  
Massive Open Online Courses ◽  
Massive Open Online

423 Massive Open Online Courses in Anatomy Education: A Systematic Review

2021 ◽  
Vol 108 (Supplement_2) ◽  
Author(s):  
J Cheong ◽  
I Keenan
Keyword(s):  
Systematic Review ◽  
Medical Education ◽  
Online Courses ◽  
Massive Open Online Courses ◽  
Learning Approaches ◽  
Discussion Forums ◽  
Massive Open Online ◽  
Pubmed Database ◽  
Literature Search Strategy ◽  
Learning Development

Abstract Introduction Massive open online courses (MOOCs) have become increasingly popular for remotely delivering education to global audiences. MOOCs can provide an online platform for participants coming from a variety of professional backgrounds and international locations. Our systematic review investigated current literature surrounding MOOCs, and identified the value of such courses with respect to anatomical and medical education. Method Our literature search strategy involved exploring the PubMed database for the terms ’MOOC + Anatomy’ and ‘MOOC + Medical Education’ identified 290 relevant articles. Following implementation of the PRISMA criteria, 24 articles out of 290 were selected for inclusion in our systematic review. Results Participants completing MOOCs in anatomical and medical education generally showed increased knowledge and skills. We found that MOOC discussion forums encourage participants’ social learning development. MOOCs have shown to address participants’ needs and expectations while supplementing traditional learning approaches. However, the majority of experimental research studies did not include pre-post testing or appropriate controls. Furthermore, high levels of participant attrition, inability to address all learning approaches were identified as limitations with respect to MOOCs. Conclusions Although MOOCs have shown success in providing an excellent platform for learning, it has yet to show definitive improvements when compared to traditional teaching methods.

scholarly journals Initial trends in enrolment and completion of massive open online courses

2014 ◽  
Vol 15 (1) ◽  
Author(s):  
Katy Jordan
Keyword(s):  
Online Courses ◽  
Rapid Development ◽  
Good Deal ◽  
Massive Open Online Courses ◽  
Completion Rates ◽  
Massive Open Online ◽  
Factors Affecting ◽  
The Public ◽  
The Past ◽  
Course Length

<p>The past two years have seen rapid development of massive open online courses (MOOCs) with the rise of a number of MOOC platforms. The scale of enrolment and participation in the earliest mainstream MOOC courses has garnered a good deal of media attention. However, data about how the enrolment and completion figures have changed since the early courses is not consistently released. This paper seeks to draw together the data that has found its way into the public domain in order to explore factors affecting enrolment and completion. The average MOOC course is found to enroll around 43,000 students, 6.5% of whom complete the course. Enrolment numbers are decreasing over time and are positively correlated with course length. Completion rates are consistent across time, university rank, and total enrolment, but negatively correlated with course length. This study provides a more detailed view of trends in enrolment and completion than was available previously, and a more accurate view of how the MOOC field is developing.</p>

scholarly journals Troubleshooters for Tasks of Introductory Programming MOOCs

2018 ◽  
Vol 19 (4) ◽  
Author(s):  
Marina Lepp ◽  
Tauno Palts ◽  
Piret Luik ◽  
Kaspar Papli ◽  
Reelika Suviste ◽  
...  
Keyword(s):  
Online Courses ◽  
Assessment System ◽  
Massive Open Online Courses ◽  
Completion Rates ◽  
Massive Open Online ◽  
Automated Assessment ◽  
Persistent Problem ◽  
Help Systems ◽  
The Masses ◽  
Learning Programming

Learning programming has become more and more popular and organizing introductory massive open online courses (MOOCs) on programming can be one way to bring this education to the masses. While programming MOOCs usually use automated assessment to give feedback on the submitted code, the lack of understanding of certain aspects of the tasks and feedback given by the automated assessment system can be one persistent problem for many participants. This paper introduces troubleshooters, which are help systems, structured like decision trees, for giving hints and examples of certain aspects of the course tasks. The goal of this paper is to give an overview of usability (benefits and dangers) of, and the participants’ feedback on, using troubleshooters. Troubleshooters have been used from the year 2016 in two different programming MOOCs for adults in Estonia. These MOOCs are characterized by high completion rates (50–70%), which is unusual for MOOCs. Data is gathered from the learning analytics integrated into the troubleshooters’ environment, letters from the participants, questionnaires, and tasks conducted through the courses. As it was not compulsory to use troubleshooters, the results indicate that only 19.8% of the users did not use troubleshooters at all and 10% of the participants did not find troubleshooters helpful at all. The main difference that appeared is that the number of questions asked from the organizers about the programming tasks during the courses via helpdesk declined about 29%.

scholarly journals MOOC Success Factors: Proposal of an Analysis Framework

10.28945/3861 ◽  
2017 ◽  
Vol 16 ◽  
pp. 233-251 ◽  
Author(s):  
Jose Azevedo ◽  
Margarida M. Marques
Keyword(s):  
Best Practices ◽  
Success Factors ◽  
Online Courses ◽  
Massive Open Online Courses ◽  
Future Research ◽  
Completion Rates ◽  
Analysis Framework ◽  
Factors Analysis ◽  
Future Work

Aim/Purpose: From an idea of lifelong-learning-for-all to a phenomenon affecting higher education, Massive Open Online Courses (MOOCs) can be the next step to a truly universal education. Indeed, MOOC enrolment rates can be astoundingly high; still, their completion rates are frequently disappointingly low. Nevertheless, as courses, the participants’ enrolment and learning within the MOOCs must be considered when assessing their success. In this paper, the authors’ aim is to reflect on what makes a MOOC successful to propose an analysis framework of MOOC success factors. Background: A literature review was conducted to identify reported MOOC success factors and to propose an analysis framework. Methodology: This literature-based framework was tested against data of a specific MOOC and refined, within a qualitative interpretivist methodology. The data were collected from the ‘As alterações climáticas nos média escolares - Clima@EduMedia’ course, which was developed by the project Clima@EduMedia and was submitted to content analysis. This MOOC aimed to support science and school media teachers in the use of media to teach climate change Contribution: By proposing a MOOC success factors framework the authors are attempting to contribute to fill in a literature gap regarding what concerns criteria to consider a specific MOOC successful. Findings: This work major finding is a literature-based and empirically-refined MOOC success factors analysis framework. Recommendations for Practitioners: The proposed framework is also a set of best practices relevant to MOOC developers, particularly when targeting teachers as potential participants. Recommendation for Researchers: This work’s relevance is also based on its contribution to increasing empirical research on MOOCs. Impact on Society: By providing a proposal of a framework on factors to make a MOOC successful, the authors hope to contribute to the quality of MOOCs. Future Research: Future work should refine further the proposed framework, by in testing it against data collected in other MOOCs.

scholarly journals openSAP: Evaluating xMOOC Usage and Challenges for Scalable and Open Enterprise Education

2016 ◽  
Vol 9 (2) ◽  
pp. 34 ◽  
Author(s):  
Jan Renz ◽  
Florian Schwerer ◽  
Christoph Meinel
Keyword(s):  
Knowledge Transfer ◽  
Learning Environment ◽  
Online Courses ◽  
Calculation Model ◽  
Digital Transformation ◽  
Massive Open Online Courses ◽  
Massive Open Online ◽  
Enterprise Education ◽  
Consumption Rates ◽  
Future Work

<div class="page" title="Page 1"><div class="layoutArea"><div class="column"><p><span>The openSAP University is a co-innovative initiative founded in 2013 by SAP SE in partnership with the Hasso-Plattner-Institute (HPI) located in Potsdam, Germany. With its new course offering, SAP responds to a rising demand for scalable knowledge transfer due to the digital transformation by making use of the Massive Open Online Courses (MOOC) format. This paper provides a brief introduction to the first Enterprise MOOC platform openSAP, including details about the learning environment and the underlying platform, different team roles and usage statistics. In addition, the topic of dropouts in enterprise MOOCs will be addressed and discussed. A standardized calculation model for enterprise MOOCs to measure completion and consumption rates is proposed. The paper closes with an outlook about the future work on enterprise MOOCs. </span></p></div></div></div>

scholarly journals Massive open online course completion rates revisited: Assessment, length and attrition

2015 ◽  
Vol 16 (3) ◽  
Author(s):  
Katy Jordan
Keyword(s):  
Online Courses ◽  
Course Completion ◽  
Massive Open Online Courses ◽  
Online Course ◽  
Completion Rates ◽  
Massive Open Online ◽  
Attrition Rates ◽  
Start Date ◽  
Massive Open Online Course ◽  
Course Length

<p>This analysis is based upon enrolment and completion data collected for a total of 221 Massive Open Online Courses (MOOCs). It extends previously reported work (Jordan, 2014) with an expanded dataset; the original work is extended to include a multiple regression analysis of factors that affect completion rates and analysis of attrition rates during courses. Completion rates (defined as the percentage of enrolled students who completed the course) vary from 0.7% to 52.1%, with a median value of 12.6%. Since their inception, enrolments on MOOCs have fallen while completion rates have increased. Completion rates vary significantly according to course length (longer courses having lower completion rates), start date (more recent courses having higher percentage completion) and assessment type (courses using auto grading only having higher completion rates). For a sub-sample of courses where rates of active use and assessment submission across the course are available, the first and second weeks appear to be critical in achieving student engagement, after which the proportion of active students and those submitting assessments levels out, with less than 3% difference between them.</p>

scholarly journals Framework for Personalizing Mooc Courses based on Learners’ Stress Levels Towards Increased Course Completion Rates

2019 ◽  
Vol 8 (9) ◽  
pp. 2721-2724
Keyword(s):  
Online Courses ◽  
Course Completion ◽  
Content Delivery ◽  
Massive Open Online Courses ◽  
Completion Rates ◽  
Massive Open Online ◽  
Online Learners ◽  
Learning Platform ◽  
Stress Levels ◽  
Open Nature

Massive Open Online Courses (MOOC) has gained a huge popularity amongst the current generation students mainly because of its open nature and its ubiquity. MOOC made it possible for thousands of aspiring learners to learn from their favorite Universities. Though this online learning platform has its advantages, many studies have proved that these massive courses are suffering from tremendous rates in students’ dropouts. This study surveys the major causes of dropouts and would try to link the MOOC failures with the learners’ stress levels. The study also proposes a framework which could be used while designing MOOC courses and will help MOOC providers to personalize the content delivery according to the online learners’ stress levels.

scholarly journals Massive Open Online Courses (MOOCs) Dropout Rate in the World: A Systematic Review Protocol

2020 ◽  
Author(s):  
Manoosh Mehrabi ◽  
Ali Reza Safarpour ◽  
Abbas Ali Keshtkar
Keyword(s):  
Systematic Review ◽  
Online Courses ◽  
Meta Analysis ◽  
Dropout Rate ◽  
Open Science ◽  
Massive Open Online Courses ◽  
Massive Open Online ◽  
The World ◽  
Review Protocol ◽  
Science Framework

Abstract BackgroundRecently, massive open online courses (MOOCs) have received increasing popularity throughout the world. Regardless of the subject taught and the university providing the course, the dropout rate of MOOCs is one of the most important challenges ahead.Methods This systematic review will search MEDLINE/PubMed, Scopus, Web of Science (Clarivate Analytics), Embase (Embase.com), ASSIA, CINAHL, Education Research, BEI, and Eric databases systematically according to predefined criteria without language restrictions to retrieve prospective and retrospective observational studies conducted between the 1st of January 2000 and 30th of March 2020 which evaluated the frequency of leaving MOOCs throughout the world. In the absence of severe methodological heterogeneity, the data will be combined and a meta-analysis will be performed. DiscussionAs dropout rate is one of the most challenges that universities may encounter, this systematic review will help universities extend their view, save their resources or maybe design their MOOCs differently.RegistrationRegistered in Open Science Framework, available at: https://osf.io/jgyqx/

Sign in / Sign up

Export Citation Format

Share Document