scholarly journals Massive Open Online Course Evaluation Methods: Systematic Review (Preprint)

Author(s):  
Abrar Alturkistani ◽  
Ching Lam ◽  
Kimberley Foley ◽  
Terese Stenfors ◽  
Elizabeth R Blum ◽  
...  

BACKGROUND Massive open online courses (MOOCs) have the potential to make a broader educational impact because many learners undertake these courses. Despite their reach, there is a lack of knowledge about which methods are used for evaluating these courses. OBJECTIVE The aim of this review was to identify current MOOC evaluation methods to inform future study designs. METHODS We systematically searched the following databases for studies published from January 2008 to October 2018: (1) Scopus, (2) Education Resources Information Center, (3) IEEE (Institute of Electrical and Electronic Engineers) Xplore, (4) PubMed, (5) Web of Science, (6) British Education Index, and (7) Google Scholar search engine. Two reviewers independently screened the abstracts and titles of the studies. Published studies in the English language that evaluated MOOCs were included. The study design of the evaluations, the underlying motivation for the evaluation studies, data collection, and data analysis methods were quantitatively and qualitatively analyzed. The quality of the included studies was appraised using the Cochrane Collaboration Risk of Bias Tool for randomized controlled trials (RCTs) and the National Institutes of Health—National Heart, Lung, and Blood Institute quality assessment tool for cohort observational studies and for before-after (pre-post) studies with no control group. RESULTS The initial search resulted in 3275 studies, and 33 eligible studies were included in this review. In total, 16 studies used a quantitative study design, 11 used a qualitative design, and 6 used a mixed methods study design. In all, 16 studies evaluated learner characteristics and behavior, and 20 studies evaluated learning outcomes and experiences. A total of 12 studies used 1 data source, 11 used 2 data sources, 7 used 3 data sources, 4 used 2 data sources, and 1 used 5 data sources. Overall, 3 studies used more than 3 data sources in their evaluation. In terms of the data analysis methods, quantitative methods were most prominent with descriptive and inferential statistics, which were the top 2 preferred methods. In all, 26 studies with a cross-sectional design had a low-quality assessment, whereas RCTs and quasi-experimental studies received a high-quality assessment. CONCLUSIONS The MOOC evaluation data collection and data analysis methods should be determined carefully on the basis of the aim of the evaluation. The MOOC evaluations are subject to bias, which could be reduced using pre-MOOC measures for comparison or by controlling for confounding variables. Future MOOC evaluations should consider using more diverse data sources and data analysis methods. INTERNATIONAL REGISTERED REPORT RR2-10.2196/12087

10.2196/13851 ◽  
2020 ◽  
Vol 22 (4) ◽  
pp. e13851 ◽  
Author(s):  
Abrar Alturkistani ◽  
Ching Lam ◽  
Kimberley Foley ◽  
Terese Stenfors ◽  
Elizabeth R Blum ◽  
...  

Background Massive open online courses (MOOCs) have the potential to make a broader educational impact because many learners undertake these courses. Despite their reach, there is a lack of knowledge about which methods are used for evaluating these courses. Objective The aim of this review was to identify current MOOC evaluation methods to inform future study designs. Methods We systematically searched the following databases for studies published from January 2008 to October 2018: (1) Scopus, (2) Education Resources Information Center, (3) IEEE (Institute of Electrical and Electronic Engineers) Xplore, (4) PubMed, (5) Web of Science, (6) British Education Index, and (7) Google Scholar search engine. Two reviewers independently screened the abstracts and titles of the studies. Published studies in the English language that evaluated MOOCs were included. The study design of the evaluations, the underlying motivation for the evaluation studies, data collection, and data analysis methods were quantitatively and qualitatively analyzed. The quality of the included studies was appraised using the Cochrane Collaboration Risk of Bias Tool for randomized controlled trials (RCTs) and the National Institutes of Health—National Heart, Lung, and Blood Institute quality assessment tool for cohort observational studies and for before-after (pre-post) studies with no control group. Results The initial search resulted in 3275 studies, and 33 eligible studies were included in this review. In total, 16 studies used a quantitative study design, 11 used a qualitative design, and 6 used a mixed methods study design. In all, 16 studies evaluated learner characteristics and behavior, and 20 studies evaluated learning outcomes and experiences. A total of 12 studies used 1 data source, 11 used 2 data sources, 7 used 3 data sources, 4 used 2 data sources, and 1 used 5 data sources. Overall, 3 studies used more than 3 data sources in their evaluation. In terms of the data analysis methods, quantitative methods were most prominent with descriptive and inferential statistics, which were the top 2 preferred methods. In all, 26 studies with a cross-sectional design had a low-quality assessment, whereas RCTs and quasi-experimental studies received a high-quality assessment. Conclusions The MOOC evaluation data collection and data analysis methods should be determined carefully on the basis of the aim of the evaluation. The MOOC evaluations are subject to bias, which could be reduced using pre-MOOC measures for comparison or by controlling for confounding variables. Future MOOC evaluations should consider using more diverse data sources and data analysis methods. International Registered Report Identifier (IRRID) RR2-10.2196/12087


Jurnal CMES ◽  
2017 ◽  
Vol 9 (2) ◽  
pp. 137
Author(s):  
Abdul Jawat Nur

This paper will discuss al-af’āl al-injāziyyah or illocutionary speech acts in a novel Achbabtuka Aktsara Min Mā Yanbaghī as work 'Asīr ‘Abdullāh an-Nimsyī based on the study of pragmatics. Al-af’āl al-injāziyyah in the novel that need to be investigated as it includes expressions that use illocutionary speech acts. Three methods were used in this study, the method of data collection, data analysis methods, and methods of reporting the results of the data analysis. Based on research that has been conducted, concluded that the novel Achbabtuka Aktsara Min Mā Yanbaghī by 'Asīr ‘Abdullāh an-Nimsyī (2014)  use of various kinds of al-af’āl al-injāziyyah or illocutionary speech acts. These al-af’āl al-injāziyyah are (1) al-ikhbāriyyah (assertive), (2) al-injāziyyah (declarative), (3) al-iltizāmiyyah (commissive), (4) at-ta’bīriyyah (expressive), and (5) at-taujīhiyyāt (directive). Among the five kinds of illocutionary speech acts are the most widely used in novel Achbabtuka Aktsara Min Mā Yanbaghī is a directive speech act or at-taujīhiyyāt.


2016 ◽  
Vol 16 (2) ◽  
pp. 213
Author(s):  
Aria Septi Anggaira

Abstract           This study aimed to describe the phonemes produced by children aged 2 years and 10 months and describes forms of exchange or metathesis sound that occurs in producing the sounds of language in words. The data collection technique use three stages of strategic sequence. These stages are (1) a method of providing data, (2) data analysis methods, and (3) methods of presenting the results of the analysis. Data in the form of speech is transcribed into a phonetic transcription. The findings of this research are: The respondent has been able to produce almost any sounds or phonemes that exist in Indonesian. Phonemes produced consisting of consonant phonemes that are already emerging that a total of 18 phonemes: / b /, / t∫ /, / d /, / g /, / d /, / dj /, / k /, / l /, / m /, / n /, / ŋ /, / ñ /, / p /, / r /, / s /, / t /, / w /, / y /. From the 18 consonant phonemes are emerging, 8 of them have variations, so that the number of phonemes is generated as a whole is 27 consonant phonemes. Respondents have been able to produce six vowel phonemes plus two variations so that all amount to 8 vowel phonemes. It was found five pieces of diphthongs are: / au /, / ai /, / ei /, / o /, and / ua /. In the span of less than one month found 19 words that contain elements of metathesis. From the 19 words, found 5 types or form of an exchange of sounds and sound accompaniment of addition and subtraction.           Keywords: language acquisition, phonology, metathesis, phonemes.


2021 ◽  
Vol 4 (15) ◽  
pp. 71-80
Author(s):  
Ahmad Mujahideen Haji Yusoff ◽  
Muhammad Nasron Yaacob ◽  
Norhidayah Mohamed Hussin

Muslims to this day still face the challenges of modern ideology for a relatively long period of time. The emergence of modern ideologies such as secularism, liberalism, pluralism, and others became a great disaster that could erode the faith of Muslims towards Islam itself. Therefore, this article discusses the concerns of Muslims towards the threat of modern ideology which is a necessity today. This article is fully qualitative using data collection and data analysis methods involving library methods from printed materials using N-Vivo 2.0 software. This article finds that the beliefs of Muslims are increasingly threatened because some Muslims themselves prefer to choose modern ideology as a social style in life rather than Islamic teachings. They are based on modernity and the need for modern progress which indirectly causes Islam to become increasingly alienated from the core beliefs of Muslims. Therefore, Muslims need to be mobilized again to realize the threats and dangers of this modern ideology and return to the practice of the true religion of Islam.


Jurnal CMES ◽  
2018 ◽  
Vol 10 (2) ◽  
pp. 143
Author(s):  
Abdul Jawat Nur

<p>This paper will describe al-afʻāl al-injāziyyah at-taujīhiyyah or acts of directive illocution speech in the novel Syaiʻun fī Shadrī the work of Ichsān 'Abdu Al -Quddūs which is studied based on pragmatic studies. Novel Syaiʻun fī Shadrī is a novel classified as new (2016) in which many expressions containing acts of directive illocution speech. This is the reason for this research. To facilitate the course of research, this research through three strategic stages, namely data collection methods, data analysis methods, and methods of reporting the results of data analysis. Based on research that has been done concluded that in the novel SFS Ichsānby'Abdu Al-Quddūs is used various kinds of the act of directive illocution speech. They are (1) The act of saying thalabiyyah is a request to do or leave something, such as: rule 'amr', ask permission 'isti'zān ', suggests' iqtirāch', warns' tachdzīr ', motivates' tasyjī' ', begs attention' tanbīh, threatens' tahdīd', prays'du'ā', swearing 'qasam' and (2) The act of nafsiyyah speech is a speech act related to psychological conditions, such as motivating, cursing, pitting, and joking.</p>


JALABAHASA ◽  
2017 ◽  
Vol 13 (1) ◽  
pp. 50-60
Author(s):  
Aristia Fatmawati

Tujuan penelitian ini adalah mengetahui karakteristik dan pelanggaran prinsip kerja sama dalam tuturan masyarakat Samin yang terkenal dengan bahasanya yang unik, yaitu bahasa yang polos, lugu, dan apa adanya. Metode analisis data berupa analisis kualitatif dengan teori wacana pragmatik. Pengumpulan data dilakukan dengan observasi dan wawancara langsung. Berdasarkan data yang diperoleh, ternyata banyak sekali pelanggaran yang dilakukan oleh masyarakat samin saat mereka bertutur, hal ini tidak akan menjadi hambatan, apabila mereka berbicara dengan lingkup sesama orang samin, tetapi sebaliknya justru akan menjadi masalah apabila digunakan ketika berbicara dengan orang lain diluar kelompok mereka. Pelanggaran prinsip kerja sama yaitu meliputi empat maksim, yaitu maksim kuantitas, maksim kualitas, maksim relevansi, dan maksim pelaksanaan.AbstractThe purpose of this study was to determine the characteristics and violation of the principle of cooperation in a famous Samin speech community with a unique language, a language that is plain, simple, and straightforward. Data analysis methods such as qualitative analysis of discourse theory of pragmatics. The data collection is done by direct observation and interviews. Based on the data obtained, it was a lot of offenses committed by public samin when they speak, this would not be an obstacle, if they talk to the scope fellow samin, but instead it will be a problem if used when talking to others outside their group , Violation of the principle of cooperation that includes four maxims, that maxim of quantity, maxim of quality, maxim of relevance, and the maxim of implementation. Key word : Pragmatics, Violation of principle of cooperation, Samin speech


2020 ◽  
Author(s):  
Siti Taformasi Saidyah Permata Sari ◽  
Yosep Eka Putra

The purpose of this study is to find out how the ratio of profitability at Bank Mandiri. Data collection methods used by means of literature study. Data analysis methods used are qualitative analysis methods. The results of this study indicate that the bank ROA level is still in a Good or Healthy position. ROE also shows that the bank is in good condition in managing the company's finances. The bank NPM is still in a good or healthy position. In the third financial position this ratio can be categorized as Good or Healthy. So Bank Mandiri has reached the standard PBI regulation No. 15 / PBI / 2013


2021 ◽  
Vol 10 (87) ◽  

This research is a content analysis study in which studies on individuals with special needs and music education are handled in terms of various variables. In the research, it is aimed to examine the studies on individuals with special needs and music education conducted between the years 2000-2020 in Turkey. For this purpose, the distribution of studies according to publication year, publication type, university, journal in which they were published, subject area, type of disability, sample level, number of samples, research method, data collection tools and data analysis method were analyzed. The research group of the study consists of 27 articles, 27 master's theses and 4 doctoral theses, which were scanned with YOK National Thesis Center and Google Scholar on individuals with special needs and music education. Therefore, the contents of 58 studies included in the research were examined according to year, publication type, university, journal, subject, type of disability, sample group/number, research method, data collection tool and data analysis methods. The research is considered important in that the content analysis of the studies on individuals with special needs and music education gives an idea about the methods, data analysis, sample group that they will use for the researchers who want to work in this field in the future, and that there are few similar studies done in the field. The findings obtained from the research were arranged according to sub-problems and presented descriptively as frequency and percentage tables. In the research, the most studies on the subject were conducted in 2011 and 2016, these studies were published as articles and master's thesis, the most postgraduate thesis was published in Gazi University, the article was published in the Journal of the Faculty of Education of Abant İzzet Baysal University, most of the studies were conducted for mainstreaming students, and the most The results were obtained as many quantitative data analysis methods were preferred. Keywords: Individuals with special needs, music education, music therapy


Author(s):  
Hülya Sönmez

The aim of this study is to analyze research methods, data collection tools, and data analysis methods of the needs assessment studies conducted in the language education and teaching process. In this study, the general screening model, which is based on an examination of research on needs analysis, was used. The data collected in accordance with the general screening model were examined by the content analysis method based on the examination of the documents. The methods of these studies, data collection tools, and data analysis methods were reviewed. In accordance with the results from the review process, the frequency of use, efficiency, and functionality of the research method, data collection tool and data analysis methods used were evaluated. Next, during the needs assessment process, the importance and priority of students’ and teachers’ needs were discussed. The results of these discussions have been included at the end of the research. In the light of the findings of the research and the results, suggestions were made regarding the importance of teacher and student needs factors in the process of identifying and analyzing language education needs. The classification made shows that researchers generally concentrate on four models which are mixed, survey, descriptive and experimental models. As for the data collection tools, it is understood that different data collection tools are used in the sample studies to determine the needs.


Sign in / Sign up

Export Citation Format

Share Document