A Meta-analysis of Multimedia Applications: How Effective Are Interventions with e-Books, Computer-Assisted Instruction and TV/Video on Literacy Learning?

Author(s):  
Victor H. P. van Daal ◽  
Jenny Miglis Sandvik ◽  
Herman J. Adèr
2006 ◽  
Vol 1 (3) ◽  
pp. 3 ◽  
Author(s):  
Denise Koufogiannakis ◽  
Natasha Wiebe

Objective - The objective of this review was to assess which library instruction methods are most effective for improving the information skills of students at an introductory, undergraduate level, using cognitive outcomes (measuring changes in knowledge). The study sought to address the following questions: 1) What is the overall state of research on this topic? 2) Which teaching methods are more effective? Methods - Systematic review methodology was used. Fifteen databases were searched for relevant articles retrieving 4356 potentially relevant citations. Titles and abstracts were reviewed for relevance. Of those, 257 full articles were considered in-depth using a predetermined inclusion/exclusion form. 122 unique studies met the inclusion criteria and underwent an extensive data extraction and critical appraisal process. 55 of these studies met author defined quality criteria to provide information on the effectiveness of different teaching methods. Of these, 16 studies provided sufficient information to enable meta-analyses using standardized mean difference to be undertaken. Results - The overwhelming majority of studies were conducted in the United States (88%). 79 studies (65%) used experimental or quasi-experimental research methods. Teaching methods used in the studies varied, with the majority focused on traditional methods of teaching, followed by computer assisted instruction, and self-directed independent learning. Studies measured outcomes that correlated with Bloom’s lower levels of learning (Remember, Understand, Apply). 16 studies compared traditional instruction with no instruction, and 12 found a positive outcome. Meta-analysis of the data from 4 of these studies agreed with the positive conclusions favouring traditional instruction. 14 studies compared computer assisted instruction with traditional instruction. 9 of these showed a neutral result, and meta-analysis of 8 of these studies agreed with this neutral result. 6 studies compared self-directed independent learning with no instruction, and meta-analysis of 5 of these agreed that the result was positive in favour of self-directed independent learning. Conclusions - Based on the results of this meta-analysis, there is sufficient evidence to suggest that computer assisted instruction is as effective as traditional instruction. Evidence also suggests that both traditional instruction and self-directed independent instruction are more effective than no instruction. Additional comparative research needs to be done across different teaching methods. Studies comparing active learning, computer assisted instruction, and self-directed independent learning would greatly enrich the research literature. Further studies utilizing appropriate methodologies and validated research tools would enrich our evidence base, and contribute to the growth of knowledge about effectiveness of particular teaching methods.


1996 ◽  
Vol 15 (2) ◽  
pp. 157-174 ◽  
Author(s):  
Richard P. Niemiec ◽  
Christian Sikorski ◽  
Herbert J. Walberg

This article concerns the effects of learner control in computer-assisted instruction (CAI). After reviewing previous reviews of research on the topic, twenty-four studies of learner control were subjected to meta-analysis. The results of both the review and meta-analysis are equivocal. Several reviews indicate that learner control works less well with younger, less able students. Other reviews indicate that, given optimal conditions, learner control can work with any students. The meta-analysis, however, yielded an average effect size that was small and negative suggesting that the average student would be slightly better off without it. Although learner control has theoretical appeal, its effects on learning seem neither powerful nor consistent.


BMJ Open ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. e028800 ◽  
Author(s):  
Charle André Viljoen ◽  
Rob Scott Millar ◽  
Mark E Engel ◽  
Mary Shelton ◽  
Vanessa Burch

ObjectivesIt remains unclear whether computer-assisted instruction (CAI) is more effective than other teaching methods in acquiring and retaining ECG competence among medical students and residents.DesignThis systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.Data sourcesElectronic literature searches of PubMed, databases via EBSCOhost, Scopus, Web of Science, Google Scholar and grey literature were conducted on 28 November 2017. We subsequently reviewed the citation indexes for articles identified by the search.Eligibility criteriaStudies were included if a comparative research design was used to evaluate the efficacy of CAI versus other methods of ECG instruction, as determined by the acquisition and/or retention of ECG competence of medical students and/or residents.Data extraction and synthesisTwo reviewers independently extracted data from all eligible studies and assessed the risk of bias. After duplicates were removed, 559 papers were screened. Thirteen studies met the eligibility criteria. Eight studies reported sufficient data to be included in the meta-analysis.ResultsIn all studies, CAI was compared with face-to-face ECG instruction. There was a wide range of computer-assisted and face-to-face teaching methods. Overall, the meta-analysis found no significant difference in acquired ECG competence between those who received computer-assisted or face-to-face instruction. However, subanalyses showed that CAI in a blended learning context was better than face-to-face teaching alone, especially if trainees had unlimited access to teaching materials and/or deliberate practice with feedback. There was no conclusive evidence that CAI was better than face-to-face teaching for longer-term retention of ECG competence.ConclusionCAI was not better than face-to-face ECG teaching. However, this meta-analysis was constrained by significant heterogeneity amongst studies. Nevertheless, the finding that blended learning is more effective than face-to-face ECG teaching is important in the era of increased implementation of e-learning.PROSPERO registration numberCRD42017067054.


BMJ Open ◽  
2017 ◽  
Vol 7 (12) ◽  
pp. e018811 ◽  
Author(s):  
Charle André Viljoen ◽  
Rob Scott Millar ◽  
Mark E Engel ◽  
Mary Shelton ◽  
Vanessa Burch

IntroductionAlthough ECG interpretation is an essential skill in clinical medicine, medical students and residents often lack ECG competence. Novel teaching methods are increasingly being implemented and investigated to improve ECG training. Computer-assisted instruction is one such method under investigation; however, its efficacy in achieving better ECG competence among medical students and residents remains uncertain.Methods and analysisThis article describes the protocol for a systematic review and meta-analysis that will compare the effectiveness of computer-assisted instruction with other teaching methods used for the ECG training of medical students and residents. Only studies with a comparative research design will be considered. Articles will be searched for in electronic databases (PubMed, Scopus, Web of Science, Academic Search Premier, CINAHL, PsycINFO, Education Resources Information Center, Africa-Wide Information and Teacher Reference Center). In addition, we will review citation indexes and conduct a grey literature search. Data extraction will be done on articles that met the predefined eligibility criteria. A descriptive analysis of the different teaching modalities will be provided and their educational impact will be assessed in terms of effect size and the modified version of Kirkpatrick framework for the evaluation of educational interventions. This systematic review aims to provide evidence as to whether computer-assisted instruction is an effective teaching modality for ECG training. It is hoped that the information garnered from this systematic review will assist in future curricular development and improve ECG training.Ethics and disseminationAs this research is a systematic review of published literature, ethical approval is not required. The results will be reported according to the Preferred Reporting Items for Systematic Review and Meta-Analysis statement and will be submitted to a peer-reviewed journal. The protocol and systematic review will be included in a PhD dissertation.PROSPERO registration numberCRD42017067054; Pre-results.


2017 ◽  
Vol 4 ◽  
pp. 238212051772042 ◽  
Author(s):  
Jennifer Tomesko ◽  
Riva Touger-Decker ◽  
Margaret Dreker ◽  
Rena Zelig ◽  
James Scott Parrott

Purpose: To explore knowledge and skill acquisition outcomes related to learning physical examination (PE) through computer-assisted instruction (CAI) compared with a face-to-face (F2F) approach. Method: A systematic literature review and meta-analysis published between January 2001 and December 2016 was conducted. Databases searched included Medline, Cochrane, CINAHL, ERIC, Ebsco, Scopus, and Web of Science. Studies were synthesized by study design, intervention, and outcomes. Statistical analyses included DerSimonian-Laird random-effects model. Results: In total, 7 studies were included in the review, and 5 in the meta-analysis. There were no statistically significant differences for knowledge (mean difference [MD] = 5.39, 95% confidence interval [CI]: −2.05 to 12.84) or skill acquisition (MD = 0.35, 95% CI: −5.30 to 6.01). Conclusions: The evidence does not suggest a strong consistent preference for either CAI or F2F instruction to teach students/trainees PE. Further research is needed to identify conditions which examine knowledge and skill acquisition outcomes that favor one mode of instruction over the other.


1995 ◽  
Vol 12 (3) ◽  
pp. 219-241 ◽  
Author(s):  
Claire M. Fletcher-Flinn ◽  
Breon Gravatt

There has been a long-standing dispute about the efficacy of computer assisted instruction (CAI) with regard to the interpretation of effect size estimates in reviews using techniques of meta-analysis. It has been claimed that the data used to calculate these estimates come from studies which are methodologically flawed. The aim of this study was to provide an updated meta-analysis on the learning effect of (CAI) over a broad range of study features with particular attention focused on the effectiveness debate. Using standard procedures, the results and estimates were similar to previous reviews and showed a learning benefit for CAI. The mean effect size for CAI was (.24) for the years 1987–1992, with more recent studies showing an average of (.33). Although moderate, these estimates tended to raise the average student from at least the 50th and 60th percentile. However, studies which controlled for teacher and materials, and were of longer duration, and studies using pencil and paper equivalents of CAI showed no learning advantage over traditional forms of instruction. It is suggested that what accounts for the typical learning advantage of CAI in this meta-analysis and others is the better quality instruction provided by CAI materials. These materials seem versatile enough to be used effectively over a broad range of subjects and educational settings. While the materials did not seem to improve substantially over the past two decades as reflected by effect sizes, these estimates did not include the newer multimedia technology. It is concluded that educational approaches should be judged by a number of criteria including achievement gains and when this is done CAI may far surpass other forms of instruction.


1994 ◽  
Vol 11 (1) ◽  
pp. 1-26 ◽  
Author(s):  
Dave Goforth

Research into the effectiveness of learner control in tutorial computer assisted instruction has produced equivocal results. In order to analyze these results, learner control is defined within a general model of decisions and information in instructional systems. When the research is categorized according to this model, the effectiveness of learner control is confirmed and a preliminary conclusion concerning the importance of information is reached. A case is made for an instructional design focus in learner control research based on model building rather than hypothesis testing.


Sign in / Sign up

Export Citation Format

Share Document