A meta-analysis of the effects of instruction and corrective feedback on L2 pragmatics and the role of moderator variables

2019 ◽  
Vol 170 (2) ◽  
pp. 277-308
Author(s):  
Marziyeh Yousefi ◽  
Hossein Nassaji

Abstract This paper reports the results of a meta-analysis of 39 published studies conducted during the last decade (from 2006 to 2016) on the effects of instruction and corrective feedback on learning second language (L2) pragmatics. The study meta-analyzed the effects of instruction in terms of several moderator variables including mode of instruction, type of instruction, outcome measures, length of instruction, language proficiency, and durability of the instructional effects. It was found that (a) computer-assisted instruction generated larger effects than face-to-face instruction, (b) instruction was generally more effective for L2 pragmatic comprehension than production, (c) instruction produced larger effects when tested by selected response outcome measures although different patterns were observed across explicit-implicit categories, (d) longer treatments generated a larger effect size than shorter treatments, (e) studies conducted with intermediate level learners produced larger effect sizes than beginner or advanced level learners, and (f) the observed effects of instruction were maintained.

BMJ Open ◽  
2019 ◽  
Vol 9 (11) ◽  
pp. e028800 ◽  
Author(s):  
Charle André Viljoen ◽  
Rob Scott Millar ◽  
Mark E Engel ◽  
Mary Shelton ◽  
Vanessa Burch

ObjectivesIt remains unclear whether computer-assisted instruction (CAI) is more effective than other teaching methods in acquiring and retaining ECG competence among medical students and residents.DesignThis systematic review and meta-analysis followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.Data sourcesElectronic literature searches of PubMed, databases via EBSCOhost, Scopus, Web of Science, Google Scholar and grey literature were conducted on 28 November 2017. We subsequently reviewed the citation indexes for articles identified by the search.Eligibility criteriaStudies were included if a comparative research design was used to evaluate the efficacy of CAI versus other methods of ECG instruction, as determined by the acquisition and/or retention of ECG competence of medical students and/or residents.Data extraction and synthesisTwo reviewers independently extracted data from all eligible studies and assessed the risk of bias. After duplicates were removed, 559 papers were screened. Thirteen studies met the eligibility criteria. Eight studies reported sufficient data to be included in the meta-analysis.ResultsIn all studies, CAI was compared with face-to-face ECG instruction. There was a wide range of computer-assisted and face-to-face teaching methods. Overall, the meta-analysis found no significant difference in acquired ECG competence between those who received computer-assisted or face-to-face instruction. However, subanalyses showed that CAI in a blended learning context was better than face-to-face teaching alone, especially if trainees had unlimited access to teaching materials and/or deliberate practice with feedback. There was no conclusive evidence that CAI was better than face-to-face teaching for longer-term retention of ECG competence.ConclusionCAI was not better than face-to-face ECG teaching. However, this meta-analysis was constrained by significant heterogeneity amongst studies. Nevertheless, the finding that blended learning is more effective than face-to-face ECG teaching is important in the era of increased implementation of e-learning.PROSPERO registration numberCRD42017067054.


2017 ◽  
Vol 4 ◽  
pp. 238212051772042 ◽  
Author(s):  
Jennifer Tomesko ◽  
Riva Touger-Decker ◽  
Margaret Dreker ◽  
Rena Zelig ◽  
James Scott Parrott

Purpose: To explore knowledge and skill acquisition outcomes related to learning physical examination (PE) through computer-assisted instruction (CAI) compared with a face-to-face (F2F) approach. Method: A systematic literature review and meta-analysis published between January 2001 and December 2016 was conducted. Databases searched included Medline, Cochrane, CINAHL, ERIC, Ebsco, Scopus, and Web of Science. Studies were synthesized by study design, intervention, and outcomes. Statistical analyses included DerSimonian-Laird random-effects model. Results: In total, 7 studies were included in the review, and 5 in the meta-analysis. There were no statistically significant differences for knowledge (mean difference [MD] = 5.39, 95% confidence interval [CI]: −2.05 to 12.84) or skill acquisition (MD = 0.35, 95% CI: −5.30 to 6.01). Conclusions: The evidence does not suggest a strong consistent preference for either CAI or F2F instruction to teach students/trainees PE. Further research is needed to identify conditions which examine knowledge and skill acquisition outcomes that favor one mode of instruction over the other.


2021 ◽  
Author(s):  
◽  
Tabitha Gaylyn Kura McKenzie

<p>What are the effects of using mobile devices as part of teacher professional development focused on teaching and learning the Māori language for Māori immersion educational settings? Answers to this question are explored by researching the extent to which electronic devices could be an effective strategy to address the crisis of the continuing decline of the Māori language. Another issue explored in the research is whether learners make expected gains in language proficiency through the use of mobile devices in comparison to standard face-to-face methods of language instruction.  An indigenous framework, Hei Korowai, was used to guide the research and ensure the practices used were culturally appropriate, particularly when entering into and negotiating the research project with participants. Kaupapa Māori and Māori centred approaches were also drawn on to gather data from semi-structured interviews, observations of mobile device use, online questionnaires, and Māori language proficiency tests results. Fifty two participants in total took part in the research, 46 from a PLD programme that used mobile devices and 6 from a separate PLD programme that used mainly face-to-face instruction.  Electronic forms of second language acquisition could be advantageous for learners to access audio and video content on the move and at a time, pace and place convenient for them. The capacity to have literally a library’s worth of resources, functions and internet connectivity all in one tool and at the touch of a button could also be of particular significance to users. Conversely, participant attitudes about technology, varied needs for initial and on-going training in how to operate the electronic devices, and interaction preferences were challenges experienced with utilising the device as part of the language learning and teaching process. Videos viewed on the device could also be seen as one-way learning with a lack of spiritual connection and no opportunities for discussion about content, potentially causing road blocks for learners who need extra support.  Face-to-face instruction was a preferred method for participants and the physical presence of the teacher highly valued to allow the space to pose and answer questions and receive an immediate response, which is not possible when learning via videos on a mobile device. However, there was acknowledgement of the complementary nature and value of utilising the mobile device followed by face-to-face meetings.  Evidence suggests that Māori have been quick to adopt and adapt new technologies since the arrival of the early settlers to the shores of Aotearoa. Could technology be the panacea, the cure-all for the revitalisation of the Māori language, a tool that provides access to language, culture and identity to the multitudes? This research tests the hypotheses in the context of two items of modern technology, the iPod Touch® and the iPad®.  The limitations of the research include potential bias in interpretation given the researcher’s insider position, the relatively small scale of the project, and the absence of a widely accepted theoretical framework for mobile learning. Critical questions that still remain are the implications of promoting ‘one Māori language’ for a large-scale programme and the risks in doing so for the preservation of tribal dialect and community identity. This study has, however, begun the conversation about the use of mobile devices in Māori medium educational settings, and it may contribute to an understanding of how to design technologies, media, and interactions to support learning within these settings towards innovative practices.</p>


2013 ◽  
Vol 115 (3) ◽  
pp. 1-47 ◽  
Author(s):  
Barbara Means ◽  
Yukie Toyama ◽  
Robert Murphy ◽  
Marianne Baki

Background/Context Earlier research on various forms of distance learning concluded that these technologies do not differ significantly from regular classroom instruction in terms of learning outcomes. Now that web-based learning has emerged as a major trend in both K–12 and higher education, the relative efficacy of online and face-to-face instruction needs to be revisited. The increased capabilities of web-based applications and collaboration technologies and the rise of blended learning models combining web-based and face-to-face classroom instruction have raised expectations for the effectiveness of online learning. Purpose/Objective/Research Question/Focus of Study This meta-analysis was designed to produce a statistical synthesis of studies contrasting learning outcomes for either fully online or blended learning conditions with those of face-to-face classroom instruction. Population/Participants/Subjects The types of learners in the meta-analysis studies were about evenly split between students in college or earlier years of education and learners in graduate programs or professional training. The average learner age in a study ranged from 13 to 44. Intervention/Program/Practice The meta-analysis was conducted on 50 effects found in 45 studies contrasting a fully or partially online condition with a fully face-to-face instructional condition. Length of instruction varied across studies and exceeded one month in the majority of them. Research Design The meta-analysis corpus consisted of (1) experimental studies using random assignment and (2) quasi-experiments with statistical control for preexisting group differences. An effect size was calculated or estimated for each contrast, and average effect sizes were computed for fully online learning and for blended learning. A coding scheme was applied to classify each study in terms of a set of conditions, practices, and methodological variables. Findings/Results The meta-analysis found that, on average, students in online learning conditions performed modestly better than those receiving face-to-face instruction. The advantage over face-to-face classes was significant in those studies contrasting blended learning with traditional face-to-face instruction but not in those studies contrasting purely online with face-to-face conditions. Conclusions/Recommendations Studies using blended learning also tended to involve additional learning time, instructional resources, and course elements that encourage interactions among learners. This confounding leaves open the possibility that one or all of these other practice variables contributed to the particularly positive outcomes for blended learning. Further research and development on different blended learning models is warranted. Experimental research testing design principles for blending online and face-to-face instruction for different kinds of learners is needed.


2006 ◽  
Vol 1 (3) ◽  
pp. 3 ◽  
Author(s):  
Denise Koufogiannakis ◽  
Natasha Wiebe

Objective - The objective of this review was to assess which library instruction methods are most effective for improving the information skills of students at an introductory, undergraduate level, using cognitive outcomes (measuring changes in knowledge). The study sought to address the following questions: 1) What is the overall state of research on this topic? 2) Which teaching methods are more effective? Methods - Systematic review methodology was used. Fifteen databases were searched for relevant articles retrieving 4356 potentially relevant citations. Titles and abstracts were reviewed for relevance. Of those, 257 full articles were considered in-depth using a predetermined inclusion/exclusion form. 122 unique studies met the inclusion criteria and underwent an extensive data extraction and critical appraisal process. 55 of these studies met author defined quality criteria to provide information on the effectiveness of different teaching methods. Of these, 16 studies provided sufficient information to enable meta-analyses using standardized mean difference to be undertaken. Results - The overwhelming majority of studies were conducted in the United States (88%). 79 studies (65%) used experimental or quasi-experimental research methods. Teaching methods used in the studies varied, with the majority focused on traditional methods of teaching, followed by computer assisted instruction, and self-directed independent learning. Studies measured outcomes that correlated with Bloom’s lower levels of learning (Remember, Understand, Apply). 16 studies compared traditional instruction with no instruction, and 12 found a positive outcome. Meta-analysis of the data from 4 of these studies agreed with the positive conclusions favouring traditional instruction. 14 studies compared computer assisted instruction with traditional instruction. 9 of these showed a neutral result, and meta-analysis of 8 of these studies agreed with this neutral result. 6 studies compared self-directed independent learning with no instruction, and meta-analysis of 5 of these agreed that the result was positive in favour of self-directed independent learning. Conclusions - Based on the results of this meta-analysis, there is sufficient evidence to suggest that computer assisted instruction is as effective as traditional instruction. Evidence also suggests that both traditional instruction and self-directed independent instruction are more effective than no instruction. Additional comparative research needs to be done across different teaching methods. Studies comparing active learning, computer assisted instruction, and self-directed independent learning would greatly enrich the research literature. Further studies utilizing appropriate methodologies and validated research tools would enrich our evidence base, and contribute to the growth of knowledge about effectiveness of particular teaching methods.


1996 ◽  
Vol 15 (2) ◽  
pp. 157-174 ◽  
Author(s):  
Richard P. Niemiec ◽  
Christian Sikorski ◽  
Herbert J. Walberg

This article concerns the effects of learner control in computer-assisted instruction (CAI). After reviewing previous reviews of research on the topic, twenty-four studies of learner control were subjected to meta-analysis. The results of both the review and meta-analysis are equivocal. Several reviews indicate that learner control works less well with younger, less able students. Other reviews indicate that, given optimal conditions, learner control can work with any students. The meta-analysis, however, yielded an average effect size that was small and negative suggesting that the average student would be slightly better off without it. Although learner control has theoretical appeal, its effects on learning seem neither powerful nor consistent.


Author(s):  
Fu Lee Wang ◽  
Tak-Lam Wong

Teaching and learning computer programming has created significant difficulties to both teacher and student. Large class size is one of the major barriers to effective instruction. A well-designed pedagogy can make the instruction most effective. Hybrid teaching and learning combines face-to-face instruction and computer-assisted instruction to maximize students’ learning. This chapter will share the authors’ experiences in City University of Hong Kong (CityU) as they teach computer programming courses with large class size by hybrid learning model. Evaluation has showed that hybrid teaching and learning provide great flexibilities to both teaching and learning of computer programming. The students’ academic results have been significantly improved in computer programming courses.


Author(s):  
Lee L. Mason ◽  
Tae Jeon ◽  
Peter Blair ◽  
Nancy Glomb

In this study, the experiences and beliefs of volunteer tutors using a multi-user virtual environment to teach literacy instruction are examined to get a better understanding of the benefits and challenges of learning within this environment. Literacy tutors who were teaching adults with poor reading skills served as participants. During the study, participants delivered direct instruction reading lessons to researchers in Second Life and adult learners during live face-to-face tutoring sessions. Immediately following each session in Second Life, tutors were provided with corrective feedback on specific teaching behaviors. Data on rate of acquisition and generalization from the virtual environment to the natural environment was collected for each participant. At the conclusion of the study, tutors were asked to describe their experiences of learning to teach in a multi-user virtual environment. Results indicate that effective teaching behaviors trained in a virtual environment generalize to face-to-face instruction. However, tutors tended to disagree with the researchers’ perceptions of what constitutes effective teaching practices.


Sign in / Sign up

Export Citation Format

Share Document