Advances in Quasi-experimental Methods

Author(s):  
Peter Miksza ◽  
Kenneth Elpus

Although the primacy of the randomized experiment is often thought of as sacrosanct, in education research—and in music education research in particular—random assignment is often unachievable, unethical, or undesirable for one or more of many potential reasons. Methodologists have developed quasi-experimental research methods that attempt to achieve results that approximate the highly trustworthy results obtained from a randomized experiment. This chapter details two newer methods for quasi-experimental research that have become quite common in the broader field of education but have not yet become frequently employed within the field of music education research. These two methods are regression discontinuity designs and the use of propensity scores for the equating of nonequivalent groups.

2017 ◽  
Vol 107 (5) ◽  
pp. 240-245 ◽  
Author(s):  
Atila AbdulkadIroğlu ◽  
Joshua D. Angrist ◽  
Yusuke Narita ◽  
Parag A. Pathak ◽  
Roman A. Zarate

Many school and college admission systems use centralized mechanisms to allocate seats based on applicant preferences and school priorities. When tie-breaking uses non-randomly assigned criteria like distance or a test score, applicants with the same preferences and priorities are not directly comparable. The non-lottery setting does generate a kind of local random assignment that opens the door to regression discontinuity designs. This paper introduces a hybrid RD/propensity score empirical strategy that exploits quasi-experiments embedded in serial dictatorship, a mechanism widely used for college and selective K-12 school admissions. We use our approach to estimate achievement effects of Chicago's exam schools.


2020 ◽  
Vol 44 (1) ◽  
pp. 218-243 ◽  
Author(s):  
Maithreyi Gopalan ◽  
Kelly Rosinger ◽  
Jee Bin Ahn

In the past few decades, we have seen a rapid proliferation in the use of quasi-experimental research designs in education research. This trend, stemming in part from the “credibility revolution” in the social sciences, particularly economics, is notable along with the increasing use of randomized controlled trials in the strive toward rigorous causal inference. The overarching purpose of this chapter is to explore and document the growth, applicability, promise, and limitations of quasi-experimental research designs in education research. We first provide an overview of widely used quasi-experimental research methods in this growing literature, with particular emphasis on articles from the top ranked education research journals, including those published by the American Educational Research Association. Next, we demonstrate the applicability and promise of these methods in enhancing our understanding of the causal effects of education policies and interventions using key examples and case studies culled from the extant literature across the pre-K–16 education spectrum. Finally, we explore the limitations of these methods and conclude with thoughts on how education researchers can adapt these innovative, interdisciplinary techniques to further our understanding of some of the most enduring questions in educational policy and practice.


2010 ◽  
Vol 48 (2) ◽  
pp. 281-355 ◽  
Author(s):  
David S Lee ◽  
Thomas Lemieux

This paper provides an introduction and “user guide” to Regression Discontinuity (RD) designs for empirical researchers. It presents the basic theory behind the research design, details when RD is likely to be valid or invalid given economic incentives, explains why it is considered a “quasi-experimental” design, and summarizes different ways (with their advantages and disadvantages) of estimating RD designs and the limitations of interpreting these estimates. Concepts are discussed using examples drawn from the growing body of empirical research using RD. (JEL C21, C31)


Author(s):  
Peter Miksza ◽  
Kenneth Elpus

This chapter explores the philosophy of science surrounding warrants for causal claims, how researchers can use quantitative data to create causal knowledge, and how to evaluate the validity of causal knowledge generated through research. In music education, carefully answered causal questions can provide insights that improve both teaching and learning in music at all levels and in all contexts. In this chapter, details are provided on the kinds of experimental and quasi-experimental research designs most commonly employed for causal research, the challenges that researchers using these methods often face, and specific threats to validity that commonly occur in those designs.


2019 ◽  
Vol 10 (4) ◽  
pp. 683
Author(s):  
Yeshambel Tadele Alem

The study investigated the effect critical reflection exerted on students’ motivation of learning EFL critical reading.  In this respect, the present study conducted quasi-experimental research design. 32 participants were involved in the control group while 31 were in the experimental one. According to the pre-intervention questionnaire results by using independent samples T-test test of data analysis, participants of the control and the experimental groups were almost homogeneously motivated while learning critical reading although random assignment was not possible. In similar with the pre-intervention questionnaire, 30 questions were also asked to participants (control and experimental groups) as post-intervention questionnaire to evaluate to what extent participants improved their motivation of learning EFL critical reading after practicing critical reflection. The post-intervention questionnaire results proved that critical reflection has the effect in enhancing students’ motivation of learning EFL critical reading regarding independent samples T-test test of data analysis.


2021 ◽  
Vol 12 ◽  
Author(s):  
Verena Schneider ◽  
Anette Rohmann

Arts education in schools frequently experiences the pressure of being validated by demonstrating quantitative impact on academic outcomes. The quantitative evidence to date has been characterized by the application of largely correlational designs and frequently applies a narrow focus on instrumental outcomes such as academically relevant competencies. The present review aims to summarize quantitative evidence from quasi-experimental and experimental studies with pre-test post-test designs on the effects of school-based arts education on a broader range of competency outcomes, including intra- and interindividual competencies. A systematic literature search was conducted to identify relevant evaluation studies. Twenty-four articles reporting on 26 evaluation studies were eligible for inclusion, and their results were reviewed in terms of art domains and outcome categories. Whilst there is some evidence of beneficial effects on some competencies, for example of music education on arithmetic abilities, speech segmentation and processing speed, the evidence across arts domains and for different outcomes is limited due to small sample sizes, small number of studies, and a large range of effect sizes. The review highlights that sufficiently powered (quasi-)experimental studies with pre-test post-test designs evaluating arts education are sparse and that the “gold standard” of experimental research comes at the expense of a number of other study characteristics such as sample size, intervention and follow-up length. By summarizing the limitations of the current (quasi-)experimental research, the application of experimental designs is critically assessed and a combination with qualitative methods in mixed-method designs and choice of relevant outcomes discussed.


Author(s):  
Jean-David Cohen ◽  
Cyril Crozet ◽  
Jean-François d’Ivernois ◽  
Rémi Gagnayre

Very old studies and clinical experiences of physicians already signal the ability of some patients to feel subclinical signs. These patients are called sentinel patients because they can anticipate crisis very early and therefore intervene quickly to prevent them. Studies have shown that these patients develop these skills from their own experience, in steps which are similar to quasi-experimental research. They test and adjust their competence all the more easily as they have an objective external measure available. This faculty of patients suggests the possibility of using medical devices as a means of learning for patients to tutor themselves in support of this singular skill.


2017 ◽  
Vol 19 (1) ◽  
pp. 36-42
Author(s):  
Agus Hendra Al-Rahmad

Background : Scaling Up Nutrition movement is a global effort to strengthen our commitment and accelerating action plan to improve nutrition, particularly the handling of nutrition in the first 1,000 days of life is exclusive breastfeeding and it until 24 months. One of the way is with exclusive breastfeeding counselling that can reduce stunting. The counseling is addressed to brides who need special attention in improving the nutrition and health. Objective : The aim of research to improve knowledge about exclusive breastfeeding counseling the bride through the use of leaflets. Method : This quasi-experimental study was a sample of 30 person a brides with non-random assignment, the variable a knowledge obtained through interviews using questionnaires while the method of counseling does face to face with an exclusive breastfeeding leaflet. The data was analyzed by dependent t-test. Result : The results showed exclusive breastfeeding counseling can improve knowledge bride (p= 0,000) with a mean difference is 6,13 and a deviation is 3,71. Conclusion : Increase of knowledge among ‘bride-to be’ about exclusive breastfeeding could be improved through the use of exclusive breastfeeding leaflet. Each health center must be in collaboration with Office of Religious Affairs to have exclusive breastfeeding counseling, and set one of the priority programs in the prevention of child stunting.   Keywords: Bride, counseling, knowledge of exclusive breastfeeding


2019 ◽  
Vol 7 (2) ◽  
Author(s):  
Fatma Gustina ◽  
Khadijah Khadijah ◽  
Fauziah Nasution

<p><em>This research was conducted at TK Islam Ibnu Qoyyim, Medan Selayang District. Tthe type of research is experimental research with uses Quasi Experimental Designs. This study aims to determine the influence of Maria Montessori's learning model on the discipline of children in TK Islam Ibnu Qoyyim. The results showed that the Montessori learning model had an effect on the discipline of group A children. The results of the pretest class were 9.3 and the post-test average was 16.80 with the highest post-test 20 and the lowest post-test 12. Class control with an average pre test 9.7 and the average post test 11.7 with the highest value 16 and the lowest value 7. The results of hypothesis testing obtained t count&gt; t table is 18.31&gt; 2.048 with significant numbers. Thus the hypothesis Ho is rejected and Ha is accepted so that it is stated that there is a Significant Effect of Maria Montessori's Learning Model on the Discipline of Group A Children 4-5 Years Old in the TK Islam Ibnu Qoyyim.</em><em></em></p>


Sign in / Sign up

Export Citation Format

Share Document