Using “Broken” Lotteries to Check the Validity of Charter School Evaluations Using Matching Designs

2017 ◽  
Vol 33 (7) ◽  
pp. 977-1001 ◽  
Author(s):  
Leesa M. Foreman ◽  
Kaitlin P. Anderson ◽  
Gary W. Ritter ◽  
Patrick J. Wolf
Keyword(s):  
Charter School ◽  
Internal Validity ◽  
Randomized Control Trials ◽  
School Evaluation ◽  
Evaluation Design ◽  
Self Selection ◽  
Research Designs ◽  
Quasi Experimental ◽  
Randomized Control ◽  
Matched Comparison

We consider situations in which public charter school lotteries are neither universally conducted nor consistently documented. Such lotteries produce “broken” Randomized Control Trials, but provide opportunities to assess the internal validity of quasi-experimental research designs. Here, we present the results of a statewide charter school evaluation using a broad-based student matching evaluation design, and run two additional analyses using the charter application waitlists as robustness checks. Our additional models, which address concerns of self-selection by using only charter applicants as matched comparison students, yield similar effect estimates and thus provide support for the use of matching designs in charter school evaluations.

scholarly journals Alternatives to Randomized Control Trials: A Review of Three Quasi-experimental Designs for Causal Inference

2015 ◽  
Vol 29 (119) ◽  
pp. 19 ◽  
Author(s):  
Brittany Gorrall ◽  
Jacob Curtis ◽  
Todd Little ◽  
Pavel Panko
Keyword(s):  
Causal Inference ◽  
Experimental Designs ◽  
Randomized Control Trials ◽  
Quasi Experimental ◽  
Randomized Control

<p><span>Los diseños de Pruebas Controladas Aleatorizadas (PCA) son típicamente vistas como el mejor diseño en la investigación en psicología. Como tal, no es siempre posible cumplir con las especificaciones de las PCA y por ello muchos estudios son realizados en un marco cuasi experimental. Aunque los diseños cuasi experimentales son considerados menos convenientes que los diseños PCA, con directrices estos pueden producir inferencias igualmente válidas. En este artículo presentamos tres diseños cuasi experimentales que son formas alternativas a los diseños PCA. Estos diseños son Regresión de Punto de Desplazamiento (RPD), Regresión Discontinua (RD), Pareamiento por Puntaje de Propensión (PPP). Adicionalmente, describimos varias mejorías metodológicas para usar con este tipo de diseños. </span></p>

scholarly journals The Efficacy of Yoga as a Form of Treatment for Depression

2017 ◽  
Vol 22 (4) ◽  
pp. 1017-1028 ◽  
Author(s):  
Ledetra Bridges ◽  
Manoj Sharma
Keyword(s):  
The United States ◽  
Small Sample ◽  
Randomized Control Trials ◽  
Intervention Period ◽  
Short Term ◽  
Behavioral Theories ◽  
Quasi Experimental ◽  
Randomized Control ◽  
Small Sample Sizes ◽  
Study Designs

The purpose of this article was to systematically review yoga interventions aimed at improving depressive symptoms. A total of 23 interventions published between 2011 and May 2016 were evaluated in this review. Three study designs were used: randomized control trials, quasi-experimental, and pretest/posttest, with majority being randomized control trials. Most of the studies were in the United States. Various yoga schools were used, with the most common being Hatha yoga. The number of participants participating in the studies ranged from 14 to 136, implying that most studies had a small sample. The duration of the intervention period varied greatly, with the majority being 6 weeks or longer. Limitations of the interventions involved the small sample sizes used by the majority of the studies, most studies examining the short-term effect of yoga for depression, and the nonutilization of behavioral theories. Despite the limitations, it can be concluded that the yoga interventions were effective in reducing depression.

scholarly journals The Effectiveness of Physical Activities on Fatigue In The Elderly: A Systematic Review

2020 ◽  
Vol 9 (2) ◽  
pp. 1558-1566
Author(s):  
Hendrik Prayitno Luawo ◽  
Tintin Sukartini ◽  
Joko Suwito
Keyword(s):  
Systematic Review ◽  
Exercise Intervention ◽  
The Elderly ◽  
Good Choice ◽  
Physical Activities ◽  
Randomized Control Trials ◽  
Inclusion Criteria ◽  
Joint Activities ◽  
Quasi Experimental ◽  
Randomized Control

The method in preparing this Systematic review is based on literature studies from various electronic databases including Scopus, Proquest, CINAHL, MEDLINE, and ScienceDirect by conducting a comprehensive review using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyzes) guidelines. The keywords used are"effectiveness and "physical activity" AND "fatigue" AND "elderly". There are 9 original articles with 6 articles using the Randomized Control Trials (RCTs) research method, 2 articles using the quasi-experimental method, and 1 article using the prospective cohort method according to the inclusion criteria. This systematic review shows the effectiveness of various physical activities on reducing fatigue in the elderly, this systematic review can be used as evidence when doing a combination of joint activities and self-exercise at home as a good choice physical exercise intervention for the purpose of reducing fatigue in the elderly

scholarly journals Psychological Interventions in Improving Positive Body Image in Adolescents: A Systematic Review

2020 ◽  
Vol 9 (2) ◽  
pp. 772-789
Author(s):  
Retno Puji Astuti ◽  
Rizki Fitryasari ◽  
Hendy Muagiri Margono
Keyword(s):  
Systematic Review ◽  
Body Image ◽  
Research Design ◽  
Psychological Intervention ◽  
Psychological Interventions ◽  
Randomized Control Trials ◽  
White Skin ◽  
Positive Body Image ◽  
Quasi Experimental ◽  
Randomized Control

Body image is an important issue for adolescents. This is related to the surrounding appearance that is considered attractive by most people where beautiful people are those who have a tall body and white skin. The purpose of this Systematic review is to analyze the effect of psychological interventions on adolescent's body image. Systematic review accessed five electronic databases (Scopus, MEDLINE, CINAHL, Science Direct, and ProQuest). The search was carried out from April to June. 25 articles were analyzed. Most of the psychological interventions provided offline were 16 studies and the rest were through indirect intervention methods. The research design consisted of 17 randomized control trials and 8 studies using quasi-experimental. Two types of psychological interventions can be used as alternatives to enhance and maintain a positive body image: direct psychological intervention and indirect psychological intervention using technology.

A quality assessment of randomized control trials of primary treatment of breast cancer.

1986 ◽  
Vol 4 (6) ◽  
pp. 942-951 ◽  
Author(s):  
A Liberati ◽  
H N Himel ◽  
T C Chalmers
Keyword(s):  
Breast Cancer ◽  
Internal Validity ◽  
Primary Treatment ◽  
Treatment Modalities ◽  
Randomized Control Trials ◽  
System A ◽  
Randomized Control ◽  
Telephone Calls

The methodology of randomized control trials (RCTs) of the primary treatment of early breast cancer has been reviewed using a quantitative method. Sixty-three RCTs comparing various treatment modalities tested on over 34,000 patients and reported in 119 papers were evaluated according to a standardized scoring system. A percentage score was developed to assess the internal validity of a study (referring to the quality of its design and execution) and its external validity (referring to presentation of information required to determine its generalizability). An overall score was also calculated as the combination of the two. The mean overall score for the 63 RCTs was 50% (95% confidence interval [CI] = 46% to 54%) with small and nonstatistically significant differences between types of trial. The most common methodologic deficiencies encountered in these studies were related to the randomization process (only 27 of the 63 RCTs adopted a truly blinded procedure), the handling of withdrawals (only 26 RCTs included all patients in the analyses), the description of the follow-up schedule (only 12 RCTs reported adequately), the report of side effects (adequate information given in 33 RCTs), and the description of the patient population (satisfactory in 29 RCTs). Telephone calls to the principal investigators improved the quality scores by seven points on a scale of 100, indicating that some of the deficiencies lay in reporting rather than performance. There was evidence that quality has improved over time and that the increasing tendency of involving a biostatistician in the research team was positively associated with the improvement of the internal validity but not with the external.

Sign in / Sign up

Export Citation Format

Share Document