scholarly journals Assessing the Effectiveness of Quantway®: A Multilevel Model With Propensity Score Matching

2018 ◽  
Vol 46 (3) ◽  
pp. 257-287 ◽  
Author(s):  
Hiroyuki Yamada ◽  
Angel X. Bohannon ◽  
Alicia Grunow ◽  
Christopher A. Thorn

Objective: Quantway is a Carnegie Math Pathways initiative, which redesigns the content, pedagogy, and structure of traditional developmental mathematics courses to simultaneously tackle traditional barriers to student success and support a broad range of developmental students in achieving their mathematics potential. Specifically, Quantway is a quantitative reasoning sequence that is comprised of a single term accelerated developmental mathematics course called Quantway 1 and a college-level mathematics course called Quantway 2. This study assesses the effectiveness of the developmental mathematics course, Quantway 1, during its first six semesters of implementation. Method: We used a hierarchical linear modeling technique to conduct propensity score matching across 37 student characteristics to compare the course performance of Quantway 1 students with matched comparison students from traditional developmental mathematics courses. Results: Quantway 1 students demonstrated significantly higher odds of success in fulfilling developmental mathematics course requirements and enrolling in college mathematics courses in the following year than matched comparison students. In addition, Quantway 1 effects were positive across all sex and race/ethnicity subgroups as well as in nearly all classrooms and colleges. Contributions: This study provides robust evidence that Quantway 1 increases student success in fulfilling developmental mathematics requirements and advances equity in student outcomes. Implications of and future directions for the Pathways are discussed.

2021 ◽  
Vol 4 (Supplement_1) ◽  
pp. 168-170
Author(s):  
K Elsolh ◽  
D Tham ◽  
M A Scaffidi ◽  
R Bansal ◽  
J Li ◽  
...  

Abstract Background Inflammatory Bowel Disease (IBD) studies have commonly relied on real-world evidence to evaluate different therapies. An emerging idea has been the use of propensity score matching as a statistical method to account for baseline characteristics in IBD patients. In retrospective studies, propensity score matching of patients helps reduce treatment assignment bias and mimic the effects of randomization. Recently, propensity-score matching has become an important tool in IBD studies comparing biologic therapeutics. Biologic medications are among the highest-grossing drugs worldwide, and their pharmaceutical producers make considerable payments to physicians to market them. In spite of this, there is a lack of evidence examining the role of undue industry influence among propensity-score matched comparative studies evaluating biologic therapeutics for IBD. Aims Given the documented association between IBD biologics and FCOI, we hypothesize a high burden of FCOI in propensity-score matched studies. The aim of this study was to evaluate the prevalence of disclosed & undisclosed financial conflicts of Interest (FCOI) in propensity-score matched comparison studies evaluating biologics for IBD. Methods We developed & ran a librarian-reviewed systematic search on EMBASE, MEDLINE, and Cochrane Library databases for all propensity-score matched retrospective studies comparing biologics for the treatment of IBD. Full-text retrieval & screening was performed on all studies in duplicate. 16 articles were identified. Industry payments to authors were only considered FCOI if they were made by a company producing a biologic that was included in the comparison study. Disclosed FCOI were identified by authors’ interests disclosures in full-texts. Any undisclosed FCOI among US authors were identified using the Centre for Medicare and Medicaid Services (CMS) Open Payments Database, which collects industry payments to physicians. Results Based on a preliminary analysis of 16 studies, there was at least one author with a relevant FCOI in 14 (88%) of the 16 studies. 14 studies (88%) had at least one disclosed FCOI, while 6 studies (37.5%) had at least one undisclosed FCOI. Among studies with disclosed FCOI, a mean of 40.2% (SD = 23.4%) of authors/study reported FCOI. Among studies with undisclosed FCOI, a mean of 18.8% (SD = 7.0%) of authors/study reported FCOI. The total dollar value of FCOIs was $1,974,328.3. The median conflict dollar value was $5,576.6 (IQR: $321.6 to $36,394.9). Conclusions We found a high burden of undisclosed FCOI (37.5%) among authors of propensity-score matched studies evaluating IBD biologics. Given the potential for undue industry influence stemming from such payments, authors should ensure better transparency with industry relationships. Funding Agencies None


Vaccines ◽  
2020 ◽  
Vol 8 (4) ◽  
pp. 717
Author(s):  
Giorgio Bogani ◽  
Francesco Raspagliesi ◽  
Francesco Sopracordevole ◽  
Andrea Ciavattini ◽  
Alessandro Ghelardi ◽  
...  

Background: Primary prevention through vaccination is a prophylactic approach aiming to reduce the risk of developing human papillomavirus (HPV)-related lesions. No mature and long-term data supported the adoption of vaccination in women undergoing conization. Methods: This is a retrospective multi-institutional study. Charts of consecutive patients undergoing conization between 2010 and 2014 were collected. All patients included had at least 5 years of follow-up. We compared outcomes of patients undergoing conization plus vaccination and conization alone. A propensity-score matching algorithm was applied in order to reduce allocation biases. The risk of developing recurrence was estimated using Kaplan-Meir and Cox hazard models. Results: Overall, charts of 1914 women were analyzed. The study group included 116 (6.1%) and 1798 (93.9%) women undergoing conization plus vaccination and conization alone, respectively. Five-year recurrence rate was 1.7% (n = 2) and 5.7% (n = 102) after conization plus vaccination and conization alone, respectively (p = 0.068). After the application of a propensity-score matching, we selected 100 patients undergoing conization plus vaccination and 200 patients undergoing conization alone. The crude number of recurrences was 2 (2%) and 11 (5.5%) for patients undergoing conization plus vaccination and conization alone, respectively (p = 0.231). Vaccination had no impact on persistent lesions (no negative examination between conization and new cervical dysplasia; p = 0.603), but reduced the risk of recurrent disease (patients who had at least one negative examination between conization and the diagnosis of recurrent cervical dysplasia; p = 0.031). Conclusions: Patients having vaccination experience a slightly lower risk of recurrence than women who had not, although not statistically significantly different. Further evidence is needed to assess the cost effectiveness of adopting vaccination in this setting.


2013 ◽  
Vol 37 (12) ◽  
pp. 990-1010 ◽  
Author(s):  
Linda Reichwein Zientek ◽  
Z. Ebrar Yetkiner Ozel ◽  
Carlton J. Fong ◽  
Mel Griffin

2017 ◽  
Vol 9 (10) ◽  
pp. 189 ◽  
Author(s):  
Chun-Chang Lee

This study investigates the impacts of individual characteristics and branch characteristics on housing agent performance. Data were analyzed using hierarchical linear modeling (HLM) to provide estimations. The empirical results suggest that individual performance varies significantly from branch to branch and is better in branches with higher levels of compensation for individual performance. Individual characteristics including college level education, having children over the age of six, work experience, the square of work experience, and work experience outside the real estate industry have significant effects on individual performance. Individual performance is also better in branches with requirements for hours worked. The individual performance of salespeople working under team compensation schemes is not significantly better than that of salespeople working in branches without team compensation schemes. When the average housing prices for the areas in which branches operate are higher, individual performance will be higher. As the average housing price for an area increases, however, the corresponding increase in individual performance will be less and less strong. According to the empirical results, there was a degree of self-selection in the samples. The results of two-stage estimation were not significantly different from the estimation results of the original model. Hence, the results demonstrate the robustness of the estimation model used.


2021 ◽  
Author(s):  
Corey Shanbrom ◽  
Michelle Norris ◽  
Caitlin Esgana ◽  
Matthew Krauel ◽  
Vincent Pigno ◽  
...  

The Peer Assisted Learning program at Sacramento State University (PAL) was established in 2012 with one section supporting introductory chemistry. It now serves 17 gatekeeper courses in Biology, Chemistry, Mathematics, Physics, and Statistics, enrolling approximately 1,400 students annually. Adapting the Peer-Led Team Learning model, PAL Facilitators do not teach, tutor, or even confirm answers; they do ask scaffolding questions, provide encouragement, and ensure that all group members participate in problem-solving. Here we assess the efficacy of the program in terms of student success in the parent course. As PAL is an opt-in program, we employ propensity score matching techniques to account for confounding factors. Our analysis of 11 classes shows that PAL provides an average course GPA bump ranging from .23 to .71 grade points (mean .42). Compared to the non-PAL baseline course GPA, this amounts to an increase of 9% to 51% (mean 23%). We consider data from over 25,000 students, and our propensity score analysis uses over 10,000 students (4,519 PAL, 5,814 non-PAL) for whom appropriate matches could be found.


2010 ◽  
Vol 24 (1) ◽  
pp. 5-22 ◽  
Author(s):  
Jürgen Baumert ◽  
Michael Becker ◽  
Marko Neumann ◽  
Roumiana Nikolova

Der vorliegende Beitrag geht der Frage nach, ob Schülerinnen und Schüler, die nach der vierten Klasse in Berlin in ein grundständiges Gymnasium wechseln, in Abhängigkeit vom Profil des besuchten Gymnasiums im Vergleich zu Grundschülern mit vergleichbaren Lernvoraussetzungen unterschiedliche Lernzuwächse im Leseverständnis, in Mathematik und Englisch erreichen. Auf der Datengrundlage der ELEMENT-Studie wurde die Leistungsentwicklung von Schülerinnen und Schülern an grundständigen Gymnasien (N = 1758) und Grundschulen (N = 3169) während der 5. und 6. Jahrgangsstufe mithilfe von Propensity Score Matching-Analysen (PSM) modelliert. Nach Kontrolle von leistungsrelevanten Unterschieden zwischen den Schülergruppen am Ende der 4. Jahrgangsstufe zeigten sich für das Leseverständnis am Ende der 6. Klasse keine statistisch signifikanten Unterschiede. Für die Mathematikleistung ließen sich Unterschiede lediglich zugunsten eines grundständigen Gymnasiums, das zum Untersuchungszeitpunkt noch kein spezifisches Profil entwickelt hatte, nachweisen. In der Domäne Englisch, in der die curricularen Unterschiede zwischen den Schulzweigen stärker akzentuiert sind, wurden positive Ergebnisse im Vergleich zu den Grundschulen für die so genannten Schnellläuferzüge, die englisch-bilingualen Klassen und das grundständige Gymnasium ohne spezifisches Profil ermittelt. Die Lernstände am Ende der 6. Klasse in den altsprachlichen Gymnasien fielen dagegen im Vergleich zu den Grundschulen geringer aus. Die Befunde widersprechen der Annahme, dass mit dem frühen Übergang auf ein grundständiges Gymnasium automatisch eine besondere Förderung der Lesefähigkeit und des mathematischen Verständnisses besonders leistungsfähiger Schülerinnen und Schüler erreicht werde. Die Ergebnisse zu den Englischleistungen weisen hingegen darauf hin, dass Unterschiede in der Leistungsentwicklung auftreten können, sofern die Aufteilung auf Schulen mit unterschiedlichen Bildungsprogrammen mit curricularen Unterschieden im Unterricht einhergeht. Methodische und inhaltliche Implikationen der Befunde und Grenzen ihrer Generalisierbarkeit werden diskutiert.


2008 ◽  
Vol 24 (3) ◽  
pp. 165-173 ◽  
Author(s):  
Niko Kohls ◽  
Harald Walach

Validation studies of standard scales in the particular sample that one is studying are essential for accurate conclusions. We investigated the differences in answering patterns of the Brief-Symptom-Inventory (BSI), Transpersonal Trust Scale (TPV), Sense of Coherence Questionnaire (SOC), and a Social Support Scale (F-SoZu) for a matched sample of spiritually practicing (SP) and nonpracticing (NSP) individuals at two measurement points (t1, t2). Applying a sample matching procedure based on propensity scores, we selected two sociodemographically balanced subsamples of N = 120 out of a total sample of N = 431. Employing repeated measures ANOVAs, we found an intersample difference in means only for TPV and an intrasample difference for F-SoZu. Additionally, a group × time interaction effect was found for TPV. While Cronbach’s α was acceptable and comparable for both samples, a significantly lower test-rest-reliability for the BSI was found in the SP sample (rSP = .62; rNSP = .78). Thus, when researching the effects of spiritual practice, one should not only look at differences in means but also consider time stability. We recommend propensity score matching as an alternative for randomization in variables that defy experimental manipulation such as spirituality.


2019 ◽  
Vol 18 (2) ◽  
pp. 106-111
Author(s):  
Fong-Yi Lai ◽  
Szu-Chi Lu ◽  
Cheng-Chen Lin ◽  
Yu-Chin Lee

Abstract. The present study proposed that, unlike prior leader–member exchange (LMX) research which often implicitly assumed that each leader develops equal-quality relationships with their supervisors (leader’s LMX; LLX), every leader develops different relationships with their supervisors and, in turn, receive different amounts of resources. Moreover, these differentiated relationships with superiors will influence how leader–member relationship quality affects team members’ voice and creativity. We adopted a multi-temporal (three wave) and multi-source (leaders and employees) research design. Hypotheses were tested on a sample of 227 bank employees working in 52 departments. Results of the hierarchical linear modeling (HLM) analysis showed that LLX moderates the relationship between LMX and team members’ voice behavior and creative performance. Strengths, limitations, practical implications, and directions for future research are discussed.


Sign in / Sign up

Export Citation Format

Share Document