scholarly journals Multigroup Propensity Score Approach to Evaluating an Effectiveness Trial of the New Beginnings Program

2018 ◽  
Vol 41 (2) ◽  
pp. 290-320 ◽  
Author(s):  
Jenn-Yun Tein ◽  
Gina L. Mazza ◽  
Heather J. Gunn ◽  
Hanjoe Kim ◽  
Elizabeth A. Stuart ◽  
...  

We used a multigroup propensity score approach to evaluate a randomized effectiveness trial of the New Beginnings Program (NBP), an intervention targeting divorced or separated families. Two features of effectiveness trials, high nonattendance rates and inclusion of an active control, make program effects harder to detect. To estimate program effects based on actual intervention participation, we created a synthetic inactive control comprised of nonattenders and assessed the impact of attending the NBP or active control relative to no intervention (inactive control). We estimated propensity scores using generalized boosted models and applied inverse probability of treatment weighting for the comparisons. Relative to the inactive control, NBP strengthened parenting quality as well as reduced child exposure to interparental conflict, parent psychological distress, and child internalizing problems. Some effects were moderated by parent gender, parent ethnicity, or child age. On the other hand, the effects of active versus inactive control were minimal for parenting and in the unexpected direction for child internalizing problems. Findings from the propensity score approach complement and enhance the interpretation of findings from the intention-to-treat approach.

2020 ◽  
Vol 29 (12) ◽  
pp. 3623-3640
Author(s):  
John A Craycroft ◽  
Jiapeng Huang ◽  
Maiying Kong

Propensity score methods are commonly used in statistical analyses of observational data to reduce the impact of confounding bias in estimations of average treatment effect. While the propensity score is defined as the conditional probability of a subject being in the treatment group given that subject’s covariates, the most precise estimation of average treatment effect results from specifying the propensity score as a function of true confounders and predictors only. This property has been demonstrated via simulation in multiple prior research articles. However, we have seen no theoretical explanation as to why this should be so. This paper provides that theoretical proof. Furthermore, this paper presents a method for performing the necessary variable selection by means of elastic net regression, and then estimating the propensity scores so as to obtain optimal estimates of average treatment effect. The proposed method is compared against two other recently introduced methods, outcome-adaptive lasso and covariate balancing propensity score. Extensive simulation analyses are employed to determine the circumstances under which each method appears most effective. We applied the proposed methods to examine the effect of pre-cardiac surgery coagulation indicator on mortality based on a linked dataset from a retrospective review of 1390 patient medical records at Jewish Hospital (Louisville, KY) with the Society of Thoracic Surgeons database.


2010 ◽  
Vol 41 (2) ◽  
pp. 147-168 ◽  
Author(s):  
Suzanne E. Graham

Selection bias is a problem for mathematics education researchers interested in using observational rather than experimental data to make causal inferences about the effects of different instructional methods in mathematics on student outcomes. Propensity score methods represent 1 approach to dealing with such selection bias. This article describes general principles underlying propensity score methods and illustrates their application to mathematics education research using 2 examples investigating the impact of problem-solving emphasis in mathematics classrooms on students' subsequent mathematics achievement and course taking. Limitations of the method are discussed.


2018 ◽  
Vol 55 (2) ◽  
pp. 273-279 ◽  
Author(s):  
Pier Luigi Filosso ◽  
Francesco Guerrera ◽  
Nicola Rosario Falco ◽  
Pascal Thomas ◽  
Mariano Garcia Yuste ◽  
...  

Abstract OBJECTIVES Typical carcinoids (TCs) are rare, slow-growing neoplasms, usually characterized by satisfactory surgical outcomes. Due to the rarity of TCs, international guidelines for the management of particular clinical presentations currently do not exist. In particular, non-anatomical resections (wedges) are sometimes advocated for Stage 1 TCs because of their indolent behaviour. The aim of this paper was to evaluate the most effective type of surgery for Stage 1 TCs, using the European Society of Thoracic Surgeons retrospective database of the Neuroendocrine Tumors of the Lung Working Group. METHODS We analysed the effect of surgical procedure on the survival of patients with Stage 1 TCs. Overall survival (OS) was calculated from the date of intervention. The cumulative incidence of cause-specific death (tumour- and non-tumour-related) was also estimated. The impact of the surgical procedure (i.e. lobectomy vs segmentectomy vs wedge resection) on survival was investigated using the Cox model with shared frailty (for OS, accounting for the within-centre correlation) and the Fine and Gray model (for cause-specific mortality) using the approach based on the multinomial propensity score. Effects were estimated including in the model the logit-transformed propensity scores of segmentectomy and wedge resection as covariates. RESULTS A total of 876 patients with Stage 1 TCs (569 women, 65%) were included in this study. The median age was 60 years (interquartile range 47–69). At the last follow-up, 66 patients had died: The 5-year OS rate was 94.3% [95% confidence interval (CI) 92.2–95.9]. The 5-year cumulative incidences of tumour- and non-tumour-related deaths were 2.4% (95% CI 1.4–3.9) and 3.9% (95% CI 2.5–5.6%), respectively. The analysis performed using the multinomial propensity score approach confirmed the significantly worse survival of patients treated with a wedge resection compared to those treated with a lobectomy (hazard ratio 2.01, 95% CI 1.09–3.69; P = 0.024). Similar effects of wedge resection are detectable for cause-specific deaths: tumour-related (hazard ratio 2.28, 95% CI 0.86–6.02; P = 0.096) and non-tumour-related (hazard ratio 1.74, 95% CI 0.89–3.40; P = 0.105). CONCLUSIONS In a large cohort of patients, we were able to demonstrate the superiority of anatomical surgical resection in Stage 1 TCs in terms of OS. This result should therefore be considered for future clinical guidelines for the management of TCs.


Heart ◽  
2017 ◽  
Vol 104 (12) ◽  
pp. 1014-1018 ◽  
Author(s):  
Edward Buratto ◽  
Michael Daley ◽  
Xin Tao Ye ◽  
Dorothy J Radford ◽  
Nelson Alphonso ◽  
...  

ObjectivePartial atrioventricular septal defect (pAVSD) is usually repaired between 2 and 4 years of age with excellent results. Repair during infancy has been associated with poorer outcomes. However, most infants in reported series had heart failure or significant left atrioventricular valve (LAVV) regurgitation. The impact of surgery during infancy on outcomes remains unclear.MethodsAll children at three institutions who underwent repair of pAVSD from 1975 to 2015 were included. Infants (aged <1 year) were compared with older children in a propensity score matched analysis. Variables used to generate propensity scores were: failure to thrive, congestive heart failure, preoperative LAVV regurgitation, associated congenital heart disease, sex and the presence of trisomy 21.ResultspAVSD repair was performed on 430 children, 17.4% (75/430) were infants. Infants (mean age 0.5±0.3 years) had higher rates of LAVV regurgitation, heart failure and additional cardiac malformations than older children (mean age 4.7±3.5 years). At 30 years, survival for infants was 82.1% (95% CI 70.1% to 89.6%) compared with 95.7% (95% CI 91.3% to 97.9%) in older children (P<0.001).Propensity score matching yielded 52 well-matched pairs. Survival at 30 years was 87.9% (95% CI 75.0% to 94.4%) for infants compared with 98.1% (95% CI 87.1% to 99.7%) for older children (P=0.04). There was no significant difference in freedom from reoperation between the groups.ConclusionsDespite matching for risk factors, survival after repair of pAVSD during infancy is lower than that when repair is performed in older children, with no difference in reoperation rates. This suggests that elective repair of pAVSD should be deferred until after infancy.


2021 ◽  
Author(s):  
Gustavo Laham ◽  
Gervasio Soler Pujol ◽  
Jenny Guzman ◽  
Natalia Boccia ◽  
Anabel Abib ◽  
...  

Abstract Introduction: Deciding when and how to initiate hemodialysis (HD) is still controversial. An early start (ES) seems to show a lack of benefit. “Lead time bias" and comorbidities have been associated with different outcomes in ES groups. On the other hand, it is well accepted the impact that the type of vascular access (VA) has on patient survival. Our aim was to evaluate survival with early start (ES) vs. late start (LS) on HD, taking into account the vascular access (VA) used.Methods: Between 01/95 and 06/18, 503 incidental patients initiated HD at our Dialysis Unit. eGFR was estimated by the CKD-EPI equation. Diabetes mellitus (DM), coronary disease (CD), and peripheral vascular disease (PVD) were considered co-morbid conditions. According to eGFR and VA, patients were divided into four groups: G1: ES (eGFR > 7 ml/min) with catheter (ES+C), G2: ES with fistula or graft (F/G) (ES+F/G), G3: LS (eGFR< 7 ml/min) with catheter (LS+C), and G4: LS with F/G (LS+F/G). The cut-off value to define ES or LS was based on median eGFR for these 503 patients. We compared patient’s survival rates by Kaplan-Meier and log-rank test. The four groups were compared before and after matching with propensity scores (PS). Cox analysis was performed to determine the impact of predictors of mortality. Results: Median eGFR was 7 (5.3-9.5) ml/min/1.73m2, median follow-up time was 30.9 (13-50) months, 52.1% had F/G access at entry, and 46.9 % died during the observation period. Among the four groups, the ES+C were significantly older, there were more diabetics and co-morbid conditions, while phosphatemia, iPTH, albumin, and hemoglobin were significantly higher in the LS groups. Before propensity score (PS) matching, the ES+C group had a poor survival rate (P<0.0001), while LS+F/G access had the best survival. After PS, a total of 180 patients were selected in the same four groups and ES+C kept showing a statistically significant poorer survival. Multivariate analysis revealed that ES+C was an independent predictor of mortality.Conclusion: In this retrospective study, ES+C on HD was associated with a higher mortality rate than LS. This association persisted after PS matching.


2015 ◽  
Vol 33 (7_suppl) ◽  
pp. 292-292 ◽  
Author(s):  
Matt D. Galsky ◽  
Kristian Stensland ◽  
Erin L. Moshier ◽  
John Sfakianos ◽  
Russell Bailey McBride ◽  
...  

292 Background: Though Level I evidence supports the use of neoadjuvant chemotherapy (NAC) in BCa, the data supporting AC has been mixed. Experience suggests an adequately powered trial to definitively assess the role of AC is unlikely to be completed. Alternative approaches to evidence development are necessary. Methods: Patients who underwent cystectomy for ≥pT3 and/or pN+ M0 BCa were identified from the National Cancer Database. Patients who received NAC and/or diagnosed after 2006 (most recent year with survival data) were excluded. Logistic regression was used to calculate propensity scores representing the predicted probabilities of assignment to AC versus observation based on: age, demographics, year of diagnosis, pT stage, margin status, lymph node density, distance to hospital, hospital cystectomy volume, and hospital type and location. A propensity score-matched cohort of AC versus observation (1:2) patients was created. Stratified Cox proportional hazards regression was used to estimate the hazard ratio (HR) for overall survival for the matched sample while propensity score adjusted and inverse probability of treatment weighted proportional hazards models were used to estimate adjusted HR for the full sample. A sensitivity analysis examined the impact of comorbidities. Results: 3,294 patients undergoing cystectomy alone and 937 patients undergoing cystectomy plus AC met inclusion criteria.Patients receiving AC were significantly more likely to: be younger, have more lymph nodes examined and involved, have higher pT stage, have positive margins, reside in the Northeast and closer to the hospital, and have private insurance. AC was associated with improved overall survival (Table). The results were robust to sensitivity analysis for comorbidities. Conclusions: AC was associated with improved survival in patients with ≥pT3 and/or pN+ BCa in this large comparative effectiveness analysis. [Table: see text]


2008 ◽  
Vol 24 (3) ◽  
pp. 165-173 ◽  
Author(s):  
Niko Kohls ◽  
Harald Walach

Validation studies of standard scales in the particular sample that one is studying are essential for accurate conclusions. We investigated the differences in answering patterns of the Brief-Symptom-Inventory (BSI), Transpersonal Trust Scale (TPV), Sense of Coherence Questionnaire (SOC), and a Social Support Scale (F-SoZu) for a matched sample of spiritually practicing (SP) and nonpracticing (NSP) individuals at two measurement points (t1, t2). Applying a sample matching procedure based on propensity scores, we selected two sociodemographically balanced subsamples of N = 120 out of a total sample of N = 431. Employing repeated measures ANOVAs, we found an intersample difference in means only for TPV and an intrasample difference for F-SoZu. Additionally, a group × time interaction effect was found for TPV. While Cronbach’s α was acceptable and comparable for both samples, a significantly lower test-rest-reliability for the BSI was found in the SP sample (rSP = .62; rNSP = .78). Thus, when researching the effects of spiritual practice, one should not only look at differences in means but also consider time stability. We recommend propensity score matching as an alternative for randomization in variables that defy experimental manipulation such as spirituality.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 408-408
Author(s):  
Si Young Song ◽  
Hey Jung Jun ◽  
Sun Ah Lee

Abstract The purpose of this study is to explore the effect of employment on depression and life satisfaction among old-aged. Using 12th (2017) wave and 13th (2018) wave of Korean Welfare Panel Study (KoWePS), three stages of analyses were conducted. First, through propensity score matching (PSM) method, sample with similar propensity scores was matched between the group that did not work in 12th wave but worked in 13th wave (experimental group, N=180), and the group that did not work in 12th and 13th wave (comparative group, N=180). Second, the matched sample was used to conduct multiple regression analysis with the group dummy variable (experimental group, comparative group) as an independent variable, and depression and life satisfaction as the dependent variables. Third, combined model of propensity score matching (PSM) and double difference (DD) method was conducted to more appropriately derive the net effect of employment. The results of multiple regression after propensity matching showed that employment had a positive effect on reducing depression (B= -1.70, p&lt; .01) and increasing life satisfaction (B= .12, p&lt; .01) in old-aged. Furthermore, in combined model of PSM and DD, life satisfaction was improved when employed compared to non-employed (B= .15, p&lt; .05). The results of this study are meaningful in that the meaning of employment in old-aged is more clearly derived by solving selection bias and endogenous problems. Also, this study may provide reference for establishing welfare policies related to employment among old-aged.


Sign in / Sign up

Export Citation Format

Share Document