scholarly journals Propensity score matching in otolaryngologic literature: A systematic review and critical appraisal

PLoS ONE ◽  
2020 ◽  
Vol 15 (12) ◽  
pp. e0244423
Author(s):  
Aman Prasad ◽  
Max Shin ◽  
Ryan M. Carey ◽  
Kevin Chorath ◽  
Harman Parhar ◽  
...  

Background Propensity score techniques can reduce confounding and bias in observational studies. Such analyses are able to measure and balance pre-determined covariates between treated and untreated groups, leading to results that can approximate those generated by randomized prospective studies when such trials are not feasible. The most commonly used propensity score -based analytic technique is propensity score matching (PSM). Although PSM popularity has continued to increase in medical literature, improper methodology or methodological reporting may lead to biased interpretation of treatment effects or limited scientific reproducibility and generalizability. In this study, we aim to characterize and assess the quality of PSM methodology reporting in high-impact otolaryngologic literature. Methods PubMed and Embase based systematic review of the top 20 journals in otolaryngology, as measured by impact factor from the Journal Citations Reports from 2012 to 2018, for articles using PSM analysis throughout their publication history. Eligible articles were reviewed and assessed for quality and reporting of PSM methodology. Results Our search yielded 101 studies, of which 92 were eligible for final analysis and review. The proportion of studies utilizing PSM increased significantly over time (p < 0.001). Nearly all studies (96.7%, n = 89) specified the covariates used to calculate propensity scores. Covariate balance was illustrated in 67.4% (n = 62) of studies, most frequently through p-values. A minority (17.4%, n = 16) of studies were found to be fully reproducible according to previously established criteria. Conclusions While PSM analysis is becoming increasingly prevalent in otolaryngologic literature, the quality of PSM methodology reporting can be improved. We provide potential recommendations for authors regarding optimal reporting for analyses using PSM.

2020 ◽  
Vol 7 (1) ◽  
pp. 143-176 ◽  
Author(s):  
Paul R. Rosenbaum

Using a small example as an illustration, this article reviews multivariate matching from the perspective of a working scientist who wishes to make effective use of available methods. The several goals of multivariate matching are discussed. Matching tools are reviewed, including propensity scores, covariate distances, fine balance, and related methods such as near-fine and refined balance, exact and near-exact matching, tactics addressing missing covariate values, the entire number, and checks of covariate balance. Matching structures are described, such as matching with a variable number of controls, full matching, subset matching and risk-set matching. Software packages in R are described. A brief review is given of the theory underlying propensity scores and the associated sensitivity analysis concerning an unobserved covariate omitted from the propensity score.


PLoS ONE ◽  
2021 ◽  
Vol 16 (4) ◽  
pp. e0250949
Author(s):  
Aman Prasad ◽  
Max Shin ◽  
Ryan M. Carey ◽  
Kevin Chorath ◽  
Harman Parhar ◽  
...  

Author(s):  
Chin Lin ◽  
Rui Imamura ◽  
Felipe Fregni

This chapter explores the important issue of confounding in observational studies. The potential imbalances that result for not controlling assignment of treatment or exposure may lead to imbalance of variables that are associated with both treatment and intervention (or exposure) thus confounding results. Therefore, in this context, a potential relationship between an intervention and an outcome could be invalid. This chapter therefore explains basic definitions of confounding and presents some methods to control for confounders, highlighting the use of the propensity score, which is considered a robust method for this purpose. Different techniques of adjustment using propensity score (matching, stratification, regression, and weighting) are also discussed. This chapter concludes with a case discussion about confounding and how to address it.


2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Anna Maria Marangos ◽  
Jurjen Iedema ◽  
Mirjam de Klerk ◽  
Isolde Woittiez ◽  
Peter P. Groenewegen

Abstract Objectives Personal budgets for social and health care have been introduced in many European countries over recent decades. The assumption is that people with a personal budget are able to purchase care that matches their needs more closely and therefore experience greater independence and improved well-being. The question is whether this assumption is true. Little research has been carried out on this and the research that has been carried out is inconclusive and hampered by methodological limitations. Methods We performed a secondary analysis of data collected in a survey among persons who had submitted an application for social support. Propensity score matching was used to investigate whether people with a personal budget experience better independence, participation in society and quality of life than comparable people using conventionally organised help. Results After matching, no significant effects of the personal budget were initially found. A sensitivity analysis that excluded the variable sense of mastery from the calculation of the propensity scores, showed a significantly greater independence for those using a personal budget. Conclusion There may be several reasons for this lack of effect. First, perhaps there are no effects. It is also possible that effects can only be found in specific situations and/or specific groups.


2008 ◽  
Vol 24 (3) ◽  
pp. 165-173 ◽  
Author(s):  
Niko Kohls ◽  
Harald Walach

Validation studies of standard scales in the particular sample that one is studying are essential for accurate conclusions. We investigated the differences in answering patterns of the Brief-Symptom-Inventory (BSI), Transpersonal Trust Scale (TPV), Sense of Coherence Questionnaire (SOC), and a Social Support Scale (F-SoZu) for a matched sample of spiritually practicing (SP) and nonpracticing (NSP) individuals at two measurement points (t1, t2). Applying a sample matching procedure based on propensity scores, we selected two sociodemographically balanced subsamples of N = 120 out of a total sample of N = 431. Employing repeated measures ANOVAs, we found an intersample difference in means only for TPV and an intrasample difference for F-SoZu. Additionally, a group × time interaction effect was found for TPV. While Cronbach’s α was acceptable and comparable for both samples, a significantly lower test-rest-reliability for the BSI was found in the SP sample (rSP = .62; rNSP = .78). Thus, when researching the effects of spiritual practice, one should not only look at differences in means but also consider time stability. We recommend propensity score matching as an alternative for randomization in variables that defy experimental manipulation such as spirituality.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 408-408
Author(s):  
Si Young Song ◽  
Hey Jung Jun ◽  
Sun Ah Lee

Abstract The purpose of this study is to explore the effect of employment on depression and life satisfaction among old-aged. Using 12th (2017) wave and 13th (2018) wave of Korean Welfare Panel Study (KoWePS), three stages of analyses were conducted. First, through propensity score matching (PSM) method, sample with similar propensity scores was matched between the group that did not work in 12th wave but worked in 13th wave (experimental group, N=180), and the group that did not work in 12th and 13th wave (comparative group, N=180). Second, the matched sample was used to conduct multiple regression analysis with the group dummy variable (experimental group, comparative group) as an independent variable, and depression and life satisfaction as the dependent variables. Third, combined model of propensity score matching (PSM) and double difference (DD) method was conducted to more appropriately derive the net effect of employment. The results of multiple regression after propensity matching showed that employment had a positive effect on reducing depression (B= -1.70, p&lt; .01) and increasing life satisfaction (B= .12, p&lt; .01) in old-aged. Furthermore, in combined model of PSM and DD, life satisfaction was improved when employed compared to non-employed (B= .15, p&lt; .05). The results of this study are meaningful in that the meaning of employment in old-aged is more clearly derived by solving selection bias and endogenous problems. Also, this study may provide reference for establishing welfare policies related to employment among old-aged.


2021 ◽  
pp. 096228022110370
Author(s):  
Seungbong Han ◽  
Kam-Wah Tsui ◽  
Hui Zhang ◽  
Gi-Ae Kim ◽  
Young-Suk Lim ◽  
...  

Propensity score matching is widely used to determine the effects of treatments in observational studies. Competing risk survival data are common to medical research. However, there is a paucity of propensity score matching studies related to competing risk survival data with missing causes of failure. In this study, we provide guidelines for estimating the treatment effect on the cumulative incidence function when using propensity score matching on competing risk survival data with missing causes of failure. We examined the performances of different methods for imputing the data with missing causes. We then evaluated the gain from the missing cause imputation in an extensive simulation study and applied the proposed data imputation method to the data from a study on the risk of hepatocellular carcinoma in patients with chronic hepatitis B and chronic hepatitis C.


Sign in / Sign up

Export Citation Format

Share Document