scholarly journals Addressing bias in prediction models by improving subpopulation calibration

Author(s):  
Noam Barda ◽  
Gal Yona ◽  
Guy N Rothblum ◽  
Philip Greenland ◽  
Morton Leibowitz ◽  
...  

Abstract Objective To illustrate the problem of subpopulation miscalibration, to adapt an algorithm for recalibration of the predictions, and to validate its performance. Materials and Methods In this retrospective cohort study, we evaluated the calibration of predictions based on the Pooled Cohort Equations (PCE) and the fracture risk assessment tool (FRAX) in the overall population and in subpopulations defined by the intersection of age, sex, ethnicity, socioeconomic status, and immigration history. We next applied the recalibration algorithm and assessed the change in calibration metrics, including calibration-in-the-large. Results 1 021 041 patients were included in the PCE population, and 1 116 324 patients were included in the FRAX population. Baseline overall model calibration of the 2 tested models was good, but calibration in a substantial portion of the subpopulations was poor. After applying the algorithm, subpopulation calibration statistics were greatly improved, with the variance of the calibration-in-the-large values across all subpopulations reduced by 98.8% and 94.3% in the PCE and FRAX models, respectively. Discussion Prediction models in medicine are increasingly common. Calibration, the agreement between predicted and observed risks, is commonly poor for subpopulations that were underrepresented in the development set of the models, resulting in bias and reduced performance for these subpopulations. In this work, we empirically evaluated an adapted version of the fairness algorithm designed by Hebert-Johnson et al. (2017) and demonstrated its use in improving subpopulation miscalibration. Conclusion A postprocessing and model-independent fairness algorithm for recalibration of predictive models greatly decreases the bias of subpopulation miscalibration and thus increases fairness and equality.

2022 ◽  
Author(s):  
Łukasz Pulik ◽  
Katarzyna Poszka ◽  
Krzysztof Romaniuk ◽  
Aleksandra Sibilska ◽  
Andrzej Jedynak ◽  
...  

Abstract Introduction: Developmental dysplasia of the hip (DDH) is one of the most common musculoskeletal conditions in children. Not treated DDH leads to disability, gait abnormalities, limb shortening and chronic pain. Our study aims to determine the impact of multiple risk factors on the occurrence of DDH and develop an interactive risk assessment tool.Materials and Methods: We conducted a retrospective cohort study in the Outpatient Clinic for Children of University Hospital. The Graf classification system was used for ultrasonographic universal screening. In total, 3102 infants met the eligibility criteria (n =6204 hip joints). Results: The incidence of DDH was 4.45%. In multivariate analysis, risk factors for DDH were weight (OR = 2.17 (1.41-3.32)), week of delivery (OR = 1.18 (1.00-1.37)), gender (OR = 8.16 (4.86-13.71)), breech delivery presentation (OR = 5.92 (3.37-10.40)), symptoms of DDH (25.28 (8.77-72.83)) and positive family history in siblings (5.74 (2.68-12.31)). Multivariate logistic regression predictive model was used to construct the interactive risk calculator.Conclusion: We confirmed well-known DDH risk factors in the studied population. Our results support the recent hypothesis that preterm infants (37 < week) have lower rate of DDH. The DDH risk calculator was built but needs external validation in prospective study before being used in a clinical setting.Level of Evidence: Retrospective cohort study: Level III


2016 ◽  
Vol 1 (1) ◽  
pp. 15-19 ◽  
Author(s):  
Arman Ahmadzadeh ◽  
Tahere Sabaghian ◽  
Mina Ebrahimi-Rad ◽  
Mohammad Moslemizadeh ◽  
Mohammad Mehdi Emam ◽  
...  

2010 ◽  
Vol 13 (1) ◽  
pp. 119
Author(s):  
Thananit Sangkomkamhang ◽  
Ussanee Swadpanich Sangkomkamhang ◽  
Prasit Hanpinichsak ◽  
Somkid Lerdsinudom ◽  
Tanawat Vaseenon

2021 ◽  
Vol 80 (Suppl 1) ◽  
pp. 277.2-277
Author(s):  
E. Usova ◽  
O. Malyshenko ◽  
M. Letaeva ◽  
J. Averkieva ◽  
M. Koroleva ◽  
...  

Background:The relationship between osteoporosis and osteoarthritis (OA) is complex and contradictory. Some studies suggest a protective effect of OA in osteoporosis [1-2]. However, other studies show that increased bone mineral density (BMD) in OA not only does not reduce the risk of fractures, but can also increase it [3-4].Objectives:To assess the 10-year probability of osteoporotic fractures using the FRAX calculator in women with OA of the knee joint.Methods:The study included 22 women (average age 63.7±1.01 years) diagnosed with ACP of the knee joint according to the ACR criteria (1991). The Control Group included 24 conditionally healthy women without OA knee joint, with an average age of 63.6±1.37 years.The BMD (g/cm2) and the T-criterion (standard deviation, SD) of the neck of the femur and lumbar spine (LI-LIV) were evaluated by the method of two-power X-ray absorption (DXA) (apparatus «Lunar Prodigy Primo», USA). 10-year probability of major osteoporotic fractures (clinically significant fracture of the spine, distal fracture of the forearm, fracture of the proximal femur, or fracture of the shoulder) and fracture of the proximal thigh with the FRAX calculator (version 3.5 for Russian population).Results:An osteopenic syndrome in the cohort under investigation was found in 42 (91.3%) patients, of whom osteopenia in 24 (52.2%) women and osteoporosis in 18 (39.1%). A normal BMD is registered in 4 (8.7%) patients.In the group of patients with knee joint OA, only 2 (9.1%) of women had a normal BMD, 11 (50.0%) of osteoporosis, and 9 (40.9%). Osteopenic syndrome is generally found in 20 (90,9%) patients.In the control group, osteopenic syndrome has been diagnosed in 22 (91,7%) of whom: osteopenia in 13 (54.2%), osteoporosis in 9 (37.5%) patients. Two (8.3%) women had a normal BMD. There were no statistically significant differences in the structure of the osteopenic syndrome among the studied groups (p=0.961).An analysis of the 10-year probability of major osteoporotic fractures found that women with OA knee joint had the above probability of 12.3±0.91, and in the control group 14.2±1.06 (p=0.085).The 10-year probability of fracture of the proximal femur in women with OA was statistically less significant than in the control group: 1.55 (0.70;1.98) and 2.10 (1.20;2.95), (p=0.031), respectively.Conclusion:The total incidence of the osteopenic syndrome in the cohort under investigation was 91.3% (90.9% in women with OA, 91.7% in the control group). The frequency of registration of osteopenia and osteoporosis in women with OA did not differ statistically significantly from the control group. The probability of major osteoporotic fractures within 10 years was comparable in these groups. The probability of a proximal femur fracture in women with OA was statistically significant, but not clinically significant, compared to the control group.References:[1]Yamamoto Y, Turkiewicz A, Wingstrand H, et al. Fragility Fractures in Patients with Rheumatoid Arthritis and Osteoarthritis Compared with the General Population. J Rheumatol. 2015 Nov;42(11):2055-8.[2]Vala CH, Kärrholm J, Kanis JA, et al. Risk for hip fracture before and after total knee replacement in Sweden. Osteoporos Int. 2020 May;31(5):887-895.[3]Kim BY, Kim HA, Jung JY, et al. Clinical Impact of the Fracture Risk Assessment Tool on the Treatment Decision for Osteoporosis in Patients with Knee Osteoarthritis: A Multicenter Comparative Study of the Fracture Risk Assessment Tool and World Health Organization Criteria. J Clin Med. 2019 Jun 26;8(7):918.[4]Soh SE, Barker AL, Morello RT, et al. Applying the International Classification of Functioning, Disability and Health framework to determine the predictors of falls and fractures in people with osteoarthritis or at high risk of developing osteoarthritis: data from the Osteoarthritis Initiative. BMC Musculoskelet Disord. 2020 Feb 29;21(1):138.Disclosure of Interests:None declared


2016 ◽  
Vol 15 (2) ◽  
Author(s):  
Talita Farias Feitosa ◽  
Moelisa Queiroz Dos Santos Dantas ◽  
Cássia Brito Da Silva ◽  
Álvaro Pereira

Aim: To verify, in the scientific production, the degree of reliability of the  Semmens-Weinstein  monofilament  as  a  risk  assessment  tool  for  diabetic  foot. Method:  This  is  an  integrative  literature  review  conducted  from  consultation  of  the electronic  databases  CINAHL,  MEDLINE,  SCOPUS  and  SCIELO.  Results:  Six  articles comprising  five  cross-sectional  studies  and  one  cohort  study  were selected.  The  six articles included in the review were taken from medical journals; no nursing publication was  found  that  met  the  goal.  Conclusion:  The  Semmens-Weinstein  monofilament  is  a reliable tool which has the best performance for assessing the risk for diabetic foot and its applicability is extremely important in consultations.


Sign in / Sign up

Export Citation Format

Share Document