Effect of Changing Breast Cancer Incidence Rates on the Calibration of the Gail Model

Purpose The Gail model combines relative risks (RRs) for five breast cancer risk factors with age-specific breast cancer incidence rates and competing mortality rates from the Surveillance, Epidemiology, and End Results (SEER) program from 1983 to 1987 to predict risk of invasive breast cancer over a given time period. Motivated by changes in breast cancer incidence during the 1990s, we evaluated the model's calibration in two recent cohorts. Methods We included white, postmenopausal women from the National Institutes of Health (NIH) –AARP Diet and Health Study (NIH-AARP, 1995 to 2003), and the Prostate, Lung, Colorectal and Ovarian Cancer Screening Trial (PLCO, 1993 to 2006). Calibration was assessed by comparing the number of breast cancers expected from the Gail model with that observed. We then evaluated calibration by using an updated model that combined Gail model RRs with 1995 to 2003 SEER invasive breast cancer incidence rates. Results Overall, the Gail model significantly underpredicted the number of invasive breast cancers in NIH-AARP, with an expected-to-observed ratio of 0.87 (95% CI, 0.85 to 0.89), and in PLCO, with an expected-to-observed ratio of 0.86 (95% CI, 0.82 to 0.90). The updated model was well-calibrated overall, with an expected-to-observed ratio of 1.03 (95% CI, 1.00 to 1.05) in NIH-AARP and an expected-to-observed ratio of 1.01 (95% CI: 0.97 to 1.06) in PLCO. Of women age 50 to 55 years at baseline, 13% to 14% had a projected Gail model 5-year risk lower than the recommended threshold of 1.66% for use of tamoxifen or raloxifene but ≥ 1.66% when using the updated model. The Gail model was well calibrated in PLCO when the prediction period was restricted to 2003 to 2006. Conclusion This study highlights that model calibration is important to ensure the usefulness of risk prediction models for clinical decision making.