Mammographic breast density (MBD) is a strong and highly heritable predictor of breast cancer risk and a biomarker for the disease. This study systematically assesses MBD as an endophenotype for breast cancer—a quantitative trait that is heritable and genetically correlated with disease risk. Using data from the family-based kConFab Study and the 1994/1995 cross-sectional Busselton Health Study, participants were divided into three status groups—cases, relatives of cases and controls. Participant’s mammograms were used to measure absolute dense area (DA) and percentage dense area (PDA). To address each endophenotype criterion, linear mixed models and heritability analysis were conducted. Both measures of MBD were significantly associated with breast cancer risk in two independent samples. These measures were also highly heritable. Meta-analyses of both studies showed that MBD measures were higher in cases compared to relatives (β = 0.48, 95% CI = 0.10, 0.86 and β = 0.41, 95% CI = 0.06, 0.78 for DA and PDA, respectively) and in relatives compared to controls (β = 0.16, 95% CI = −0.24, 0.56 and β = 0.16, 95% CI = −0.21, 0.53 for DA and PDA, respectively). This study formally demonstrates, for the first time, that MBD is an endophenotype for breast cancer.