42 Background: Growing national attention to the need for metrics to document delivery of quality palliative care has resulted in a proliferation of measures and standards (e.g., Commission on Cancer, Quality Oncology Practice Initiative). While these standards offer benchmarks to strive for, there are few resources for programs to self-assess development of organizational infrastructure to achieve them. Methods: The NCCCP Cancer Palliative Care Matrix (PCM) is a performance measure and evaluation tool to aid palliative care program development in the community setting. The PCM was completed annually by 21 NCCCP sites from 2010 to 2013. Four domains related to quality measures are reported here. Proportional-odds logistic regression models were used to evaluate the relationship between year and level of response. Results: Variations in program development were seen in the quality domains of symptom assessment, palliative care services offered across the continuum of care, identification for palliative care services, and use of quality measures. In 2010, 13/21 sites reported that symptom assessment were not performed or performed inconsistently. By 2013, 13 sites reported consistent assessment with standardized tools, with 5 of these 13 able to review sequential patient assessment (p=0.002). Similar gains were seen in the domains of providing services across the continuum of cancer care and utilization of quality measures such as patient/provider satisfaction and service utilization (p=0.004, p<0.0001). Despite three years of effort, little change was seen in patient identification processes for palliative care services with only 6 of 21 sites in 2013, compared to 5 in 2010, reporting improvement in "upstream" patient identification regardless of cancer stage (p=0.065). Conclusions: Data suggest the utility of the PCM to evaluate process and quality outcomes in palliative care program development. In addition, identification of challenge and growth areas can be used to develop interventions to address quality performance in both clinical and research contexts.