Concordance between a clinical decision-support system and treatments selected by clinicians as a function of cancer type or stage.
95 Background: Watson for Oncology (WFO) is an artificial intelligence (AI) based clinical decision-support tool trained by Memorial Sloan Kettering. This retrospective observational study of breast, lung, colon and rectal cancer examined the concordance of treatment options provided by WFO to treatments selected by clinicians at Bumrungrad International Hospital (BIH) as a function of stage or cancer type. Methods: Concordance between WFO treatment options and treatments selected by BIH clinicians (WFO-BIH concordance) was defined as identical or equally acceptable treatments, as determined by a panel of experts blinded to the source of treatment. Relationships between stage or type of cancer and WFO-BIH concordant treatments were evaluated by Chi-squared analysis. Results: Analysis revealed a statistically significant association ( P = 0.02) between cancer stage and concordance. For all 4 cancer types combined, stages I-III demonstrated higher concordance than stage IV. A highly significant association ( P < 0.001) between concordance and cancer type was identified. Colon cancer demonstrated the highest concordance, followed by rectal, lung and breast cancer. Reasons for discordance, when given, related to oncologist or patient preferences, and treatment availability. Conclusions: BIH clinicians tended to agree more with WFO therapeutic options for stage I-III cancers and colon cancer in general, as compared to relatively less agreement for stage IV cancers and breast cancer in general, suggesting the need to understand reasons for discordance among all cancer types and stages. An AI tool, trained by experts in the U.S., provides treatment options consistent with some therapies selected in international settings, but preferences and treatment availability may affect choices made in practice. [Table: see text]