Background Older persons living with diabetes have an obligation to change their daily lifestyle, which may contribute to diabetes distress. Furthermore, predictive factors of diabetes distress in older persons might be different from other age groups due to age-related factors. Aims The purpose of the study was to examine the predictive factors of diabetes distress in older persons diagnosed with type 2 diabetes mellitus (T2DM) in Indonesia. Methods A cross-sectional design was used in this study. Participants were recruited from an outpatient department of a tertiary hospital in Klaten City, Central Java, Indonesia. Data were analysed using multiple linear regression with a stepwise method. Results A total 198 older persons were included in the study. The study demonstrated self-efficacy (β = −0.298, P < 0.01), spirituality (β = −0.139, P < 0.05), blood glucose (β = 0.134, P < 0.05), and non-supportive family behaviour (β = 0.135, P < 0.05) as the variables that could statistically predict diabetes distress in older persons with T2DM. Conclusions Self-efficacy is the strongest predictor of diabetes distress. Moreover, the findings can be used as evidence to guide identification and future management of diabetes distress among older persons with T2DM.