Numerous studies have indicated the existence of size effect on axial compression behavior of stirrup-confined concrete columns. However, most of these studies have been stressed in terms of nominal compressive strength. The investigation on the size effect of axial strain (at peak load) and descending branch was limited. In this study, the size effect behavior of square stirrup-confined concrete columns under axial compression was explored, by using 3-D mesoscale simulation method. Based on the numerical and available experimental results, the influence of specimen size on the peak axial stress (i.e., the compressive strength), the corresponding strain and the softening rate were explored. Moreover, the quantitative relationships between specimen size and the peak axial stress, the corresponding strain and the softening rate for circular and square stirrup-confined concrete columns were derived. Finally, considering the size effect of peak axial stress, the corresponding strain and the softening rate, a novel stress-strain model describing the axial compression behavior of stirrup-confined concrete was developed. The proposed model was verified by comparing with the available experimental results and the existing models provided.