Analysis and calculation of stray light is important to improve the performance of infrared detection system. In this article, we mainly discussed two sources: earth and atmosphere emission and thermal stray radiation. A method based on Monte Carlo ray-tracing in TracePro is proposed to calculate the irradiance of detector arisen from earth and atmosphere emission. The thermal stray light irradiance on detector can also be obtained by simulation in TracePro.