The asphalt surface crack fracture mainly includes load cracks and non-load cracks. The former is due to the weight of the vehicle itself causing excessive fatigue weight, therefore, this crack is also known as road load fatigue crack. Non-load crack is affected by nature factors such as temperature and humidity, which makes the road structure cracking. In this paper, finite element method is used to analyze the transient temperature field, and on this basis, the temperature stress simulation of pavement structure is carried out. The stress intensity factor of asphalt surface crack tip is analyzed by finite element method. The results show that the modulus of the surface and the base layer and the increase of the temperature coefficient of the base layer will lead to the increase of the stress intensity factor of the crack tip. The temperature coefficient of the surface layer has no obvious effect on the stress intensity factor. In addition, increasing the thickness of the surface layer can effectively reduce the stress intensity factor at the crack tip. The paper also concludes that the gravel base can effectively slow down the expansion of the road refection crack.