To solve the early rutting failure of asphalt pavement, the application of rock asphalt from Sichuan, China, based on anti-rutting performance, was studied. Preparations of North Sichuan rock asphalt (NS RA) and NS RA-modified asphalt mixture were elaborated in detail. Using Zhonghai AH-70 asphalt, Esso AH-70 asphalt, North American rock asphalt (NA RA) and NS RA, the performances of NS RA modified asphalt were researched based on index tests, Brookfield rotary viscosity test and bending beam rheometer test. A performance verification of NS RA-modified asphalt was carried out using rutting calculation, the rutting, indirect tensile fatigue, freeze–thaw split and small beam bending tests based on five kinds of selected gradations. The results indicated that in comparison with NA RA, the NS RA has a good modification effect as well. The NS RA can obviously improve the anti-rutting ability of the asphalt binder, and it can enhance its anti-aging performance as well. For the NS RA-modified asphalt mixture, it is feasible to determine the optimum NS RA content, based on its anti-rutting performance, and its optimum NS RA content is about 8%. The dynamic stability values of NS RA-modified asphalt mixtures are at least 3-fold higher than those of the base asphalt mixtures, and they are all far greater than the summer hot area requirement (no less than 2800 times/mm). NS RA-modified asphalt mixtures used in the middle course of asphalt pavement can obviously improve the anti-rutting performance of the pavement, and to enhance the anti-rutting ability of pavements, it should be used in the middle course of the pavement. The fatigue life values of NS RA-modified asphalt mixtures are at least 14.5-fold higher than those of the base asphalt mixtures. The freeze–thaw splitting strength ratio values of NS RA-modified asphalt mixtures are improved by at least 9.5% over the base asphalt mixtures, and their freeze–thaw splitting strength ratio values are all greater than the requirement (no less than 75%). In comparison with the base asphalt, the low temperature performances of NS RA-modified asphalt and its mixtures slightly decline, but they can meet the requirements for the zones with a minimum temperature of no less than –21.5 °C too. Therefore, except for the extremely low temperature area, it is an effective method for solving the rutting problem of pavement for using NS RA-modified asphalt.