Porous asphalt mixture can be used as a road surface paving material with the remarkable advantage to prevent water accumulation and ponding. However, the performance of porous asphalt mixture in low temperature environment has not been thoroughly investigated, and this forms the subject of research in the present study. The mineral aggregate gradation of porous asphalt mixture was designed based on Bailey method, and the low temperature performance of porous asphalt mixture was studied by means of the low temperature bending test. The factors affecting the low temperature performance of porous asphalt mixture were analyzed through the orthogonal experimental design method, and the effects of porosity, modifier content, aging condition, and test temperature on the low temperature performance of porous asphalt mixture were evaluated. The results showed that the modifier content was the most important factor affecting the low temperature performance of porous asphalt mixture, followed by the test temperature, while the porosity and the aging condition were the least. Among the three performance evaluation indicators, namely the flexural tensile strength, maximum bending strain, and bending stiffness modulus, the maximum bending strain had the highest sensitivity to the porosity. It can be seen from the single factor influence test of porosity that there existed an approximately linear relationship between the maximum bending strain and the porosity of porous asphalt mixture, and the maximum bending strain decreased with increasing porosity. Furthermore, in order to ensure the good working performance of porous asphalt mixture in low temperature environment, the porosity should also satisfy the required limits of the maximum bending strain.