Video surveillance system with image recognition and image tracking capabilities has a wide range of applications in the field of city protection, social security and public safety. In this paper, based on the analysis of image detection and tracking principles, image recognition and tracking algorithm based PID fuzzy control is proposed. First, the image on the basis of the gray-scale image is acquired by the video processor and the linearization processing, and then through the expansion operation of mathematical morphology the candidate region of the image recognition is taken, and then the final image region is obtained through the vertical positioning and horizontal positioning of the region Finally, through the PID control algorithm it is the image of the track. Simulation results show that the PID fuzzy control-based image recognition and tracking algorithm possesses good vehicle license plate image recognition and tracking performance and good practicability.