Smart cars are the result of the combination of the latest technological achievements in the fields of artificial intelligence, sensors, control science, computer, and network technology with the modern automobile industry. Intelligent cars usually have functions, such as automatic shifting, automatic driving, and automatic road condition recognition. The research of intelligent car technology involves many disciplines. This thesis focuses on the field of smart car visual navigation, focusing on image denoising, image information recognition, extraction, and pattern recognition control algorithms. The traditional trajectory tracking algorithm is mainly used in industrial computer or high-performance computer. The computational complexity leads to poor real-time control, and it is easily interfered by external complex terrain environment and internal disordered electromagnetic environment during vehicle driving. In general, on a regular basis, by the image analysis of the driver or the driver information, the image information is proposed using way trace processing technology, vehicle tracking control method and automatic driving rules. The simulation and experimental results show that the proposed control methods and rules used to carry out automatic driving vehicle are feasible. The algorithm reduces the complexity of the algorithm, improves the real-time and stability of the control and finally achieves a good trajectory tracking effect of the car on high-speed automatic driving.