A new similarity measurement standard is proposed, namely background similarity matching. Learning algorithm based on kernel function is utilized in the method for feature extraction and classification of face image. Meanwhile, a real-time video face recognition method is proposed, image binary algorithm in similarity calculation is introduced, and a video face recognition system is designed and implemented [1-2]. The system is provided with a camera to obtain face images, and face recognition is realized through image preprocessing, face detection and positioning, feature extraction, feature learning and matching. Design, image preprocessing, feature positioning and extraction, face recognition and other major technologies of face recognition systems are introduced in details. Lookup mode from top down is improved, thereby improving lookup accuracy and speed [3-4]. The experimental results showed that the method has high recognition rate. Higher recognition rate still can be obtained even for limited change images of face images and face gesture with slightly uneven illumination. Meanwhile, training speed and recognition speed of the method are very fast, thereby fully meeting real-time requirements of face recognition system [5]. The system has certain face recognition function and can well recognize front faces.