With the innovations and development in sophisticated video editing technology, it is becoming increasingly significant to assure the trustworthiness of video information. Today digital videos are also increasingly transmitted over non-secure channels, such as the Internet. Therefore, in surveillance, medical, and various other fields, video content must be protected against attempts to manipulate them. Video authentication has gained much attention in recent years. However, many existing authentication techniques have their own advantages and obvious drawbacks; we propose a novel authentication technique that uses an intelligent approach for video authentication. This book chapter presents an intelligent video authentication algorithm using support vector machine, which is a non-linear classifier, and its applications. It covers both kinds of tampering attacks, spatial and temporal. It uses a database of more than 4000 tampered and non-tampered video frames and gives excellent results with 95% classification accuracy. The authors discuss a vast diversity of tampering attacks, which can be possible for video sequences. Their algorithm gives very good results for almost all kinds of tampering attacks.