Camshift, namely "Continuously Adaptive Mean-Shift" algorithm, is an adaptive tracking algorithm. This algorithm is based on the color information to track the moving target in image sequence. In the simple background, this algorithm achieved a steady and current tracking effect. But in dynamic scene, the global motion caused by the camera, the background of the light and occlusion will affect the accuracy, or even lose the tracking of the target. In order to solve the above problem, this paper adjust the H component in HSV color space, as well use weighted color histogram to improve the Camshift algorithm, then combined with Kalman filter to track the target in the image sequence. The experimental result shows that this approach can track object stability and correctly in dynamic scene.