Human Skin Color(HSC) features have been widely used in video moving human positioning. However, in complex background video sequences, due to illumination changes or other moving objects which have similar HSC regions, the effect of moving human positioning is not satisfactory. A new method of moving human positioning applied on complex background video sequences is presented in this paper. Firstly, brightness information of the video sequence images is detected and analyzed based on HSV color model. Secondly, adopt the multi frame subtraction method to extract the moving object regions from motionless background. Then, the regions with distinctive HSC features are separated from other moving objects using the data fusion model of HSC and brightness information. Finally, identify human object among regions with HSC features according to the prior knowledge of human. The experimental results show that the method provided in this paper is effective in moving human positioning of complex background video, and has the strong illumination change adaptability and anti-jamming ability.