In this paper, a video summarization representation algorithm was proposed in compressed domain. In particular, Rough sets(RS) theory is introduced for video analysis to increase. Firstly, DCT coefficients and DC coefficients are extracted from video image sequences, so an Information System can construct with DC coefficients. Then Information System is reduced by ruduction theory of RS, the representation of the video frame is obtained by reduced DC coefficients. Finally, we can obtain the reduced Information System, i.e. the Core of Information System. Since the Core contained all the information in video sequences, and at the same time it banished redundant video frame, so it can be viewed as the effective summarization representation. Experimental results indicate that the algorithm can efficiently generate a set of summarization representative of videos sequences and enjoys following advantages. Only a subset of video frames considered during video analysis, so it can avoid the computational complexity, the video summarization representation becomes more scientific than previous methods.