Through the analyzing of the color, motion, parallax and the degree of clarity in scene-all the elements presented on the 2D video, People can produce 3D video smoothly. The paper introduces a kind of pick-up algorithm of depth map, the method of combining the abstraction of motion in depth based on the block matching and the abstraction of background in depth on the basis of background subtraction. The extracted map can be applied to the video conversion technology of "2D to 3D".