Motion estimation is used to remove interpixel redundancy in video data and block based motion estimation algorithms are widely used for it. Computation in these algorithms is reduced by limiting the number of candidate search points within the search window or simplifying the distortion measurement criterion. In literature, there are integral frame based block motion estimation algorithms which drastically reduce computation cost. However, these algorithms have a serious drawback of spurious block matching possibility, leading to poor quality results. In this manuscript, a multilevel block matching criterion based on integral frame concept is proposed to minimize this drawback. Experimental results show that an increase up to 12% in terms of PSNR (dB) has been achieved than integral frame based sum of absolute difference block sum criterion (SAD_BS) with almost same execution time. Further, in terms of [Formula: see text] ratio, proposed method has 25–26% gain over SAD_BS.