A Fast Inter-frame Prediction Unit Mode Decision Algorithm for High Efficiency Video Coding Based on Temporal Correlation

2014 ◽  
Vol 35 (10) ◽  
pp. 2365-2370 ◽  
Author(s):  
Yuan Li ◽  
Xiao-hai He ◽  
Guo-yun Zhong ◽  
Lin-bo Qing
2020 ◽  
pp. short57-1-short57-8
Author(s):  
Ban Doan ◽  
Andrey Tropchenko

In order to achieve greater coding efficiency compared with the previous video coding standards, various advanced coding techniques are used in the High Efficiency Video Coding (HEVC) standard, such as a flexible partition and a large number of intra prediction modes. However, these techniques lead to much greater complexity that restricts HEVC from realtime applications. To solve this problem, a fast intra mode decision algorithm is proposed in this paper that uses the block’s textural properties to determine the partition depth range and decide whether to split or skip smaller sizes of the coding unit. Besides that, the number of candidate modes for the rough mode decision process is also reduced depending on the block’s property. Experimental results for the recommended test sequences by the JCT-VC show that the proposed algorithm can save an average of 44% encoder time with a slight loss in performance compared to the reference software HM-16.20.


2014 ◽  
Vol 2014 ◽  
pp. 1-9 ◽  
Author(s):  
Qiuwen Zhang ◽  
Nana Li ◽  
Qinggang Wu

The emerging international standard of high efficiency video coding based 3D video coding (3D-HEVC) is a successor to multiview video coding (MVC). In 3D-HEVC depth intracoding, depth modeling mode (DMM) and high efficiency video coding (HEVC) intraprediction mode are both employed to select the best coding mode for each coding unit (CU). This technique achieves the highest possible coding efficiency, but it results in extremely large encoding time which obstructs the 3D-HEVC from practical application. In this paper, a fast mode decision algorithm based on the correlation between texture video and depth map is proposed to reduce 3D-HEVC depth intracoding computational complexity. Since the texture video and its associated depth map represent the same scene, there is a high correlation among the prediction mode from texture video and depth map. Therefore, we can skip some specific depth intraprediction modes rarely used in related texture CU. Experimental results show that the proposed algorithm can significantly reduce computational complexity of 3D-HEVC depth intracoding while maintaining coding efficiency.


2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Soulef Bouaafia ◽  
Randa Khemiri ◽  
Amna Maraoui ◽  
Fatma Elzahra Sayadi

High-Efficiency Video Coding provides a better compression ratio compared to earlier standard, H.264/Advanced Video Coding. In fact, HEVC saves 50% bit rate compared to H.264/AVC for the same subjective quality. This improvement is notably obtained through the hierarchical quadtree structured Coding Unit. However, the computational complexity significantly increases due to the full search Rate-Distortion Optimization, which allows reaching the optimal Coding Tree Unit partition. Despite the many speedup algorithms developed in the literature, the HEVC encoding complexity still remains a crucial problem in video coding field. Towards this goal, we propose in this paper a deep learning model-based fast mode decision algorithm for HEVC intermode. Firstly, we provide a deep insight overview of the proposed CNN-LSTM, which plays a kernel and pivotal role in this contribution, thus predicting the CU splitting and reducing the HEVC encoding complexity. Secondly, a large training and inference dataset for HEVC intercoding was investigated to train and test the proposed deep framework. Based on this framework, the temporal correlation of the CU partition for each video frame is solved by the LSTM network. Numerical results prove that the proposed CNN-LSTM scheme reduces the encoding complexity by 58.60% with an increase in the BD rate of 1.78% and a decrease in the BD-PSNR of -0.053 dB. Compared to the related works, the proposed scheme has achieved a best compromise between RD performance and complexity reduction, as proven by experimental results.


Author(s):  
Wenchan Jiang ◽  
Ming Yang ◽  
Ying Xie ◽  
Zhigang Li

High efficiency video coding (HEVC) has been deemed as the newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. In this research project, in compliance with H.265 standard, the authors focused on improving the performance of encode/decode by optimizing the partition of prediction block in coding unit with the help of supervised machine learning. The authors used Keras library as the main tool to implement the experiments. Key parameters were tuned for the model in the convolution neuron network. The coding tree unit mode decision time produced in the model was compared with that produced in the reference software for HEVC, and it was proven to have improved significantly. The intra-picture prediction mode decision was also investigated with modified model and yielded satisfactory results.


2020 ◽  
Vol 34 (07) ◽  
pp. 11580-11587
Author(s):  
Haojie Liu ◽  
Han Shen ◽  
Lichao Huang ◽  
Ming Lu ◽  
Tong Chen ◽  
...  

Traditional video compression technologies have been developed over decades in pursuit of higher coding efficiency. Efficient temporal information representation plays a key role in video coding. Thus, in this paper, we propose to exploit the temporal correlation using both first-order optical flow and second-order flow prediction. We suggest an one-stage learning approach to encapsulate flow as quantized features from consecutive frames which is then entropy coded with adaptive contexts conditioned on joint spatial-temporal priors to exploit second-order correlations. Joint priors are embedded in autoregressive spatial neighbors, co-located hyper elements and temporal neighbors using ConvLSTM recurrently. We evaluate our approach for the low-delay scenario with High-Efficiency Video Coding (H.265/HEVC), H.264/AVC and another learned video compression method, following the common test settings. Our work offers the state-of-the-art performance, with consistent gains across all popular test sequences.


Sign in / Sign up

Export Citation Format

Share Document