scholarly journals Decision tree accelerated CTU partition algorithm for intra prediction in versatile video coding

PLoS ONE ◽  
2021 ◽  
Vol 16 (11) ◽  
pp. e0258890
Author(s):  
Guowei Teng ◽  
Danqi Xiong ◽  
Ran Ma ◽  
Ping An
Keyword(s):  
Decision Tree ◽  
Video Coding ◽  
High Efficiency ◽  
Intra Prediction ◽  
Image Features ◽  
Test Model ◽  
High Efficiency Video Coding ◽  
Partition Structure ◽  
Partition Process ◽  
Coding Unit

Versatile video coding (VVC) achieves enormous improvement over the advanced high efficiency video coding (HEVC) standard due to the adoption of the quadtree with nested multi-type tree (QTMT) partition structure and other coding tools. However, the computational complexity increases dramatically as well. To tackle this problem, we propose a decision tree accelerated coding tree units (CTU) partition algorithm for intra prediction in VVC. Firstly, specially designated image features are extracted to characterize the coding unit (CU) complexity. Then, the trained decision tree is employed to predict the partition results. Finally, based on our newly designed intra prediction framework, the partition process is early terminated or redundant partition modes are screened out. The experimental results show that the proposed algorithm could achieve around 52% encoding time reduction for various test video sequences on average with only 1.75% Bjontegaard delta bit rate increase compared with the reference test model VTM9.0 of VVC.

A Fast Mode Decision Algorithm for Intra Prediction in High Efficiency Video Coding

2020 ◽  
Vol 10 (2) ◽  
pp. 496-501
Author(s):  
Wen Si ◽  
Qian Zhang ◽  
Zhengcheng Shi ◽  
Bin Wang ◽  
Tao Yan ◽  
...  
Keyword(s):  
Video Coding ◽  
High Efficiency ◽  
Rate Increase ◽  
Intra Prediction ◽  
High Efficiency Video Coding ◽  
Candidate List ◽  
Decision Algorithm ◽  
Coding Efficiency ◽  
Gradient Based ◽  
Coding Unit

High Efficiency Video Coding (HEVC) is the next generation video coding standard. In HEVC, 35 intra prediction modes are defined to improve coding efficiency, which result in huge computational complexity, as a large number of prediction modes and a flexible coding unit (CU) structure is adopted in CU coding. To reduce this computational burden, this paper presents a gradient-based candidate list clipping algorithm for Intra mode prediction. Experimental results show that the proposed algorithm can reduce 29.16% total encoding time with just 1.34% BD-rate increase and –0.07 dB decrease of BD-PSNR.

scholarly journals Adaptive CU Split Decision Based on Deep Learning and Multifeature Fusion for H.266/VVC

2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Jinchao Zhao ◽  
Yihan Wang ◽  
Qiuwen Zhang
Keyword(s):  
Deep Learning ◽  
Video Coding ◽  
High Efficiency ◽  
Texture Classification ◽  
Rate Distortion ◽  
Classification Model ◽  
High Efficiency Video Coding ◽  
Fast Encoding ◽  
Training Samples ◽  
Coding Unit

With the development of technology, the hardware requirement and expectations of user for visual enjoyment are getting higher and higher. The multitype tree (MTT) architecture is proposed by the Joint Video Experts Team (JVET). Therefore, it is necessary to determine not only coding unit (CU) depth but also its split mode in the H.266/Versatile Video Coding (H.266/VVC). Although H.266/VVC achieves significant coding performance on the basis of H.265/High Efficiency Video Coding (H.265/HEVC), it causes significantly coding complexity and increases coding time, where the most time-consuming part is traversal calculation rate-distortion (RD) of CU. To solve these problems, this paper proposes an adaptive CU split decision method based on deep learning and multifeature fusion. Firstly, we develop a texture classification model based on threshold to recognize complex and homogeneous CU. Secondly, if the complex CUs belong to edge CU, a Convolutional Neural Network (CNN) structure based on multifeature fusion is utilized to classify CU. Otherwise, an adaptive CNN structure is used to classify CUs. Finally, the division of CU is determined by the trained network and the parameters of CU. When the complex CUs are split, the above two CNN schemes can successfully process the training samples and terminate the rate-distortion optimization (RDO) calculation for some CUs. The experimental results indicate that the proposed method reduces the computational complexity and saves 39.39% encoding time, thereby achieving fast encoding in H.266/VVC.

Improving Intra Prediction in High-Efficiency Video Coding

2016 ◽  
Vol 25 (8) ◽  
pp. 3671-3682 ◽  
Author(s):  
Haoming Chen ◽  
Tao Zhang ◽  
Ming-Ting Sun ◽  
Ankur Saxena ◽  
Madhukar Budagavi
Keyword(s):  
Video Coding ◽  
High Efficiency ◽  
Intra Prediction ◽  
High Efficiency Video Coding
Sign in / Sign up

Export Citation Format

Share Document