A Spatial Prediction-Based Motion-Compensated Frame Rate Up-Conversion

In Multimedia Internet of Things (IoT), in order to reduce the bandwidth consumption of wireless channels, Motion-Compensated Frame Rate Up-Conversion (MC-FRUC) is often used to support the low-bitrate video communication. In this paper, we propose a spatial predictive algorithm which is used to improve the performance of MC-FRUC. The core of the proposed algorithm is a predictive model to split a frame into two kinds of blocks: basic blocks and absent blocks. Then an improved bilateral motion estimation is proposed to compute the Motion Vectors (MVs) of basic blocks. Finally, with the spatial correlation of Motion Vector Field (MVF), the MV of an absent block is predicted based on the MVs of its neighboring basic blocks. Experimental results show that the proposed spatial prediction algorithm can improve both the objective and the subjective quality of the interpolated frame, with a low computational complexity.

Download Full-text

A Novel Frame Rate Up-Conversion Algorithm Based on Soft Threshold Bandelet Transform

International Journal of Pattern Recognition and Artificial Intelligence ◽

10.1142/s0218001416500178 ◽

2016 ◽

Vol 30 (07) ◽

pp. 1650017 ◽

Cited By ~ 2

Author(s):

Mingjun Deng ◽

Fengchun Tian ◽

Jian Ran ◽

Zhiyong Shi ◽

Li Zhang

Keyword(s):

Motion Vector ◽

Block Matching ◽

Frame Rate ◽

Matching Algorithm ◽

Block Matching Algorithm ◽

Block Motion ◽

Soft Threshold ◽

Frame Rate Up Conversion ◽

Vector Median

The most important part of frame rate up-conversion (FRUC) is block matching. The geometric properties of the image were not taken into consideration in traditional block matching algorithm, so the matching result of motion estimation cannot reach the optimal. A novel FRUC algorithm based on Bandelet was proposed in this paper. The algorithm includes: Firstly, a soft threshold Bandelet transform of matching block was performed. The optimal matching block was determined through detection of direction similarity and Bandelet coefficient similarity; secondly, vector median filtering (VMF) and overlapped block motion compensation (OBMC) were carried out by adopting motion vector to realize interpolated frame algorithm. Experimental results show that the FRUC algorithm based on Bandelet can further promote the quality of FRUC.

Download Full-text

A Low-Complex Frame Rate Up-Conversion with Edge-Preserved Filtering

Electronics ◽

10.3390/electronics9010156 ◽

2020 ◽

Vol 9 (1) ◽

pp. 156 ◽

Cited By ~ 1

Author(s):

Ran Li ◽

Wendan Ma ◽

Yanling Li ◽

Lei You

Keyword(s):

Computational Complexity ◽

Motion Vector ◽

Frame Rate ◽

Video Frame ◽

Continuous Increase ◽

Video Frames ◽

Motion Vector Field ◽

Frequency Components ◽

Speed Up ◽

Frame Rate Up Conversion

The improvement of resolution of digital video requires a continuous increase of computation invested into Frame Rate Up-Conversion (FRUC). In this paper, we combine the advantages of Edge-Preserved Filtering (EPF) and Bidirectional Motion Estimation (BME) in an attempt to reduce the computational complexity. The inaccuracy of BME results from the existing similar structures in the texture regions, which can be avoided by using EPF to remove the texture details of video frames. EPF filters out by the high-frequency components, so each video frame can be subsampled before BME, at the same time, with the least accuracy degradation. EPF also preserves the edges, which prevents the deformation of object in the process of subsampling. Besides, we use predictive search to reduce the redundant search points according to the local smoothness of Motion Vector Field (MVF) to speed up BME. The experimental results show that the proposed FRUC algorithm brings good objective and subjective qualities of the interpolated frames with a low computational complexity.

Download Full-text