Content-Based Video Streaming Approaches and Challenges

Author(s):  
Ashraf M.A. Ahmad

Video streaming poses significant technical challenges in quality of service guarantee and efficient resource management. Generally, it is recognized that end-to-end quality requirements of video streaming application can be reasonably achieved only by integrative study of advanced networking and content processing techniques. However, most existing integration techniques stop at the bit stream level, ignoring a deeper understanding of the media content. Yet, the underlying visual content of the video stream contains a vast amount of information that can be used to predict the bit-rate or quality more accurately. In the content-aware video streaming framework, video content is extracted automatically and used to control video quality under various manipulations and network resource requirements.

2010 ◽  
Vol 6 (3) ◽  
pp. 259-280 ◽  
Author(s):  
N. Qadri ◽  
M. Altaf ◽  
M. Fleury ◽  
M. Ghanbari

Video communication within a Vehicular Ad Hoc Network (VANET) has the potential to be of considerable benefit in an urban emergency, as it allows emergency vehicles approaching the scene to better understand the nature of the emergency. However, the lack of centralized routing and network resource management within a VANET is an impediment to video streaming. To overcome these problems the paper pioneers source-coding techniques for VANET video streaming. The paper firstly investigates two practical multiple-path schemes, Video Redundancy Coding (VRC) and the H.264/AVC codec's redundant frames. The VRC scheme is reinforced by gradual decoder refresh to improve the delivered video quality. Evaluation shows that multiple-path 'redundant frames' achieves acceptable video quality at some destinations, whereas VRC is insufficient. The paper also demonstrates a third source coding scheme, single-path streaming with Flexible Macroblock Ordering, which is also capable of delivery of reasonable quality video. Therefore, video communication between vehicles is indeed shown to be feasible in an urban emergency if the suitable source coding techniques are selected.


Author(s):  
Emad Abdullah Danish ◽  
Mazin I. Alshamrani

Research in network resource utilisation introduced several techniques for more efficient power and bandwidth consumption. The majority of these techniques, however, were based on Quality of Service (QoS) and network parameters. Therefore, in this study a different approach is taken to investigate the possibility of a more efficient resource utilisation if resources are distributed based on users' Quality of Experience (QoE), in the context of 3D video transmission over WiMAX access networks. In particular, this study suggests a QoE-driven technique to identify the operational regions (bounds) for Modulation and Coding Schemes (MCS). A mobile 3D video transmission is simulated, through which the correlation between receiver's Signal-to-Noise Ratio (SNR) and perceived video quality is identified. The main conclusions drawn from the study demonstrate that a considerable saving in signal power and bandwidth can be achieved in comparison to QoS-based techniques.


2012 ◽  
pp. 737-763
Author(s):  
Ghaida A. Al-Suhail ◽  
Martin Fleury ◽  
Salah M. Saleh Al-Majeed

All-IP networks are under development with multimedia services in mind. Video multicast is an efficient way to deliver one video simultaneously to many users over such heterogeneous wired-to-wireless networks, such as in wireless IP applications where a mobile terminal communicates with an IP server through a wired IP network in tandem with a wireless network. Unicast video streaming is also an attractive way to deliver time-shifted TV to mobile devices. This Chapter presents a simple cross-layer model that leads to the optimal throughput to multiple users for multicasting video over a heterogeneous network. An adaptive forward-error-correction scheme is applied at the byte-level as well as at the packet-level to reduce channel errors. The results show that a server can significantly adapt to the bandwidth and FEC codes to maximize the video quality of service. For unicast streaming, the Chapter presents a single negative acknowledgment scheme in which a video stream is transmitted over a heterogeneous network from a streaming server to a mobile device in a WiMAX network. The broadband streaming system is compared to several candidate solutions based on originally wired network congestion controllers. Multi-connection streaming is also investigated.


2011 ◽  
Vol 179-180 ◽  
pp. 243-248
Author(s):  
Fu Zheng Yang ◽  
Jia Run Song ◽  
Shu Ai Wan

In the paper a no-reference system for quality assessment of video streaming over RTP is proposed for monitoring the quality of networked video. The proposed system is composed of four modules, where the quality assessment module utilizes information extracted from the bit-stream by the modules of RTP header analysis, frame header analysis and display buffer simulation. Taking MPEG-4 encoded video stream over RTP as an example, the process of video quality assessment using the proposed system is described in this paper. The proposed system is featured by its high efficiency without sorting to the original video or video decoding, and therefore well suited for real-time networked video applications.


Author(s):  
Ghaida A. Al-Suhail ◽  
Martin Fleury ◽  
Salah M. Saleh Al-Majeed

All-IP networks are under development with multimedia services in mind. Video multicast is an efficient way to deliver one video simultaneously to many users over such heterogeneous wired-to-wireless networks, such as in wireless IP applications where a mobile terminal communicates with an IP server through a wired IP network in tandem with a wireless network. Unicast video streaming is also an attractive way to deliver time-shifted TV to mobile devices. This Chapter presents a simple cross-layer model that leads to the optimal throughput to multiple users for multicasting video over a heterogeneous network. An adaptive forward-error-correction scheme is applied at the byte-level as well as at the packet-level to reduce channel errors. The results show that a server can significantly adapt to the bandwidth and FEC codes to maximize the video quality of service. For unicast streaming, the Chapter presents a single negative acknowledgment scheme in which a video stream is transmitted over a heterogeneous network from a streaming server to a mobile device in a WiMAX network. The broadband streaming system is compared to several candidate solutions based on originally wired network congestion controllers. Multi-connection streaming is also investigated.


Author(s):  
Abubakr O. Al-Abbasi ◽  
Vaneet Aggarwal

As video-streaming services have expanded and improved, cloud-based video has evolved into a necessary feature of any successful business for reaching internal and external audiences. In this article, video streaming over distributed storage is considered where the video segments are encoded using an erasure code for better reliability. We consider a representative system architecture for a realistic (typical) content delivery network (CDN). Given multiple parallel streams/link between each server and the edge router, we need to determine, for each client request, the subset of servers to stream the video, as well as one of the parallel streams from each chosen server. To have this scheduling, this article proposes a two-stage probabilistic scheduling. The selection of video quality is also chosen with a certain probability distribution that is optimized in our algorithm. With these parameters, the playback time of video segments is determined by characterizing the download time of each coded chunk for each video segment. Using the playback times, a bound on the moment generating function of the stall duration is used to bound the mean stall duration. Based on this, we formulate an optimization problem to jointly optimize the convex combination of mean stall duration and average video quality for all requests, where the two-stage probabilistic scheduling, video quality selection, bandwidth split among parallel streams, and auxiliary bound parameters can be chosen. This non-convex problem is solved using an efficient iterative algorithm. Based on the offline version of our proposed algorithm, an online policy is developed where servers selection, quality, bandwidth split, and parallel streams are selected in an online manner. Experimental results show significant improvement in QoE metrics for cloud-based video as compared to the considered baselines.


Entropy ◽  
2021 ◽  
Vol 23 (8) ◽  
pp. 948
Author(s):  
Carlos Eduardo Maffini Santos ◽  
Carlos Alexandre Gouvea da Silva ◽  
Carlos Marcelo Pedroso

Quality of service (QoS) requirements for live streaming are most required for video-on-demand (VoD), where they are more sensitive to variations in delay, jitter, and packet loss. Dynamic Adaptive Streaming over HTTP (DASH) is the most popular technology for live streaming and VoD, where it has been massively deployed on the Internet. DASH is an over-the-top application using unmanaged networks to distribute content with the best possible quality. Widely, it uses large reception buffers in order to keep a seamless playback for VoD applications. However, the use of large buffers in live streaming services is not allowed because of the induced delay. Hence, network congestion caused by insufficient queues could decrease the user-perceived video quality. Active Queue Management (AQM) arises as an alternative to control the congestion in a router’s queue, pressing the TCP traffic sources to reduce their transmission rate when it detects incipient congestion. As a consequence, the DASH client tends to decrease the quality of the streamed video. In this article, we evaluate the performance of recent AQM strategies for real-time adaptive video streaming and propose a new AQM algorithm using Long Short-Term Memory (LSTM) neural networks to improve the user-perceived video quality. The LSTM forecast the trend of queue delay to allow earlier packet discard in order to avoid the network congestion. The results show that the proposed method outperforms the competing AQM algorithms, mainly in scenarios where there are congested networks.


2021 ◽  
Vol 27 (1) ◽  
pp. 112-129
Author(s):  
Saba Qasim Jabbar ◽  
Dheyaa Jasim Kadhim

A robust video-bitrate adaptive scheme at client-aspect plays a significant role in keeping a good quality of video streaming technology experience. Video quality affects the amount of time the video has turned off playing due to the unfilled buffer state. Therefore to maintain a video streaming continuously with smooth bandwidth fluctuation, a video buffer structure based on adapting the video bitrate is considered in this work. Initially, the video buffer structure is formulated as an optimal control-theoretic problem that combines both video bitrate and video buffer feedback signals. While protecting the video buffer occupancy from exceeding the limited operating level can provide continuous video streaming, it may also cause a video bitrate oscillation. So the video buffer structure is adjusted by adding two thresholds as operating points for overflow and underflow states to filter the impact of throughput fluctuation on video buffer occupancy level. Then a bandwidth prediction algorithm is proposed for enhancing the performance of video bitrate adaptation. This algorithm's work depends on the current video buffer level, video bitrate of the previous segment, and iterative throughput measurements to predict the best video bitrate for the next segment. Simulation results show that reserving a bandwidth margin is better in adapting the video bitrate under bandwidth variation and then reducing the risk of video playback freezing. Simulation results proved that the playback freezing happens two times: firstly, when there is no bandwidth margin used and secondly, when the bandwidth margin is high while smooth video bitrate is obtained with moderate value. The proposed scheme is compared with other two schemes such as smoothed throughput rate (STR) and Buffer Based Rate (BBR) in terms of prediction error, QoE preferences, buffer size, and startup delay time, then the proposed scheme outperforms these schemes in attaining smooth video bitrates and continuous video playback.


Sign in / Sign up

Export Citation Format

Share Document