Towards Video Quality of Experience and Selective Attention: A Subtitle-Based Measurement Study

Author(s):  
Lingyan Zhang ◽  
Qibo Sun ◽  
Shangguang Wang ◽  
Sen Su ◽  
Fangchun Yang
Author(s):  
André F. Marquet ◽  
Jânio M. Monteiro ◽  
Nuno J. Martins ◽  
Mario S. Nunes

In legacy television services, user centric metrics have been used for more than twenty years to evaluate video quality. These subjective assessment metrics are usually obtained using a panel of human evaluators in standard defined methods to measure the impairments caused by a diversity of factors of the Human Visual System (HVS), constituting what is also called Quality of Experience (QoE) metrics. As video services move to IP networks, the supporting distribution platforms and the type of receiving terminals is getting more heterogeneous, when compared with classical video distributions. The flexibility introduced by these new architectures is, at the same time, enabling an increment of the transmitted video quality to higher definitions and is supporting the transmission of video to lower capability terminals, like mobile terminals. In IP Networks, while Quality of Service (QoS) metrics have been consistently used for evaluating the quality of a transmission and provide an objective way to measure the reliability of communication networks for various purposes, QoE metrics are emerging as a solution to address the limitations of conventional QoS measuring when evaluating quality from the service and user point of view. In terms of media, compressed video usually constitutes a very interdependent structure degrading in a non-graceful manner when exposed to Binary Erasure Channels (BEC), like the Internet or wireless networks. Accordingly, not only the type of encoder and its major encoding parameters (e.g. transmission rate, image definition or frame rate) contribute to the quality of a received video, but also QoS parameters are usually a cause for different types of decoding artifacts. As a result of this, several worldwide standard entities have been evaluating new metrics for the subjective assessment of video transmission over IP networks. In this chapter we are especially interested in explaining some of the best practices available to monitor, evaluate and assure good levels of QoE in packet oriented networks for rich media applications like high quality video streaming. For such applications, service requirements are relatively loose or difficult to quantify and therefore specific techniques have to be clearly understood and evaluated. By the mid of the chapter the reader should have understood why even networks with excellent QoS parameters might have QoE issues, as QoE is a systemic approach that does not relate solely to QoS but to the ensemble of components composing the communication system.


2018 ◽  
Vol 2018 ◽  
pp. 1-10 ◽  
Author(s):  
Hongyun Zheng ◽  
Yongxiang Zhao ◽  
Xi Lu ◽  
Rongzhen Cao

Video service has become a killer application for mobile terminals. For providing such services, most of the traffic is carried by the Dynamic Adaptive Streaming over HTTP (DASH) technique. The key to improve video quality perceived by users, i.e., Quality of Experience (QoE), is to effectively characterize it by using measured data. There have been many literatures that studied this issue. Some existing solutions use probe mechanism at client/server, which, however, are not applicable to network operator. Some other solutions, which aimed to predict QoE by deep packet parsing, cannot work properly as more and more video traffic is encrypted. In this paper, we propose a fog-assisted real-time QoE prediction scheme, which can predict the QoE of DASH-supported video streaming using fog nodes. Neither client/server participations nor deep packet parsing at network equipment is needed, which makes this scheme easy to deploy. Experimental results show that this scheme can accurately detect QoE with high accuracy even when the video traffic is encrypted.


2020 ◽  
Vol 10 (5) ◽  
pp. 1793
Author(s):  
Lina Du ◽  
Li Zhuo ◽  
Jiafeng Li ◽  
Jing Zhang ◽  
Xiaoguang Li ◽  
...  

DASH (Dynamic Adaptive Streaming over HTTP (HyperText Transfer Protocol)) as a universal unified multimedia streaming standard selects the appropriate video bitrate to improve the user’s Quality of Experience (QoE) according to network conditions, client status, etc. Considering that the quantitative expression of the user’s QoE is also a difficult point in itself, this paper researched the distortion caused due to video compression, network transmission and other aspects, and then proposes a video QoE metric for dynamic adaptive streaming services. Three-Dimensional Convolutional Neural Networks (3D CNN) and Long Short-Term Memory (LSTM) are used together to extract the deep spatial-temporal features to represent the content characteristics of the video. While accounting for the fluctuation in the quality of a video caused by bitrate switching on the QoE, other factors such as video content characteristics, video quality and video fluency, are combined to form the input feature vector. The ridge regression method is adopted to establish a QoE metric that enables to dynamically describe the relationship between the input feature vector and the value of the Mean Opinion Score (MOS). The experimental results on different datasets demonstrate that the prediction accuracy of the proposed method can achieve superior performance over the state-of-the-art methods, which proves the proposed QoE model can effectively guide the client’s bitrate selection in dynamic adaptive streaming media services.


2019 ◽  
Vol 9 (11) ◽  
pp. 2297
Author(s):  
Kyeongseon Kim ◽  
Dohyun Kwon ◽  
Joongheon Kim ◽  
Aziz Mohaisen

As the demand for over-the-top and online streaming services exponentially increases, many techniques for Quality of Experience (QoE) provisioning have been studied. Users can take actions (e.g., skipping) while streaming a video. Therefore, we should consider the viewing pattern of users rather than the network condition or video quality. In this context, we propose a proactive content-loading algorithm for improving per-user personalized preferences using multinomial softmax classification. Based on experimental results, the proposed algorithm has a personalized per-user content waiting time that is significantly lower than that of competing algorithms.


2016 ◽  
Vol 2016 ◽  
pp. 1-17 ◽  
Author(s):  
Diego José Luis Botia Valderrama ◽  
Natalia Gaviria Gómez

The measurement and evaluation of the QoE (Quality of Experience) have become one of the main focuses in the telecommunications to provide services with the expected quality for their users. However, factors like the network parameters and codification can affect the quality of video, limiting the correlation between the objective and subjective metrics. The above increases the complexity to evaluate the real quality of video perceived by users. In this paper, a model based on artificial neural networks such as BPNNs (Backpropagation Neural Networks) and the RNNs (Random Neural Networks) is applied to evaluate the subjective quality metrics MOS (Mean Opinion Score) and the PSNR (Peak Signal Noise Ratio), SSIM (Structural Similarity Index Metric), VQM (Video Quality Metric), and QIBF (Quality Index Based Frame). The proposed model allows establishing the QoS (Quality of Service) based in the strategyDiffserv. The metrics were analyzed through Pearson’s and Spearman’s correlation coefficients, RMSE (Root Mean Square Error), and outliers rate. Correlation values greater than 90% were obtained for all the evaluated metrics.


2017 ◽  
Vol 26 (11) ◽  
pp. 5217-5231 ◽  
Author(s):  
Christos George Bampis ◽  
Zhi Li ◽  
Anush Krishna Moorthy ◽  
Ioannis Katsavounidis ◽  
Anne Aaron ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document