An EEG-Based Study on Perception of Video Distortion Under Various Content Motion Conditions

被引:21
作者
Liu, Xiwen [1 ,2 ]
Tao, Xiaoming [3 ]
Xu, Mai [4 ]
Zhan, Yafeng [1 ,2 ]
Lu, Jianhua [1 ,2 ]
机构
[1] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Space Ctr, Beijing 100084, Peoples R China
[3] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[4] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
Distortion; Electroencephalography; Quality assessment; Distortion measurement; Sensitivity; Visualization; Cognitive processes; perceptibility threshold; EEG; P300; LDA classifier; AUC;
D O I
10.1109/TMM.2019.2934425
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human perception sensitivity to video distortion is vital for visual quality assessment (VQA). Different from the perception mechanism of image distortion that has been thoroughly studied, the perception of video distortion is inevitably influenced by motion of dynamic content due to the characteristics of the human visual system (HVS). In this paper, electroencephalography (EEG) is used as a novel psychophysiological method to study the human perception sensitivity to quantification-aroused video distortion under various content motion conditions. For this purpose, we conduct experiments to record the EEG signals of the subjects when they are watching distorted videos. According to the feature analysis of EEG data, the P300 component aroused by human perception of video quality change is selected as the indicator of human perception of distortion. By the means of classification based on linear discriminant analysis (LDA), it is found that the separability of the P300 component, which is measured by the area under curve (AUC) of the receiver operating characteristic (ROC), is positively correlated with the perceptibility of distortion. The correlation provides a valid psychophysiological method, which is exempt from being influenced by subjective bias due to human high-level cognitive activities, for evaluating distortion perceptibility. In addition, the regression analysis results demonstrate a sigmoid-typed quantitative relation between the perceptibility of distortion and separability of the P300 component. Based on such relation, the perceptibility thresholds of distortion corresponding to various content motion speeds are calibrated by EEG signals and it is found that the content motion speed has a significant impact on distortion perceptibility.
引用
收藏
页码:949 / 960
页数:12
相关论文
共 50 条
[1]  
Chou C.-H., Li Y.-C., A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile, IEEE Trans. Circuits Syst. Video Technol., 5, 6, pp. 467-476, (1995)
[2]  
Hontsch I., Karam L.J., Adaptive image coding with perceptual distortion control, IEEE Trans. Image Process., 11, 3, pp. 213-222, (2002)
[3]  
Roodaki H., Iravani Z., Hashemi M.R., Shirmohammadi S., A view-level rate distortion model for multi-view/3d video, IEEE Trans. Multimedia, 18, 1, pp. 14-24, (2016)
[4]  
Ki S., Bae S.H., Kim M., Ko H., Learning-based just-noticeablequantization-distortion modeling for perceptual video coding, IEEE Trans. Image Process., 27, 7, pp. 3178-3193, (2018)
[5]  
Narwaria M., Krasula L., Callet P.L., Data analysis in multimedia quality assessment: Revisiting the statistical tests, IEEE Trans. Multimedia, 20, 8, pp. 2063-2072, (2018)
[6]  
Bosse S., Et al., Assessing perceived image quality using steady-state visual evoked potentials and spatio-spectral decomposition, IEEE Trans. Circuits Syst. Video Technol., 28, 8, pp. 1694-1706, (2018)
[7]  
Scholler S., Et al., Toward a direct measure of video quality perception using EEG, IEEE Trans. Image Process., 21, 5, pp. 2619-2629, (2012)
[8]  
Engelke U., Et al., Psychophysiology-based QoE assessment: A survey, IEEE J. Sel. Topics Signal Process., 11, 1, pp. 6-21, (2017)
[9]  
Chen X., Chen X., Ward R.K., Wang Z.J., A joint multimodal group analysis framework for modeling corticomuscular activity, IEEE Trans. Multimedia, 15, 5, pp. 1049-1059, (2013)
[10]  
Dahne S., Et al., Integration of multivariate data streams with bandpower signals, IEEE Trans. Multimedia, 15, 5, pp. 1001-1013, (2013)