Fully Connected Network-Based Intra Prediction for Image Coding

被引:153
作者
Li, Jiahao [1 ]
Li, Bin [2 ]
Xu, Jizheng [2 ]
Xiong, Ruiqin [1 ]
Gao, Wen [1 ]
机构
[1] Peking Univ, Sch Elect Engn & Comp Sci, Inst Digital Media, Beijing 100871, Peoples R China
[2] Microsoft Res Asia, Beijing 100080, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
HEVC; image coding; intra prediction; deep learning; fully connected network;
D O I
10.1109/TIP.2018.2817044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a deep learning method for intra prediction. Different from traditional methods utilizing some fixed rules, we propose using a fully connected network to learn an end-to-end mapping from neighboring reconstructed pixels to the current block. In the proposed method, the network is fed by multiple reference lines. Compared with traditional single line-based methods, more contextual information of the current block is utilized. For this reason, the proposed network has the potential to generate better prediction. In addition, the proposed network has good generalization ability on different bitrate settings. The model trained from a specified bitrate setting also works well on other bitrate settings. Experimental results demonstrate the effectiveness of the proposed method. When compared with high efficiency video coding reference software HM-16.9, our network can achieve an average of 3.4% bitrate saving. In particular, the average result of 4K sequences is 4.5% bitrate saving, where the maximum one is 7.4%.
引用
收藏
页码:3236 / 3247
页数:12
相关论文
共 45 条
[1]  
[Anonymous], 2017, LEARNING CONVOLUTION
[2]  
[Anonymous], JCTVCL1003
[3]  
[Anonymous], 2017, CONVOLUTIONAL NEURAL
[4]  
[Anonymous], 2016, IDENTITY MAPPINGS DE
[5]  
[Anonymous], JVETB0045
[6]  
[Anonymous], 1985, ICS8506
[7]  
[Anonymous], 2016, Full resolution image compression with recurrent neural networks
[8]  
[Anonymous], ELECT J DIFFERENTIAL, DOI DOI 10.1109/VCIP.2011.6115979
[9]  
[Anonymous], 26 M GEN SWITZ JAN
[10]  
[Anonymous], 2015, Variable rate image compression with recurrent neural networks