LIGHT FIELD IMAGE COMPRESSION BASED ON DEEP LEARNING

被引:0
作者
Zhao, Zhenghui [1 ]
Wang, Shanshe [2 ]
Jia, Chuanmin [2 ]
Zhang, Xinfeng [3 ]
Ma, Siwei [2 ]
Yang, Jiansheng [1 ,4 ]
机构
[1] Peking Univ, Sch Math Sci, LMAM, Beijing 100871, Peoples R China
[2] Peking Univ, Sch EE&CS, Inst Digital Media, Beijing 100871, Peoples R China
[3] Univ Southern Calif, Viterbi Sch Engn, Los Angeles, CA USA
[4] Capital Normal Univ, Beijing Adv Innovat Ctr Imaging Technol, Beijing 100048, Peoples R China
来源
2018 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME) | 2018年
基金
中国国家自然科学基金;
关键词
Light field; image coding; view reconstruction; deep learning;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we propose a novel light field image compression scheme by exploiting the intrinsic similarity of light field images with deep learning. In particular, instead of conveying all LF sub-views, only sparsely sampled LF sub-views are compressed and the remaining sub-views are reconstructed from the coded sub-views in the neighbourhood with convolutional neural network (CNN). To jointly suppress the artifacts induced in compression and reconstruct the un-coded views with high geometric accuracy, a multi-view joint enhancement network is introduced to improve the coding performance. Extensive experiments show the superior compression performance of our scheme compared with the state-of-the-art methods.
引用
收藏
页数:6
相关论文
共 20 条
[1]  
[Anonymous], JPEG PLENO CALL PROP
[2]   Light Field Compression With Disparity-Guided Sparse Coding Based on Structural Key Views [J].
Chen, Jie ;
Hou, Junhui ;
Chau, Lap-Pui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :314-324
[3]   Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras [J].
Dansereau, Donald G. ;
Pizarro, Oscar ;
Williams, Stefan B. .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1027-1034
[4]   JPEG Pleno: Toward an Efficient Representation of Visual Reality [J].
Ebrahimi, Touradj ;
Foessel, Siegfried ;
Pereira, Fernando ;
Schelkens, Peter .
IEEE MULTIMEDIA, 2016, 23 (04) :14-20
[5]  
Glorot X., 2011, P 14 INT C ART INT S, P315, DOI DOI 10.1002/ECS2.1832
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]  
Jia CM, 2017, 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP)
[8]   Learning-Based View Synthesis for Light Field Cameras [J].
Kalantari, Nima Khademi ;
Wang, Ting-Chun ;
Ramamoorthi, Ravi .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)
[9]   Accurate Image Super-Resolution Using Very Deep Convolutional Networks [J].
Kim, Jiwon ;
Lee, Jung Kwon ;
Lee, Kyoung Mu .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1646-1654
[10]  
King DB, 2015, ACS SYM SER, V1214, P1