Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [41] Tree Species Classification in UAV Remote Sensing Images Based on Super-Resolution Reconstruction and Deep Learning
    Huang, Yingkang
    Wen, Xiaorong
    Gao, Yuanyun
    Zhang, Yanli
    Lin, Guozhong
    REMOTE SENSING, 2023, 15 (11)
  • [42] Misalignment-Resistant Deep Unfolding Network for multi-modal MRI super-resolution and reconstruction
    Wei, Jinbao
    Yang, Gang
    Wang, Zhijie
    Liu, Yu
    Liu, Aiping
    Chen, Xun
    KNOWLEDGE-BASED SYSTEMS, 2024, 296
  • [43] CVGSR: Stereo image Super-Resolution with Cross-View guidance *
    Chen, Wenfei
    Ni, Shijia
    Shao, Feng
    DISPLAYS, 2024, 83
  • [44] Synthetic aperture imaging using multi-view super-resolution
    Zhang, Jiaqing
    Pei, Zhao
    Jin, Min
    Zhang, Wenwen
    Li, Jun
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (03)
  • [45] Structured image super-resolution network based on improved Transformer
    Lv X.-D.
    Li J.
    Deng Z.-N.
    Feng H.
    Cui X.-T.
    Deng H.-X.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2023, 57 (05): : 865 - 874+910
  • [46] HYBRID TRANSFORMER ARCHITECTURE FOR SPECTRAL SUPER-RESOLUTION RECONSTRUCTION OF MULTISPECTRAL IMAGES
    Zhao, Genping
    He, Yudan
    Wang, Zhuowei
    Wu, Heng
    2024 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2024), 2024, : 9468 - 9471
  • [47] LOW REDUNDANT ATTENTION NETWORK FOR EFFICIENT IMAGE SUPER-RESOLUTION
    Liu, Yican
    Li, Jiacheng
    Zeng, Delu
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 2950 - 2954
  • [48] GLOBAL-LOCAL AWARENESS NETWORK FOR IMAGE SUPER-RESOLUTION
    Pan, Pin-Chi
    Hsu, Tzu-Hao
    Wei, Wen-Li
    Lin, Jen-Chun
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1150 - 1154
  • [49] Light Field Super-Resolution Using a Low-Rank Prior and Deep Convolutional Neural Networks
    Farrugia, Reuben A.
    Guillemot, Christine
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (05) : 1162 - 1175
  • [50] Lightweight Image Super-Resolution Reconstruction Method Based on Multi-scale Spatial Adaptive Attention Network
    Huang, Feng
    Liu, Hongwei
    Shen, Ying
    Qiu, Zhaobing
    Chen, Liqiong
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2025, 38 (01): : 36 - 50