Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [31] Cross-contrast mutual fusion network for joint MRI reconstruction and super-resolution
    Ding, Yue
    Zhou, Tao
    Xiang, Lei
    Wu, Ye
    PATTERN RECOGNITION, 2024, 154
  • [32] Dual residual and large receptive field network for lightweight image super-resolution
    Pan, Lulu
    Li, Guo
    Xu, Ke
    Lv, Yanheng
    Zhang, Wenbo
    Li, Lingxiao
    Lei, Le
    NEUROCOMPUTING, 2024, 600
  • [33] Strong-Weak Cross-View Interaction Network for Stereo Image Super-Resolution
    He, Kun
    Li, Changyu
    Shao, Jie
    PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 550 - 554
  • [34] Deep Light Field Super-Resolution Using Frequency Domain Analysis and Semantic Prior
    Chen, Yeyao
    Jiang, Gangyi
    Jiang, Zhidi
    Yu, Mei
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3722 - 3737
  • [35] LIGHT FIELD SUPER-RESOLUTION VIA LFBM5D SPARSE CODING
    Alain, Martin
    Smolic, Aljosa
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2501 - 2505
  • [36] Joint MR image reconstruction and super-resolution via mutual co-attention network
    Chen, Jiacheng
    Wu, Fei
    Wang, Wanliang
    JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2024, 11 (01) : 288 - 304
  • [37] Brain MRI Image Super-Resolution Reconstruction: A Systematic Review
    Muhammad, Abdulhamid
    Aramvith, Supavadee
    Duangchaemkarn, Khanita
    Sun, Ming-Ting
    IEEE ACCESS, 2024, 12 : 156347 - 156362
  • [38] Deform-Mamba Network for MRI Super-Resolution
    Ji, Zexin
    Zou, Beiji
    Kui, Xiaoyan
    Vera, Pierre
    Ruan, Su
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VII, 2024, 15007 : 242 - 252
  • [39] Super-Resolution Reconstruction for Stereoscopic Omnidirectional Display Systems via Dynamic Convolutions and Cross-View Transformer
    Chai, Xiongli
    Shao, Feng
    Chen, Hangwei
    Mu, Baoyang
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [40] Beyond Subspace Isolation: Many-to-Many Transformer for Light Field Image Super-Resolution
    Hu, Zeke Zexi
    Chen, Xiaoming
    Chung, Vera Yuk Ying
    Shen, Yiran
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1334 - 1348