Non-uniform motion deblurring with blurry component divided guidance

被引:12
作者
Wang, Pei [1 ,5 ]
Sun, Wei [2 ]
Yan, Qingsen [3 ]
Niu, Axi [1 ,5 ]
Li, Rui [1 ,5 ]
Zhu, Yu [1 ,5 ]
Sun, Jinqiu [4 ,5 ]
Zhang, Yanning [1 ,5 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710072, Peoples R China
[3] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[4] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[5] Natl Engn Lab Integrated Aero Space Ground Ocean, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Non-uiniform deblurring; Component divided; Attention mechanism; INTENSITY; IMAGES;
D O I
10.1016/j.patcog.2021.108082
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Blind image deblurring is a fundamental and challenging computer vision problem, which aims to recover both the blur kernel and the latent sharp image from only a blurry observation. Despite the superiority of deep learning methods in image deblurring have displayed, there still exists a major challenge with various non-uniform motion blur. Previous methods simply take all the image features as the input to the decoder, which handles different degrees (e.g. large blur, small blur) simultaneously, leading to challenges for sharp image generation. To tackle the above problems, we present a deep two-branch network to deal with blurry images via a component divided module, which divides an image into two components based on the representation of blurry degree. Specifically, two component attentive blocks are employed to learn attention maps to exploit useful deblurring feature representations on both large and small blurry regions. Then, the blur-aware features are fed into two-branch reconstruction decoders respectively. In addition, a new feature fusion mechanism, orientation-based feature fusion, is proposed to merge sharp features of the two branches. Both qualitative and quantitative experimental results show that our method performs favorably against the state-of-the-art approaches. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:16
相关论文
共 59 条
  • [1] [Anonymous], 2017, AAAI C ART INT
  • [2] Contour Detection and Hierarchical Image Segmentation
    Arbelaez, Pablo
    Maire, Michael
    Fowlkes, Charless
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) : 898 - 916
  • [3] The 2018 PIRM Challenge on Perceptual Image Super-Resolution
    Blau, Yochai
    Mechrez, Roey
    Timofte, Radu
    Michaeli, Tomer
    Zelnik-Manor, Lihi
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 334 - 355
  • [4] Attention-GAN for Object Transfiguration in Wild Images
    Chen, Xinyuan
    Xu, Chang
    Yang, Xiaokang
    Tao, Dacheng
    [J]. COMPUTER VISION - ECCV 2018, PT II, 2018, 11206 : 167 - 184
  • [5] Deformable Convolutional Networks
    Dai, Jifeng
    Qi, Haozhi
    Xiong, Yuwen
    Li, Yi
    Zhang, Guodong
    Hu, Han
    Wei, Yichen
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 764 - 773
  • [6] Dongwon Park, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12351), P327, DOI 10.1007/978-3-030-58539-6_20
  • [7] Everingham M., 2010, INT J COMPUT VISION, V88, P303, DOI DOI 10.1007/s11263-009-0275-4
  • [8] Removing camera shake from a single photograph
    Fergus, Rob
    Singh, Barun
    Hertzmann, Aaron
    Roweis, Sam T.
    Freeman, William T.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03): : 787 - 794
  • [9] Need for Speed: A Benchmark for Higher Frame Rate Object Tracking
    Galoogahi, Hamed Kiani
    Fagg, Ashton
    Huang, Chen
    Ramanan, Deva
    Lucey, Simon
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1134 - 1143
  • [10] Dynamic Scene Deblurring with Parameter Selective Sharing and Nested Skip Connections
    Gao, Hongyun
    Tao, Xin
    Shen, Xiaoyong
    Jia, Jiaya
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3843 - 3851