Revitalizing Convolutional Network for Image Restoration

被引:1
作者
Cui, Yuning [1 ]
Ren, Wenqi [2 ]
Cao, Xiaochun [2 ]
Knoll, Alois [1 ]
机构
[1] Tech Univ Munich, Sch Computat Informat & Technol, D-85748 Munich, Germany
[2] Sun Yat Sen Univ, Sch Cyber Sci & Technol, Shenzhen Campus, Shenzhen 518107, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional neural networks; frequency modulation; image restoration; representation learning; SNOW;
D O I
10.1109/TPAMI.2024.3419007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image restoration aims to reconstruct a high-quality image from its corrupted version, playing essential roles in many scenarios. Recent years have witnessed a paradigm shift in image restoration from convolutional neural networks (CNNs) to Transformer-based models due to their powerful ability to model long-range pixel interactions. In this paper, we explore the potential of CNNs for image restoration and show that the proposed simple convolutional network architecture, termed ConvIR, can perform on par with or better than the Transformer counterparts. By re-examing the characteristics of advanced image restoration algorithms, we discover several key factors leading to the performance improvement of restoration models. This motivates us to develop a novel network for image restoration based on cheap convolution operators. Comprehensive experiments demonstrate that our ConvIR delivers state-of-the-art performance with low computation complexity among 20 benchmark datasets on five representative image restoration tasks, including image dehazing, image motion/defocus deblurring, image deraining, and image desnowing.
引用
收藏
页码:9423 / 9438
页数:16
相关论文
共 105 条
[1]   Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning [J].
Abuolaim, Abdullah ;
Afifi, Mahmoud ;
Brown, Michael S. .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :82-90
[2]   Defocus Deblurring Using Dual-Pixel Data [J].
Abuolaim, Abdullah ;
Brown, Michael S. .
COMPUTER VISION - ECCV 2020, PT X, 2020, 12355 :111-126
[3]   NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1798-1805
[4]  
Ancuti CO, 2019, IEEE IMAGE PROC, P1014, DOI [10.1109/ICIP.2019.8803046, 10.1109/icip.2019.8803046]
[5]   O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images [J].
Ancuti, Codruta O. ;
Ancuti, Cosmin ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :867-875
[6]   I-HAZE: A Dehazing Benchmark with Real Hazy and Haze-Free Indoor Images [J].
Ancuti, Cosmin ;
Ancuti, Codruta O. ;
Timofte, Radu ;
De Vleeschouwer, Christophe .
ADVANCED CONCEPTS FOR INTELLIGENT VISION SYSTEMS, ACIVS 2018, 2018, 11182 :620-631
[7]  
Ancuti C, 2016, IEEE IMAGE PROC, P2256, DOI 10.1109/ICIP.2016.7532760
[8]   Digital image restoration [J].
Banham, MR ;
Katsaggelos, AK .
IEEE SIGNAL PROCESSING MAGAZINE, 1997, 14 (02) :24-41
[9]   DehazeNet: An End-to-End System for Single Image Haze Removal [J].
Cai, Bolun ;
Xu, Xiangmin ;
Jia, Kui ;
Qing, Chunmei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (11) :5187-5198
[10]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383