High-order Adams Network (HIAN) for image dehazing

被引:0
作者
Yin, Shibai [1 ,2 ,3 ]
Hu, Shuhao [1 ]
Wang, Yibin [4 ]
Yang, Yee -Hong [5 ]
机构
[1] Southwestern Univ Finance & Econ, Dept Comp & Artificial Intelligence, Chengdu 611130, Sichuan, Peoples R China
[2] Kash Inst Elect & Informat Ind, Kashgar 844000, Xinjiang, Peoples R China
[3] Southwestern Univ Finance & Econ, Complex Lab New Finance & Econ, Chengdu 611130, Sichuan, Peoples R China
[4] Sichuan Normal Univ, Dept Engn, Chengdu 610066, Sichuan, Peoples R China
[5] Univ Alberta, Dept Comp Sci, Edmonton, AB T6G 2E8, Canada
基金
中国国家自然科学基金; 加拿大自然科学与工程研究理事会;
关键词
Implicit Adams Predictor-Corrector; Non-Local Sparse Attention; Neural Architecture Search; Dehazing;
D O I
10.1016/j.asoc.2023.110204
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional Neural Networks (CNN) are widely used in image dehazing. However, existing network frameworks are built based on manual design from practical experience, lacking interpretable result or theoretical guidelines. Recently, residual networks are regarded as the explicit Euler forward approximation of the ODE (Ordinary Differential Equation), and several ODE-inspired networks are proposed based on the low-order explicit Euler schemes. However, on the issues of system stability and training convergence, high-order Implicit Adams Predictor-Corrector (IAPC) methods have proven to be better than low-order explicit Euler methods. Hence, we extend the IAPC method to the High-order Implicit Adams Network (HIAN). To do so, we design a series of Implicit Adams Predictor-Corrector Blocks (IABs) based on the high-order IAPC methods, all of which give better stability and accuracy than the ones designed using the low-order Euler methods. Given that, we further propose the Implicit Adams Predictor-Corrector Module (IAM) by combining the Non-local Sparse Attention (NSA) and Attention Feature Fusion (AFF) with stacked IABs where the NSA explores the mutual-correlation among intermediate features with low computation cost via a sparse constraint, while the AFF fuses intermediate features by reweighting the features from stacked IABs adaptively. Moreover, because manual network design with IABs limits dehazing performance, the Neural Architecture Search (NAS) is used to find an optimal architecture automatically. This resulting design not only is interpretable for image dehazing but also provides a reliable guideline on future network designs. The experiments demonstrate that the proposed method outperforms most existing methods on both synthetic and real images.(c) 2023 Elsevier B.V. All rights reserved.
引用
收藏
页数:14
相关论文
共 44 条
[1]  
Andoni A, 2015, ADV NEUR IN, V28
[2]  
Barnsley M.F., 1993, FRACTALS EVERYWHERE, Vsecond, P412
[3]   Non-Local Image Dehazing [J].
Berman, Dana ;
Treibitz, Tali ;
Avidan, Shai .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1674-1682
[4]   EMONAS-Net: Efficient multiobjective neural architecture search using surrogate-assisted evolutionary algorithm for 3D medical image segmentation [J].
Calisto, Maria Baldeon ;
Lai-Yuen, Susana K. .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2021, 119
[5]  
Chang B., 2017, ARXIV
[6]   Gated Context Aggregation Network for Image Dehazing and Deraining [J].
Chen, Dongdong ;
He, Mingming ;
Fan, Qingnan ;
Liao, Jing ;
Zhang, Liheng ;
Hou, Dongdong ;
Yuan, Lu ;
Hua, Gang .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1375-1383
[7]  
Dong Y, 2020, AAAI CONF ARTIF INTE, V34, P10729
[8]   New Step Size Control Algorithm for Semi-Implicit Composition ODE Solvers [J].
Fedoseev, Petr ;
Pesterev, Dmitriy ;
Karimov, Artur ;
Butusov, Denis .
ALGORITHMS, 2022, 15 (08)
[9]   URNet: A U-Net based residual network for image dehazing [J].
Feng, Ting ;
Wang, Chuansheng ;
Chen, Xinwei ;
Fan, Haoyi ;
Zeng, Kun ;
Li, Zuoyong .
APPLIED SOFT COMPUTING, 2021, 102
[10]   Image dehazing by artificial multiple-exposure image fusion [J].
Galdran, A. .
SIGNAL PROCESSING, 2018, 149 :135-147