Multi-scale representation for image deraining with state space model

被引:0
|
作者
Li, Yufeng [1 ]
Xie, Chuanlong [1 ]
Chen, Hongming [2 ]
机构
[1] Shenyang Aerosp Univ, Coll Elect & Informat Engn, Shenyang 110136, Peoples R China
[2] Dalian Maritime Univ, Coll Informat & Sci Technol, Dalian 116026, Peoples R China
关键词
State space model; Image deraining; Multi-scale Mamba; Multi-scale 2D scanning;
D O I
10.1007/s11760-024-03798-7
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the rapid development of deep learning, significant progress has been made in image deraining techniques, with current methods primarily based on Convolutional Neural Network (CNN) and Transformer architectures. However, these approaches often face limitations due to the fixed receptive fields of CNN and the computational complexity of Transformer. Moreover, most existing image deraining methods adopt a single-input single-output network architecture, which struggles with multi-scale feature representation, particularly in capturing both global and local information, leading to potential information loss. To address these issues, this paper proposes a multi-scale visual state space model for image deraining, aiming to improve deraining performance and image restoration quality by combining multi-scale networks with state space model. Specifically, we design a multi-scale Mamba block that models global features with linear computational complexity, and we develop an efficient multi-scale 2D scanning strategy that uses geometric transformations to apply different numbers of scanning directions at various scales, thereby better extracting feature information at each scale. Additionally, we introduce a Frequency Feature Enhancement Module to capture local feature information, and a Gated Feature Fusion Module to adaptively aggregate complementary features across scales, further enhancing image restoration quality and deraining performance. Experimental results demonstrate that our method achieves superior deraining performance on multiple public benchmark datasets, outperforming the current state-of-the-art methods, while significantly improving efficiency and maintaining low computational cost.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Multi-scale transformer with conditioned prompt for image deraining
    Wu, Xianhao
    Chen, Hongming
    Chen, Xiang
    Xu, Guili
    DIGITAL SIGNAL PROCESSING, 2025, 156
  • [2] Image Deraining Algorithm Based on Multi-Scale Features
    Yang, Jingkai
    Wang, Jingyuan
    Li, Yanbo
    Yao, Bobin
    Xu, Tangwen
    Lu, Ting
    Gao, Xiaoxuan
    Chen, Junshuo
    Liu, Weiyu
    APPLIED SCIENCES-BASEL, 2024, 14 (13):
  • [3] Developing a Data Model for an Omnidirectional Image-Based Multi-Scale Representation of Space
    Claridades, Alexis Richard C.
    Kim, Misun
    Lee, Jiyeong
    19TH 3D GEOINFO CONFERENCE 2024, VOL. 10-4, 2024, : 95 - 102
  • [4] Image deraining using multi-scale aggregated generator network
    Zhang, Yan
    Zhang, Juan
    Wang, Feng
    Guo, Mengyan
    Cai, Lizhi
    Liu, Qiaohong
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (06)
  • [5] Multi-Scale Progressive Fusion Network for Single Image Deraining
    Jiang, Kui
    Wang, Zhongyuan
    Yi, Peng
    Chen, Chen
    Huang, Baojin
    Luo, Yimin
    Ma, Jiayi
    Jiang, Junjun
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 8343 - 8352
  • [6] Multi-Scale Hybrid Fusion Network for Single Image Deraining
    Jiang, Kui
    Wang, Zhongyuan
    Yi, Peng
    Chen, Chen
    Wang, Guangcheng
    Han, Zhen
    Jiang, Junjun
    Xiong, Zixiang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (07) : 3594 - 3608
  • [7] Multi-Scale Fusion and Decomposition Network for Single Image Deraining
    Wang, Qiong
    Jiang, Kui
    Wang, Zheng
    Ren, Wenqi
    Zhang, Jianhui
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 191 - 204
  • [8] Bidirectional Multi-Scale Implicit Neural Representations for Image Deraining
    Chen, Xiang
    Pan, Jinshan
    Dong, Jiangxin
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 25627 - 25636
  • [9] Multi-scale Attentive Residual Network for Single Image Deraining
    Tan, Jing
    Zhang, Yu
    Fu, Huiyuan
    Ma, Huadong
    Gao, Ning
    HUMAN CENTERED COMPUTING, 2019, 11956 : 351 - 362
  • [10] Multi-scale Dilated Convolution Transformer for Single Image Deraining
    Wu, Xianhao
    JiyangLu
    Wu, Jindi
    Li, Yufeng
    2023 IEEE 25TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, MMSP, 2023,