Contourlet Residual for Prompt Learning Enhanced Infrared Image Super-Resolution

被引:1
作者
Li, Xingyuan [1 ]
Liu, Jinyuan [1 ]
Chen, Zhixin [2 ]
Zou, Yang [3 ]
Ma, Long [1 ]
Fan, Xin [1 ]
Liu, Risheng [1 ]
机构
[1] Dalian Univ Technol, Sch Software Technol, Dalian, Peoples R China
[2] Waseda Univ, Grad Sch Informat Prod & Syst, Shinjuku Ku, Tokyo, Japan
[3] Univ Sydney, Sch Comp Sci, Sydney, NSW, Australia
来源
COMPUTER VISION - ECCV 2024, PT III | 2025年 / 15061卷
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Infrared Image Super-Resolution; Contourlet Residual; Prompt Learning; EFFICIENT; NETWORKS; FUSION;
D O I
10.1007/978-3-031-72646-0_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image super-resolution (SR) is a critical technique for enhancing image quality, playing a vital role in image enhancement. While recent advancements, notably transformer-based methods, have advanced the field, infrared image SR remains a formidable challenge. Due to the inherent characteristics of infrared sensors, such as limited resolution, temperature sensitivity, high noise levels, and environmental impacts, existing deep learning methods result in suboptimal enhancement outcomes when applied to infrared images. To address these challenges, we propose a specialized Contourlet residual framework tailored for infrared images to restore and enhance the critical details from the multi-scale and multi-directional infrared spectra decomposition. It precisely captures and amplifies the high-pass subbands of infrared images, such as edge details and texture nuances, which are vital for achieving superior reconstruction quality. Moreover, recognizing the limitations of traditional learning techniques in capturing the inherent characteristics of infrared images, we incorporate a prompt-based learning paradigm. This approach facilitates a more nuanced understanding and targeted optimization process for infrared images by leveraging the semantic comprehension offered by the visual language model. Our approach not only addresses the common pitfalls associated with infrared imaging but also sets a new paradigm for infrared image SR. Extensive experiments demonstrate that our approach obtains superior results, attaining state-of-the-art performance. Project page: https://github.com/hey-it-s-me/CoRPLE.
引用
收藏
页码:270 / 288
页数:19
相关论文
共 55 条
  • [1] InstructPix2Pix: Learning to Follow Image Editing Instructions
    Brooks, Tim
    Holynski, Aleksander
    Efros, Alexei A.
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18392 - 18402
  • [2] Cao J., 2021, arXiv, DOI arXiv:2106.06847
  • [3] Pre-Trained Image Processing Transformer
    Chen, Hanting
    Wang, Yunhe
    Guo, Tianyu
    Xu, Chang
    Deng, Yiping
    Liu, Zhenhua
    Ma, Siwei
    Xu, Chunjing
    Xu, Chao
    Gao, Wen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12294 - 12305
  • [4] Activating More Pixels in Image Super-Resolution Transformer
    Chen, Xiangyu
    Wang, Xintao
    Zhou, Jiantao
    Qiao, Yu
    Dong, Chao
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 22367 - 22377
  • [5] Dual Aggregation Transformer for Image Super-Resolution
    Chen, Zheng
    Zhang, Yulun
    Gu, Jinjin
    Kong, Linghe
    Yang, Xiaokang
    Yu, Fisher
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12278 - 12287
  • [6] Chen Z, 2023, Arxiv, DOI arXiv:2211.13654
  • [7] Chen Z, 2024, Arxiv, DOI arXiv:2303.06373
  • [8] The contourlet transform: An efficient directional multiresolution image representation
    Do, MN
    Vetterli, M
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (12) : 2091 - 2106
  • [9] Accelerating the Super-Resolution Convolutional Neural Network
    Dong, Chao
    Loy, Chen Change
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 : 391 - 407
  • [10] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307