Spatio-Spectral Feature Fusion for Low-Light Image Enhancement

被引:2
作者
Qiu, Yansheng [1 ]
Chen, Jun [1 ]
Wang, Zheng [1 ]
Wang, Xiao [2 ]
Lin, Chia-Wen [3 ,4 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Natl Engn Res Ctr Multimedia Software, Wuhan 430072, Peoples R China
[2] Wuhan Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430081, Peoples R China
[3] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 300044, Taiwan
[4] Natl Tsing Hua Univ, Inst Commun Engn, Hsinchu 300044, Taiwan
基金
中国国家自然科学基金;
关键词
Frequency-domain analysis; Convolution; Image enhancement; Discrete wavelet transforms; Training; Image color analysis; Feature extraction; Wavelet; low-light enhancement; spatio-spectral fusion;
D O I
10.1109/LSP.2021.3118640
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Low-light image enhancement aims to improve an image's visual quality, which is essential for many downstream computer vision and multimedia tasks. Existing spatial-domain enhancement methods barely focus on the regions containing object boundaries, which take the most informative characteristics. However, solely focusing on enhancing high-frequency details not only causes over-sharpening of an image but also leads to color distortion. In this letter, we propose a novel spatio-spectral feature fusion network (S2F2N), that involves a frequency-feature representation branch (FRB) and a spatial-feature representation branch (SRB) to learn the domain-specific representation individually. Moreover, a spatial-channel mixed attention block (MAB) is introduced to learn the joint representation of spatio-spectral features for final image relighting. Extensive experiments on several benchmark datasets demonstrate that our method can produce high fidelity results for low-light images.
引用
收藏
页码:2157 / 2161
页数:5
相关论文
共 36 条
[1]   Deep Underwater Image Restoration and Beyond [J].
Dudhane, Akshay ;
Hambarde, Praful ;
Patil, Prashant ;
Murala, Subrahmanyam .
IEEE SIGNAL PROCESSING LETTERS, 2020, 27 :675-679
[2]   Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement [J].
Guo, Chunle ;
Li, Chongyi ;
Guo, Jichang ;
Loy, Chen Change ;
Hou, Junhui ;
Kwong, Sam ;
Cong, Runmin .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1777-1786
[3]   Deep Wavelet Prediction for Image Super-resolution [J].
Guo, Tiantong ;
Mousavi, Hojjat Seyed ;
Vu, Tiep Huu ;
Monga, Vishal .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1100-1109
[4]   LIME: Low-Light Image Enhancement via Illumination Map Estimation [J].
Guo, Xiaojie ;
Li, Yu ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (02) :982-993
[5]   Conditional Sequential Modulation for Efficient Global Image Retouching [J].
He, Jingwen ;
Liu, Yihao ;
Qiao, Yu ;
Dong, Chao .
COMPUTER VISION - ECCV 2020, PT XIII, 2020, 12358 :679-695
[6]   Wavelet-SRNet: A Wavelet-based CNN for Multi-scale Face Super Resolution [J].
Huang, Huaibo ;
He, Ran ;
Sun, Zhenan ;
Tan, Tieniu .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1698-1706
[7]   Brightness preserving dynamic histogram equalization for image contrast enhancement [J].
Ibrahim, Haidi ;
Kong, Nicholas Sia Pik .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2007, 53 (04) :1752-1758
[8]   Rain-Free and Residue Hand-in-Hand: A Progressive Coupled Network for Real-Time Image Deraining [J].
Jiang, Kui ;
Wang, Zhongyuan ;
Yi, Peng ;
Chen, Chen ;
Wang, Zheng ;
Wang, Xiao ;
Jiang, Junjun ;
Lin, Chia-Wen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :7404-7418
[9]   Hierarchical dense recursive network for image super-resolution [J].
Jiang, Kui ;
Wang, Zhongyuan ;
Yi, Peng ;
Jiang, Junjun .
PATTERN RECOGNITION, 2020, 107
[10]   ATMFN: Adaptive-Threshold-Based Multi-Model Fusion Network for Compressed Face Hallucination [J].
Jiang, Kui ;
Wang, Zhongyuan ;
Yi, Peng ;
Wang, Guangcheng ;
Gu, Ke ;
Jiang, Junjun .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (10) :2734-2747