An improved image enhancement framework based on multiple attention mechanism

被引:22
作者
Chen, Qili [1 ]
Fan, Junfang [1 ,2 ]
Chen, Wenbai [1 ]
机构
[1] Beijing Informat Sci & Technol Univ, 12 Xiaoyingdonglu, Beijing 100192, Peoples R China
[2] Beijing Key Lab High Dynam Nav Technol, 12 Xiaoyingdonglu, Beijing 100192, Peoples R China
基金
中国国家自然科学基金;
关键词
Image enhancement; Multiple Attention mechanism; Full convolution neural network; QUALITY ASSESSMENT;
D O I
10.1016/j.displa.2021.102091
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Image enhancement can accentuate image feature and is necessary process in image processing. This work focuses on fusing multi-exposure image sequences low-light image enhancement. Inspired by the classical non local means in computer vision, we proposed an improved deep neural network framework with attentions for image enhancement. Firstly, the original image was preprocessed in different dimensions. we get the edge images using an edge extracted algorithm and fusion multi exposed images to get an better initial images based on fully convolutional neural network with position and channel attention mechanism. Secondly, the head network is constructed by fully convolutional neural network. For capturing long-range dependencies between features maps, we designed a non-local attention module for head network to get better enhancement image. Finally, emerging the original images, edge image and fusion image as the input of the head network, it can enhance the images to get high-quality images. Experiments show that our framework proposed in this paper is effective and the attention mechanism play a significant hole in the network.
引用
收藏
页数:6
相关论文
共 44 条
[1]  
[Anonymous], 2014, APPL 2 LEVEL ATTENTI
[2]   Learning a Deep Single Image Contrast Enhancer from Multi-Exposure Images [J].
Cai, Jianrui ;
Gu, Shuhang ;
Zhang, Lei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) :2049-2062
[4]  
Chen C., 2018, 2018 IEEE CVF C COMP
[5]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[6]   Ensemble Meta-Learning for Few-Shot Soot Density Recognition [J].
Gu, Ke ;
Zhang, Yonghui ;
Qiao, Junfei .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) :2261-2270
[7]   Learning a Unified Blind Image Quality Metric via On-Line and Off-Line Big Training Instances [J].
Gu, Ke ;
Xu, Xin ;
Qiao, Junfei ;
Jiang, Qiuping ;
Lin, Weisi ;
Thalmann, Daniel .
IEEE TRANSACTIONS ON BIG DATA, 2020, 6 (04) :780-791
[8]   Stacked Selective Ensemble for PM2.5 Forecast [J].
Gu, Ke ;
Xia, Zhifang ;
Qiao, Junfei .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (03) :660-671
[9]   Deep Dual-Channel Neural Network for Image-Based Smoke Detection [J].
Gu, Ke ;
Xia, Zhifang ;
Qiao, Junfei ;
Lin, Weisi .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (02) :311-323
[10]   No-Reference Quality Assessment of Screen Content Pictures [J].
Gu, Ke ;
Zhou, Jun ;
Qiao, Jun-Fei ;
Zhai, Guangtao ;
Lin, Weisi ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (08) :4005-4018