共 42 条
Multi-Exposure Image Fusion via Multi-Scale and Context-Aware Feature Learning
被引:11
作者:

Liu, Yu
论文数: 0 引用数: 0
h-index: 0
机构:
Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China

Yang, Zhigang
论文数: 0 引用数: 0
h-index: 0
机构:
Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China

Cheng, Juan
论文数: 0 引用数: 0
h-index: 0
机构:
Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China

Chen, Xun
论文数: 0 引用数: 0
h-index: 0
机构:
Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
机构:
[1] Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Peoples R China
[2] Hefei Univ Technol, Anhui Prov Key Lab Measuring Theory & Precis Instr, Hefei 230009, Peoples R China
[3] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Peoples R China
基金:
中国国家自然科学基金;
关键词:
Feature extraction;
Semantics;
Image fusion;
Decoding;
Transforms;
Transformers;
Visualization;
Auto-encoder;
global contextual information;
multi-exposure image fusion;
multi-scale features;
Transformer;
QUALITY ASSESSMENT;
D O I:
10.1109/LSP.2023.3243767
中图分类号:
TM [电工技术];
TN [电子技术、通信技术];
学科分类号:
0808 ;
0809 ;
摘要:
In this letter, a deep learning (DL)-based multi-exposure image fusion (MEF) method via multi-scale and context-aware feature learning is proposed, aiming to overcome the defects of existing traditional and DL-based methods. The proposed network is based on an auto-encoder architecture. First, an encoder that combines the convolutional network and Transformer is designed to extract multi-scale features and capture the global contextual information. Then, a multi-scale feature interaction (MSFI) module is devised to enrich the scale diversity of extracted features using cross-scale fusion and Atrous spatial pyramid pooling (ASPP). Finally, a decoder with a nest connection architecture is introduced to reconstruct the fused image. Experimental results show that the proposed method outperforms several representative traditional and DL-based MEF methods in terms of both visual quality and objective assessment.
引用
收藏
页码:100 / 104
页数:5
相关论文
共 42 条
[31]
Multi-Exposure Decomposition-Fusion Model for High Dynamic Range Image Saliency Detection
[J].
Wang, Xu
;
Sun, Zhenhao
;
Zhang, Qiudan
;
Fang, Yuming
;
Ma, Lin
;
Wang, Shiqi
;
Kwong, Sam
.
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,
2020, 30 (12)
:4409-4420

Wang, Xu
论文数: 0 引用数: 0
h-index: 0
机构:
Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen 518060, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Sun, Zhenhao
论文数: 0 引用数: 0
h-index: 0
机构:
Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
Shenzhen Univ, Guangdong Lab Artificial Intelligence & Digital E, Shenzhen 518060, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Zhang, Qiudan
论文数: 0 引用数: 0
h-index: 0
机构:
City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Fang, Yuming
论文数: 0 引用数: 0
h-index: 0
机构:
Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330013, Jiangxi, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Ma, Lin
论文数: 0 引用数: 0
h-index: 0
机构:
Tencent AI Lab, Shenzhen 518057, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Wang, Shiqi
论文数: 0 引用数: 0
h-index: 0
机构:
City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China

Kwong, Sam
论文数: 0 引用数: 0
h-index: 0
机构:
City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[32]
Image quality assessment: From error visibility to structural similarity
[J].
Wang, Z
;
Bovik, AC
;
Sheikh, HR
;
Simoncelli, EP
.
IEEE TRANSACTIONS ON IMAGE PROCESSING,
2004, 13 (04)
:600-612

Wang, Z
论文数: 0 引用数: 0
h-index: 0
机构: NYU, Howard Hughes Med Inst, Ctr Neural Sci, New York, NY 10012 USA

Bovik, AC
论文数: 0 引用数: 0
h-index: 0
机构: NYU, Howard Hughes Med Inst, Ctr Neural Sci, New York, NY 10012 USA

Sheikh, HR
论文数: 0 引用数: 0
h-index: 0
机构: NYU, Howard Hughes Med Inst, Ctr Neural Sci, New York, NY 10012 USA

Simoncelli, EP
论文数: 0 引用数: 0
h-index: 0
机构: NYU, Howard Hughes Med Inst, Ctr Neural Sci, New York, NY 10012 USA
[33]
Multi-Exposure Image Fusion Techniques: A Comprehensive Review
[J].
Xu, Fang
;
Liu, Jinghong
;
Song, Yueming
;
Sun, Hui
;
Wang, Xuan
.
REMOTE SENSING,
2022, 14 (03)

Xu, Fang
论文数: 0 引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China

Liu, Jinghong
论文数: 0 引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China

Song, Yueming
论文数: 0 引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China

Sun, Hui
论文数: 0 引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China

Wang, Xuan
论文数: 0 引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[34]
U2Fusion: A Unified Unsupervised Image Fusion Network
[J].
Xu, Han
;
Ma, Jiayi
;
Jiang, Junjun
;
Guo, Xiaojie
;
Ling, Haibin
.
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE,
2022, 44 (01)
:502-518

Xu, Han
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China

Ma, Jiayi
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China

Jiang, Junjun
论文数: 0 引用数: 0
h-index: 0
机构:
Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China

Guo, Xiaojie
论文数: 0 引用数: 0
h-index: 0
机构:
Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China

Ling, Haibin
论文数: 0 引用数: 0
h-index: 0
机构:
SUNY Stony Brook, Dept Comp Sci, Stony Brook, NY 11794 USA Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
[35]
MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks
[J].
Xu, Han
;
Ma, Jiayi
;
Zhang, Xiao-Ping
.
IEEE TRANSACTIONS ON IMAGE PROCESSING,
2020, 29
:7203-7216

Xu, Han
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China

Ma, Jiayi
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China

Zhang, Xiao-Ping
论文数: 0 引用数: 0
h-index: 0
机构:
Ryerson Univ, Dept Elect Comp & Biomed Engn, Toronto, ON M5B 2K3, Canada Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
[36]
Multi-Scale Fusion of Two Large-Exposure-Ratio Images
[J].
Yang, Yi
;
Cao, Wei
;
Wu, Shiqian
;
Li, Zhengguo
.
IEEE SIGNAL PROCESSING LETTERS,
2018, 25 (12)
:1885-1889

Yang, Yi
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ Sch & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China Wuhan Univ Sch & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China

Cao, Wei
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ Sch & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China Wuhan Univ Sch & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China

Wu, Shiqian
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ Sci & Technol, Sch Machinery & Automat, Wuhan 430081, Hubei, Peoples R China Wuhan Univ Sch & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China

Li, Zhengguo
论文数: 0 引用数: 0
h-index: 0
机构:
Inst Infocomm Res, Singapore 138632, Singapore Wuhan Univ Sch & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[37]
Multi-Scale Exposure Fusion Based on Multi-Visual Feature Measurement and Detail Enhancement Representation
[J].
Yang, Yong
;
Zhang, Danjie
;
Wan, Weiguo
;
Huang, Shuying
.
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT,
2022, 71

Yang, Yong
论文数: 0 引用数: 0
h-index: 0
机构:
Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China
Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China

Zhang, Danjie
论文数: 0 引用数: 0
h-index: 0
机构:
Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China

Wan, Weiguo
论文数: 0 引用数: 0
h-index: 0
机构:
Jiangxi Univ Finance & Econ, Sch Software & Internet Things Engn, Nanchang 330032, Jiangxi, Peoples R China Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China

Huang, Shuying
论文数: 0 引用数: 0
h-index: 0
机构:
Tiangong Univ, Sch Software, Tianjin 300387, Peoples R China Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China
[38]
GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks
[J].
Yang, Zhiguang
;
Chen, Youping
;
Le, Zhuliang
;
Ma, Yong
.
NEURAL COMPUTING & APPLICATIONS,
2021, 33 (11)
:6133-6145

Yang, Zhiguang
论文数: 0 引用数: 0
h-index: 0
机构:
Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China

Chen, Youping
论文数: 0 引用数: 0
h-index: 0
机构:
Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China

Le, Zhuliang
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China

Ma, Yong
论文数: 0 引用数: 0
h-index: 0
机构:
Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China Huazhong Univ Sci & Technol, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
[39]
Benchmarking and comparing multi-exposure image fusion algorithms
[J].
Zhang, Xingchen
.
INFORMATION FUSION,
2021, 74 (74)
:111-131

Zhang, Xingchen
论文数: 0 引用数: 0
h-index: 0
机构:
Imperial Coll London, Dept Elect & Elect Engn, South Kensington Campus,Exhibit Rd, London SW7 2BT, England Imperial Coll London, Dept Elect & Elect Engn, South Kensington Campus,Exhibit Rd, London SW7 2BT, England
[40]
IFCNN: A general image fusion framework based on convolutional neural network
[J].
Zhang, Yu
;
Liu, Yu
;
Sun, Peng
;
Yan, Han
;
Zhao, Xiaolin
;
Zhang, Li
.
INFORMATION FUSION,
2020, 54
:99-118

Zhang, Yu
论文数: 0 引用数: 0
h-index: 0
机构:
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China

Liu, Yu
论文数: 0 引用数: 0
h-index: 0
机构:
Hefei Univ Technol, Dept Biomed Engn, Hefei 230009, Anhui, Peoples R China Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China

Sun, Peng
论文数: 0 引用数: 0
h-index: 0
机构:
Beijing Aerosp Automat Control Inst, Beijing 100854, Peoples R China Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China

Yan, Han
论文数: 0 引用数: 0
h-index: 0
机构:
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China

Zhao, Xiaolin
论文数: 0 引用数: 0
h-index: 0
机构:
Airforce Engn Univ, Sch Aeronaut & Astronaut Engn, Xian 710038, Shaanxi, Peoples R China Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China

Zhang, Li
论文数: 0 引用数: 0
h-index: 0
机构:
Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China