Fractional differential and variational method for image fusion and super-resolution

被引:53
作者
Li, Huafeng [1 ,2 ]
Yu, Zhengtao [1 ]
Mao, Cunli [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Yunnan, Peoples R China
[2] Chongqing Univ, Coll Automat, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Image fusion; Fractional differential; Fractional total variation; Image super-resolution; Edge enhancement; CONTOURLET TRANSFORM; PERFORMANCE; REGULARIZATION; CURVELET;
D O I
10.1016/j.neucom.2015.06.035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper introduces a novel fractional differential and variational model that includes the terms of fusion and super-resolution, edge enhancement and noise suppression. In image fusion and super-resolution term, the structure tensor is employed to describe the geometry of all the input images. According to the fact that the fused image and the source inputs should have the same or similar structure tensor, the energy functional of the image fusion and super-resolution is established combining with the down-sampling operator. For edge enhancement, the bidirectional diffusion term is incorporated into the image fusion and super-resolution model to enhance the visualization of the fused image. In the noise suppression term, a new variational model is developed based on the fractional differential and fractional total variation. Thanks to the above three terms, the proposed model can realize the image fusion, super-resolution, and the edge information enhancement simultaneously. To search for the optimal solution, a gradient descent iteration scheme derived from the Euler-Lagrange equation of the proposed model is employed. The numerical results indicate that the proposed method is feasible and effective. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:138 / 148
页数:11
相关论文
共 36 条
[1]   Variational Bayesian Super Resolution [J].
Babacan, S. Derin ;
Molina, Rafael ;
Katsaggelos, Aggelos K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (04) :984-999
[2]   Fractional-order anisotropic diffusion for image denoising [J].
Bai, Jian ;
Feng, Xiang-Chu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (10) :2492-2502
[3]   On multisensor image fusion performance limits from an estimation theory perspective [J].
Blum, Rick S. .
INFORMATION FUSION, 2006, 7 (03) :250-263
[4]   Fast discrete curvelet transforms [J].
Candes, Emmanuel ;
Demanet, Laurent ;
Donoho, David ;
Ying, Lexing .
MULTISCALE MODELING & SIMULATION, 2006, 5 (03) :861-899
[5]   The nonsubsampled contourlet transform: Theory, design, and applications [J].
da Cunha, Arthur L. ;
Zhou, Jianping ;
Do, Minh N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (10) :3089-3101
[6]   The contourlet transform: An efficient directional multiresolution image representation [J].
Do, MN ;
Vetterli, M .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2005, 14 (12) :2091-2106
[7]   High quality multi-spectral and panchromatic image fusion technologies based on Curvelet transform [J].
Dong, Limin ;
Yang, Qingxiang ;
Wu, Haiyong ;
Xiao, Huachao ;
Xu, Mingliang .
NEUROCOMPUTING, 2015, 159 :268-274
[8]   A feature-dependent fuzzy bidirectional flow for adaptive image sharpening [J].
Fu, Shujun ;
Ruan, Qiuqi ;
Wang, Wenqia ;
Gao, Fuzheng ;
Cheng, Heng-Da .
NEUROCOMPUTING, 2007, 70 (4-6) :883-895
[9]   Image fusion with morphological component analysis [J].
Jiang, Yong ;
Wang, Minghui .
INFORMATION FUSION, 2014, 18 :107-118
[10]   Improved direction estimation for Di Zenzo's multichannel image gradient operator [J].
Jin, Lianghai ;
Liu, Hong ;
Xu, Xiangyang ;
Song, Enmin .
PATTERN RECOGNITION, 2012, 45 (12) :4300-4311