A novel image decomposition-based hybrid technique with super-resolution method for multi-focus image fusion

被引:58
作者
Aymaz, Samet [1 ]
Kose, Cemal [1 ]
机构
[1] Karadeniz Tech Univ, Dept Comp Engn, Trabzon, Turkey
关键词
Multi-focus; Super-resolution; Interpolation; Image fusion; SWT; PCA; SPARSE REPRESENTATION; WAVELET TRANSFORM; ALGORITHM; MULTIWAVELET;
D O I
10.1016/j.inffus.2018.01.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-focus image fusion combines two or more images which have different focus values of the same scene using fusion rules. The meaningful image is named all-in-focus image which is more informative and useful for visual perception. In this paper, a novel approach for multi-focus image fusion is proposed. The method is a hybrid method with super-resolution. Firstly, super-resolution method is applied to all source images to enhance information like contrast. Thus, low-resolution source images are converted to high-resolution source images. Secondly, due to decomposing these source images, Stationary Wavelet Transform (SWT) is implemented and images are divided into four sub-bands. These sub-bands are LL (low-low), LH (low-high), HL (high-low) and HH (high-high). LL is the approximation coefficient of source images and others are the detail coefficients of source images. For all these sub-bands, Principal Component Analysis (PCA) is implemented and maximum eigenvector of each sub-band of source images is selected separately to fuse images. Then, Inverse Stationary Wavelet Transform (ISWT) is used to reconstruct the fused sub-bands. Finally, to measure quality of the proposed method objectively, fused image is resized to original source images size using interpolation based resizing method. To measure the success of method, different metrics without reference image and with reference image, are selected. Results show that the proposed method produce clear edges, good visual perception, good clarity and very few distortion. The proposed hybrid method is applied to produce better quality fused images. Results prove success of the approach in this area. Also visual and quantitative results are very impressive.
引用
收藏
页码:113 / 127
页数:15
相关论文
共 35 条
[1]   Image Super Resolution Based on Interpolation of Wavelet Domain High Frequency Subbands and the Spatial Domain Input Image [J].
Anbarjafari, Gholamreza ;
Demirel, Hasan .
ETRI JOURNAL, 2010, 32 (03) :390-394
[2]  
Anish A., 2012, International Journal of Advanced Research in Computer Engineering Technology (IJARCET), V1, P319
[3]  
Baohua Z., 2016, SIGNAL PROCESS, V58, P50
[4]  
Brahmbhatt KN., 2013, Int. J. Adv. Res. Eng. Technol, V4, P161
[5]   Multifocus Image Fusion Based on Multiwavelet and DFB [J].
Chen, Changhong ;
Geng, Peng ;
Lu, Kai .
IAEDS15: INTERNATIONAL CONFERENCE IN APPLIED ENGINEERING AND MANAGEMENT, 2015, 46 :277-282
[6]  
Deshmukh C., 2016, INT J SCI ENG RES, V7, P474
[7]   The optimal algorithm for Multi-source RS image fusion [J].
Fu, Wei ;
Huang, Shui-guang ;
Li, Zeng-shun ;
Shen, Hao ;
Li, Jun-shuai ;
Wang, Peng-yuan .
METHODSX, 2016, 3 :87-101
[8]  
Han Z., 2013, INT ARCH PHOTOGRAMME
[9]   A novel multi-focus image fusion algorithm based on random walks [J].
Hua, Kai-Lung ;
Wang, Hong-Cyuan ;
Rusdi, Aulia Hakim ;
Jiang, Shin-Yi .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (05) :951-962
[10]   A Review of Quality Metrics for Fused Image [J].
Jagalingam, P. ;
Hegde, Arkal Vittal .
INTERNATIONAL CONFERENCE ON WATER RESOURCES, COASTAL AND OCEAN ENGINEERING (ICWRCOE'15), 2015, 4 :133-142