Convolutional analysis operator learning for multifocus image fusion

被引:7
作者
Zhang, Chengfang [1 ,2 ]
Feng, Ziliang [1 ]
机构
[1] Sichuan Univ, Coll Comp Sci, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu 610039, Peoples R China
[2] Sichuan Police Coll, Ctr Lab & Equipment, Luzhou 646000, Peoples R China
关键词
Multifocus image fusion; Analysis-based signal model; Convolution analysis operator learning; BPEG-M; ADMM; CBPDN; ANALYSIS MODEL; PERFORMANCE; INFORMATION; ALGORITHMS; TRANSFORM;
D O I
10.1016/j.image.2022.116632
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Sparse representation (SR), convolutional sparse representation (CSR) and convolutional dictionary learning (CDL) are synthetic-based priors that have proven to be successful in signal inverse problems (such as multifocus image fusion). Unlike "synthesis " formulas, "analysis " model assigns probabilities to signals through various forward measurements of signals. Analysis operator learning (AOL) is a classical analysis-based learning method. Convolutional analysis operator learning (CAOL) is convolutional form of AOL. CAOL uses unsupervised learning method to train autocoded convolutional neural network (CNN) to more accurately solve inverse problem. From the perspective of CAOL, this paper introduces learned convolutional regularizers into multifocus image fusion and proposes CAOL-based multifocus image fusion algorithm. In the CDL stage, convergent block proximal extrapolated gradient method with majorizer (BPEG-M) and adaptive momentum restarting scheme are used. In the sparse fusion stage, alternating direction method of multipliers (ADMM) approach with convolutional basis pursuit denoising (CBPDN) and I-1 norm maximum strategy are employed for high-frequency and low-frequency component, respectively. 3 types of multifocus images (static gray images, gray images in sports and color images) are tested to verify performance of the proposed method. A comparison with representative methods demonstrates superiority of our method in terms of subjective observation and objective evaluation.
引用
收藏
页数:13
相关论文
共 55 条
  • [1] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [2] Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain
    Chai, Yi
    Li, Huafeng
    Zhang, Xiaoyang
    [J]. OPTIK, 2012, 123 (07): : 569 - 581
  • [3] A new automated quality assessment algorithm for image fusion
    Chen, Yin
    Blum, Rick S.
    [J]. IMAGE AND VISION COMPUTING, 2009, 27 (10) : 1421 - 1432
  • [4] Convolutional Analysis Operator Learning: Acceleration and Convergence
    Chun, Il Yong
    Fessler, Jeffrey A.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (01) : 2108 - 2122
  • [5] Chun IY, 2019, IEEE SIGNAL PROC LET, V26, P1137, DOI [10.1109/LSP.2019.2921446, 10.1109/LSR2019.2921446, 10.1109/lsp.2019.2921446]
  • [6] Chun IY, 2018, CONF REC ASILOMAR C, P1631, DOI 10.1109/ACSSC.2018.8645500
  • [7] Convolutional Dictionary Learning: Acceleration and Convergence
    Chun, Il Yong
    Fessler, Jeffrey A.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (04) : 1697 - 1712
  • [8] Image fusion metric based on mutual information and Tsallis entropy
    Cvejic, N.
    Canagarajah, C. N.
    Bull, D. R.
    [J]. ELECTRONICS LETTERS, 2006, 42 (11) : 626 - 627
  • [9] Analysis SimCO Algorithms for Sparse Analysis Model Based Dictionary Learning
    Dong, Jing
    Wang, Wenwu
    Dai, Wei
    Plumbley, Mark D.
    Han, Zi-Fa
    Chambers, Jonathon
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (02) : 417 - 431
  • [10] Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA)
    Elad, M
    Starck, JL
    Querre, P
    Donoho, DL
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2005, 19 (03) : 340 - 358