3D shape reconstruction from multifocus image fusion using a multidirectional modified Laplacian operator

被引:33
作者
Yan, Tao [1 ,2 ]
Hu, Zhiguo [1 ,2 ]
Qian, Yuhua [2 ]
Qiao, Zhiwei [1 ,2 ]
Zhang, Linyuan [3 ]
机构
[1] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Shanxi, Peoples R China
[2] Shanxi Univ, Inst Big Data Sci & Ind, Taiyuan 030006, Shanxi, Peoples R China
[3] Beijing Zhongchao Banknote Designing & Platemakin, Beijing 100070, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
3D shape reconstruction; Image fusion; Shape-from-focus; Microscopic imaging; Nonsubsampled shearlet transform; FOCUS; TRANSFORM; RECOVERY;
D O I
10.1016/j.patcog.2019.107065
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multifocus image fusion techniques primarily emphasize human vision and machine perception to evaluate an image, which often ignore depth information contained in the focus regions. In this paper, a novel 3D shape reconstruction algorithm based on nonsubsampled shearlet transform (NSST) microscopic multifocus image fusion method is proposed to mine 3D depth information from the fusion process. The shift-invariant property of NSST guarantees the spatial corresponding relationship between the image sequence and its high-frequency subbands. Since the high-frequency components of an image represent the focus level of the image, a new multidirectional modified Laplacian (MDML) as the focus measure maps the high-frequency subbands to images of various levels of depth. Next, the initial 3D reconstruction result is obtained by using an optimal level selection strategy based on the summation of the multiscale Laplace responses to exploit these depth maps. Finally, an iterative edge repair method is implemented to refine the reconstruction result. The experimental results show that the proposed method has better performance, especially when the source images have low-contrast regions. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 44 条
  • [1] An Y., 2008, INT C FUT GEN COMM N, V1, P517
  • [2] [Anonymous], 2013, SIGNAL IMAGE VIDEO P, DOI DOI 10.1007/S11760-012-0361-X
  • [3] Averbuch A., 2001, SIAM J SCI COMPUT, P1
  • [4] Automatic Semantic Modeling of Indoor Scenes from Low-quality RGB-D Data using Contextual Information
    Chen, Kang
    Lai, Yu-Kun
    Wu, Yu-Xin
    Martin, Ralph
    Hu, Shi-Min
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2014, 33 (06):
  • [5] The nonsubsampled contourlet transform: Theory, design, and applications
    da Cunha, Arthur L.
    Zhou, Jianping
    Do, Minh N.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (10) : 3089 - 3101
  • [6] Sparse directional image representations using the discrete shearlet transform
    Easley, Glenn
    Labate, Demetrio
    Lim, Wang-Q
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2008, 25 (01) : 25 - 46
  • [7] Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks
    Ge, Liuhao
    Liang, Hui
    Yuan, Junsong
    Thalmann, Daniel
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (04) : 956 - 970
  • [8] 3D modeling of multiple-object scenes from sets of images
    Grum, Matthew
    Bors, Adrian G.
    [J]. PATTERN RECOGNITION, 2014, 47 (01) : 326 - 343
  • [9] Multi-view ensemble manifold regularization for 3D object recognition
    Hong, Chaoqun
    Yu, Jun
    You, Jane
    Chen, Xuhui
    Tao, Dapeng
    [J]. INFORMATION SCIENCES, 2015, 320 : 395 - 405
  • [10] Sparse transfer for facial shape-from-shading
    Hu, Jian-Fang
    Zheng, Wei-Shi
    Xie, Xiaohua
    Lai, Jianhuang
    [J]. PATTERN RECOGNITION, 2017, 68 : 272 - 285