Fixed-Lens camera setup and calibrated image registration for multifocus multiview 3D reconstruction

被引:11
作者
Chowdhury, Shah Ariful Hoque [1 ]
Nguyen, Chuong [2 ]
Li, Hengjia [3 ]
Hartley, Richard [1 ]
机构
[1] Australian Natl Univ, Canberra, ACT, Australia
[2] CSIRO Data61, Canberra, ACT, Australia
[3] UCL, London, England
关键词
Fixed-lens multifocus capture; Macroimaging; Multifocus stacking; Multifocus image fusion; Image registration; Perspective image formation; Multiview stereo; 3D reconstruction; Multifocus multiview reconstruction; Image-based 3D reconstruction; Insects; Small objects; Small specimens; GENERATIVE ADVERSARIAL NETWORK; FOCUS IMAGES; FUSION; CONSTRAINTS;
D O I
10.1007/s00521-021-05926-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image-based 3D reconstruction or 3D photogrammetry of small-scale objects including insects and biological specimens is challenging due to the use of a high magnification lens with inherently limited depth of field, and the object's fine structures. Therefore, the traditional 3D reconstruction techniques cannot be applied without additional image preprocessing. One such preprocessing technique is multifocus stacking/fusion that combines a set of partially focused images captured at different distances from the same viewing angle to create a single in-focus image. We found that the image formation is not properly considered by the traditional multifocus image capture and stacking techniques. The resulting in-focus images contain artifacts that violate the perspective projection. A 3D reconstruction using such images often fails to produce accurate 3D models of the captured objects. This paper shows how this problem can be solved effectively by a new multifocus multiview 3D reconstruction procedure which includes a new Fixed-Lens multifocus image capture and a calibrated image registration technique using analytic homography transformation. The experimental results using the real and synthetic images demonstrate the effectiveness of the proposed solutions by showing that both the fixed-lens image capture and multifocus stacking with calibrated image alignment significantly reduce the errors in the camera poses and produce more complete 3D reconstructed models as compared with those by the conventional moving lens image capture and multifocus stacking.
引用
收藏
页码:7421 / 7440
页数:20
相关论文
共 63 条
[51]  
Szeliski, 2010, COMPUT VISION ALGORI
[52]   Image Alignment and Stitching: A Tutorial [J].
Szeliski, Richard .
FOUNDATIONS AND TRENDS IN COMPUTER GRAPHICS AND VISION, 2006, 2 (01) :1-109
[53]   IMAGE FUSION BY A RATIO OF LOW-PASS PYRAMID [J].
TOET, A .
PATTERN RECOGNITION LETTERS, 1989, 9 (04) :245-253
[54]  
Wencheng Wang, 2011, Journal of Computers, V6, P2559, DOI 10.4304/jcp.6.12.2559-2566
[55]   A Deep Model for Multi-Focus Image Fusion Based on Gradients and Connected Regions [J].
Xu, Han ;
Fan, Fan ;
Zhang, Hao ;
Le, Zhuliang ;
Huang, Jun .
IEEE ACCESS, 2020, 8 :26316-26327
[56]   Multifocus Image Fusion and Restoration With Sparse Representation [J].
Yang, Bin ;
Li, Shutao .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2010, 59 (04) :884-892
[57]   Review of pixel-level image fusion [J].
Yang B. ;
Jing Z.-L. ;
Zhao H.-T. .
Journal of Shanghai Jiaotong University (Science), 2010, 15 (1) :6-12
[58]   MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion [J].
Zhang, Hao ;
Le, Zhuliang ;
Shao, Zhenfeng ;
Xu, Han ;
Ma, Jiayi .
INFORMATION FUSION, 2021, 66 :40-53
[59]   Multifocus image fusion using the nonsubsampled contourlet transform [J].
Zhang, Qiang ;
Guo, Bao-long .
SIGNAL PROCESSING, 2009, 89 (07) :1334-1346
[60]  
Zhou Y, 2015, 2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, P976, DOI 10.1109/ICInfA.2015.7279428