Fixed-Lens camera setup and calibrated image registration for multifocus multiview 3D reconstruction

被引:11
作者
Chowdhury, Shah Ariful Hoque [1 ]
Nguyen, Chuong [2 ]
Li, Hengjia [3 ]
Hartley, Richard [1 ]
机构
[1] Australian Natl Univ, Canberra, ACT, Australia
[2] CSIRO Data61, Canberra, ACT, Australia
[3] UCL, London, England
关键词
Fixed-lens multifocus capture; Macroimaging; Multifocus stacking; Multifocus image fusion; Image registration; Perspective image formation; Multiview stereo; 3D reconstruction; Multifocus multiview reconstruction; Image-based 3D reconstruction; Insects; Small objects; Small specimens; GENERATIVE ADVERSARIAL NETWORK; FOCUS IMAGES; FUSION; CONSTRAINTS;
D O I
10.1007/s00521-021-05926-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image-based 3D reconstruction or 3D photogrammetry of small-scale objects including insects and biological specimens is challenging due to the use of a high magnification lens with inherently limited depth of field, and the object's fine structures. Therefore, the traditional 3D reconstruction techniques cannot be applied without additional image preprocessing. One such preprocessing technique is multifocus stacking/fusion that combines a set of partially focused images captured at different distances from the same viewing angle to create a single in-focus image. We found that the image formation is not properly considered by the traditional multifocus image capture and stacking techniques. The resulting in-focus images contain artifacts that violate the perspective projection. A 3D reconstruction using such images often fails to produce accurate 3D models of the captured objects. This paper shows how this problem can be solved effectively by a new multifocus multiview 3D reconstruction procedure which includes a new Fixed-Lens multifocus image capture and a calibrated image registration technique using analytic homography transformation. The experimental results using the real and synthetic images demonstrate the effectiveness of the proposed solutions by showing that both the fixed-lens image capture and multifocus stacking with calibrated image alignment significantly reduce the errors in the camera poses and produce more complete 3D reconstructed models as compared with those by the conventional moving lens image capture and multifocus stacking.
引用
收藏
页码:7421 / 7440
页数:20
相关论文
共 63 条
[1]  
3DSOM, 2019, 3DSOM 3 MOD PHOT
[2]  
Agisoft, 2019, AG MET PHOT
[3]  
AliceVision, 2019, MESHR 3D REC SOFTW
[4]  
Amin-Naji M, 2018, 2018 9TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), P553, DOI 10.1109/ISTEL.2018.8660989
[5]  
Ascencio C., 2020, Estimation of the Homography Matrix to Image Stitching", book-Title"Applications of Hybrid Metaheuristic Algorithms for Image Processing, P205, DOI DOI 10.1007/978-3-030-40977-7_10
[6]   Fusion of multi-focus images using differential evolution algorithm [J].
Aslantas, V. ;
Kurban, R. .
EXPERT SYSTEMS WITH APPLICATIONS, 2010, 37 (12) :8861-8870
[7]   Quadtree-based multi-focus image fusion using a weighted focus-measure [J].
Bai, Xiangzhi ;
Zhang, Yu ;
Zhou, Fugen ;
Xue, Bindang .
INFORMATION FUSION, 2015, 22 :105-118
[8]  
Blender-Foundation, 2020, BLEND 3D MOD REND PA
[9]   THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE [J].
BURT, PJ ;
ADELSON, EH .
IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) :532-540
[10]  
Cignoni P., 2008, EUR IT CHAPT C, P129, DOI DOI 10.2312/LOCALCHAPTEREVENTS/ITALCHAP/ITALIANCHAPCONF2008/129-136