Fast and Accurate 3D Reconstruction of Plants Using MVSNet and Multi-View Images

被引:2
作者
Chen, Zhen [1 ]
Lv, Hui [1 ]
Lou, Lu [1 ]
Doonan, John H. [2 ]
机构
[1] Chongqing Jiaotong Univ, Coll Informat Sci & Engn, Chongqing, Peoples R China
[2] Aberystwyth Univ, Natl Plant Phen Ctr, IBERS, Aberystwyth, Dyfed, Wales
来源
ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS | 2022年 / 1409卷
基金
英国生物技术与生命科学研究理事会;
关键词
Deep learning; MVSNet; 3D reconstruction; TREES;
D O I
10.1007/978-3-030-87094-2_34
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurate 3D reconstruction of morphological structures, growth processes is a prerequisite for image-based measurement of biological organisms. It is a particular challenge for digital plant and crop research. In this paper, multi-view images of structurally very different plants including Arabidopsis, Wheat and Physalis, were taken with a consumer-grade digital camera with a zoom lens and a turntable. Camera parameters were estimated using the SfM method (COLMAP), and then 3D point clouds were reconstructed using MVSNet and the camera parameters. The results show that the proposed method is able to quickly produce denser and complete 3D point cloud of plants. Compared with the existing methods, our method is an end-to-end framework and is more automatic and more promising for dense 3D reconstruction of plants, especially for plant phenotyping.
引用
收藏
页码:390 / 399
页数:10
相关论文
共 19 条
[1]  
Barnes C, 2010, LECT NOTES COMPUT SC, V6313, P29
[2]   Deep Segmentation of Point Clouds of Wheat [J].
Ghahremani, Morteza ;
Williams, Kevin ;
Corke, Fiona M. K. ;
Tiddeman, Bernard ;
Liu, Yonghuai ;
Doonan, John H. .
FRONTIERS IN PLANT SCIENCE, 2021, 12
[3]  
Hartley R., 2004, Multiple view geometry in computer vision, DOI [10.1017/CBO9780511811685, DOI 10.1017/CBO9780511811685]
[4]   Image-based dynamic quantification and high-accuracy 3D evaluation of canopy structure of plant populations [J].
Hui, Fang ;
Zhu, Jinyu ;
Hu, Pengcheng ;
Meng, Lei ;
Zhu, Binglin ;
Guo, Yan ;
Li, Baoguo ;
Ma, Yuntao .
ANNALS OF BOTANY, 2018, 121 (05) :1079-1088
[5]   A quasi-dense approach to surface reconstruction from uncalibrated images [J].
Lhuillier, M ;
Quan, L .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2005, 27 (03) :418-433
[6]   Automatic Reconstruction of Tree Skeletal Structures from Point Clouds [J].
Livny, Yotam ;
Yan, Feilong ;
Olson, Matt ;
Chen, Baoquan ;
Zhang, Hao ;
El-Sana, Jihad .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (06)
[7]  
Lou L., 2016, Cost-effective accurate 3-D reconstruction based on multi-view images for plant phenotyping
[8]  
Merrell P, 2007, IEEE I CONF COMP VIS, P1221
[9]   3D modelling of individual trees using a handheld camera: Accuracy of height, diameter and volume estimates [J].
Miller, Jordan ;
Morgenroth, Justin ;
Gomez, Christopher .
URBAN FORESTRY & URBAN GREENING, 2015, 14 (04) :932-940
[10]   Interactive design of botanical trees using freehand sketches and example-based editing [J].
Okabe, M ;
Owada, S ;
Igarashi, T .
COMPUTER GRAPHICS FORUM, 2005, 24 (03) :487-496