Near-real-time gradually expanding 3D land surface reconstruction in disaster areas by sequential drone imagery

被引:22
作者
Cheng, Min-Lung [1 ]
Matsuoka, Masashi [1 ]
Liu, Wen [2 ]
Yamazaki, Fumio [3 ]
机构
[1] Tokyo Inst Technol, Dept Architecture & Bldg Engn, Tokyo, Japan
[2] Chiba Univ, Grad Sch Engn, Chiba, Japan
[3] Natl Res Inst Earth Sci & Disaster Resilience, Ibaraki, Japan
关键词
Drone; UAS; Optical image; 3D reconstruction; Disaster management; STRUCTURE-FROM-MOTION; PHOTOGRAMMETRY; SCALE; CALIBRATION; SIFT;
D O I
10.1016/j.autcon.2021.104105
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The ability of drones to access disaster areas has been proven powerful and flexible for acquiring first-hand optical imagery data for environmental observation. However, such imagery data usually undergo post processing, and the three-dimensional (3D) products are mainly for accurate land surveys. The postprocessing procedure is too time-consuming to meet instant decision support and rescue response requirements. Therefore, this paper intends to develop a systematic workflow that is able to achieve on-the-fly 3D reconstruction in disaster areas by optical imagery sequentially acquired by drones. This study proposes a strategy to spatially link sequential images (SLSI) for image localization and suitable stereopair selection. In addition, the criteria for valid epipolar stereoapair determination are developed to make the 3D dense reconstruction more automatic and effective. The 3D digital land surface can be gradually reconstructed and expanded in the computer system while the drone is capturing new images. This paper utilizes the imagery dataset of collapsed buildings induced by the 2016 Kumamoto earthquake in Japan to simulate the more effective 3D reconstruction. Although the accuracy of the consequence is reported to be closely one meter, the mean data processing time for every image can achieve the level by approximately ten seconds while performing the proposed scheme on an iMac with Intel Core i5 and 16 GB random access memory (RAM). As a result, the efficiency and computational power needed are significantly reduced to support emergency applications soon after a disaster occurs.
引用
收藏
页数:12
相关论文
共 75 条
[11]  
Bradski G, 2000, DR DOBBS J, V25, P120
[12]   Extracting three-dimensional (3D) spatial information from sequential oblique unmanned aerial system (UAS) imagery for digital surface modeling [J].
Cheng, Min-Lung ;
Matsuoka, Masashi .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (05) :1643-1663
[13]   An Enhanced Image Matching Strategy Using Binary-Stream Feature Descriptors [J].
Cheng, Min-Lung ;
Matsuoka, Masashi .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (07) :1253-1257
[14]  
Cho W., 1993, INT ARCHIVE PHOTOGRA, P404, DOI DOI 10.5194/ISPRSARCHIVES-XL-5-187-2014
[15]   Unmanned aerial systems for photogrammetry and remote sensing: A review [J].
Colomina, I. ;
Molina, P. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 92 :79-97
[16]   A review on absolute visual localization for UAV [J].
Couturier, Andy ;
Akhloufi, Moulay A. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2021, 135
[17]   Modelling and interpretation of architecture from several images [J].
Dick, AR ;
Torr, PHS ;
Cipolla, R .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :111-134
[18]   Multiview 3D reconstruction of the archaeological site at Weymouth from image series [J].
Ducke, Benjamin ;
Score, David ;
Reeves, Joseph .
COMPUTERS & GRAPHICS-UK, 2011, 35 (02) :375-382
[19]  
Forster C, 2014, IEEE INT CONF ROBOT, P15, DOI 10.1109/ICRA.2014.6906584
[20]  
Fraser C., 2018, PROCEEDING ISPRS TEC