An experimental comparison of multi-view stereo approaches on satellite images

被引:17
作者
Gomez, Alvaro [1 ]
Randall, Gregory [1 ]
Facciolo, Gabriele [2 ]
von Gioi, Rafael Grompone [2 ]
机构
[1] Univ Republica, Fac Ingn, Montevideo, Uruguay
[2] ENS Paris Saclay, Ctr Borelli, Paris, France
来源
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022) | 2022年
关键词
D O I
10.1109/WACV51458.2022.00078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Different methods can be applied to satellite images to derive an altitude map from a set of images. In this article we evaluate a set of representative methods from different approaches. We consider true multi-view stereo methods as well as pair-wise ones, classic methods and deep learning based ones, methods already in use on satellite images and others that were originally devised for close range imaging and are adapted to satellite imagery. While deep learning (DL) methods have taken over multi-view stereo reconstruction in the last years, this tendency has not fully reached satellite stereo pipelines that still largely rely on pair-wise classic algorithms. For the comparison, we set-up a framework that allows to interface a DL-based stereo method taken from the computer vision literature with a satellite stereo pipeline. For multi-view stereo algorithms we build on a recently proposed framework originally devised to apply Colmap method to satellite images. Methods are compared on several datasets that include sets of images taken within a few days and sets of images taken months apart. Results show that DL methods have, in general, a good generalization power. In particular, the use of the GANet DL method as the matching step in a pair-wise stereo pipeline is promising as it already performs better than the classic counterpart, even without a specific training.
引用
收藏
页码:707 / 716
页数:10
相关论文
共 37 条
[1]  
[Anonymous], 2014, ISPRS ANN PHOTOGRAMM
[2]   PatchMatch Stereo - Stereo Matching with Slanted Support Windows [J].
Bleyer, Michael ;
Rhemann, Christoph ;
Rother, Carsten .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,
[3]  
Bosch Marc, 2016, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), DOI 10.1109/AIPR.2016.8010543
[4]   Semantic Stereo for Incidental Satellite Images [J].
Bosch, Marc ;
Foster, Kevin ;
Christie, Gordon ;
Wang, Sean ;
Hager, Gregory D. ;
Brown, Myron .
2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, :1524-1532
[5]   3-D SURFACE DESCRIPTION FROM BINOCULAR STEREO [J].
COCHRAN, SD ;
MEDIONI, G .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (10) :981-994
[6]   A space-sweep approach to true multi-image matching [J].
Collins, RT .
1996 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1996, :358-363
[7]  
Facciolo G., 2015, P BRIT MACHINE VISIO
[8]   Automatic 3D Reconstruction from Multi-Date Satellite Images [J].
Facciolo, Gabriele ;
de Franchis, Carlo ;
Meinhardt-Llopis, Enric .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1542-1551
[9]  
Fua P., 1993, Machine Vision and Applications, V6, P35, DOI 10.1007/BF01212430
[10]   Multi-View Stereo: A Tutorial [J].
Furukawa, Yasutaka ;
Hernandez, Carlos .
FOUNDATIONS AND TRENDS IN COMPUTER GRAPHICS AND VISION, 2013, 9 (1-2) :1-148