Multi-view stereo of an object immersed in a refractive medium

被引:0
作者
Bruneau, Robin [1 ,2 ]
Brument, Baptiste [1 ]
Calvet, Lilian [3 ]
Cassidy, Matthew [1 ]
Melou, Jean [1 ]
Queau, Yvain [4 ]
Durou, Jean-Denis [1 ]
Lauze, Francois [2 ]
机构
[1] Univ Toulouse, UMR CNRS 5505, IRIT, Toulouse, France
[2] DIKU, Dept Comp Sci, Copenhagen, Denmark
[3] Univ Zurich, Balgrist Hosp, OR X, Zurich, Switzerland
[4] Normandie Univ, UNICAEN, CNRS, ENSICAEN,GREYC, Caen, France
关键词
three-dimensional reconstruction; multi-view stereo; refraction; LIGHT; DEPTH; POSE;
D O I
10.1117/1.JEI.33.3.033005
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
. In this article, we show how to extend the multi-view stereo technique when the object to be reconstructed is inside a transparent but refractive medium, which causes distortions in the images. We provide a theoretical formulation of the problem accounting for a general non-planar shape of the refractive interface, and then a discrete solving method. We also present a pipeline to recover precisely the geometry of the refractive interface, considered as a convex polyhedral object. It is based on the extraction of visible polyhedron vertices from silhouette images and matching across a sequence of images acquired under circular camera motion. These contributions are validated by tests on synthetic and real data.
引用
收藏
页数:22
相关论文
共 60 条
  • [1] Correcting Image Refraction: Towards Accurate Aerial Image-Based Bathymetry Mapping in Shallow Waters
    Agrafiotis, Panagiotis
    Karantzalos, Konstantinos
    Georgopoulos, Andreas
    Skarlatos, Dimitrios
    [J]. REMOTE SENSING, 2020, 12 (02)
  • [2] DepthLearn: Learning to Correct the Refraction on Point Clouds Derived from Aerial Imagery for Accurate Dense Shallow Water Bathymetry Based on SVMs-Fusion with LiDAR Point Clouds
    Agrafiotis, Panagiotis
    Skarlatos, Dimitrios
    Georgopoulos, Andreas
    Karantzalos, Konstantinos
    [J]. REMOTE SENSING, 2019, 11 (19)
  • [3] Agrawal A, 2012, PROC CVPR IEEE, P3346, DOI 10.1109/CVPR.2012.6248073
  • [4] Ahuja N., 2006, 2006 IEEE COMPUTER S, V2, P2316
  • [5] Triangulation in Random Refractive Distortions
    Alterman, Marina
    Schechner, Yoav Y.
    Swirski, Yohay
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (03) : 603 - 616
  • [6] 3D in Natural Random Refractive Distortions
    Alterman, Marina
    Schechner, Yoav Y.
    [J]. THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2016, 2016, 9867
  • [7] Bemana Mojtaba, 2022, SIGGRAPH22 Conference Proceeding: Special Interest Group on Computer Graphics and Interactive Techniques Conference Proceedings, DOI 10.1145/3528233.3530706
  • [8] Ben-Ezra M, 2003, NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, P1025
  • [9] Brument Baptiste, 2023, Proceedings of SPIE, DOI 10.1117/12.3000368
  • [10] Universal algorithm for water depth refraction correction in through-water stereo remote sensing
    Cao, Bin
    Deng, Ruru
    Zhu, Shulong
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2020, 91