Simultaneous estimation of projector and camera poses for multiple oneshot scan using pixel-wise correspondences estimated by U-Nets and GCN

被引:0
|
作者
Furukawa, Ryo [1 ]
Mikamo, Michihiro [1 ]
Kawasaki, Hiroshi [2 ]
Sagawa, Ryusuke [3 ]
Oka, Shiro [4 ]
Kotachi, Takahiro [4 ]
Okamoto, Yuki [4 ]
Tanaka, Shinji [4 ]
机构
[1] Hiroshima City Univ, Hiroshima, Japan
[2] Kyushu Univ, Fukuoka, Japan
[3] Natl Inst Adv Ind Sci & Technol, Tsukuba, Japan
[4] Hiroshima Univ Hosp, Hiroshima, Japan
关键词
3D endoscope; active stereo; GCN; RECONSTRUCTION;
D O I
10.1080/21681163.2021.2009376
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Dense and accurate 3D shape acquisition of objects by active-stereo technique has been an important research topic and intensively researched. One of the promising fields for active-stereo techniques is medical applications, such as 3D endoscope systems. In such systems, since a sensor is dynamically moved during the operation, single-frame shape reconstruction, a.k.a. oneshot scan, is necessary. For oneshot scan, there are several open problems, such as low resolution because of spatial coding, and unstable correspondence estimation between the detected patterns and the projected pattern because of irregular reflection. In this paper, we propose a solution for those problems. To increase the resolution, an accurate and stable interpolation method based on deep neural networks (DNNs) is proposed. Since most patterns used for oneshot scan are periodic, pixel-wise phase estimation can be achieved by detecting repetition in the pattern. A graph convolutional network (GCN), which is a deep neural network for graphs, is used for the correspondence problem. In the experiment, pixel-wise shape reconstruction results, as well as robust correspondence estimation using DNNs and a GCN, are shown. In addition, the effectiveness of the techniques is confirmed by comparing the proposed method with existing methods.
引用
收藏
页码:540 / 548
页数:9
相关论文
共 1 条
  • [1] Simultaneous shape and camera-projector parameter estimation for 3D endoscopic system using CNN-based grid-oneshot scan
    Furukawa, Ryo
    Nagamatsu, Genki
    Oka, Shiro
    Kotachi, Takahiro
    Okamoto, Yuki
    Tanaka, Shinji
    Kawasaki, Hiroshi
    HEALTHCARE TECHNOLOGY LETTERS, 2019, 6 (06) : 249 - 254