共 1 条
Simultaneous estimation of projector and camera poses for multiple oneshot scan using pixel-wise correspondences estimated by U-Nets and GCN
被引:0
|作者:
Furukawa, Ryo
[1
]
Mikamo, Michihiro
[1
]
Kawasaki, Hiroshi
[2
]
Sagawa, Ryusuke
[3
]
Oka, Shiro
[4
]
Kotachi, Takahiro
[4
]
Okamoto, Yuki
[4
]
Tanaka, Shinji
[4
]
机构:
[1] Hiroshima City Univ, Hiroshima, Japan
[2] Kyushu Univ, Fukuoka, Japan
[3] Natl Inst Adv Ind Sci & Technol, Tsukuba, Japan
[4] Hiroshima Univ Hosp, Hiroshima, Japan
来源:
关键词:
3D endoscope;
active stereo;
GCN;
RECONSTRUCTION;
D O I:
10.1080/21681163.2021.2009376
中图分类号:
R318 [生物医学工程];
学科分类号:
0831 ;
摘要:
Dense and accurate 3D shape acquisition of objects by active-stereo technique has been an important research topic and intensively researched. One of the promising fields for active-stereo techniques is medical applications, such as 3D endoscope systems. In such systems, since a sensor is dynamically moved during the operation, single-frame shape reconstruction, a.k.a. oneshot scan, is necessary. For oneshot scan, there are several open problems, such as low resolution because of spatial coding, and unstable correspondence estimation between the detected patterns and the projected pattern because of irregular reflection. In this paper, we propose a solution for those problems. To increase the resolution, an accurate and stable interpolation method based on deep neural networks (DNNs) is proposed. Since most patterns used for oneshot scan are periodic, pixel-wise phase estimation can be achieved by detecting repetition in the pattern. A graph convolutional network (GCN), which is a deep neural network for graphs, is used for the correspondence problem. In the experiment, pixel-wise shape reconstruction results, as well as robust correspondence estimation using DNNs and a GCN, are shown. In addition, the effectiveness of the techniques is confirmed by comparing the proposed method with existing methods.
引用
收藏
页码:540 / 548
页数:9
相关论文