Intraoperative laparoscopic liver surface registration with preoperative CT usingmixing features and overlapping region masks

被引:3
|
作者
Guan, Peidong [1 ,2 ]
Luo, Huoling [1 ]
Guo, Jianxi [3 ]
Zhang, Yanfang [3 ]
Jia, Fucang [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Res Ctr Med AI, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[2] Univ Chinese Acad & Sci, Shenzhen Coll Adv Technol, Shenzhen, Peoples R China
[3] Shenzhen Peoples Hosp, Dept Intervent Radiol, Shenzhen, Peoples R China
[4] Pazhou Lab, Guangzhou, Peoples R China
关键词
Point cloud registration; Augmented reality; Laparoscopic liver resection; Deep learning; HEPATECTOMY; RESECTION;
D O I
10.1007/s11548-023-02846-w
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Laparoscopic liver resection is a minimal invasive surgery. Augmented reality can map preoperative anatomy information extracted from computed tomography to the intraoperative liver surface reconstructed from stereo 3D laparoscopy. However, liver surface registration is particularly challenging as the intraoperative surface is only partially visible and suffers from large liver deformations due to pneumoperitoneum. This study proposes a deep learning-based robust point cloud registration network. Methods This study proposed a low overlap liver surface registration algorithm combining local mixed features and global features of point clouds. A learned overlap mask is used to filter the non-overlapping region of the point cloud, and a network is used to predict the overlapping region threshold to regulate the training process. Results We validated the algorithm on the DePoLL (the Deformable Porcine Laparoscopic Liver) dataset. Compared with the baseline method and other state-of-the-art registration methods, our method achieves minimum target registration error (TRE) of 19.9 +/- 2.7 mm. Conclusion The proposed point cloud registration method uses the learned overlapping mask to filter the non-overlapping areas in the point cloud, then the extracted overlapping area point cloud is registered according to the mixed features and global features, and this method is robust and efficient in low-overlap liver surface registration.
引用
收藏
页码:1521 / 1531
页数:11
相关论文
共 50 条
  • [21] Vessel segmentation for automatic registration of untracked laparoscopic ultrasound to CT of the liver
    Montana-Brown, Nina
    Ramalhinho, Joao
    Allam, Moustafa
    Davidson, Brian
    Hu, Yipeng
    Clarkson, Matthew J.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2021, 16 (07) : 1151 - 1160
  • [22] Using multiple images and contours for deformable 3D-2D registration of a preoperative CT in laparoscopic liver surgery
    Espinel, Yamid
    Calvet, Lilian
    Botros, Karim
    Buc, Emmanuel
    Tilmant, Christophe
    Bartoli, Adrien
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (12) : 2211 - 2219
  • [23] Registration of Liver Images to Minimally Invasive Intraoperative Surface and Subsurface data
    Wu, Yifei
    Rucker, D. Caleb
    Conley, Rebekah H.
    Pheiffer, Thomas S.
    Simpson, Amber L.
    Geevarghese, Sunil K.
    Miga, Michael I.
    MEDICAL IMAGING 2014: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2014, 9036
  • [24] Technical note: Nonrigid registration for laparoscopic liver surgery using sparse intraoperative data
    Heiselman, Jon S.
    Collins, Jarrod A.
    Clements, Logan W.
    Weis, Jared A.
    Simpson, Amber L.
    Geevarghese, Sunil K.
    Kingham, T. Peter
    Jarnagin, William R.
    Miga, Michael I.
    MEDICAL IMAGING 2018: IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, 2018, 10576
  • [25] Using multiple images and contours for deformable 3D–2D registration of a preoperative CT in laparoscopic liver surgery
    Yamid Espinel
    Lilian Calvet
    Karim Botros
    Emmanuel Buc
    Christophe Tilmant
    Adrien Bartoli
    International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 2211 - 2219
  • [26] Intelligent viewpoint selection for efficient CT to video registration in laparoscopic liver surgery
    Robu, Maria R.
    Edwards, Philip
    Ramalhinho, Joao
    Thompson, Stephen
    Davidson, Brian
    Hawkes, David
    Stoyanov, Danail
    Clarkson, Matthew J.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2017, 12 (07) : 1079 - 1088
  • [27] Intelligent viewpoint selection for efficient CT to video registration in laparoscopic liver surgery
    Maria R. Robu
    Philip Edwards
    João Ramalhinho
    Stephen Thompson
    Brian Davidson
    David Hawkes
    Danail Stoyanov
    Matthew J. Clarkson
    International Journal of Computer Assisted Radiology and Surgery, 2017, 12 : 1079 - 1088
  • [28] Registration of MR and CT images of the liver: comparison of voxel similarity and surface based registration algorithms
    Lee, WCC
    Tublin, ME
    Chapman, BE
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2005, 78 (02) : 101 - 114
  • [29] A Novel Technique to Predict Liver Damage After Laparoscopic Gastrectomy From the Stomach Volume Overlapping the Liver by Preoperative Computed Tomography
    Kaida, Sachiko
    Murakami, Yoko
    Ohta, Shinichi
    Yamaguchi, Tsuyoshi
    Takebayashi, Katsushi
    Murata, Satoshi
    Nitta, Norihisa
    Shimizu, Tomoharu
    Tani, Masaji
    WORLD JOURNAL OF SURGERY, 2020, 44 (09) : 3052 - 3060
  • [30] A Novel Technique to Predict Liver Damage After Laparoscopic Gastrectomy From the Stomach Volume Overlapping the Liver by Preoperative Computed Tomography
    Sachiko Kaida
    Yoko Murakami
    Shinichi Ohta
    Tsuyoshi Yamaguchi
    Katsushi Takebayashi
    Satoshi Murata
    Norihisa Nitta
    Tomoharu Shimizu
    Masaji Tani
    World Journal of Surgery, 2020, 44 : 3052 - 3060