Intraoperative laparoscopic liver surface registration with preoperative CT usingmixing features and overlapping region masks

被引:3
|
作者
Guan, Peidong [1 ,2 ]
Luo, Huoling [1 ]
Guo, Jianxi [3 ]
Zhang, Yanfang [3 ]
Jia, Fucang [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Res Ctr Med AI, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[2] Univ Chinese Acad & Sci, Shenzhen Coll Adv Technol, Shenzhen, Peoples R China
[3] Shenzhen Peoples Hosp, Dept Intervent Radiol, Shenzhen, Peoples R China
[4] Pazhou Lab, Guangzhou, Peoples R China
关键词
Point cloud registration; Augmented reality; Laparoscopic liver resection; Deep learning; HEPATECTOMY; RESECTION;
D O I
10.1007/s11548-023-02846-w
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Laparoscopic liver resection is a minimal invasive surgery. Augmented reality can map preoperative anatomy information extracted from computed tomography to the intraoperative liver surface reconstructed from stereo 3D laparoscopy. However, liver surface registration is particularly challenging as the intraoperative surface is only partially visible and suffers from large liver deformations due to pneumoperitoneum. This study proposes a deep learning-based robust point cloud registration network. Methods This study proposed a low overlap liver surface registration algorithm combining local mixed features and global features of point clouds. A learned overlap mask is used to filter the non-overlapping region of the point cloud, and a network is used to predict the overlapping region threshold to regulate the training process. Results We validated the algorithm on the DePoLL (the Deformable Porcine Laparoscopic Liver) dataset. Compared with the baseline method and other state-of-the-art registration methods, our method achieves minimum target registration error (TRE) of 19.9 +/- 2.7 mm. Conclusion The proposed point cloud registration method uses the learned overlapping mask to filter the non-overlapping areas in the point cloud, then the extracted overlapping area point cloud is registered according to the mixed features and global features, and this method is robust and efficient in low-overlap liver surface registration.
引用
收藏
页码:1521 / 1531
页数:11
相关论文
共 50 条
  • [31] Intraoperative ultrasound (IOUS) in patients with potentially resectable liver metastases and preoperative PET/CT imaging
    Wildi, Stephan M.
    Gubler, Christoph
    Hany, Thomas
    Petrowsky, Henrik
    Gerlach, Tilman J.
    Clavien, Pierre A.
    Fried, Michael
    Mullhaupt, Beat
    GASTROENTEROLOGY, 2006, 130 (04) : A791 - A791
  • [32] Improved Surface-Based Registration of CT and Intraoperative 3D Ultrasound of Bones
    Fanti, Zian
    Torres, Fabian
    Hazan-Lasri, Eric
    Gastelum-Strozzi, Alfonso
    Ruiz-Huerta, Leopoldo
    Caballero-Ruiz, Alberto
    Arambula Cosio, F.
    JOURNAL OF HEALTHCARE ENGINEERING, 2018, 2018
  • [33] Validation of a two- to three-dimensional registration algorithm for aligning preoperative CT images and intraoperative fluoroscopy images
    Penney, GP
    Batchelor, PG
    Hill, DLG
    Hawkes, DJ
    Weese, J
    MEDICAL PHYSICS, 2001, 28 (06) : 1024 - 1032
  • [34] Living donor right liver lobes: Preoperative CT volumetric measurement for calculation of intraoperative weight and volume
    Lemke, Arne-Joern
    Brinkmann, Martin Julius
    Schott, Thomas
    Niehues, Stefan Markus
    Settmacher, Utz
    Neuhaus, Peter
    Felix, Roland
    RADIOLOGY, 2006, 240 (03) : 736 - 742
  • [35] Intraoperative sonography in patients with colorectal cancer and resectable liver metastases on preoperative FDG-PET-CT
    Wildi, Stephan M.
    Gubler, Christoph
    Hany, Thomas
    Petrowsky, Henrik
    Clavien, Pierre A.
    Jochum, Wolfram
    Gerlach, Tilman
    Fried, Michael
    Mullhaupt, Beat
    JOURNAL OF CLINICAL ULTRASOUND, 2008, 36 (01) : 20 - 26
  • [36] Accuracy evaluation of shape-based registration for image-guided hip surgery - Effect of quality of preoperative CT model and intraoperative data on registration accuracy
    Sasama, T
    Sato, Y
    Sugano, N
    Yamaguchi, K
    Tamura, S
    Ohzono, K
    Ochi, T
    CAR '98 - COMPUTER ASSISTED RADIOLOGY AND SURGERY, 1998, 1165 : 911 - 911
  • [37] Semiautomated registration of pre- and intraoperative CT for image-guided percutaneous liver tumor ablation interventions
    Gunay, Gokhan
    Manh Ha Luu
    Moelker, Adriaan
    van Walsum, Theo
    Klein, Stefan
    MEDICAL PHYSICS, 2017, 44 (07) : 3718 - 3725
  • [38] Evaluation of PET/CT, endoscopic ultrasonography and laparoscopic ultrasonography in the preoperative assessment of resectability in patients with liver tumors
    Ainsworth, Alan
    Pless, Torsten
    Petersen, Henrik
    Svolgaard, Birgitte
    Hoeilund-Carlsen, Poul-Fleming
    Nielsen, Hemming O.
    SCANDINAVIAN JOURNAL OF GASTROENTEROLOGY, 2010, 45 : 52 - 53
  • [39] Robust surface registration using salient anatomical features in image-guided liver surgery
    Clements, Logan W.
    Cash, David M.
    Chapman, William C.
    Galloway, Robert L., Jr.
    Miga, Michael I.
    MEDICAL IMAGING 2006: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND DISPLAY, 2006, 6141
  • [40] A Hybrid 3D-2D Image Registration Framework for Pedicle Screw Trajectory Registration between Intraoperative X-ray Image and Preoperative CT Image
    Naik, Roshan Ramakrishna
    Hoblidar, Anitha
    Bhat, Shyamasunder N.
    Ampar, Nishanth
    Kundangar, Raghuraj
    JOURNAL OF IMAGING, 2022, 8 (07)