Intraoperative laparoscopic liver surface registration with preoperative CT usingmixing features and overlapping region masks

被引:3
|
作者
Guan, Peidong [1 ,2 ]
Luo, Huoling [1 ]
Guo, Jianxi [3 ]
Zhang, Yanfang [3 ]
Jia, Fucang [1 ,2 ,4 ]
机构
[1] Chinese Acad Sci, Res Ctr Med AI, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[2] Univ Chinese Acad & Sci, Shenzhen Coll Adv Technol, Shenzhen, Peoples R China
[3] Shenzhen Peoples Hosp, Dept Intervent Radiol, Shenzhen, Peoples R China
[4] Pazhou Lab, Guangzhou, Peoples R China
关键词
Point cloud registration; Augmented reality; Laparoscopic liver resection; Deep learning; HEPATECTOMY; RESECTION;
D O I
10.1007/s11548-023-02846-w
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Laparoscopic liver resection is a minimal invasive surgery. Augmented reality can map preoperative anatomy information extracted from computed tomography to the intraoperative liver surface reconstructed from stereo 3D laparoscopy. However, liver surface registration is particularly challenging as the intraoperative surface is only partially visible and suffers from large liver deformations due to pneumoperitoneum. This study proposes a deep learning-based robust point cloud registration network. Methods This study proposed a low overlap liver surface registration algorithm combining local mixed features and global features of point clouds. A learned overlap mask is used to filter the non-overlapping region of the point cloud, and a network is used to predict the overlapping region threshold to regulate the training process. Results We validated the algorithm on the DePoLL (the Deformable Porcine Laparoscopic Liver) dataset. Compared with the baseline method and other state-of-the-art registration methods, our method achieves minimum target registration error (TRE) of 19.9 +/- 2.7 mm. Conclusion The proposed point cloud registration method uses the learned overlapping mask to filter the non-overlapping areas in the point cloud, then the extracted overlapping area point cloud is registered according to the mixed features and global features, and this method is robust and efficient in low-overlap liver surface registration.
引用
收藏
页码:1521 / 1531
页数:11
相关论文
共 50 条
  • [41] Rigid 2D/3D registration of intraoperative digital X-ray images and preoperative CT and MR images
    Tomazevic, D
    Likar, B
    Pernus, F
    MEDICAL IMAGING 2002: IMAGE PROCESSING, VOL 1-3, 2002, 4684 : 507 - 517
  • [42] Preoperative high-dose helical CT of the liver: Comparison with surgery, pathology, and intraoperative US in the detection of hypovascular hepatic neoplasms
    Ikeda, AK
    Freeny, PC
    Ryan, JA
    Crane, RD
    Nghiem, HV
    Winter, TC
    RADIOLOGY, 1996, 201 : 1571 - 1571
  • [43] Automatic liver segmentation on CT images combining region-based techniques and convolutional features
    Czipczer, Vanda
    Manno-Kovacs, Andrea
    2019 INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING (CBMI), 2019,
  • [44] Prediction of liver regeneration in recipients after living-donor liver transplantation in using preoperative CT texture analysis and clinical features
    Junghoan Park
    Jung Hoon Kim
    Ji-Eun Kim
    Sang Joon Park
    Nam-Joon Yi
    Joon Koo Han
    Abdominal Radiology, 2020, 45 : 3763 - 3774
  • [45] Prediction of liver regeneration in recipients after living-donor liver transplantation in using preoperative CT texture analysis and clinical features
    Park, Junghoan
    Kim, Jung Hoon
    Kim, Ji-Eun
    Park, Sang Joon
    Yi, Nam-Joon
    Han, Joon Koo
    ABDOMINAL RADIOLOGY, 2020, 45 (11) : 3763 - 3774
  • [46] Preoperative CT Quantification of Liver Surface Nodularity Helps Anticipating Postoperative Morbidity in HCC Patients Requiring Liver Resection.
    Cauchy, Francois
    Hobeika, Christian
    Sartoris, Riccardo
    Paradis, Valerie
    Pote, Nicolas
    Bouattour, Mohamed
    Vilgrain, Valerie
    Durand, Francois
    Ronot, Maxime
    Soubrane, Olivier
    HEPATOLOGY, 2018, 68 : 659A - 659A
  • [47] An objective comparison of methods for augmented reality in laparoscopic liver resection by preoperative-to-intraoperative image fusion from the MICCAI2022 challenge
    Ali, Sharib
    Espinel, Yamid
    Jin, Yueming
    Liu, Peng
    Guettner, Bianca
    Zhang, Xukun
    Zhang, Lihua
    Dowrick, Tom
    Clarkson, Matthew J.
    Xiao, Shiting
    Wu, Yifan
    Yang, Yijun
    Zhu, Lei
    Sun, Dai
    Li, Lan
    Pfeiffer, Micha
    Farid, Shahid
    Maier-Hein, Lena
    Buc, Emmanuel
    Bartoli, Adrien
    MEDICAL IMAGE ANALYSIS, 2025, 99
  • [48] Robust surface registration using salient anatomical features for image-guided liver surgery: Algorithm and validation
    Clements, Logan W.
    Chapman, William C.
    Dawant, Benoit M.
    Galloway, Robert L., Jr.
    Miga, Michael I.
    MEDICAL PHYSICS, 2008, 35 (06) : 2528 - 2540
  • [49] Intraoperative Correction of Liver Deformation Using Sparse Surface and Vascular Features via Linearized Iterative Boundary Reconstruction
    Heiselman, Jon S.
    Jarnagin, William R.
    Miga, Michael I.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (06) : 2223 - 2234
  • [50] Preoperative chemotherapy in patients undergoing resection of colorectal liver metastases: Assessment of pattern of tumor response using CT registration imaging.
    Cai, G.
    van Vledder, M. G.
    Kamel, I. R.
    Diaz, L. A.
    Boctor, E.
    Pawlik, T. M.
    Choti, M. A.
    JOURNAL OF CLINICAL ONCOLOGY, 2011, 29 (04)