Position tracking of moving liver lesion based on real-time registration between 2D ultrasound and 3D preoperative images

被引:14
作者
Weon, Chijun [1 ]
Nam, Woo Hyun [1 ]
Lee, Duhgoon [1 ]
Lee, Jae Young [2 ]
Ra, Jong Beom [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Dept Elect Engn, Taejon 305701, South Korea
[2] Seoul Natl Univ Hosp, Dept Radiol, Seoul 110744, South Korea
关键词
ultrasound; 4D preoperative image; image-guided intervention; real-time registration; lesion tracking; NONRIGID REGISTRATION; CT IMAGES; INTENSITY; MOTION;
D O I
10.1118/1.4903945
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose: Registration between 2D ultrasound (US) and 3D preoperative magnetic resonance (MR) (or computed tomography, CT) images has been studied recently for US-guided intervention. However, the existing techniques have some limits, either in the registration speed or the performance. The purpose of this work is to develop a real-time and fully automatic registration system between two intermodal images of the liver, and subsequently an indirect lesion positioning/tracking algorithm based on the registration result, for image-guided interventions. Methods: The proposed position tracking system consists of three stages. In the preoperative stage, the authors acquire several 3D preoperative MR (or CT) images at different respiratory phases. Based on the transformations obtained from nonrigid registration of the acquired 3D images, they then generate a 4D preoperative image along the respiratory phase. In the intraoperative preparatory stage, they properly attach a 3D US transducer to the patient's body and fix its pose using a holding mechanism. They then acquire a couple of respiratory-controlled 3D US images. Via the rigid registration of these US images to the 3D preoperative images in the 4D image, the pose information of the fixed-pose 3D US transducer is determined with respect to the preoperative image coordinates. As feature(s) to use for the rigid registration, they may choose either internal liver vessels or the inferior vena cava. Since the latter is especially useful in patients with a diffuse liver disease, the authors newly propose using it. In the intraoperative real-time stage, they acquire 2D US images in real-time from the fixed-pose transducer. For each US image, they select candidates for its corresponding 2D preoperative slice from the 4D preoperative MR (or CT) image, based on the predetermined pose information of the transducer. The correct corresponding image is then found among those candidates via real-time 2D registration based on a gradient-based similarity measure. Finally, if needed, they obtain the position information of the liver lesion using the 3D preoperative image to which the registered 2D preoperative slice belongs. Results: The proposed method was applied to 23 clinical datasets and quantitative evaluations were conducted. With the exception of one clinical dataset that included US images of extremely low quality, 22 datasets of various liver status were successfully applied in the evaluation. Experimental results showed that the registration error between the anatomical features of US and preoperative MR images is less than 3 mm on average. The lesion tracking error was also found to be less than 5 mm at maximum. Conclusions: A new system has been proposed for real-time registration between 2D US and successive multiple 3D preoperative MR/CT images of the liver and was applied for indirect lesion tracking for image-guided intervention. The system is fully automatic and robust even with images that had low quality due to patient status. Through visual examinations and quantitative evaluations, it was verified that the proposed system can provide high lesion tracking accuracy as well as high registration accuracy, at performance levels which were acceptable for various clinical applications. (c) 2015 American Association of Physicists in Medicine.
引用
收藏
页码:335 / 347
页数:13
相关论文
共 50 条
[41]   Convolution neural networks for real-time needle detection and localization in 2D ultrasound [J].
Cosmas Mwikirize ;
John L. Nosher ;
Ilker Hacihaliloglu .
International Journal of Computer Assisted Radiology and Surgery, 2018, 13 :647-657
[42]   Passive Markers for Tracking Surgical Instruments in Real-Time 3-D Ultrasound Imaging [J].
Stoll, Jeffrey ;
Ren, Hongliang ;
Dupont, Pierre E. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2012, 31 (03) :563-575
[43]   Parameterization of Real-Time 3D Speckle Tracking Framework for Cardiac Strain Assessment [J].
Lorsakul, Auranuch ;
Duan, Qi ;
Po, Ming Jack ;
Angelini, Elsa ;
Homma, Shunichi ;
Laine, Andrew F. .
2011 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2011, :2654-2657
[44]   Integrated endoscope for real-time 3D ultrasound imaging and hyperthermia: Feasibility study [J].
Pua, Eric C. ;
Qiu, Yupeng ;
Smith, S. W. .
ULTRASONIC IMAGING, 2007, 29 (01) :1-14
[45]   Stereoscopic images of breast tumors using 3D real-time tissue elastography [J].
Konno, Sachiyo ;
Takada, Etsuo ;
Ejiri, Natsuki ;
Kawamata, Misaki ;
Takase, Naotoshi ;
Nakazato, Yoshimasa ;
Suzuki, Keisuke ;
Takekawa, Hidehiro .
JOURNAL OF MEDICAL ULTRASONICS, 2015, 42 (03) :365-371
[46]   A real-time IGRT method using a Kalman filter framework to extract 3D positions from 2D projections [J].
Nguyen, Doan Trang ;
Keall, Paul ;
Booth, Jeremy ;
Shieh, Chun-Chien ;
Poulsen, Per ;
O'Brien, Ricky .
PHYSICS IN MEDICINE AND BIOLOGY, 2021, 66 (21)
[47]   A 2D/3D Non-rigid Registration Method for Lung Images Based on a Non-linear Correlation Between Displacement Vectors and Similarity Measures [J].
Zhang, Jiayi ;
Xia, Wei ;
Jin, Qingpeng ;
Gao, Xin .
JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2021, 41 (03) :331-342
[48]   Training in adult subclavian venous catheterization: contribution of real-time 2d ultrasound guidance [J].
Forestier, F ;
Rossi, H ;
Calderon, J ;
Soubiron, L ;
Bourdarias, B ;
Janvier, G .
ANNALES FRANCAISES D ANESTHESIE ET DE REANIMATION, 2002, 21 (09) :698-702
[49]   Deep Generative Models to Simulate 2D Patient-Specific Ultrasound Images in Real Time [J].
Magnetti, Cesare ;
Zimmer, Veronika ;
Ghavami, Nooshin ;
Skelton, Emily ;
Matthew, Jacqueline ;
Lloyd, Karen ;
Hajnal, Jo ;
Schnabel, Julia A. ;
Gomez, Alberto .
MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, 2020, 1248 :423-435
[50]   Real-Time 2D-3D Deformable Registration with Deep Learning and Application to Lung Radiotherapy Targeting [J].
Foote, Markus D. ;
Zimmerman, Blake E. ;
Sawant, Amit ;
Joshi, Sarang C. .
INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2019, 2019, 11492 :265-276