Optical Flow-Based Vascular Respiratory Motion Compensation

被引:2
|
作者
Yang, Keke [1 ]
Zhang, Zheng [1 ,2 ]
Li, Meng [3 ]
Cao, Tuoyu [4 ]
Ghaffari, Maani [3 ]
Song, Jingwei [4 ]
机构
[1] United Imaging Hlth, Shanghai 2258, Peoples R China
[2] Shanghai Jiao Tong Univ, Inst Med Imaging Technol, Sch Biomed Engn, Shanghai 200030, Peoples R China
[3] Univ Michigan, Ann Arbor, MI 48109 USA
[4] United Imaging Res Inst Intelligent Imaging, Beijing 100144, Peoples R China
关键词
Robot-assisted vascular interventions; vascular respiratory motion compensation; dynamic roadmapping; optical flow;
D O I
10.1109/LRA.2023.3313936
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This letter develops a new vascular respiratory motion compensation algorithm, Motion-Related Compensation (MRC), to conduct vascular respiratory motion compensation by extrapolating the correlation between invisible vascular and visible non-vascular. Robot-assisted vascular intervention can significantly reduce the radiation exposure of surgeons. In robot-assisted image-guided intervention, blood vessels are constantly moving/deforming due to respiration, and they are invisible in the X-ray images unless contrast agents are injected. The vascular respiratory motion compensation technique predicts 2D vascular roadmaps in live X-ray images. When blood vessels are visible after contrast agents injection, vascular respiratory motion compensation is conducted based on the sparse Lucas-Kanade feature tracker. An MRC model is trained to learn the correlation between vascular and non-vascular motions. During the intervention, invisible blood vessels are predicted with visible tissues and the trained MRC model. Moreover, a Gaussian-based outlier filter is adopted for refinement. Experiments on in-vivo data sets show that the proposed method can yield vascular respiratory motion compensation in $0.032 \sec$, with an average error $\text{1.086}\;\text{mm}$. Our real-time and accurate vascular respiratory motion compensation approach contributes to modern vascular intervention and surgical robots.
引用
收藏
页码:6987 / 6994
页数:8
相关论文
共 50 条
  • [1] Optical Flow-Based Fast Motion Parameters Estimation for Affine Motion Compensation
    Chauvet, Antoine
    Sugaya, Yoshihiro
    Miyazaki, Tomo
    Omachi, Shinichiro
    APPLIED SCIENCES-BASEL, 2020, 10 (02):
  • [2] An overview of optical flow-based approaches for motion segmentation
    Anthwal, Shivangi
    Ganotra, Dinesh
    IMAGING SCIENCE JOURNAL, 2019, 67 (05): : 284 - 294
  • [3] Optical flow-based motion compensation algorithm for very low-bit-rate video coding
    Shi, YQ
    Lin, S
    Zhang, YQ
    INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 1998, 9 (04) : 230 - 237
  • [4] Motion estimation with optical flow-based adaptive search region
    Kim, KK
    Ban, SW
    Lee, KI
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2001, E84A (06): : 1529 - 1531
  • [5] Motion estimation with optical flow-based adaptive search region
    Kim, K.-K.
    Ban, S.-W.
    Lee, K.-I.
    IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 2001, E84-A (06) : 1529 - 1531
  • [6] Real-time Accurate Optical Flow-based Motion Sensor
    Wei, Zhaoyi
    Lee, Dah-Jye
    Nelson, Brent E.
    Archibald, James K.
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 2966 - 2969
  • [7] Motion flow-based video retrieval
    Su, Chih-Wen
    Liao, Hong-Yuan Mark
    Tyan, Hsiao-Rong
    Lin, Chia-Wen
    Chen, Duan-Yu
    Fan, Kuo-Chin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (06) : 1193 - 1201
  • [8] Optical flow-based structure-from-motion for the reconstruction of epithelial surfaces
    Tan-Binh Phan
    Dinh-Hoan Trinh
    Wolf, Didier
    Daul, Christian
    PATTERN RECOGNITION, 2020, 105
  • [9] Optical flow-based probabilistic tracking
    Lucena, M
    Fuertes, JM
    Gomez, JI
    de la Blanca, NP
    Garrido, A
    SEVENTH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS, VOL 2, PROCEEDINGS, 2003, : 219 - 222
  • [10] Unsupervised Event-Based Optical Flow Using Motion Compensation
    Zhu, Alex Zihao
    Yuan, Liangzhe
    Chaney, Kenneth
    Daniilidis, Kostas
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT VI, 2019, 11134 : 711 - 714