Probabilistic Tracking of Affine-Invariant Anisotropic Regions

被引:60
|
作者
Giannarou, Stamatia [1 ]
Visentini-Scarzanella, Marco [1 ,2 ]
Yang, Guang-Zhong [1 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Hamlyn Ctr Robot Surg, London SW7 2AZ, England
[2] Univ London Imperial Coll Sci Technol & Med, Dept Elect & Elect Engn, Commun & Signal Proc Grp, London SW7 2AZ, England
基金
英国工程与自然科学研究理事会;
关键词
Salient feature extraction; feature point tracking; image-guided navigation; VISUAL TRACKING; SCALE; CUES;
D O I
10.1109/TPAMI.2012.81
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite a wide range of feature detectors developed in the computer vision community over the years, direct application of these techniques to surgical navigation has shown significant difficulties due to the paucity of reliable salient features coupled with free-form tissue deformation and changing visual appearance of surgical scenes. The aim of this paper is to propose a novel probabilistic framework to track affine-invariant anisotropic regions under contrastingly different visual appearances during Minimally Invasive Surgery (MIS). The theoretical background of the affine-invariant anisotropic feature detector is presented and a real-time implementation exploiting the computational power of the GPU is proposed. An Extended Kalman Filter (EKF) parameterization scheme is used to adaptively adjust the optimal templates of the detected regions, enabling accurate identification and matching of the tracked features. For effective tracking verification, spatial context and region similarity have also been incorporated. They are used to boost the prediction of the EKF and recover potential tracking failure due to drift or false positives. The proposed framework is compared to the existing methods and their respective performance is evaluated with in vivo video sequences recorded from robotic-assisted MIS procedures, as well as real-world scenes.
引用
收藏
页码:130 / 143
页数:14
相关论文
共 50 条
  • [1] AFFINE-INVARIANT ANISOTROPIC DETECTOR FOR SOFT TISSUE TRACKING IN MINIMALLY INVASIVE SURGERY
    Giannarou, Stamatia
    Visentini-Scarzanella, Marco
    Yang, Guang-Zhong
    2009 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1 AND 2, 2009, : 1059 - 1062
  • [2] Affine-invariant image watermarking using the hyperbolic chirp
    Fletcher, Peter
    Larkin, Kieran
    Hardy, Stephen
    2009 DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2009), 2009, : 6 - 13
  • [3] Spatially-Sensitive Affine-Invariant Image Descriptors
    Bronstein, Alexander M.
    Bronstein, Michael M.
    COMPUTER VISION-ECCV 2010, PT II, 2010, 6312 : 197 - 208
  • [4] Affine-invariant regions and geometric relationship constrained matching for low-altitude images of urban area
    Li, Congmin
    Shao, Zhenfeng
    Liu, Bo
    2016 4RTH INTERNATIONAL WORKSHOP ON EARTH OBSERVATION AND REMOTE SENSING APPLICATIONS (EORSA), 2016,
  • [5] FAST AFFINE-INVARIANT IMAGE MATCHING BASED ON GLOBAL BHATTACHARYYA MEASURE WITH ADAPTIVE TREE
    Son, Jongin
    Kim, Setingryong
    Sohn, Kwanghoon
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 3190 - 3194
  • [6] Affine-invariant Description of Keypoint Bundles for Detecting Partial Near-duplicates in Random Images
    Sluzek, Andrzej
    2013 IEEE 20TH INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS, AND SYSTEMS (ICECS), 2013, : 269 - 272
  • [7] Robust video watermarking based on affine invariant regions in the compressed domain
    Ling, Hefei
    Wang, Liyun
    Zou, Fuhao
    Lu, Zhengding
    Li, Ping
    SIGNAL PROCESSING, 2011, 91 (08) : 1863 - 1875
  • [8] On Affine Invariant Descriptors Related to SIFT
    Sadek, R.
    Constantinopoulos, C.
    Meinhardt, E.
    Ballester, C.
    Caselles, V.
    SIAM JOURNAL ON IMAGING SCIENCES, 2012, 5 (02): : 652 - 687
  • [9] AFFINE INVARIANT IMAGE COMPARISON UNDER REPETITIVE STRUCTURES
    Rodriguez, Mariano
    von Gioi, Rafael Grompone
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 1203 - 1207
  • [10] A New Shape Adaptation Scheme to Affine Invariant Detector
    Liu, Congxin
    Yang, Jie
    Zhou, Yue
    Feng, Deying
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2010, 4 (06): : 1253 - 1272