Semi-supervised Anatomy Tracking with Contrastive Representation Learning in Ultrasound Sequences

被引:1
作者
Liang, Hanying [1 ]
Ning, Guochen [1 ]
Zhang, Xinran [1 ]
Liao, Hongen [1 ]
机构
[1] Tsinghua Univ, Dept Biomed Engn, Beijing, Peoples R China
来源
2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI | 2023年
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Semi-supervised learning; anatomy tracking; ultrasound sequences; contrastive learning; pseudo labeling; LOCALIZATION; IMAGES;
D O I
10.1109/ISBI53787.2023.10230348
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anatomy tracking plays an essential role in real-time US image interpretation. However, the low US image quality poses a challenge to this task. Intensive manual labeling is often required to obtain acceptable performance. In this work, we propose a Semi-Supervised US Anatomy Tracking method (SSAT-US) with minimum supervision for each US sequence. Self-supervised contrastive learning (SSCL) along with US-specific data augmentation is first applied to warm up a discriminative patch feature representation. To take full advantage of the unlabeled data, a confidence-aware pseudo-labeling module is presented to select reliable training pairs for semi-supervised training. Evaluations on clinical and public datasets of different anatomies were conducted. Results showed that SSAT-US could achieve accurate tracking performance with 0.832 (EAO), 0.000 (Rob), 0.812 (Acc), and generalize to the challenging unseen dataset with 0.472 (EAO), 0.329 (Rob), 0.789 (Acc), demonstrating that our method could perform accurate and robust anatomy-agnostic real-time tracking in US sequences.
引用
收藏
页数:5
相关论文
共 18 条
[1]   Fully-Convolutional Siamese Networks for Object Tracking [J].
Bertinetto, Luca ;
Valmadre, Jack ;
Henriques, Joao F. ;
Vedaldi, Andrea ;
Torr, Philip H. S. .
COMPUTER VISION - ECCV 2016 WORKSHOPS, PT II, 2016, 9914 :850-865
[2]  
Bharadwa S., 2020, 2020 IEEE INT ULTR S, P1
[3]   USCL: Pretraining Deep Ultrasound Image Diagnosis Model Through Video Contrastive Representation Learning [J].
Chen, Yixiong ;
Zhang, Chunhui ;
Liu, Li ;
Feng, Cheng ;
Dong, Changfeng ;
Luo, Yongfang ;
Wan, Xiang .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VIII, 2021, 12908 :627-637
[4]  
Fu Z., 2022, P EUR C COMP VIS MED, P1
[5]  
Gomariz A, 2019, I S BIOMED IMAGING, P1757, DOI [10.1109/ISBI.2019.8759382, 10.1109/isbi.2019.8759382]
[6]  
Grill J.-B., 2020, ADV NEURAL INFORM PR, V33, P21271
[7]   Autonomous Robotic Screening of Tubular Structures Based Only on Real-Time Ultrasound Imaging Feedback [J].
Jiang, Zhongliang ;
Li, Zhenyu ;
Grimm, Matthias ;
Zhou, Mingchuan ;
Esposito, Marco ;
Wein, Wolfgang ;
Stechele, Walter ;
Wendler, Thomas ;
Navab, Nassir .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (07) :7064-7075
[8]   The Visual Object Tracking VOT2015 challenge results [J].
Kristan, Matej ;
Matas, Jiri ;
Leonardis, Ales ;
Felsberg, Michael ;
Cehovin, Luka ;
Fernandez, Gustavo ;
Vojir, Tomas ;
Hager, Gustav ;
Nebehay, Georg ;
Pflugfelder, Roman ;
Gupta, Abhinav ;
Bibi, Adel ;
Lukezic, Alan ;
Garcia-Martins, Alvaro ;
Saffari, Amir ;
Petrosino, Alfredo ;
Montero, Andres Solis ;
Varfolomieiev, Anton ;
Baskurt, Atilla ;
Zhao, Baojun ;
Ghanem, Bernard ;
Martinez, Brais ;
Lee, ByeongJu ;
Han, Bohyung ;
Wang, Chaohui ;
Garcia, Christophe ;
Zhang, Chunyuan ;
Schmid, Cordelia ;
Tao, Dacheng ;
Kim, Daijin ;
Huang, Dafei ;
Prokhorov, Danil ;
Du, Dawei ;
Yeung, Dit-Yan ;
Ribeiro, Eraldo ;
Khan, Fahad Shahbaz ;
Porikli, Fatih ;
Bunyak, Filiz ;
Zhu, Gao ;
Seetharaman, Guna ;
Kieritz, Hilke ;
Yau, Hing Tuen ;
Li, Hongdong ;
Qi, Honggang ;
Bischof, Horst ;
Possegger, Horst ;
Lee, Hyemin ;
Nam, Hyeonseob ;
Bogun, Ivan ;
Jeong, Jae-chan .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOP (ICCVW), 2015, :564-586
[9]   A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images [J].
Leitner, Christoph ;
Jarolim, Robert ;
Englmair, Bernhard ;
Kruse, Annika ;
Hernandez, Karen Andrea Lara ;
Konrad, Andreas ;
Su, Eric Yung-Sheng ;
Schroettner, Joerg ;
Kelly, Luke A. ;
Lichtwark, Glen A. ;
Tilp, Markus ;
Baumgartner, Christian .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2022, 69 (06) :1920-1930
[10]  
Liu F., 2022, Medical image analysis, V65, P1