Bridging the Domain Gap in Satellite Pose Estimation: A Self-Training Approach Based on Geometrical Constraints

被引:28
作者
Wang, Zi [1 ,2 ]
Chen, Minglin [3 ]
Guo, Yulan [3 ,4 ]
Li, Zhang [1 ,2 ]
Yu, Qifeng [1 ,2 ]
机构
[1] Natl Univ Def Technol, Coll Aerosp Sci & Engn, Changsha 410073, Peoples R China
[2] Hunan Prov Key Lab Image Measurement & Vis Nav, Changsha 410073, Peoples R China
[3] Sun Yat Sen Univ, Sch Elect & Commun Engn, Shenzhen 518000, Peoples R China
[4] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Satellites; Pose estimation; Task analysis; Three-dimensional displays; Heating systems; Cameras; Training; Computer vision; deep learning; domain adaptation; satellite pose estimation; self-training;
D O I
10.1109/TAES.2023.3250385
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
Unsupervised domain adaptation in satellite posed estimation aimed at alleviating the annotation cost for training deep models has been gaining attention. To this end, we propose a self-training framework based on the domain-agnostic geometrical constraints. Specifically, we train a neural network to predict the 2-D keypoints of a satellite and then use perspective-n-point (PnP) to estimate the pose. The poses of target samples are regarded as latent variables to formulate the task as a minimization problem. Furthermore, we leverage fine-grained segmentation to tackle the information loss issue caused by abstracting the satellite as sparse keypoints. Finally, we iteratively solve the minimization problem in two steps: pseudolabel generation and network training. Experimental results show that our method adapts well to the target domain. Moreover, our method won the first place on the sunlamp task of the second international Satellite Pose Estimation Competition.
引用
收藏
页码:2500 / 2514
页数:15
相关论文
共 65 条
[1]  
[Anonymous], 2006, Multiple View Geometry in Computer Vision
[2]   Uncertainty-Driven 6D Pose Estimation of Objects and Scenes from a Single RGB Image [J].
Brachmann, Eric ;
Michel, Frank ;
Krull, Alexander ;
Yang, Michael Ying ;
Gumhold, Stefan ;
Rother, Carsten .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3364-3372
[3]   Albumentations: Fast and Flexible Image Augmentations [J].
Buslaev, Alexander ;
Iglovikov, Vladimir I. ;
Khvedchenya, Eugene ;
Parinov, Alex ;
Druzhinin, Mikhail ;
Kalinin, Alexandr A. .
INFORMATION, 2020, 11 (02)
[4]   Satellite Pose Estimation with Deep Landmark Regression and Nonlinear Pose Refinement [J].
Chen, Bo ;
Cao, Jiewei ;
Parra, Alvaro ;
Chin, Tat-Jun .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :2816-2824
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]   Domain Adaptive Faster R-CNN for Object Detection in the Wild [J].
Chen, Yuhua ;
Li, Wen ;
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3339-3348
[7]   Pose estimation of an uncooperative spacecraft from actual space imagery [J].
D'Amico, Simone ;
Benn, Mathias ;
Jorgensen, John L. .
INTERNATIONAL JOURNAL OF SPACE SCIENCE AND ENGINEERING, 2014, 2 (02) :171-189
[8]   Proximity operations about and identification of non-cooperative resident space objects using stereo imaging [J].
Davis, Jill ;
Pernicka, Henry .
ACTA ASTRONAUTICA, 2019, 155 :418-425
[9]   Unbiased Mean Teacher for Cross-domain Object Detection [J].
Deng, Jinhong ;
Li, Wen ;
Chen, Yuhua ;
Duan, Lixin .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4089-4099
[10]  
Fedorov V., 2022, Aerospace Systems, V5, P185