Trajectory-BERT: Trajectory Estimation Based on BERT Trajectory Pre-Training Model and Particle Filter Algorithm

被引:0
|
作者
Wu, You [1 ]
Yu, Hongyi [1 ]
Du, Jianping [1 ]
Ge, Chenglong [1 ]
机构
[1] PLA Strateg Support Force Informat Engn Univ, Informat Syst Engn Coll, Zhengzhou 450001, Peoples R China
关键词
BERT; trajectory; particle filter; maximum posterior probability; RECURRENT NEURAL-NETWORKS;
D O I
10.3390/s23229120
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
In the realm of aviation, trajectory data play a crucial role in determining the target's flight intentions and guaranteeing flight safety. However, the data collection process can be hindered by noise or signal interruptions, thus diminishing the precision of the data. This paper uses the bidirectional encoder representations from transformers (BERT) model to solve the problem by masking the high-precision automatic dependent survey broadcast (ADS-B) trajectory data and estimating the mask position value based on the front and rear trajectory points during BERT model training. Through this process, the model acquires knowledge of intricate motion patterns within the trajectory data and acquires the BERT pre-training Model. Afterwards, a refined particle filter algorithm is utilized to generate alternative trajectory sets for observation trajectory data that is prone to noise. Ultimately, the BERT trajectory pre-training model is supplied with the alternative trajectory set, and the optimal trajectory is determined by computing the maximum posterior probability. The results of the experiment show that the model has good performance and is stronger than traditional algorithms.
引用
收藏
页数:18
相关论文
共 33 条
  • [1] Research on ship AIS trajectory estimation based on particle filter algorithm
    Lian, Yujie
    Yang, Lujing
    Lu, Lingfeng
    Sun, Jingbo
    Lu, Yu
    2019 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC 2019), VOL 1, 2019, : 305 - 308
  • [2] On Effectiveness of Further Pre-training on BERT Models for Story Point Estimation
    Amasaki, Sousuke
    PROCEEDINGS OF THE 19TH INTERNATIONAL CONFERENCE ON PREDICTIVE MODELS AND DATA ANALYTICS IN SOFTWARE ENGINEERING, PROMISE 2023, 2023, : 49 - 53
  • [3] Research frontiers of pre-training mathematical models based on BERT
    Li, Guang
    Wang, Wennan
    Zhu, Liukai
    Peng, Jun
    Li, Xujia
    Luo, Ruijie
    2022 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, BIG DATA AND ALGORITHMS (EEBDA), 2022, : 154 - 158
  • [4] UniTE: A Survey and Unified Pipeline for Pre-Training Spatiotemporal Trajectory Embeddings
    Lin, Yan
    Zhou, Zeyu
    Liu, Yicheng
    Lv, Haochen
    Wen, Haomin
    Li, Tianyi
    Li, Yushuai
    Jensen, Christian S.
    Guo, Shengnan
    Lin, Youfang
    Wan, Huaiyu
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (03) : 1475 - 1494
  • [5] Trajectory-based fish event classification through pre-training with diffusion models
    Canovi, Noemi
    Ellis, Benjamin A.
    Sordalen, Tonje K.
    Allken, Vaneeda
    Halvorsen, Kim T.
    Malde, Ketil
    Beyan, Cigdem
    ECOLOGICAL INFORMATICS, 2024, 82
  • [6] Boosting UAV Tracking With Voxel-Based Trajectory-Aware Pre-Training
    Li, Sihang
    Fu, Changhong
    Lu, Kunhan
    Zuo, Haobo
    Li, Yiming
    Feng, Chen
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) : 1133 - 1140
  • [7] Bathymetric Particle Filter SLAM Based on Mean Trajectory Map Representation
    Zhang, Qianyi
    Li, Ye
    Ma, Teng
    Cong, Zheng
    Zhang, Wenjun
    IEEE ACCESS, 2021, 9 : 71725 - 71736
  • [8] Pre-Training General Trajectory Embeddings With Maximum Multi-View Entropy Coding
    Lin, Yan
    Wan, Huaiyu
    Guo, Shengnan
    Hu, Jilin
    Jensen, Christian S.
    Lin, Youfang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 9037 - 9050
  • [9] Target Trajectory Estimation Algorithm Based on TimeFrequency Enhancement
    Peng, Yiqun
    Ding, Yipeng
    Zhang, Jiawei
    Jin, Bo
    Chen, Yuxin
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [10] Investigation of improving the pre-training and fine-tuning of BERT model for biomedical relation extraction
    Peng Su
    K. Vijay-Shanker
    BMC Bioinformatics, 23