Spatial-Temporal Federated Transfer Learning with multi-sensor data fusion for cooperative positioning

被引:27
|
作者
Zhou, Xiaokang [1 ,8 ]
Yang, Qiuyue [2 ]
Liu, Qiang [3 ]
Liang, Wei [2 ]
Wang, Kevin [4 ,6 ]
Liu, Zhi [5 ]
Ma, Jianhua
Jin, Qun [7 ]
机构
[1] Shiga Univ, Fac Data Sci, Hikone 5228522, Japan
[2] Hunan Univ Technol & Business, Changsha Social Lab Artificial Intelligence, Changsha 410205, Peoples R China
[3] Hunan Univ Technol & Business, Comp Sci Inst, Changsha 410205, Peoples R China
[4] Univ Auckland, Dept Elect Comp & Software Engn, Auckland 1010, New Zealand
[5] Univ Electrocommun, Dept Comp & Network Engn, Tokyo, Japan
[6] Hosei Univ, Fac Comp & Informat Sci, Chiyoda Ku, Tokyo 1028160, Japan
[7] Waseda Univ, Fac Human Sci, Tokorozawa 3591192, Japan
[8] RIKEN, RIKEN Ctr Adv Intelligence Project, Tokyo 1030027, Japan
基金
日本学术振兴会;
关键词
Federated Transfer Learning; Siamese Network; Spatial-Temporal Clustering; Data Fusion; Cooperative Positioning; NEURAL-NETWORK; SIAMESE;
D O I
10.1016/j.inffus.2023.102182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the development of advanced embedded and communication systems, location information has become crucial factor in supporting context -aware or location -aware intelligent services. Among these services, modern Intelligent Transportation System (ITS) has the strictest requirements for real-time, accurate, and private location data. In this study, a Spatial -Temporal Federated Transfer Learning (ST-FTL) framework is designed and introduced to achieve more precise cooperative positioning with multi -sensor data fusion while protecting the location data privacy in urban ITS. Specifically, a three -layer FTL architecture is constructed to enhance the prediction accuracy on GPS positioning errors for vehicles in different regions especially when facing missing local data in some specific scenarios (e.g., urban canyons), in which Transfer Learning (TL) is incorporated to optimize the initialization of global model with faster convergence but less communication cost in Federated Learning (FL). A multi -attribute based spatial -temporal clustering algorithm is developed to facilitate the finding of more appropriate source domains similar to the target domain in a density -based scheme, while convolutional -gated unit is newly designed to further filter out the useless features and add new features based on the convolution operations and gating mechanism, resulting in more effective global model initialization and weight aggregation from cross -region selection. A multi -sensor data fusion model is built in local to improve the prediction accuracy on positioning errors, in which an improved time -aware asymmetric attention mechanism is involved to selectively adjust the weight importance of the incorporated GPS and Inertial Measurement Unit (IMU) data in a more targeted fusion process. Additionally, an improved Siamese network structure, which breaks the traditional dual network structure and only adopts one single network structure, is leveraged to realize the lightweight data augmentation based on the better utilization of historical similar data from local vehicles themselves, when suffering from insufficient training data. Experiments and evaluations based on two different public datasets demonstrate the outstanding performance of our proposed model and method in achieving superior prediction accuracy and faster convergence for cooperative positioning compared with other state-of-the-art positioning methods in urban ITS.
引用
收藏
页数:14
相关论文
共 50 条
  • [31] Spatial-Temporal Evidence Combination Method for Multi-sensor Target Recognition Based on Prospect Theory
    Zhang, Zihan
    Hu, Zhentao
    Li, Junwei
    Su, Yujie
    2022 7TH INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION ENGINEERING, ICRAE, 2022, : 365 - 369
  • [32] A Spatial-Temporal Adaptive Graph Convolutional Network with Multi-Sensor Signals for Tool Wear Prediction
    Xia, Yu
    Zheng, Guangji
    Li, Ye
    Liu, Hui
    APPLIED SCIENCES-BASEL, 2025, 15 (04):
  • [33] Spatial-Temporal Weighted Attention Model for Cooperative Vehicular Positioning System
    Chang, Hsin-Yuan
    Chang, Wei-En
    Chung, Wei-Ho
    IEEE SENSORS JOURNAL, 2025, 25 (04) : 7655 - 7666
  • [34] Multi-Sensor Fusion Vehicle Positioning Based on Kalman Filter
    Guan, Hsin
    Li, Luhao
    Jia, Xin
    2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST), 2013, : 296 - 299
  • [35] Multi-sensor fusion methodology for enhanced land vehicle positioning
    Li Xu
    Chen Wei
    Chan Chingyao
    Li Bin
    Song Xianghui
    INFORMATION FUSION, 2019, 46 : 51 - 62
  • [36] Multi-sensor Fusion Positioning System and Experimental Study of Roadheader
    Liu S.
    Cui Y.
    Meng D.
    Gu C.
    Li H.
    Jiang H.
    Zhendong Ceshi Yu Zhenduan/Journal of Vibration, Measurement and Diagnosis, 2023, 43 (03): : 476 - 484and618
  • [37] Learning Online Multi-sensor Depth Fusion
    Sandstrom, Erik
    Oswald, Martin R.
    Kumar, Suryansh
    Weder, Silvan
    Yu, Fisher
    Sminchisescu, Cristian
    Van Gool, Luc
    COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 87 - 105
  • [38] An iBeacon Indoor Positioning System based on Multi-sensor Fusion
    Shao, Shuai
    Shuo, Nan
    Kubota, Naoyuki
    2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 1115 - 1120
  • [39] Deep Transform Learning for Multi-Sensor Fusion
    Sahu, Saurabh
    Kumar, Kriti
    Majumdar, Angshul
    Chandra, M. Girish
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1996 - 2000
  • [40] Evaluation of Multi-Sensor Fusion Methods for Ultrasonic Indoor Positioning
    Mannay, Khaoula
    Urena, Jesus
    Hernandez, Alvaro
    Villadangos, Jose M.
    Machhout, Mohsen
    Aguili, Taoufik
    APPLIED SCIENCES-BASEL, 2021, 11 (15):