Spatial-Temporal Federated Transfer Learning with multi-sensor data fusion for cooperative positioning

被引:27
|
作者
Zhou, Xiaokang [1 ,8 ]
Yang, Qiuyue [2 ]
Liu, Qiang [3 ]
Liang, Wei [2 ]
Wang, Kevin [4 ,6 ]
Liu, Zhi [5 ]
Ma, Jianhua
Jin, Qun [7 ]
机构
[1] Shiga Univ, Fac Data Sci, Hikone 5228522, Japan
[2] Hunan Univ Technol & Business, Changsha Social Lab Artificial Intelligence, Changsha 410205, Peoples R China
[3] Hunan Univ Technol & Business, Comp Sci Inst, Changsha 410205, Peoples R China
[4] Univ Auckland, Dept Elect Comp & Software Engn, Auckland 1010, New Zealand
[5] Univ Electrocommun, Dept Comp & Network Engn, Tokyo, Japan
[6] Hosei Univ, Fac Comp & Informat Sci, Chiyoda Ku, Tokyo 1028160, Japan
[7] Waseda Univ, Fac Human Sci, Tokorozawa 3591192, Japan
[8] RIKEN, RIKEN Ctr Adv Intelligence Project, Tokyo 1030027, Japan
基金
日本学术振兴会;
关键词
Federated Transfer Learning; Siamese Network; Spatial-Temporal Clustering; Data Fusion; Cooperative Positioning; NEURAL-NETWORK; SIAMESE;
D O I
10.1016/j.inffus.2023.102182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the development of advanced embedded and communication systems, location information has become crucial factor in supporting context -aware or location -aware intelligent services. Among these services, modern Intelligent Transportation System (ITS) has the strictest requirements for real-time, accurate, and private location data. In this study, a Spatial -Temporal Federated Transfer Learning (ST-FTL) framework is designed and introduced to achieve more precise cooperative positioning with multi -sensor data fusion while protecting the location data privacy in urban ITS. Specifically, a three -layer FTL architecture is constructed to enhance the prediction accuracy on GPS positioning errors for vehicles in different regions especially when facing missing local data in some specific scenarios (e.g., urban canyons), in which Transfer Learning (TL) is incorporated to optimize the initialization of global model with faster convergence but less communication cost in Federated Learning (FL). A multi -attribute based spatial -temporal clustering algorithm is developed to facilitate the finding of more appropriate source domains similar to the target domain in a density -based scheme, while convolutional -gated unit is newly designed to further filter out the useless features and add new features based on the convolution operations and gating mechanism, resulting in more effective global model initialization and weight aggregation from cross -region selection. A multi -sensor data fusion model is built in local to improve the prediction accuracy on positioning errors, in which an improved time -aware asymmetric attention mechanism is involved to selectively adjust the weight importance of the incorporated GPS and Inertial Measurement Unit (IMU) data in a more targeted fusion process. Additionally, an improved Siamese network structure, which breaks the traditional dual network structure and only adopts one single network structure, is leveraged to realize the lightweight data augmentation based on the better utilization of historical similar data from local vehicles themselves, when suffering from insufficient training data. Experiments and evaluations based on two different public datasets demonstrate the outstanding performance of our proposed model and method in achieving superior prediction accuracy and faster convergence for cooperative positioning compared with other state-of-the-art positioning methods in urban ITS.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Precise Timestamping and Temporal Synchronization in Multi-Sensor Fusion
    Huck, Tobias
    Westenberger, Antje
    Fritzsche, Martin
    Schwarz, Tilo
    Dietmayer, Klaus
    2011 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2011, : 242 - 247
  • [42] Temporal fusion in multi-sensor target tracking systems
    Niu, RX
    Varshney, P
    Mehrotra, K
    Mohan, C
    PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON INFORMATION FUSION, VOL II, 2002, : 1030 - 1037
  • [43] COLLABORATIVE MULTI-SENSOR TRACKING AND DATA FUSION
    DeMars, Kyle J.
    McCabe, James S.
    Darling, Jacob E.
    SPACEFLIGHT MECHANICS 2015, PTS I-III, 2015, 155 : 1089 - 1108
  • [44] Research and Improvement of Multi-sensor Data Fusion
    Li Qiong
    Zhou Xiaobin
    Yang Jun
    PROCEEDINGS OF 2012 INTERNATIONAL CONFERENCE ON IMAGE ANALYSIS AND SIGNAL PROCESSING, 2012, : 342 - 344
  • [45] A New Method of Multi-Sensor Data Fusion
    Han, Xu
    Sheng, Huaijie
    2017 IEEE 3RD INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC), 2017, : 877 - 882
  • [46] Multi-sensor Data Fusion in Automotive Applications
    Herpel, Thomas
    Lauer, Christoph
    German, Reinhard
    Salzberger, Johannes
    PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON SENSING TECHNOLOGY, 2008, : 206 - +
  • [47] The Research of Multi-sensor Data Fusion Technology
    Jiao, Wen-cheng
    Han, Shuai
    Cui, Pei-zhang
    Wang, Xin
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER SCIENCE (AICS 2016), 2016, : 294 - 299
  • [48] Research on multi-sensor data fusion technique
    Wang Hongliang
    Ma Zhigang
    ISTM/2007: 7TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-7, CONFERENCE PROCEEDINGS, 2007, : 3480 - 3483
  • [49] Spatial-temporal dual-channel adaptive graph convolutional network for remaining useful life prediction with multi-sensor information fusion
    Zhang, Xingwu
    Leng, Zhenjiang
    Zhao, Zhibin
    Li, Ming
    Yu, Dan
    Chen, Xuefeng
    ADVANCED ENGINEERING INFORMATICS, 2023, 57
  • [50] Data Fusion in Distributed Multi-sensor System
    GUO Hang YU Min
    Geo-Spatial Information Science, 2004, (03) : 214 - 217