Spatial-Temporal Federated Transfer Learning with multi-sensor data fusion for cooperative positioning

被引:27
|
作者
Zhou, Xiaokang [1 ,8 ]
Yang, Qiuyue [2 ]
Liu, Qiang [3 ]
Liang, Wei [2 ]
Wang, Kevin [4 ,6 ]
Liu, Zhi [5 ]
Ma, Jianhua
Jin, Qun [7 ]
机构
[1] Shiga Univ, Fac Data Sci, Hikone 5228522, Japan
[2] Hunan Univ Technol & Business, Changsha Social Lab Artificial Intelligence, Changsha 410205, Peoples R China
[3] Hunan Univ Technol & Business, Comp Sci Inst, Changsha 410205, Peoples R China
[4] Univ Auckland, Dept Elect Comp & Software Engn, Auckland 1010, New Zealand
[5] Univ Electrocommun, Dept Comp & Network Engn, Tokyo, Japan
[6] Hosei Univ, Fac Comp & Informat Sci, Chiyoda Ku, Tokyo 1028160, Japan
[7] Waseda Univ, Fac Human Sci, Tokorozawa 3591192, Japan
[8] RIKEN, RIKEN Ctr Adv Intelligence Project, Tokyo 1030027, Japan
基金
日本学术振兴会;
关键词
Federated Transfer Learning; Siamese Network; Spatial-Temporal Clustering; Data Fusion; Cooperative Positioning; NEURAL-NETWORK; SIAMESE;
D O I
10.1016/j.inffus.2023.102182
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the development of advanced embedded and communication systems, location information has become crucial factor in supporting context -aware or location -aware intelligent services. Among these services, modern Intelligent Transportation System (ITS) has the strictest requirements for real-time, accurate, and private location data. In this study, a Spatial -Temporal Federated Transfer Learning (ST-FTL) framework is designed and introduced to achieve more precise cooperative positioning with multi -sensor data fusion while protecting the location data privacy in urban ITS. Specifically, a three -layer FTL architecture is constructed to enhance the prediction accuracy on GPS positioning errors for vehicles in different regions especially when facing missing local data in some specific scenarios (e.g., urban canyons), in which Transfer Learning (TL) is incorporated to optimize the initialization of global model with faster convergence but less communication cost in Federated Learning (FL). A multi -attribute based spatial -temporal clustering algorithm is developed to facilitate the finding of more appropriate source domains similar to the target domain in a density -based scheme, while convolutional -gated unit is newly designed to further filter out the useless features and add new features based on the convolution operations and gating mechanism, resulting in more effective global model initialization and weight aggregation from cross -region selection. A multi -sensor data fusion model is built in local to improve the prediction accuracy on positioning errors, in which an improved time -aware asymmetric attention mechanism is involved to selectively adjust the weight importance of the incorporated GPS and Inertial Measurement Unit (IMU) data in a more targeted fusion process. Additionally, an improved Siamese network structure, which breaks the traditional dual network structure and only adopts one single network structure, is leveraged to realize the lightweight data augmentation based on the better utilization of historical similar data from local vehicles themselves, when suffering from insufficient training data. Experiments and evaluations based on two different public datasets demonstrate the outstanding performance of our proposed model and method in achieving superior prediction accuracy and faster convergence for cooperative positioning compared with other state-of-the-art positioning methods in urban ITS.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] An estimator for multi-sensor data fusion
    Thejaswi, C.
    Ganapathy, V.
    Patro, R. K.
    Raina, M.
    Ghosh, S. K.
    2006 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-6, PROCEEDINGS, 2006, : 2690 - +
  • [22] Qualitative multi-sensor data fusion
    Falomir, Z
    Escrig, AT
    RECENT ADVANCES IN ARTIFICIAL INTELLIGENCE RESEARCH AND DEVELOPMENT, 2004, 113 : 259 - 266
  • [23] Multi-sensor data fusion architecture
    Al-Dhaher, AHG
    Mackesy, D
    3RD IEEE INTERNATIONAL WORKSHOP ON HAPTIC, AUDIO AND VISUAL ENVIRONMENTS AND THEIR APPLICATIONS - HAVE 2004, 2004, : 159 - 163
  • [24] A Low-Cost and Robust Multi-Sensor Data Fusion Scheme for Heterogeneous Multi-Robot Cooperative Positioning in Indoor Environments
    Cai, Zhi
    Liu, Jiahang
    Chi, Weijian
    Zhang, Bo
    REMOTE SENSING, 2023, 15 (23)
  • [25] A multi-sensor mapping Bi-LSTM model of bridge monitoring data based on spatial-temporal attention mechanism
    Yang, Kang
    Ding, Youliang
    Geng, Fangfang
    Jiang, Huachen
    Zou, Zhengbo
    MEASUREMENT, 2023, 217
  • [26] Multi-sensor Data Fusion Method Based on ARIMA-LightGBM for AGV Positioning
    Che, HongLei
    2021 5TH INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION SCIENCES (ICRAS 2021), 2021, : 272 - 276
  • [27] Multi-sensor Data fusion in wireless sensor networks
    Yin Zhenyu
    Zhao Hai
    Lin Kai
    Sun Peigang
    Gong Yishan
    Zhang Yongqing
    Xu Ye
    2006 IMACS: MULTICONFERENCE ON COMPUTATIONAL ENGINEERING IN SYSTEMS APPLICATIONS, VOLS 1 AND 2, 2006, : 1690 - +
  • [28] An Adaptive Federated Relevance Framework for Spatial-Temporal Graph Learning
    Zhang T.
    Liu Y.
    Shen Z.
    Xu R.
    Chen X.
    Huang X.
    Zheng X.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (05): : 2227 - 2240
  • [29] A multi-temporal multi-sensor circular fusion filter
    Stienne, G.
    Reboul, S.
    Azmani, M.
    Choquel, J. B.
    Benjelloun, M.
    INFORMATION FUSION, 2014, 18 : 86 - 100
  • [30] Survey of Federated Learning Models for Spatial-Temporal Mobility Applications
    Belal, Yacine
    Ben Mokhtar, Sonia
    Haddadi, Hamed
    Wang, Jaron
    Mashhadi, Afra
    ACM TRANSACTIONS ON SPATIAL ALGORITHMS AND SYSTEMS, 2024, 10 (03)