Real-Time Imputation Model for Missing Sensor Data Based on Alternating Attention Mechanism

被引:0
|
作者
Zhang, Mingxian [1 ,2 ]
Zhao, Ran [1 ,2 ]
Wang, Cong [1 ,2 ]
Jing, Ling [3 ]
Li, Daoliang [1 ,2 ]
机构
[1] China Agr Univ, Natl Innovat Ctr Digital Fishery, Key Lab Smart Farming Technol Aquat Anim & Livesto, Beijing Engn & Technol Res Ctr Internet Things Agr, Beijing 100083, Peoples R China
[2] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
[3] China Agr Univ, Beijing 100083, Peoples R China
关键词
Imputation; Time series analysis; Data models; Sensors; Feature extraction; Attention mechanisms; Context modeling; Computational modeling; Adaptation models; Transformers; Attention mechanism; comparison learning; missing data imputation; temporal dependencies; variables dependencies; FRAMEWORK;
D O I
10.1109/JSEN.2024.3519370
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In fields like healthcare and finance, multivariate time-series (MTS) data frequently encounter a growing number and complexity of missing values, hindering the application of advanced analytical methods. Effective imputation of missing sensor data is essential for accurate data analysis. In the MTS, the variable changing with time creates the time dependence, and the variables at each moment have a coupling relationship and influence each other. At the same time, the missing series has a similar representation ability to the complete series. Based on these time-series characteristics, this article establishes an MTS imputation model based on the attention mechanism and contrastive learning. The attention model is used to deeply extract the temporal dependencies as well as the dependencies among the variables, while contrastive learning is employed to ensure that missing series share similar feature representations with the original series, thereby enhancing the model's imputation performance for incomplete series. Finally, after conducting extensive experiments on two real-world MTS datasets that contain five missing patterns, and when compared to state-of-the-art (SOTA) methods, the model performed well, with 13 metrics achieving first place. Our method aims to provide a better database for tasks such as anomaly detection, classification, and prediction of MTS.
引用
收藏
页码:8962 / 8974
页数:13
相关论文
共 50 条
  • [1] Real-time Traffic Prediction: A Novel Imputation Optimization Algorithm with Missing Data
    Liu, Anqi
    Li, Changle
    Yue, Wenwei
    Zhou, Xun
    2018 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2018,
  • [2] A hybrid model for missing traffic flow data imputation based on clustering and attention mechanism optimizing LSTM and AdaBoost
    Shang, Qiang
    Tang, Yingping
    Yin, Longjiao
    SCIENTIFIC REPORTS, 2024, 14 (01):
  • [3] Real-time data-driven missing data imputation for short-term sensor data of marine systems. A comparative study
    Velasco-Gallego, Christian
    Lazakis, Iraklis
    OCEAN ENGINEERING, 2020, 218
  • [4] Real-time imputation of missing predictor values in clinical practice
    Nijman, Steven W. J.
    Hoogland, Jeroen
    Groenhof, T. Katrien J.
    Brandjes, Menno
    Jacobs, John J. L.
    Bots, Michiel L.
    Asselbergs, Folkert W.
    Moons, Karel G. M.
    Debray, Thomas P. A.
    EUROPEAN HEART JOURNAL - DIGITAL HEALTH, 2021, 2 (01): : 154 - 164
  • [5] PCA-based missing information imputation for real-time crash likelihood prediction under imbalanced data
    Ke, Jintao
    Zhang, Shuaichao
    Yang, Hai
    Chen, Xiqun
    TRANSPORTMETRICA A-TRANSPORT SCIENCE, 2018, 15 (02) : 872 - 895
  • [6] Multivariate time series data imputation using attention-based mechanism
    Zhao, Jingqi
    Rong, Chuitian
    Lin, Chunbin
    Dang, Xin
    NEUROCOMPUTING, 2023, 542
  • [7] Data Missing Mechanism and Missing Data Real-Time Processing Methods in the Construction Monitoring of Steel Structures
    Luo, Y. F.
    Ye, Z. W.
    Guo, X. N.
    Qiang, X. H.
    Chen, X. M.
    ADVANCES IN STRUCTURAL ENGINEERING, 2015, 18 (04) : 585 - 601
  • [8] Enhancing Sensor Data Imputation: OWA-Based Model Aggregation for Missing Values
    Al-Amidie, Muthana
    Alzubaidi, Laith
    Islam, Muhammad Aminul
    Anderson, Derek T.
    FUTURE INTERNET, 2024, 16 (06)
  • [9] REMIAN: Real-Time and Error-Tolerant Missing Value Imputation
    Ma, Qian
    Gu, Yu
    Lee, Wang-Chien
    Yu, Ge
    Liu, Hongbo
    Wu, Xindong
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2020, 14 (06)
  • [10] A Graph-Based Approach for Missing Sensor Data Imputation
    Jiang, Xiao
    Tian, Zean
    Li, Kenli
    IEEE SENSORS JOURNAL, 2021, 21 (20) : 23133 - 23144