Transformer-Based Water Quality Forecasting With Dual Patch and Trend Decomposition

被引:0
|
作者
Lin, Yongze [1 ,2 ]
Qiao, Junfei [1 ,2 ]
Bi, Jing [2 ,3 ]
Yuan, Haitao [4 ]
Wang, Mengyuan [5 ]
Zhang, Jia [6 ]
Zhou, MengChu [7 ]
机构
[1] Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing 100124, Peoples R China
[3] Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Energy & Power Engn, Beijing 100191, Peoples R China
[6] Southern Methodist Univ, Dept Comp Sci, Dallas, TX 75206 USA
[7] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2025年 / 12卷 / 08期
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Time series analysis; Market research; Computational modeling; Predictive models; Water quality; Noise; Transformers; Accuracy; Long short term memory; Semantics; Savitsky-Golay (SG) filter; self-supervised learning; transformer; trend decomposition; water quality time series prediction; NEURAL-NETWORKS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In many fields, time series prediction is gaining more and more attention, e.g., air pollution, geological hazards, and network traffic prediction. Water quality prediction uses historical data to predict future water quality. However, it is difficult to learn a representation map from a time series that captures the trends and fluctuations to effectively remove noise from the time series data and investigate complex nonlinear relationships. To solve these problems, this work proposes a time series prediction model, called DPSGT for short, which integrates Dual Patch Savitsky-Golay filtering and Transformer. First, DPSGT adopts the SG filtering to decompose the time series data and reduce the noise interference to improve long-term prediction capabilities. Second, to tackle the limitation of temporal representation capability, DPSGT adopts dual patches to ravel temporal series into local and global patches, which can tackle local semantic information and enlarge the receptive field. Third, it utilizes a transformer mechanism to address the nonlinear problem of the water quality time series and improve the accuracy of the prediction. Two real-world datasets are utilized to evaluate the proposed DPSGT, and experiments prove that DPSGT improves root mean-square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and R-2 by 6%, 5%, 8%, and 7%, respectively, compared with other benchmark models.
引用
收藏
页码:10987 / 10997
页数:11
相关论文
共 50 条
  • [31] Transformer-Based Forecasting for Sustainable Energy Consumption Toward Improving Socioeconomic Living: AI-Enabled Energy Consumption Forecasting
    Sreekumar, Gautham
    Martin, John Paul
    Raghavan, S.
    Joseph, Christina Terese
    Raja, S. P.
    IEEE SYSTEMS MAN AND CYBERNETICS MAGAZINE, 2024, 10 (02): : 52 - 60
  • [32] A transformer-based method for correcting significant wave height numerical forecasting errors
    Kang, Xianbiao
    Song, Haijun
    Zhang, Zhanshuo
    Yin, Xunqiang
    Gu, Juan
    FRONTIERS IN MARINE SCIENCE, 2024, 11
  • [33] Empirical assessment of transformer-based neural network architecture in forecasting pollution trends
    Nath, Pritthijit
    Middya, Asif Iqbal
    Roy, Sarbani
    INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2023,
  • [34] Transformer-Based Spatiotemporal Graph Diffusion Convolution Network for Traffic Flow Forecasting
    Wei, Siwei
    Yang, Yang
    Liu, Donghua
    Deng, Ke
    Wang, Chunzhi
    ELECTRONICS, 2024, 13 (16)
  • [35] Locational marginal price forecasting using Transformer-based deep learning network
    Liao, Shengyi
    Wang, Zhuo
    Luo, Yao
    Liang, Haiyan
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 8457 - 8462
  • [36] An Analysis of Phase Noise in Transformer-Based Dual-Tank Oscillators
    El-Gouhary, Amany
    Neihart, Nathan M.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2014, 61 (07) : 2098 - 2109
  • [37] TXtreme: transformer-based extreme value prediction framework for time series forecasting
    Yadav, Hemant
    Thakkar, Amit
    DISCOVER APPLIED SCIENCES, 2025, 7 (02)
  • [38] Transformer-based dual-mode voltage-controlled oscillators
    Bevilacqua, Andrea
    Pavan, Federico P.
    Sandner, Christoph
    Gerosa, Andrea
    Neviani, Andrea
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2007, 54 (04) : 293 - 297
  • [39] Transformer-Based Dual-Channel Self-Attention for UUV Autonomous Collision Avoidance
    Lin, Changjian
    Cheng, Yuhu
    Wang, Xuesong
    Yuan, Jianya
    Wang, Guoqing
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (03): : 2319 - 2331
  • [40] A Transformer-Based Approach to Leakage Detection in Water Distribution Networks
    Luo, Juan
    Wang, Chongxiao
    Yang, Jielong
    Zhong, Xionghu
    SENSORS, 2024, 24 (19)