Transformer-Based Water Quality Forecasting With Dual Patch and Trend Decomposition

被引:0
|
作者
Lin, Yongze [1 ,2 ]
Qiao, Junfei [1 ,2 ]
Bi, Jing [2 ,3 ]
Yuan, Haitao [4 ]
Wang, Mengyuan [5 ]
Zhang, Jia [6 ]
Zhou, MengChu [7 ]
机构
[1] Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing 100124, Peoples R China
[3] Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Energy & Power Engn, Beijing 100191, Peoples R China
[6] Southern Methodist Univ, Dept Comp Sci, Dallas, TX 75206 USA
[7] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2025年 / 12卷 / 08期
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Time series analysis; Market research; Computational modeling; Predictive models; Water quality; Noise; Transformers; Accuracy; Long short term memory; Semantics; Savitsky-Golay (SG) filter; self-supervised learning; transformer; trend decomposition; water quality time series prediction; NEURAL-NETWORKS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In many fields, time series prediction is gaining more and more attention, e.g., air pollution, geological hazards, and network traffic prediction. Water quality prediction uses historical data to predict future water quality. However, it is difficult to learn a representation map from a time series that captures the trends and fluctuations to effectively remove noise from the time series data and investigate complex nonlinear relationships. To solve these problems, this work proposes a time series prediction model, called DPSGT for short, which integrates Dual Patch Savitsky-Golay filtering and Transformer. First, DPSGT adopts the SG filtering to decompose the time series data and reduce the noise interference to improve long-term prediction capabilities. Second, to tackle the limitation of temporal representation capability, DPSGT adopts dual patches to ravel temporal series into local and global patches, which can tackle local semantic information and enlarge the receptive field. Third, it utilizes a transformer mechanism to address the nonlinear problem of the water quality time series and improve the accuracy of the prediction. Two real-world datasets are utilized to evaluate the proposed DPSGT, and experiments prove that DPSGT improves root mean-square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and R-2 by 6%, 5%, 8%, and 7%, respectively, compared with other benchmark models.
引用
收藏
页码:10987 / 10997
页数:11
相关论文
共 50 条
  • [1] A Transformer-Based Regression Scheme for Forecasting Significant Wave Heights in Oceans
    Pokhrel, Pujan
    Ioup, Elias
    Simeonov, Julian
    Hoque, Md Tamjidul
    Abdelguerfi, Mahdi
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2022, 47 (04) : 1010 - 1023
  • [2] Egocentric Early Action Prediction via Multimodal Transformer-Based Dual Action Prediction
    Guan, Weili
    Song, Xuemeng
    Wang, Kejie
    Wen, Haokun
    Ni, Hongda
    Wang, Yaowei
    Chang, Xiaojun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 4472 - 4483
  • [3] Transformer-Based Global Zenith Tropospheric Delay Forecasting Model
    Zhang, Huan
    Yao, Yibin
    Xu, Chaoqian
    Xu, Wei
    Shi, Junbo
    REMOTE SENSING, 2022, 14 (14)
  • [4] Transformer-Based Model for Electrical Load Forecasting
    L'Heureux, Alexandra
    Grolinger, Katarina
    Capretz, Miriam A. M.
    ENERGIES, 2022, 15 (14)
  • [5] A transformer-based framework for enterprise sales forecasting
    Sun, Yupeng
    Li, Tian
    PEERJ COMPUTER SCIENCE, 2024, 10 : 1 - 14
  • [6] MSPT: A Transformer-Based Model Using Multiscale Periodic Information for 10-30 d Subseasonal Daily Sea Surface Temperature Forecasting
    He, Qi
    Lan, Zhenfeng
    Song, Wei
    Zhang, Wenbo
    Du, Yanling
    Zhao, Wei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 8399 - 8415
  • [7] TrEnD: A transformer-based encoder-decoder model with adaptive patch embedding for mass segmentation in mammograms
    Liu, Dongdong
    Wu, Bo
    Li, Changbo
    Sun, Zheng
    Zhang, Nan
    MEDICAL PHYSICS, 2023, 50 (05) : 2884 - 2899
  • [8] WindTrans: Transformer-Based Wind Speed Forecasting Method for High-Speed Railway
    Liu, Chen
    He, Shibo
    Liu, Haoyu
    Chen, Jiming
    Dong, Hairong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (06) : 4947 - 4963
  • [9] A Dual-Scale Transformer-Based Remaining Useful Life Prediction Model in Industrial Internet of Things
    Li, Junhuai
    Wang, Kan
    Hou, Xiangwang
    Lan, Dapeng
    Wu, Yunwen
    Wang, Huaijun
    Liu, Lei
    Mumtaz, Shahid
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (16): : 26656 - 26667
  • [10] A Transformer-Based Method of Multienergy Load Forecasting in Integrated Energy System
    Wang, Chen
    Wang, Ying
    Ding, Zhetong
    Zheng, Tao
    Hu, Jiangyi
    Zhang, Kaifeng
    IEEE TRANSACTIONS ON SMART GRID, 2022, 13 (04) : 2703 - 2714