Transformer-Based Water Quality Forecasting With Dual Patch and Trend Decomposition

被引:0
|
作者
Lin, Yongze [1 ,2 ]
Qiao, Junfei [1 ,2 ]
Bi, Jing [2 ,3 ]
Yuan, Haitao [4 ]
Wang, Mengyuan [5 ]
Zhang, Jia [6 ]
Zhou, MengChu [7 ]
机构
[1] Beijing Univ Technol, Sch Informat Sci & Technol, Beijing 100124, Peoples R China
[2] Beijing Univ Technol, Beijing Lab Smart Environm Protect, Beijing 100124, Peoples R China
[3] Beijing Univ Technol, Coll Comp Sci, Beijing 100124, Peoples R China
[4] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100191, Peoples R China
[5] Beihang Univ, Sch Energy & Power Engn, Beijing 100191, Peoples R China
[6] Southern Methodist Univ, Dept Comp Sci, Dallas, TX 75206 USA
[7] New Jersey Inst Technol, Dept Elect & Comp Engn, Newark, NJ 07102 USA
来源
IEEE INTERNET OF THINGS JOURNAL | 2025年 / 12卷 / 08期
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
Time series analysis; Market research; Computational modeling; Predictive models; Water quality; Noise; Transformers; Accuracy; Long short term memory; Semantics; Savitsky-Golay (SG) filter; self-supervised learning; transformer; trend decomposition; water quality time series prediction; NEURAL-NETWORKS;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In many fields, time series prediction is gaining more and more attention, e.g., air pollution, geological hazards, and network traffic prediction. Water quality prediction uses historical data to predict future water quality. However, it is difficult to learn a representation map from a time series that captures the trends and fluctuations to effectively remove noise from the time series data and investigate complex nonlinear relationships. To solve these problems, this work proposes a time series prediction model, called DPSGT for short, which integrates Dual Patch Savitsky-Golay filtering and Transformer. First, DPSGT adopts the SG filtering to decompose the time series data and reduce the noise interference to improve long-term prediction capabilities. Second, to tackle the limitation of temporal representation capability, DPSGT adopts dual patches to ravel temporal series into local and global patches, which can tackle local semantic information and enlarge the receptive field. Third, it utilizes a transformer mechanism to address the nonlinear problem of the water quality time series and improve the accuracy of the prediction. Two real-world datasets are utilized to evaluate the proposed DPSGT, and experiments prove that DPSGT improves root mean-square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and R-2 by 6%, 5%, 8%, and 7%, respectively, compared with other benchmark models.
引用
收藏
页码:10987 / 10997
页数:11
相关论文
共 50 条
  • [41] A Hardware-Friendly Tiled Singular-Value Decomposition-Based Matrix Multiplication for Transformer-Based Models
    Li, Hailong
    Choi, Jaewan
    Kwon, Yongsuk
    Ahn, Jung Ho
    IEEE COMPUTER ARCHITECTURE LETTERS, 2023, 22 (02) : 169 - 172
  • [42] A Transformer-Based Multi-Entity Load Forecasting Method for Integrated Energy Systems
    Wang, Zhiyu
    Zhu, Zhen
    Xiao, Geyang
    Bai, Bing
    Zhang, Yinjie
    FRONTIERS IN ENERGY RESEARCH, 2022, 10
  • [43] Advancements in weather forecasting for precision agriculture: From statistical modeling to transformer-based architectures
    El Hachimi, Chouaib
    Belaqziz, Salwa
    Khabba, Said
    Hssaine, Bouchra Ait
    Kharrou, Mohamed Hakim
    Chehbouni, Abdelghani
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2024, 38 (09) : 3695 - 3717
  • [44] TCLN: A Transformer-based Conv-LSTM network for multivariate time series forecasting
    Shusen Ma
    Tianhao Zhang
    Yun-Bo Zhao
    Yu Kang
    Peng Bai
    Applied Intelligence, 2023, 53 : 28401 - 28417
  • [45] Transformer-based dual path cross fusion for pansharpening remote sensing images
    Li, Zixu
    Li, Jinjiang
    Ren, Lu
    Chen, Zheng
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2024, 45 (04) : 1170 - 1200
  • [46] TCLN: A Transformer-based Conv-LSTM network for multivariate time series forecasting
    Ma, Shusen
    Zhang, Tianhao
    Zhao, Yun-Bo
    Kang, Yu
    Bai, Peng
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28401 - 28417
  • [47] A 3.16–7 GHz transformer-based dual-band CMOS VCO
    李竹
    王志功
    李智群
    李芹
    刘法恩
    Journal of Semiconductors, 2015, (03) : 110 - 117
  • [48] A transformer-based deep neural network with wavelet transform for forecasting wind speed and wind energy
    Nascimento, Erick Giovani Sperandio
    de Melo, Talison A. C.
    Moreira, Davidson M.
    ENERGY, 2023, 278
  • [49] RSMformer: an efficient multiscale transformer-based framework for long sequence time-series forecasting
    Tong, Guoxiang
    Ge, Zhaoyuan
    Peng, Dunlu
    APPLIED INTELLIGENCE, 2024, 54 (02) : 1275 - 1296
  • [50] Power substation load forecasting using interpretable transformer-based temporal fusion neural networks
    Ferreira, Andreia B. A.
    Leite, Jonatas B.
    Salvadeo, Denis H. P.
    ELECTRIC POWER SYSTEMS RESEARCH, 2025, 238