SST: self-attention transformer for infrared deconvolution

被引:0
|
作者
Gao, Lei [1 ,2 ]
Yan, Xiaohong [1 ,2 ]
Deng, Lizhen [3 ]
Xu, Guoxia [3 ]
Zhu, Hu [3 ]
机构
[1] Nanjing Univ Post & Telecommun, Coll Elect & Opt Engn, Nanjing 210003, Peoples R China
[2] Nanjing Univ Post & Telecommun, Coll Flexible Elect Future Technol, Nanjing 210003, Peoples R China
[3] Nanjing Univ Post & Telecommun, Sch Commun & Informat Engn, Nanjing 210003, Peoples R China
基金
中国国家自然科学基金;
关键词
Infrared spectroscopy; Sparse; Self-attention mechanism; Spectrum deconvolution; BLIND DECONVOLUTION;
D O I
10.1016/j.infrared.2024.105384
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
This study addresses the challenge of enhancing denoising in infrared spectroscopy signals and proposes a novel method based on the sparse self -attention model. In the domain of long sequence spectrum deconvolution problem, traditional Transformers confront challenges, encompassing quadratic time intricacy, heightened utilization of memory, and restrictions posed by the encoder-decoder architecture. To address these concerns, we present sparse self -attention mechanisms and extraction procedures, effectively handling the quadratic time complexity within Transformers. Additionally, a carefully designed generative decoder is utilized to alleviate the constraints of the traditional encoder-decoder architecture. Applied to the restoration of infrared spectra, our proposed method yields satisfactory results. Leveraging the sparse self -attention model, we successfully achieve enhanced denoising of infrared spectroscopy signals, providing a novel and effective approach for long sequence time series prediction. Experimental findings showcase the extensive applicability of this approach in the field of infrared spectroscopy.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Unsupervised Infrared and Visible Image Fusion with Pixel Self-attention
    Cui, Saijia
    Zhou, Zhiqiang
    Li, Linhao
    Fei, Erfang
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 437 - 441
  • [42] Self-Attention Progressive Network for Infrared and Visible Image Fusion
    Li, Shuying
    Han, Muyi
    Qin, Yuemei
    Li, Qiang
    REMOTE SENSING, 2024, 16 (18)
  • [43] EEG-Transformer: Self-attention from Transformer Architecture for Decoding EEG of Imagined Speech
    Lee, Young-Eun
    Lee, Seo-Hyun
    10TH INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI2022), 2022,
  • [44] Attention to Emotions: Body Emotion Recognition In-the-Wild Using Self-attention Transformer Network
    Paiva, Pedro V. V.
    Ramos, Josue J. G.
    Gavrilova, Marina
    Carvalho, Marco A. G.
    COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VISIGRAPP 2023, 2024, 2103 : 206 - 228
  • [45] SHYNESS AND SELF-ATTENTION
    CROZIER, WR
    BULLETIN OF THE BRITISH PSYCHOLOGICAL SOCIETY, 1983, 36 (FEB): : A5 - A5
  • [46] Momentum Transformer: Closing the Performance Gap Between Self-attention and Its Linearization
    Tan Nguyen
    Baraniuk, Richard G.
    Kirby, Robert M.
    Osher, Stanley J.
    Wang, Bao
    MATHEMATICAL AND SCIENTIFIC MACHINE LEARNING, VOL 190, 2022, 190
  • [47] Fixed Encoder Self-Attention Patterns in Transformer-Based Machine Translation
    Raganato, Alessandro
    Scherrer, Yves
    Tiedemann, Jorg
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, 2020, : 556 - 568
  • [48] X-Transformer: A Machine Translation Model Enhanced by the Self-Attention Mechanism
    Liu, Huey-Ing
    Chen, Wei-Lin
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [49] Self-attention transformer model for pan evaporation prediction: a case study in Australia
    Abed, Mustafa
    Imteaz, Monzur Alam
    Huang, Yuk Feng
    Ahmed, Ali Najah
    JOURNAL OF HYDROINFORMATICS, 2024, 26 (10) : 2538 - 2556
  • [50] In-Memory Transformer Self-Attention Mechanism Using Passive Memristor Crossbar
    Cai, Jack
    Kaleem, Muhammad Ahsan
    Genov, Roman
    Azghadi, Mostafa Rahimi
    Amirsoleimani, Amirali
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,