Identification and classification of promoters using the attention mechanism based on long short-term memory

被引:10
|
作者
Li, Qingwen [1 ,2 ]
Zhang, Lichao [4 ]
Xu, Lei [5 ]
Zou, Quan [1 ]
Wu, Jin [6 ]
Li, Qingyuan [3 ]
机构
[1] Univ Elect Sci & Technol China, Inst Fundamental & Frontier Sci, Chengdu 610054, Peoples R China
[2] Chinese Acad Sci, Inst Biophys, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China
[3] Wuhan Acad Agr Sci, Forestry & Fruit Tree Res Inst, Wuhan 430075, Peoples R China
[4] Shenzhen Inst Informat Technol, Sch Intelligent Mfg & Equipment, Shenzhen 518172, Peoples R China
[5] Shenzhen Polytech, Sch Elect & Commun Engn, Shenzhen 518055, Peoples R China
[6] Shenzhen Polytech, Sch Management, Shenzhen 518055, Peoples R China
关键词
promoter; bioinformatics; natural language processing; attention mechanism; SEQUENCE-BASED PREDICTOR; RECOGNITION; SITES;
D O I
10.1007/s11704-021-0548-9
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A promoter is a short region of DNA that can bind RNA polymerase and initiate gene transcription. It is usually located directly upstream of the transcription initiation site. DNA promoters have been proven to be the main cause of many human diseases, especially diabetes, cancer or Huntington's disease. Therefore, the classification of promoters has become an interesting problem and has attracted the attention of many researchers in the field of bioinformatics. Various studies have been conducted in order to solve this problem, but their performance still needs further improvement. In this research, we segmented the DNA sequence in a k-mers manner, then trained the word vector model, inputted it into long short-term memory(LSTM) and used the attention mechanism to predict. Our method can achieve 93.45% and 90.59% cross-validation accuracy in the two layers, respectively. Our results are better than others based on the same data set, and provided some ideas for accurately predicting promoters. In addition, this research suggested that natural language processing can play a significant role in biological sequence prediction.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] An Ensemble of Long Short-Term Memory Networks with an Attention Mechanism for Upper Limb Electromyography Signal Classification
    Alotaibi, Naif D.
    Jahanshahi, Hadi
    Yao, Qijia
    Mou, Jun
    Bekiros, Stelios
    MATHEMATICS, 2023, 11 (18)
  • [22] Multivariate time-series classification using memory and attention for long and short-term dependence
    Yuan, Jianjun
    Wu, Fujun
    Wu, Hong
    APPLIED INTELLIGENCE, 2023, 53 (24) : 29677 - 29692
  • [23] Attention Mechanism-Based Bidirectional Long Short-Term Memory for Cycling Activity Recognition Using Smartphones
    Nguyen, Van Sy
    Kim, Hyunseok
    Suh, Dongjun
    IEEE ACCESS, 2023, 11 : 136206 - 136218
  • [24] Classification of HRV using Long Short-Term Memory Networks
    Leite, Argentina
    Silva, Maria Eduarda
    Rocha, Ana Paula
    2020 11TH CONFERENCE OF THE EUROPEAN STUDY GROUP ON CARDIOVASCULAR OSCILLATIONS (ESGCO): COMPUTATION AND MODELLING IN PHYSIOLOGY NEW CHALLENGES AND OPPORTUNITIES, 2020,
  • [25] Malware Classification using Long Short-term Memory Models
    Dang, Dennis
    Di Troia, Fabio
    Stamp, Mark
    ICISSP: PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON INFORMATION SYSTEMS SECURITY AND PRIVACY, 2021, : 743 - 752
  • [26] A Proton Flux Prediction Method Based on an Attention Mechanism and Long Short-Term Memory Network
    Zhang, Zhiqian
    Liu, Lei
    Quan, Lin
    Shen, Guohong
    Zhang, Rui
    Jiang, Yuqi
    Xue, Yuxiong
    Zeng, Xianghua
    AEROSPACE, 2023, 10 (12)
  • [27] Shear Wave Velocity Prediction Based on the Long Short-Term Memory Network with Attention Mechanism
    Fu, Xingan
    Wei, Youhua
    Su, Yun
    Hu, Haixia
    APPLIED SCIENCES-BASEL, 2024, 14 (06):
  • [28] Person re-identification based on attention clustering and long short-term memory network
    Wang, Jun
    Zhu, Jiahui
    Yu, Zhimin
    JOURNAL OF ELECTRONIC IMAGING, 2021, 30 (03)
  • [29] Intelligent Pavement Roughness Forecasting Based on a Long Short-Term Memory Model with Attention Mechanism
    Guo, Feng
    Qian, Yu
    AIRFIELD AND HIGHWAY PAVEMENTS 2021: PAVEMENT DESIGN, CONSTRUCTION, AND CONDITION EVALUATION, 2021, : 128 - 136
  • [30] Early Churn User Classification in Social Networking Service Using Attention-Based Long Short-Term Memory
    Sato, Koya
    Oka, Mizuki
    Kato, Kazuhiko
    TRENDS AND APPLICATIONS IN KNOWLEDGE DISCOVERY AND DATA MINING: PAKDD 2019 WORKSHOPS, 2019, 11607 : 45 - 56