MSTCRB: Predicting circRNA-RBP interaction by extracting multi-scale features based on transformer and attention mechanism

被引:0
|
作者
Zhou, Yun [1 ,2 ]
Cui, Haoyu [1 ]
Liu, Dong [1 ,2 ]
Wang, Wei [1 ,2 ]
机构
[1] Henan Normal Univ, Coll Comp & Informat Engn, Xinxiang 453007, Peoples R China
[2] Henan Normal Univ, Coll Comp & Informat Engn, Key Lab Artificial Intelligence & Personalized Lea, Xinxiang 453007, Peoples R China
关键词
Mutli-scale feature; CircRNA-RBP interaction; Transformer; Attention mechanism; CIRCULAR RNAS; DNA;
D O I
10.1016/j.ijbiomac.2024.134805
中图分类号
Q5 [生物化学]; Q7 [分子生物学];
学科分类号
071010 ; 081704 ;
摘要
CircRNAs play vital roles in biological system mainly through binding RNA-binding protein (RBP), which is essential for regulating physiological processes in vivo and for identifying causal disease variants. Therefore, predicting interactions between circRNA and RBP is a critical step for the discovery of new therapeutic agents. Application of various deep-learning models in bioinformatics has significantly improved prediction and classification performance. However, most of existing prediction models are only applicable to specific type of RNA or RNA with simple characteristics. In this study, we proposed an attractive deep learning model, MSTCRB, based on transformer and attention mechanism for extracting multi-scale features to predict circRNA-RBP interactions. Therein, K-mer and KNF encoding are employed to capture the global sequence features of circRNA, NCP and DPCP encoding are utilized to extract local sequence features, and the CDPfold method is applied to extract structural features. In order to improve prediction performance, optimized transformer framework and attention mechanism were used to integrate these multi-scale features. We compared our model's performance with other five state-of-the-art methods on 37 circRNA datasets and 31 linear RNA datasets. The results show that the average AUC value of MSTCRB reaches 98.45 %, which is better than other comparative methods. All of above datasets are deposited in https://github.com/chy001228/MSTCRB_database.git and source code are available from https://github.com/chy001228/MSTCRB.git.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Attention mechanism based multi-scale feature extraction of bearing fault diagnosis
    LEI Xue
    LU Ningyun
    CHEN Chuang
    HU Tianzhen
    JIANG Bin
    JournalofSystemsEngineeringandElectronics, 2023, 34 (05) : 1359 - 1367
  • [42] Instance segmentation convolutional neural network based on multi-scale attention mechanism
    Wang Gaihua
    Lin Jinheng
    Cheng Lei
    Dai Yingying
    Zhang Tianlun
    PLOS ONE, 2022, 17 (01):
  • [43] Multi-scale ResNet and BiGRU automatic sleep staging based on attention mechanism
    Liu, Changyuan
    Yin, Yunfu
    Sun, Yuhan
    Ersoy, Okan K.
    PLOS ONE, 2022, 17 (06):
  • [44] Super resolution reconstruction of CT images based on multi-scale attention mechanism
    Yin, Jian
    Xu, Shao-Hua
    Du, Yan-Bin
    Jia, Rui-Sheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (15) : 22651 - 22667
  • [45] Multi-scale Dilated Convolutional Neural Network Model Based on Attention Mechanism
    Wang J.
    Lai X.
    Lei J.
    Zhang J.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2021, 34 (06): : 497 - 508
  • [46] Multi-scale Few-Shot Classification Model Based on Attention Mechanism
    Xu, Yi
    Zhu, Qisheng
    Pan, ZhengYue
    Liu, Yin
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT I, ICIC 2024, 2024, 14875 : 476 - 487
  • [47] Dense Crowd Counting Algorithm Based on New Multi-scale Attention Mechanism
    Wan Honglin
    Wang Xiaomin
    Peng Zhenwei
    Bai Zhiquan
    Yang Xinghai
    Sun Jiande
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (03) : 1129 - 1136
  • [48] A MATERIAL REMOVAL STATE PREDICTION METHOD BASED ON MULTI-SCALE ATTENTION MECHANISM
    Li, Zhihang
    Tang, Qian
    Liu, Ying
    Li, Xiao
    PROCEEDINGS OF ASME 2022 INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, IDETC-CIE2022, VOL 2, 2022,
  • [49] Texture Classification Using Improved ResNet based on Multi-scale Attention Mechanism
    Lu, Qiu
    Chen, Haotian
    Yang, Tiejun
    THIRTEENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2021), 2021, 11878
  • [50] Super resolution reconstruction of CT images based on multi-scale attention mechanism
    Jian Yin
    Shao-Hua Xu
    Yan-Bin Du
    Rui-Sheng Jia
    Multimedia Tools and Applications, 2023, 82 : 22651 - 22667