Novel Fine-Tuning Strategy on Pre-trained Protein Model Enhances ACP Functional Type Classification

被引:0
|
作者
Wang, Shaokai [1 ]
Ma, Bin [1 ]
机构
[1] Univ Waterloo, David R Cheriton Sch Comp Sci, Waterloo, ON, Canada
来源
BIOINFORMATICS RESEARCH AND APPLICATIONS, PT I, ISBRA 2024 | 2024年 / 14954卷
关键词
Anti-cancer Peptide; Pre-training; Fine-tuning; LANGUAGE; PEPTIDE;
D O I
10.1007/978-981-97-5128-0_30
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cancer remains one of the most formidable health challenges globally. Anti-cancer peptides (ACPs) have recently emerged as a promising new therapeutic strategy, recognized for their targeted and efficient anti-cancer properties. To fully discover the potential of ACPs, computational methods that can accurately predict their functional types are indispensable. By leveraging a pre-trained protein sequence model, we present ACP-FT that fine-tuned specifically for predicting the functional types of ACPs. Employing a novel fine-tuning approach alongside an adversarial model training technique, our model surpasses existing methods in classification performance on two public datasets. Additionally, we provide a thorough analysis of our training strategy's effectiveness. The experimental results demonstrate that our two-step fine-tuning approach effectively prevents catastrophic forgetting in the pretrained model, while adversarial training enhances the model's robustness. Together, these techniques significantly increase the accuracy of ACP functional type predictions.
引用
收藏
页码:371 / 382
页数:12
相关论文
共 50 条
  • [41] Towards Efficient Fine-Tuning of Pre-trained Code Models: An Experimental Study and Beyond
    Shi, Ensheng
    Wang, Yanlin
    Zhang, Hongyu
    Du, Lun
    Han, Shi
    Zhang, Dongmei
    Sun, Hongbin
    PROCEEDINGS OF THE 32ND ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS, ISSTA 2023, 2023, : 39 - 51
  • [42] Confounder balancing in adversarial domain adaptation for pre-trained large models fine-tuning
    Jiang, Shuoran
    Chen, Qingcai
    Xiang, Yang
    Pan, Youcheng
    Wu, Xiangping
    Lin, Yukang
    NEURAL NETWORKS, 2024, 173
  • [43] Vision Transformers for Galaxy Morphology Classification: Fine-Tuning Pre-trained Networks vs. Training from Scratch
    Kumar, Rahul
    Sarker, Md Kamruzzaman
    Islam, Sheikh Rabiul
    DEEP LEARNING THEORY AND APPLICATIONS, DELTA 2023, 2023, 1875 : 115 - 125
  • [44] Enhancing Health Mention Classification Through Reexamining Misclassified Samples and Robust Fine-Tuning Pre-Trained Language Models
    Meng, Deyu
    Phuntsho, Tshewang
    Gonsalves, Tad
    IEEE ACCESS, 2024, 12 : 190445 - 190453
  • [45] BERT4ST:: Fine-tuning pre-trained large language model for wind power forecasting
    Lai, Zefeng
    Wu, Tangjie
    Fei, Xihong
    Ling, Qiang
    ENERGY CONVERSION AND MANAGEMENT, 2024, 307
  • [46] Fine-Tuning Pre-Trained Audio Models for Dysarthria Severity Classification: A Second Place Solution in the Multimodal Dysarthria Severity Classification Challenge
    Dai, Wei
    Li, Menglong
    He, Yingqi
    Zhu, Yongqiang
    2024 IEEE 14TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, ISCSLP 2024, 2024, : 151 - 153
  • [47] Fine-tuning of pre-trained convolutional neural networks for diabetic retinopathy screening: a clinical study
    Roshan, Saboora M.
    Karsaz, Ali
    Vejdani, Amir Hossein
    Roshan, Yaser M.
    INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2020, 21 (04) : 564 - 573
  • [48] Parameter-efficient fine-tuning of large-scale pre-trained language models
    Ning Ding
    Yujia Qin
    Guang Yang
    Fuchao Wei
    Zonghan Yang
    Yusheng Su
    Shengding Hu
    Yulin Chen
    Chi-Min Chan
    Weize Chen
    Jing Yi
    Weilin Zhao
    Xiaozhi Wang
    Zhiyuan Liu
    Hai-Tao Zheng
    Jianfei Chen
    Yang Liu
    Jie Tang
    Juanzi Li
    Maosong Sun
    Nature Machine Intelligence, 2023, 5 : 220 - 235
  • [49] Food Detection by Fine-Tuning Pre-trained Convolutional Neural Network Using Noisy Labels
    Alshomrani, Shroog
    Aljoudi, Lina
    Aljabri, Banan
    Al-Shareef, Sarah
    INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2021, 21 (07): : 182 - 190
  • [50] FINE-TUNING OF PRE-TRAINED END-TO-END SPEECH RECOGNITION WITH GENERATIVE ADVERSARIAL NETWORKS
    Haidar, Md Akmal
    Rezagholizadeh, Mehdi
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 6204 - 6208