CommonIT: Commonality-Aware Instruction Tuning for Large Language Models via Data Partitions

被引：0
|
作者：
Rao, Jun [1 ]
Liu, Xuebo [1 ]
Lian, Lian [2 ]
Cheng, Shengjun [2 ]
Liao, Yunjie [1 ]
Zhang, Min [1 ]
机构：
[1] Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen, China
[2] Huawei Cloud Computing Technologies Co., Ltd., China
来源：
EMNLP 2024 - 2024 Conference on Empirical Methods in Natural Language Processing, Proceedings of the Conference | 2024年
关键词：
Compendex;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Computational linguistics
引用
收藏
页码：10064 / 10083
相关论文
共 6 条
  • [1] Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models
    Zong, Yongshuo
    Bohdal, Ondrej
    Yu, Tingyang
    Yang, Yongxin
    Hospedales, Timothy
    Proceedings of Machine Learning Research, 2024, 235 : 62867 - 62891
  • [2] Efficient Large Models Fine-tuning on Commodity Servers via Memory-balanced Pipeline Parallelism
    Liu, Yujie
    Lai, Zhiquan
    Liu, Weijie
    Wang, Wei
    Li, Dongsheng
    Proceedings - 2023 IEEE International Conference on High Performance Computing and Communications, Data Science and Systems, Smart City and Dependability in Sensor, Cloud and Big Data Systems and Application, HPCC/DSS/SmartCity/DependSys 2023, 2023, : 726 - 727
  • [3] Editorial for Special Issue on Large-scale Pre-training: Data, Models, and Fine-tuning
    Wen, Ji-Rong
    Huang, Zi
    Zhang, Hanwang
    MACHINE INTELLIGENCE RESEARCH, 2023, 20 (02) : 145 - 146
  • [4] Accelerating Sparse Autoencoder Training via Layer-Wise Transfer Learning in Large Language Models
    Ghilardi, Davide
    Belotti, Federico
    Molinari, Marco
    Lim, Jaehyuk
    BlackboxNLP 2024 - 7th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP - Proceedings of the Workshop, 2024, : 530 - 550
  • [5] JAILBREAK ANTIDOTE: RUNTIME SAFETY-UTILITY BALANCE VIA SPARSE REPRESENTATION ADJUSTMENT IN LARGE LANGUAGE MODELS
    Shen, Guobin
    Zhao, Dongcheng
    Dong, Yiting
    He, Xiang
    Zeng, Yi
    arXiv,
  • [6] Prediction of water saturation in tight sandstone reservoirs from well log data based on the large language models (LLMs)
    Wu, Juan
    Luo, Renze
    Lei, Canru
    Yin, Jiang
    Chen, Xingting
    Natural Gas Industry, 44 (09): : 77 - 87
1