Efficient Large Models Fine-tuning on Commodity Servers via Memory-balanced Pipeline Parallelism

被引：0

作者：

Liu, Yujie ^{[1
]}

Lai, Zhiquan ^{[1
]}

Liu, Weijie ^{[1
]}

Wang, Wei ^{[1
]}

Li, Dongsheng ^{[1
]}

机构：

[1] College of Computer, National University of Defense Technology, National Key Laboratory of Parallel and Distributed Computing, Changsha, China

来源：

Proceedings - 2023 IEEE International Conference on High Performance Computing and Communications, Data Science and Systems, Smart City and Dependability in Sensor, Cloud and Big Data Systems and Application, HPCC/DSS/SmartCity/DependSys 2023 | 2023年

关键词：

Compendex;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

Program processors

引用

页码：726 / 727