Parallel and Memory-Efficient Distributed Edge Learning in B5G IoT Networks

被引：4

作者：

Zhao, Jianxin ^{[1
]}

Vandenhove, Pierre ^{[2
,3
,4
]}

Xu, Peng ^{[1
]}

Tao, Hao ^{[5
]}

Wang, Liang ^{[6
]}

Liu, Chi Harold ^{[1
]}

Crowcroft, Jon ^{[6
]}

机构：

[1] Beijing Inst Technol, Sch Comp Sci & Technol, Beijing 100081, Peoples R China

[2] FRS FNRS, UMONS, B-7000 Mons, Belgium

[3] Univ Paris Saclay, CNRS, LMF, F-91190 Gif sur yvette, France

[4] Univ Cambridge, OCaml Labs, Cambridge, England

[5] China Ship Dev & Design Ctr, Wuhan 430064, Peoples R China

[6] Univ Cambridge, Cambridge CB3 0FD, England

来源：

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING | 2023年 / 17卷 / 01期

关键词：

Edge learning; beyond; 5G; memory efficient; backpropagation;

D O I：

10.1109/JSTSP.2022.3223759

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

Nowadays we are witnessing rapid development of the Internet of Things (IoT), machine learning, and cellular network technologies. They are key components to promote wireless networks beyond 5G (B5G). The plenty of data generated from numerous IoT devices, such as smart sensors and mobile devices, can be utilised to train intelligent models. But it still remains a challenge to efficiently utilise IoT networks and edge in B5G to conduct model training. In this paper, we propose a parallel training method which uses operators as scheduling units during training task assignment. Besides, we discuss a pebble-game-based memory-efficient optimisation in training. Experiments based on various real world network architectures show the flexibility of our proposed method and good performance compared with state of the art.

引用

页码：222 / 233

页数：12

共 45 条

[1] An energy efficient IoT data compression approach for edge machine learning [J].

Azar, Joseph ;

Makhoul, Abdallah ;

Barhamgi, Mahmoud ;

Couturier, Raphael .

FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 96 :168-175

[2]

Baydin AG, 2018, J MACH LEARN RES, V18

[3]

Bonawitz K., 2019, Proceedings of Machine Learning and Systems, V1, P374

[4] Edge Computing Resources Reservation in Vehicular Networks: A Meta-Learning Approach [J].

Chen, Dawei ;

Liu, Yin-Chen ;

Kim, BaekGyu ;

Xie, Jiang ;

Hong, Choong Seon ;

Han, Zhu .

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (05) :5634-5646

[5] A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].

Chen, Mingzhe ;

Yang, Zhaohui ;

Saad, Walid ;

Yin, Changchuan ;

Poor, H. Vincent ;

Cui, Shuguang .

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283

[6] The Simple Essence of Automatic Differentiation [J].

Elliott, Conal .

PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES, 2018,

[7]

He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]

[8] DATA PARALLEL ALGORITHMS [J].

HILLIS, WD ;

STEELE, GL .

COMMUNICATIONS OF THE ACM, 1986, 29 (12) :1170-1183

[9] Intelligent MIMO Detection Using Meta Learning [J].

Huo, Haomiao ;

Xu, Jindan ;

Su, Gege ;

Xu, Wei ;

Wang, Ning .

IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (10) :2205-2209

[10]

Huo Z., 2018, INT C MACHINE LEARNI, P2098

← 1 2 3 4 5 →