SAZD: A Low Computational Load Coded Distributed Computing Framework for IoT Systems

被引:23
作者
Dai, Mingjun [1 ]
Zheng, Ziying [1 ]
Zhang, Shengli [1 ]
Wang, Hui [1 ]
Lin, Xiaohui [1 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Guangdong Prov Engn Ctr Ubiquitous Comp & Intelli, Shenzhen 518060, Peoples R China
关键词
Encoding; Task analysis; Decoding; Internet of Things; Machine learning; Delays; Coded distributed computing (CDC); computational load; Internet of Things (IoT); shift-and-addition (SA); zigzag decoding (ZD); ZIGZAG-DECODABLE CODE; EFFICIENT;
D O I
10.1109/JIOT.2020.2974045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Coded distributed computing (CDC) can overcome the problem that the computation of matrix multiplication with an extremely huge dimension cannot be executed in a single Internet-of-Things (IoT) node. All the encoding of existing CDC schemes are based on the linear combination (LC) to generate independent computation tasks, which introduces a heavy computational load, including a significant volume of expensive multiplications (compared with inexpensive additions) and even more expensive divisions to the encoding and decoding phases. Note that the number of elementwise multiplications of the LC operation during the encoding phase is N times that of the original computation task, where N denotes the number of worker nodes. In this article, to avoid expensive multiplications introduced by LC, a fresh new CDC framework based on shift-and-addition (SA) over the real field is proposed. In addition, to avoid the expensive matrix inverse operation (divisions) in the decoding phase, zigzag decoding (ZD) is incorporated. The proposed scheme, which combines SA and ZD and is hence named SAZD-based CDC, avoids expensive multiplications and divisions in both the encoding and decoding phases. It targets the following simultaneous objectives: an arbitrary K out of N generated computation tasks is independent and can recover the original computation tasks with the ZD algorithm, and the shift distance is small so as to cause a light additional computational load in the computation phase. Both analysis and practical study show that compared to the LC-based CDC, the SAZD-based CDC significantly reduces the computational load.
引用
收藏
页码:3640 / 3649
页数:10
相关论文
共 33 条
[1]   Mobile Edge Computing: A Survey [J].
Abbas, Nasir ;
Zhang, Yan ;
Taherkordi, Amir ;
Skeie, Tor .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (01) :450-465
[2]  
[Anonymous], P ACS IEEE INT C COM
[3]  
[Anonymous], 1994, Reed-Solomon Codes and Their Applications
[4]  
Da Wang, 2015, ACM SIGMETRICS Performance Evaluation Review, V43, P7, DOI 10.1145/2847220.2847223
[5]   A New Zigzag-Decodable Code with Efficient Repair in Wireless Distributed Storage [J].
Dai, Mingjun ;
Sung, Chi Wan ;
Wang, Hui ;
Gong, Xueqing ;
Lu, Zexin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2017, 16 (05) :1218-1230
[6]   Embodied Question Answering [J].
Das, Abhishek ;
Datta, Samyak ;
Gkioxari, Georgia ;
Lee, Stefan ;
Parikh, Devi ;
Batra, Dhruv .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1-10
[7]  
Dean J, 2004, USENIX ASSOCIATION PROCEEDINGS OF THE SIXTH SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION (OSDE '04), P137
[8]   The Tail at Scale [J].
Dean, Jeffrey ;
Barroso, Luiz Andre .
COMMUNICATIONS OF THE ACM, 2013, 56 (02) :74-80
[9]   Computation Offloading for Service Workflow in Mobile Cloud Computing [J].
Deng, Shuiguang ;
Huang, Longtao ;
Taheri, Javid ;
Zomaya, Albert Y. .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2015, 26 (12) :3317-3329
[10]   A Survey on Network Codes for Distributed Storage [J].
Dimakis, Alexandros G. ;
Ramchandran, Kannan ;
Wu, Yunnan ;
Suh, Changho .
PROCEEDINGS OF THE IEEE, 2011, 99 (03) :476-489