Improving robustness and efficiency of edge computing models

被引:1
作者
Li, Yilan [1 ]
Lu, Yantao [2 ]
Cui, Helei [2 ]
Velipasalar, Senem [3 ]
机构
[1] Xian Univ Technol, Xian, Shaanxi, Peoples R China
[2] Northwestern Polytech Univ, Xian, Shaanxi, Peoples R China
[3] Syracuse Univ, EECS, Syracuse, NY 13210 USA
基金
国家重点研发计划;
关键词
Neural architecture search; Robustness; Edge computing; Genetic algorithm;
D O I
10.1007/s11276-022-03115-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Existing designs of edge computing models are mostly targeted to improve the performance of accuracy. Yet, besides accuracy, robustness and inference efficiency are also crucial attributes to the performance. To achieve satisfied performance in edge-cloud computing frameworks, each distributed model is required to be both robust to perturbations and feasible for information uploading in wireless environments with limited bandwidth. In other words, feature encoders should be more robust and have faster inference time while maintaining accuracy at a competitive level. Therefore, to design accurate, robust and efficient models for bandwidth limited edge computing, we propose a systematic approach to autonomously optimize parameters and architectures of arbitrary deep neural networks. This approach employs a genetic algorithm based bi-generative adversarial network, which is utilized to autonomously develop and select the number of filters (for convolutional layers) and the number of neurons (for fully connected layers) from a wide range of values. To demonstrate the performance, we test our approach on ImageNet and ModelNet databases, and compare it with the state-of-the-art 3D volumetric network and two exclusively GA-based methods. Our results show that the proposed method can significantly improve performance by simultaneously optimizing multiple neural network parameters, regardless of the depth of the network.
引用
收藏
页码:4699 / 4711
页数:13
相关论文
共 40 条
  • [1] [Anonymous], 2015, arXiv
  • [2] [Anonymous], 2014, INT ADV SYST ICIAS 2
  • [3] [Anonymous], 2015, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition
  • [4] Factors of Transferability for a Generic ConvNet Representation
    Azizpour, Hossein
    Razavian, Ali Sharif
    Sullivan, Josephine
    Maki, Atsuto
    Carlsson, Stefan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (09) : 1790 - 1802
  • [5] Optimizing feedforward artificial neural network architecture
    Benardos, P. G.
    Vosniakos, G. -C.
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2007, 20 (03) : 365 - 382
  • [6] Bergstra J, 2012, J MACH LEARN RES, V13, P281
  • [7] A fast and elitist multiobjective genetic algorithm: NSGA-II
    Deb, K
    Pratap, A
    Agarwal, S
    Meyarivan, T
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) : 182 - 197
  • [8] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [9] Dong Y, 2017, ARXIV
  • [10] Evading Defenses to Transferable Adversarial Examples by Translation-Invariant Attacks
    Dong, Yinpeng
    Pang, Tianyu
    Su, Hang
    Zhu, Jun
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 4307 - 4316