ETNAS: An energy consumption task-driven neural architecture search

被引:1
|
作者
Dong, Dong [1 ,2 ]
Jiang, Hongxu [1 ,2 ]
Wei, Xuekai [3 ]
Song, Yanfei [1 ,2 ]
Zhuang, Xu [4 ]
Wang, Jason [5 ]
机构
[1] Beihang Univ, Beijing Key Lab Digital Media, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] BeiHang Univ, Hangzhou Innovat Inst, Hangzhou 310051, Peoples R China
[3] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[4] Guangdong Opel Mobile Commun Co Ltd, OPPO, Chengdu 610000, Peoples R China
[5] Guangdong Opel Mobile Commun Co Ltd, OPPO, Nanjing 210000, Peoples R China
来源
SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS | 2023年 / 40卷
关键词
Neural architecture search; Differentiable architecture search; Power consumption; Task-driven; Multi-objective optimization;
D O I
10.1016/j.suscom.2023.100926
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural Architecture Search (NAS) is crucial in the field of sustainable computing as it facilitates the development of highly efficient and effective neural networks. However, it cannot automate the deployment of neural networks to accommodate specific hardware resources and task requirements. This paper introduces ETNAS, which is a hardware-aware multi-objective optimal neural network architecture search algorithm based on the differentiable neural network architecture search method (DARTS). The algorithm searches for a lower-power neural network architecture with guaranteed inference accuracy by modifying the loss function of the differentiable neural network architecture search. We modify the dense network in DARTS to simultaneously search for networks with a lower memory footprint, enabling them to run on memory-constrained edge-end devices. We collected data on the power consumption and time consumption of numerous common operators on FPGA and Domain-Specific Architectures (DSA). The experimental results demonstrate that ETNAS achieves comparable accuracy performance and time efficiency while consuming less power compared to state-of-the-art algorithms, thereby validating its effectiveness in practical applications and contributing to the reduction of carbon emissions in intelligent cyber-physical systems (ICPS) edge computing inference.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] TEACh: Task-Driven Embodied Agents That Chat
    Padmakumar, Aishwarya
    Thomason, Jesse
    Shrivastava, Ayush
    Lange, Patrick
    Narayan-Chen, Anjali
    Gella, Spandana
    Piramuthu, Robinson
    Tur, Gokhan
    Tur, Dilek-Hakkani
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 2017 - 2025
  • [42] The Exploration of Task-Driven Teaching Method in a Course
    Liu, Kun
    Li, Ai'jv
    2011 INTERNATIONAL CONFERENCE ON EDUCATION SCIENCE AND MANAGEMENT ENGINEERING (ESME 2011), VOLS 1-5, 2011, : 76 - 79
  • [43] Task-Driven Saliency Detection on Music Video
    Numano, Shunsuke
    Enami, Naoko
    Ariki, Yasuo
    COMPUTER VISION - ACCV 2014 WORKSHOPS, PT II, 2015, 9009 : 658 - 671
  • [44] Task-Driven Variability Model for Speaker Verification
    Chen, Chen
    Han, Jiqing
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2020, 39 (06) : 3125 - 3144
  • [45] Task-driven visual exploration at the foveal scale
    Shelchkova, Natalya
    Tang, Christie
    Poletti, Martina
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (12) : 5811 - 5818
  • [46] Practice Research of Energy-saving Cars Competition Based on Task-driven Mode
    Chu Jun
    Qiu Qifang
    PROCEEDINGS OF THE FOURTH INTERNATIONAL SYMPOSIUM ON EDUCATION MANAGEMENT AND KNOWLEDGE INNOVATION ENGINEERING, VOLS 1 AND 2, 2011, : 450 - 454
  • [47] Semantic weights of features in task-driven map generalization
    Research Center of Spatial Information and Digital Engineering, Wuhan University, 129 Luoyu Road, Wuhan 430079, China
    Geomatics Inf. Sci. Wuhan Univ., 2007, 3 (279-281):
  • [48] Research on Task-driven Teaching Method of Computer Teaching
    Wen, Xiaosen
    2018 INTERNATIONAL CONFERENCE ON EDUCATION, PSYCHOLOGY, AND MANAGEMENT SCIENCE (ICEPMS 2018), 2018, : 1 - 4
  • [49] Multimodal Task-Driven Dictionary Learning for Image Classification
    Bahrampour, Soheil
    Nasrabadi, Nasser M.
    Ray, Asok
    Jenkins, William Kenneth
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) : 24 - 38
  • [50] Task-driven Teaching in Stomatology Technology Special Field
    Yu Weiwei
    2013 INTERNATIONAL CONFERENCE ON ECONOMIC, BUSINESS MANAGEMENT AND EDUCATION INNOVATION (EBMEI 2013), VOL 21, 2013, 21 : 333 - 336