ETNAS: An energy consumption task-driven neural architecture search

被引:1
|
作者
Dong, Dong [1 ,2 ]
Jiang, Hongxu [1 ,2 ]
Wei, Xuekai [3 ]
Song, Yanfei [1 ,2 ]
Zhuang, Xu [4 ]
Wang, Jason [5 ]
机构
[1] Beihang Univ, Beijing Key Lab Digital Media, State Key Lab Virtual Real Technol & Syst, Beijing 100191, Peoples R China
[2] BeiHang Univ, Hangzhou Innovat Inst, Hangzhou 310051, Peoples R China
[3] Chongqing Univ, Sch Comp Sci, Chongqing 400044, Peoples R China
[4] Guangdong Opel Mobile Commun Co Ltd, OPPO, Chengdu 610000, Peoples R China
[5] Guangdong Opel Mobile Commun Co Ltd, OPPO, Nanjing 210000, Peoples R China
来源
SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS | 2023年 / 40卷
关键词
Neural architecture search; Differentiable architecture search; Power consumption; Task-driven; Multi-objective optimization;
D O I
10.1016/j.suscom.2023.100926
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Neural Architecture Search (NAS) is crucial in the field of sustainable computing as it facilitates the development of highly efficient and effective neural networks. However, it cannot automate the deployment of neural networks to accommodate specific hardware resources and task requirements. This paper introduces ETNAS, which is a hardware-aware multi-objective optimal neural network architecture search algorithm based on the differentiable neural network architecture search method (DARTS). The algorithm searches for a lower-power neural network architecture with guaranteed inference accuracy by modifying the loss function of the differentiable neural network architecture search. We modify the dense network in DARTS to simultaneously search for networks with a lower memory footprint, enabling them to run on memory-constrained edge-end devices. We collected data on the power consumption and time consumption of numerous common operators on FPGA and Domain-Specific Architectures (DSA). The experimental results demonstrate that ETNAS achieves comparable accuracy performance and time efficiency while consuming less power compared to state-of-the-art algorithms, thereby validating its effectiveness in practical applications and contributing to the reduction of carbon emissions in intelligent cyber-physical systems (ICPS) edge computing inference.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] The role of feedback connections in task-driven visual search
    Hamker, FH
    CONNECTIONIST MODELS IN COGNITIVE NEUROSCIENCE, 1999, : 252 - 261
  • [2] Task-driven neural network models predict neural dynamics of proprioception
    Vargas, Alessandro Marin
    Bisi, Axel
    Chiappa, Alberto S.
    Versteeg, Chris
    Miller, Lee E.
    Mathis, Alexander
    CELL, 2024, 187 (07) : 1745 - 1761.e19
  • [3] Spotlight Modeling proprioception with task-driven neural network models
    Scherberger, Hansjorg
    NEURON, 2024, 112 (09) : 1384 - 1386
  • [4] A modular hierarchical architecture for autonomous robots based on task-driven behaviors
    Ji, Xiucai
    Liu, Lin
    Zheng, Zhiqiang
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13E : 631 - 636
  • [5] Task-driven color coding
    Tominski, Christian
    Fuchs, Georg
    Schumann, Heidrun
    PROCEEDINGS OF THE 12TH INTERNATIONAL INFORMATION VISUALISATION, 2008, : 373 - 380
  • [6] Task-Driven Software Summarization
    Binkley, Dave
    Lawrie, Dawn
    Hill, Emily
    Burge, Janet
    Harris, Ian
    Hebig, Regina
    Keszocze, Oliver
    Reed, Karl
    Slankas, John
    2013 29TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE (ICSM), 2013, : 432 - 435
  • [7] Task-Driven Webpage Saliency
    Zheng, Quanlong
    Jiao, Jianbo
    Cao, Ying
    Lau, Ronson W. H.
    COMPUTER VISION - ECCV 2018, PT XIV, 2018, 11218 : 300 - 316
  • [8] Task-Driven Dictionary Learning
    Mairal, Julien
    Bach, Francis
    Ponce, Jean
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (04) : 791 - 804
  • [9] Task-Driven Common Representation Learning via Bridge Neural Network
    Xu, Yao
    Xiang, Xueshuang
    Huang, Meiyu
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 5573 - 5580
  • [10] Explaining heterogeneity in medial entorhinal cortex with task-driven neural networks
    Nayebi, Aran
    Attinger, Alexander
    Campbell, Malcolm G.
    Hardcastle, Kiah
    Low, Isabel I. C.
    Mallory, Caitlin S.
    Mel, Gabriel C.
    Ben Sorscher
    Williams, Alex H.
    Ganguli, Surya
    Giocomo, Lisa M.
    Yamins, Daniel L. K.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34