Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applications

被引:139
作者
Azghadi, Mostafa Rahimi [1 ]
Lammie, Corey [1 ]
Eshraghian, Jason K. [2 ]
Payvand, Melika [3 ,4 ]
Donati, Elisa [3 ,4 ]
Linares-Barranco, Bernabe [5 ,6 ]
Indiveri, Giacomo [3 ,4 ]
机构
[1] James Cook Univ, Coll Sci & Engn, Townsville, Qld 4811, Australia
[2] Univ Michigan, Dept Elect Engn & Comp Sci, Ann Arbor, MI 48109 USA
[3] Univ Zurich, Inst Neuroinformat, CH-8092 Zurich, Switzerland
[4] Swiss Fed Inst Technol, CH-8092 Zurich, Switzerland
[5] CSIC, Inst Microelect Sevilla IMSE CNM, Seville 41092, Spain
[6] Univ Seville, Seville 41092, Spain
基金
欧盟地平线“2020”;
关键词
Medical services; Hardware; Medical diagnostic imaging; Neural networks; Computer architecture; Microprocessors; CMOS; deep neural networks; FPGA; healthcare; medical IoT; memristor; neuromorphic hardware; point-of-care; RRAM; spiking neural networks; NEURAL-NETWORK; LOW-POWER; SEIZURE DETECTION; WEARABLE DEVICES; BREAST-CANCER; CLASSIFICATION; SYSTEM; MODEL; PROCESSOR; SMART;
D O I
10.1109/TBCAS.2020.3036081
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The advent of dedicated Deep Learning (DL) accelerators and neuromorphic processors has brought on new opportunities for applying both Deep and Spiking Neural Network (SNN) algorithms to healthcare and biomedical applications at the edge. This can facilitate the advancement of medical Internet of Things (IoT) systems and Point of Care (PoC) devices. In this paper, we provide a tutorial describing how various technologies including emerging memristive devices, Field Programmable Gate Arrays (FPGAs), and Complementary Metal Oxide Semiconductor (CMOS) can be used to develop efficient DL accelerators to solve a wide variety of diagnostic, pattern recognition, and signal processing problems in healthcare. Furthermore, we explore how spiking neuromorphic processors can complement their DL counterparts for processing biomedical signals. The tutorial is augmented with case studies of the vast literature on neural network and neuromorphic hardware as applied to the healthcare domain. We benchmark various hardware platforms by performing a sensor fusion signal processing task combining electromyography (EMG) signals with computer vision. Comparisons are made between dedicated neuromorphic processors and embedded AI accelerators in terms of inference latency and energy. Finally, we provide our analysis of the field and share a perspective on the advantages, disadvantages, challenges, and opportunities that various accelerators and neuromorphic processors introduce to healthcare and biomedical domains.
引用
收藏
页码:1138 / 1159
页数:22
相关论文
共 162 条
[1]   Think Fast: A Tensor Streaming Processor (TSP) for Accelerating Deep Learning Workloads [J].
Abts, Dennis ;
Ross, Jonathan ;
Sparling, Jonathan ;
Wong-VanHaren, Mark ;
Baker, Max ;
Hawkins, Tom ;
Bell, Andrew ;
Thompson, John ;
Kahsai, Temesghen ;
Kimmell, Garrin ;
Hwang, Jennifer ;
Leslie-Hurd, Rebekah ;
Bye, Michael ;
Creswick, E. R. ;
Boyd, Matthew ;
Venigalla, Mahitha ;
Laforge, Evan ;
Purdy, Jon ;
Kamath, Purushotham ;
Maheshwari, Dinesh ;
Beidler, Michael ;
Rosseel, Geert ;
Ahmad, Omar ;
Gagarin, Gleb ;
Czekalski, Richard ;
Rane, Ashay ;
Parmar, Sahil ;
Werner, Jeff ;
Sproch, Jim ;
Macias, Adrian ;
Kurtz, Brian .
2020 ACM/IEEE 47TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2020), 2020, :145-158
[2]   Neuro-Detect: A Machine Learning-Based Fast and Accurate Seizure Detection System in the IoMT [J].
Abu Sayeed, Md ;
Mohanty, Saraju P. ;
Kougianos, Elias ;
Zaveri, Hitten P. .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2019, 65 (03) :359-368
[3]   Deep Neural Network for Respiratory Sound Classification in Wearable Devices Enabled by Patient Specific Model Tuning [J].
Acharya, Jyotibdha ;
Basu, Arindam .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2020, 14 (03) :535-544
[4]   Equivalent-accuracy accelerated neural-network training using analogue memory [J].
Ambrogio, Stefano ;
Narayanan, Pritish ;
Tsai, Hsinyu ;
Shelby, Robert M. ;
Boybat, Irem ;
di Nolfo, Carmelo ;
Sidler, Severin ;
Giordano, Massimo ;
Bodini, Martina ;
Farinha, Nathan C. P. ;
Killeen, Benjamin ;
Cheng, Christina ;
Jaoudi, Yassine ;
Burr, Geoffrey W. .
NATURE, 2018, 558 (7708) :60-+
[5]  
Ankit A., 2019, PUMA APROGRAMMABLE U
[6]  
Arevalo T., 2020, POLICY ADVICE
[7]  
Azghadi, 2020, ARXIV200410971
[8]   Complementary Metal-Oxide Semiconductor and Memristive Hardware for Neuromorphic Computing [J].
Azghadi, Mostafa Rahimi ;
Chen, Ying-Chen ;
Eshraghian, Jason K. ;
Chen, Jia ;
Lin, Chih-Yang ;
Amirsoleimani, Amirali ;
Mehonic, Adnan ;
Kenyon, Anthony J. ;
Fowler, Burt ;
Lee, Jack C. ;
Chang, Yao-Feng .
ADVANCED INTELLIGENT SYSTEMS, 2020, 2 (05)
[9]   A Hybrid CMOS-Memristor Neuromorphic Synapse [J].
Azghadi, Mostafa Rahimi ;
Linares-Barranco, Bernabe ;
Abbott, Derek ;
Leong, Philip H. W. .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2017, 11 (02) :434-445
[10]   Programmable Spike-Timing-Dependent Plasticity Learning Circuits in Neuromorphic VLSI Architectures [J].
Azghadi, Mostafa Rahimi ;
Moradi, Saber ;
Fasnacht, Daniel B. ;
Ozdas, Mehmet Sirin ;
Indiveri, Giacomo .
ACM JOURNAL ON EMERGING TECHNOLOGIES IN COMPUTING SYSTEMS, 2015, 12 (02)