Integrated Photonic Tensor Processing Unit for a Matrix Multiply: A Review

被引:23
|
作者
Peserico, Nicola [1 ]
Shastri, Bhavin J. [2 ]
Sorger, Volker J. [3 ,4 ]
机构
[1] George Washington Univ, Dept Elect & Comp Engn, Washington, DC 20052 USA
[2] Queens Univ, Dept Phys Engn Phys & Astron, Kingston, ON K7L 3N6, Canada
[3] George Washington Univ, Dept Elect & Comp Engn, Washington, DC 20052 USA
[4] Optelligence LLC, Wilmington, DE 19801 USA
关键词
Matrix-vector multiplication; photonics; PICs; silicon photonics; tensor core; CONVOLUTIONAL NEURAL-NETWORKS; SILICON; COMPRESSION; MODULATOR; CIRCUITS; DESIGN; OPTICS;
D O I
10.1109/JLT.2023.3269957
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The explosion of artificial intelligence and machine-learning algorithms, connected to the exponential growth of the exchanged data, is driving a search for novel application-specific hardware accelerators. Among the many, the photonics field appears to be in the perfect spotlight for this global data explosion, thanks to its almost infinite bandwidth capacity associated with limited energy consumption. In this review, we will overview the major advantages that photonics has over electronics for hardware accelerators, followed by a comparison between the major architectures implemented on Photonics Integrated Circuits (PIC) for both the linear and nonlinear parts of Neural Networks. By the end, we will highlight the main driving forces for the next generation of photonic accelerators, as well as the main limits that must be overcome.
引用
收藏
页码:3704 / 3716
页数:13
相关论文
共 50 条
  • [21] APTPU: Approximate Computing Based Tensor Processing Unit
    Elbtity, Mohammed E.
    Chandarana, Peyton S.
    Reidy, Brendan
    Eshraghian, Jason K.
    Zand, Ramtin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2022, 69 (12) : 5135 - 5146
  • [22] Compact supermode switch for photonic matrix processing
    Luan, Jiapeng
    Qin, Yue
    Wang, Zelu
    Xiao, Shuqi
    Tsang, Hon ki
    OPTICS LETTERS, 2024, 49 (10) : 2721 - 2724
  • [23] A carbon-nanotube-based tensor processing unit
    Si, Jia
    Zhang, Panpan
    Zhao, Chenyi
    Lin, Dongyi
    Xu, Lin
    Xu, Haitao
    Liu, Lijun
    Jiang, Jianhua
    Peng, Lian-Mao
    Zhang, Zhiyong
    NATURE ELECTRONICS, 2024, 7 (08): : 684 - 693
  • [24] In-Datacenter Performance Analysis of a Tensor Processing Unit
    Jouppi, Norman P.
    Young, Cliff
    Patil, Nishant
    Patterson, David
    Agrawal, Gaurav
    Bajwa, Raminder
    Bates, Sarah
    Bhatia, Suresh
    Boden, Nan
    Borchers, Al
    Boyle, Rick
    Cantin, Pierre-luc
    Chao, Clifford
    Clark, Chris
    Coriell, Jeremy
    Daley, Mike
    Dau, Matt
    Dean, Jeffrey
    Gelb, Ben
    Ghaemmaghami, Tara Vazir
    Gottipati, Rajendra
    Gulland, William
    Hagmann, Robert
    Ho, C. Richard
    Hogberg, Doug
    Hu, John
    Hundt, Robert
    Hurt, Dan
    Ibarz, Julian
    Jaffey, Aaron
    Jaworski, Alek
    Kaplan, Alexander
    Khaitan, Harshit
    Killebrew, Daniel
    Koch, Andy
    Kumar, Naveen
    Lacy, Steve
    Laudon, James
    Law, James
    Le, Diemthu
    Leary, Chris
    Liu, Zhuyuan
    Lucke, Kyle
    Lundin, Alan
    MacKean, Gordon
    Maggiore, Adriana
    Mahony, Maire
    Miller, Kieran
    Nagarajan, Rahul
    Narayanaswami, Ravi
    44TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2017), 2017, : 1 - 12
  • [25] Photonic processing with polylithic integrated optical devices
    Bechtel, JH
    Morrison, CB
    Shi, YQ
    PHOTONIC PROCESSING TECHNOLOGY AND APPLICATIONS II, 1998, 3384 : 36 - 45
  • [26] Photonic Processing Using Integrated Optical Filters
    Madsen, C. K.
    Chen, Q.
    Kim, J.
    Zhou, Y.
    2013 OPTICAL FIBER COMMUNICATION CONFERENCE AND EXPOSITION AND THE NATIONAL FIBER OPTIC ENGINEERS CONFERENCE (OFC/NFOEC), 2013,
  • [27] Matrix and Tensor Factorization Methods for Natural Language Processing
    Bouchard, Guillaume
    Naradowsky, Jason
    Riedel, Sebastian
    Rocktaschel, Tim
    Vlachos, Andreas
    53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2015), 2015, : 16 - 18
  • [28] Density Matrix Renormalization Group with Tensor Processing Units
    Ganahl, Martin
    Beall, Jackson
    Hauru, Markus
    Lewis, Adam G. M.
    Wojno, Tomasz
    Yoo, Jae Hyeon
    Zou, Yijian
    Vidal, Guifre
    PRX QUANTUM, 2023, 4 (01):
  • [29] From matrix to tensor: Multilinear algebra and signal processing
    De Lathauwer, L
    De Moor, B
    MATHEMATICS IN SIGNAL PROCESSING IV, 1998, 67 : 1 - 15
  • [30] ΦPU - A Photonic Processing Unit for Heterogeneous Optical Networks
    Schrenk, Bernhard
    Stephanie, Margareta V.
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2024, 42 (22) : 7989 - 7998