A Brief Tour of Deep Learning from a Statistical Perspective

被引:2
|
作者
Nalisnick, Eric [1 ]
Smyth, Padhraic [2 ,3 ]
Tran, Dustin [4 ]
机构
[1] Univ Amsterdam, Informat Inst, Amsterdam, Netherlands
[2] Univ Calif Irvine, Dept Comp Sci, Irvine, CA USA
[3] Univ Calif Irvine, Dept Stat, Irvine, CA USA
[4] Google Brain, Mountain View, CA USA
基金
美国国家科学基金会;
关键词
deep learning; neural networks; pattern recognition; optimization; NEURAL-NETWORKS; REPRESENTATIONS; CLASSIFIERS; PREDICTION; INFERENCE; MODELS; SYSTEM;
D O I
10.1146/annurev-statistics-032921-013738
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
We expose the statistical foundations of deep learning with the goal of facilitating conversation between the deep learning and statistics communities. We highlight core themes at the intersection; summarize key neural models, such as feedforward neural networks, sequential neural networks, and neural latent variable models; and link these ideas to their roots in probability and statistics.We also highlight research directions in deep learning where there are opportunities for statistical contributions.
引用
收藏
页码:219 / 246
页数:28
相关论文
共 50 条
  • [1] Deep learning from a statistical perspective
    Yuan, Yubai
    Deng, Yujia
    Zhang, Yanqing
    Qu, Annie
    STAT, 2020, 9 (01):
  • [2] Deep Learning: A Bayesian Perspective
    Polson, Nicholas G.
    Sokolov, Vadim
    BAYESIAN ANALYSIS, 2017, 12 (04): : 1275 - 1304
  • [3] Visual place recognition: A survey from deep learning perspective
    Zhang, Xiwu
    Wang, Lei
    Su, Yan
    PATTERN RECOGNITION, 2021, 113
  • [4] A brief review of hypernetworks in deep learning
    Chauhan, Vinod Kumar
    Zhou, Jiandong
    Lu, Ping
    Molaei, Soheila
    Clifton, David A.
    ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (09)
  • [5] Bringing AI to edge: From deep learning's perspective
    Liu, Di
    Kong, Hao
    Luo, Xiangzhong
    Liu, Weichen
    Subramaniam, Ravi
    NEUROCOMPUTING, 2022, 485 : 297 - 320
  • [6] Deep neural networks for choice analysis: A statistical learning theory perspective
    Wang, Shenhao
    Wang, Qingyi
    Bailey, Nate
    Zhao, Jinhua
    TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2021, 148 : 60 - 81
  • [7] A Brief Survey of Deep Learning Approaches for Learning Analytics on MOOCs
    Sun, Zhongtian
    Harit, Anoushka
    Yu, Jialin
    Cristea, Alexandra, I
    Shi, Lei
    INTELLIGENT TUTORING SYSTEMS (ITS 2021), 2021, 12677 : 28 - 37
  • [8] An Overview of Voice Conversion and Its Challenges: From Statistical Modeling to Deep Learning
    Sisman, Berrak
    Yamagishi, Junichi
    King, Simon
    Li, Haizhou
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 (29) : 132 - 157
  • [9] Deep learning for medical image analysis: a brief introduction
    Wiestler, Benedikt
    Menze, Bjoern
    NEURO-ONCOLOGY ADVANCES, 2020, 2 (SUPP 4) : 35 - 41
  • [10] A Brief Review on Deep Learning Applications in Genomic Studies
    Shen, Xiaoxi
    Jiang, Chang
    Wen, Yalu
    Li, Chenxi
    Lu, Qing
    FRONTIERS IN SYSTEMS BIOLOGY, 2022, 2