Integrated prediction intervals and specific value predictions for regression problems using neural networks

被引:8
作者
Simhayev, Eli [1 ]
Katz, Gilad [1 ]
Rokach, Lior [1 ]
机构
[1] Ben Gurion Univ Negev, Dept Software & Informat Syst Engn, Beer Sheva, Israel
关键词
Prediction intervals; Regression; Deep learning;
D O I
10.1016/j.knosys.2022.108685
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Improving the robustness of neural nets in regression tasks is key to their application in multiple domains. Deep learning-based approaches aim to achieve this goal either by improving their prediction of specific values (i.e., point prediction), or by producing prediction intervals (PIs) that quantify uncertainty. We present IPIV, a deep neural network for producing both a PI and a value prediction. Our loss function expresses the value prediction as a function of the upper and lower bounds, thus ensuring that it falls within the interval without increasing model complexity. Moreover, our approach makes no assumptions regarding data distribution within the PI, making its value prediction more effective for various real-world problems. Experiments and ablation tests on known benchmarks show that our approach produces tighter uncertainty bounds than the current state-of-the-art approaches for producing PIs, while maintaining comparable performance to the state-of-the-art approach for value-prediction. Additionally, we go beyond previous work and include large image datasets in our evaluation, where IPIV is combined with modern neural nets. (C)& nbsp;& nbsp;2022 Published by Elsevier B.V.
引用
收藏
页数:10
相关论文
共 38 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Ashukha Arsenii, 2020, 8 INT C LEARN REPR I
  • [3] Bojarski M., 2016, ARXIV PREPRINT ARXIV
  • [4] Gal Y, 2016, ADV NEUR IN, V29
  • [5] Gal Y, 2016, PR MACH LEARN RES, V48
  • [6] Geifman Y, 2018, INT C LEARN REPR CAN
  • [7] The RSNA Pediatric Bone Age Machine Learning Challenge
    Halabi, Safwan S.
    Prevedello, Luciano M.
    Kalpathy-Cramer, Jayashree
    Mamonov, Artem B.
    Bilbily, Alexander
    Cicero, Mark
    Pan, Ian
    Pereira, Lucas Araujo
    Sousa, Rafael Teixeira
    Abdala, Nitamar
    Kitamura, Felipe Campos
    Thodberg, Hans H.
    Chen, Leon
    Shih, George
    Andriole, Katherine
    Kohli, Marc D.
    Erickson, Bradleyj
    Flanders, Adam E.
    [J]. RADIOLOGY, 2019, 290 (02) : 498 - 503
  • [8] Hernández-Lobato JM, 2015, PR MACH LEARN RES, V37, P1861
  • [9] Densely Connected Convolutional Networks
    Huang, Gao
    Liu, Zhuang
    van der Maaten, Laurens
    Weinberger, Kilian Q.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2261 - 2269
  • [10] Ioffe S., 2015, P 32 INT C MACHINE L, P448