Gaussian-Based Runtime Detection of Out-of-distribution Inputs for Neural Networks

被引：5

作者：

Hashemi, Vahid ^{[2
]}

Kretinsky, Jan ^{[1
]}

Mohr, Stefanie ^{[1
]}

Seferis, Emmanouil ^{[1
,2
]}

机构：

[1] Tech Univ Munich, Munich, Germany

[2] AUDI AG, Ettingerstr 60, D-85057 Ingolstadt, Germany

来源：

RUNTIME VERIFICATION (RV 2021) | 2021年 / 12974卷

关键词：

D O I：

10.1007/978-3-030-88494-9_14

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

In this short paper, we introduce a simple approach for run-time monitoring of deep neural networks and show how to use it for out-of-distribution detection. The approach is based on inferring Gaussian models of some of the neurons and layers. Despite its simplicity, it performs better than recently introduced approaches based on interval abstractions which are traditionally used in verification.

引用

页码：254 / 264

页数：11

共 50 条

[1] Gaussian-Based Approach for Out-of-Distribution Detection in Deep Learning
Carvalho, Thiago
Vellasco, Marley
Amaral, Jose Franco
24TH INTERNATIONAL CONFERENCE ON ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EAAAI/EANN 2023, 2023, 1826 : 303 - 314
[2] Runtime Monitoring for Out-of-Distribution Detection in Object Detection Neural Networks
Hashemi, Vahid
Kretinsky, Jan
Rieder, Sabine
Schmidt, Jessica
FORMAL METHODS, FM 2023, 2023, 14000 : 622 - 634
[3] On Detection of Out of Distribution Inputs in Deep Neural Networks
Jha, Susmit
Roy, Anirban
2021 IEEE THIRD INTERNATIONAL CONFERENCE ON COGNITIVE MACHINE INTELLIGENCE (COGMI 2021), 2021, : 282 - 288
[4] Layer Adaptive Deep Neural Networks for Out-of-Distribution Detection
Wang, Haoliang
Zhao, Chen
Zhao, Xujiang
Chen, Feng
ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2022, PT II, 2022, 13281 : 526 - 538
[5] Performance analysis of out-of-distribution detection on trained neural networks
Henriksson, Jens
Berger, Christian
Borg, Markus
Tornberg, Lars
Sathyamoorthy, Sankar Raman
Englund, Cristofer
INFORMATION AND SOFTWARE TECHNOLOGY, 2021, 130
[6] NeuralFP: Out-of-distribution Detection using Fingerprints of Neural Networks
Lee, Wei-Han
Millman, Steve
Desai, Nirmit
Srivatsa, Mudhakar
Liu, Changchang
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 9561 - 9568
[7] Fixing Robust Out-of-distribution Detection for Deep Neural Networks
Zhou, Zhiyang
Liu, Jie
Dou, Wensheng
Li, Shuo
Kang, Liangyi
Qu, Muzi
Ye, Dan
2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, ISSRE, 2023, : 533 - 544
[8] Gaussian-Based Pooling for Convolutional Neural Networks
Kobayashi, Takumi
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
[9] Performance Analysis of Out-of-Distribution Detection on Various Trained Neural Networks
Henriksson, Jens
Berger, Christian
Borg, Markus
Tornberg, Lars
Sathyamoorthy, Sankar Raman
Englund, Cristofer
2019 45TH EUROMICRO CONFERENCE ON SOFTWARE ENGINEERING AND ADVANCED APPLICATIONS (SEAA 2019), 2019, : 113 - 120
[10] Interaction of Generalization and Out-of-Distribution Detection Capabilities in Deep Neural Networks
Aboitiz, Francisco Javier Klaiber
Legenstein, Robert
Oezdenizci, Ozan
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PART X, 2023, 14263 : 248 - 259

← 1 2 3 4 5 →