Weighted Mutual Information for Out-Of-Distribution Detection

被引:0
作者
De Bernardi, Giacomo [1 ,2 ]
Narteni, Sara [1 ]
Cambiaso, Enrico [1 ]
Muselli, Marco [1 ,3 ]
Mongelli, Maurizio [1 ]
机构
[1] CNR IEIIT, Corso FM Perrone 24, I-16152 Genoa, Italy
[2] Univ Genoa, DITEN Dept, I-16145 Genoa, Italy
[3] Rulex Inc, Rulex Innovat Labs, I-16122 Genoa, Italy
来源
EXPLAINABLE ARTIFICIAL INTELLIGENCE, XAI 2023, PT III | 2023年 / 1903卷
关键词
Out-of-distribution detection; eXplainable AI; mutual information; open data;
D O I
10.1007/978-3-031-44070-0_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Out-of-distribution detection has become an important theme in machine learning (ML) field, since the recognition of unseen data either "similar" or not (in- or out-of-distribution) to the ones the ML system has been trained on may lead to potentially fatal consequences. Operational data compliance with the training data has to be verified by the data analyst, who must also understand, in operation, if the autonomous decision-making is still safe or not. In this paper, we study an out-of-distribution (OoD) detection approach based on a rule-based eXplainable Artificial Intelligence (XAI) model. Specifically, the method relies on an innovative metric, i.e., the weighted mutual information, able to capture the different way decision rules are used in case of in- and OoD data.
引用
收藏
页码:318 / 331
页数:14
相关论文
共 26 条
  • [1] [Anonymous], 2019, Road Vehicles - Safety of the Intended Functionality
  • [2] [Anonymous], 2021, Easa concept paper: First usable guidance for level 1 machine learning applications, a deliverable of the easa ai roadmap
  • [3] [Anonymous], 2020, Standard
  • [4] Bitterwolf J, 2022, PR MACH LEARN RES
  • [5] The need to separate the wheat from the chaff in medical informatics Introducing a comprehensive checklist for the (self)-assessment of medical AI studies
    Cabitza, Federico
    Campagner, Andrea
    [J]. INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2021, 153
  • [6] DeVries T., 2018, LEARNING CONFIDENCE
  • [7] Performing Group Difference Testing on Graph Structured Data From GANs: Analysis and Applications in Neuroimaging
    Dinh, Tuan Q.
    Xiong, Yunyang
    Huang, Zhichun
    Vo, Tien
    Mishra, Akshay
    Kim, Won Hwa
    Ravi, Sathya N.
    Singh, Vikas
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) : 877 - 889
  • [8] Class-wise Thresholding for Robust Out-of-Distribution Detection
    Guarrera, Matteo
    Jin, Baihong
    Lin, Tung-Wei
    Zuluaga, Maria A.
    Chen, Yuxin
    Sangiovanni-Vincentelli, Alberto
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 2836 - 2845
  • [9] Guenais T., 2020, arXiv
  • [10] An Application-Driven Conceptualization of Corner Cases for Perception in Highly Automated Driving
    Heidecker, Florian
    Breitenstein, Jasmin
    Roesch, Kevin
    Loehdefink, Jonas
    Bieshaar, Maarten
    Stiller, Christoph
    Fingscheidt, Tim
    Sick, Bernhard
    [J]. 2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 644 - 651