CERTEM: Explaining and Debugging Black-box Entity Resolution Systems with CERTA

被引:0
|
作者
Teofili, Tommaso [1 ]
Firmani, Donatella [2 ]
Koudas, Nick [3 ]
Merialdo, Paolo [1 ]
Srivastava, Divesh [4 ]
机构
[1] Roma Tre Univ, Rome, Italy
[2] Sapienza Univ, Rome, Italy
[3] Univ Toronto, Toronto, ON, Canada
[4] AT&T Chief Data Off, Bedminster, NJ USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2022年 / 15卷 / 12期
关键词
D O I
10.14778/3554821.3554864
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Entity resolution (ER) aims at identifying record pairs that refer to the same real-world entity. Recent works have focused on deep learning (DL) techniques, to solve this problem. While such works have brought tremendous enhancements in terms of effectiveness in solving the ER problem, understanding their matching predictions is still a challenge, because of the intrinsic opaqueness of DL based solutions. Interpreting and trusting the predictions made by ER systems is crucial for humans in order to employ such methods in decision making pipelines. We demonstrate certem an explanation system for ER based on certa, a recently introduced explainability framework for ER, that is able to provide both saliency explanations, which associate each attribute with a saliency score, and counterfactual explanations, which provide examples of values that can flip a prediction. In this demonstration we will showcase how certem can be effectively employed to better understand and debug the behavior of state-of-the-art DL based ER systems on data from publicly available ER benchmarks.
引用
收藏
页码:3642 / 3645
页数:4
相关论文
共 50 条
  • [1] Challenges of Explaining the Behavior of Black-Box AI Systems
    Asatiani, Aleksandre
    Malo, Pekka
    Nagb, Per Radberg
    Penttinen, Esko
    Rinta-Kahila, Tapani
    Salovaara, Antti
    MIS QUARTERLY EXECUTIVE, 2020, 19 (04) : 259 - 278
  • [2] Explaining black-box classifiers: Properties and functions
    Amgoud, Leila
    INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2023, 155 : 40 - 65
  • [3] Explaining Black-box Classification Models with Arguments
    Amgoud, Leila
    2021 IEEE 33RD INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2021), 2021, : 791 - 795
  • [4] Explaining Black-box Android Malware Detection
    Melis, Marco
    Maiorca, Davide
    Biggio, Battista
    Giacinto, Giorgio
    Roli, Fabio
    2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 524 - 528
  • [5] BLACK-BOX MULTIGRID FOR SYSTEMS
    DENDY, JE
    APPLIED MATHEMATICS AND COMPUTATION, 1986, 19 (1-4) : 57 - 74
  • [6] Explaining the black-box smoothly-A counterfactual approach
    Singla, Sumedha
    Eslami, Motahhare
    Pollack, Brian
    Wallace, Stephen
    Batmanghelich, Kayhan
    MEDICAL IMAGE ANALYSIS, 2023, 84
  • [7] Explaining Black-Box Automated Electrocardiogram Classification to Cardiologists
    Oliveira, Derick M.
    Ribeiro, Antonio H.
    Pedrosa, Joao A. O.
    Paixdo, Gabriela M. M.
    Ribeiro, Antonio L.
    Meira Jr, Wagner
    2020 COMPUTING IN CARDIOLOGY, 2020,
  • [8] Automated Image Reduction for Explaining Black-box Classifiers
    Jiang, Mingyue
    Tang, Chengjian
    Zhang, Xiao-Yi
    Zhao, Yangyang
    Ding, Zuohua
    2023 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING, SANER, 2023, : 367 - 378
  • [9] Explaining Black-Box Models Using Interpretable Surrogates
    Kuttichira, Deepthi Praveenlal
    Gupta, Sunil
    Li, Cheng
    Rana, Santu
    Venkatesh, Svetha
    PRICAI 2019: TRENDS IN ARTIFICIAL INTELLIGENCE, PT I, 2019, 11670 : 3 - 15
  • [10] Explaining Decisions of Black-Box Models Using BARBE
    Motallebi, Mohammad
    Anik, Md Tanvir Alam
    Zaiane, Osmar R.
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2023, PT II, 2023, 14147 : 82 - 97