CERTEM: Explaining and Debugging Black-box Entity Resolution Systems with CERTA

被引:0
|
作者
Teofili, Tommaso [1 ]
Firmani, Donatella [2 ]
Koudas, Nick [3 ]
Merialdo, Paolo [1 ]
Srivastava, Divesh [4 ]
机构
[1] Roma Tre Univ, Rome, Italy
[2] Sapienza Univ, Rome, Italy
[3] Univ Toronto, Toronto, ON, Canada
[4] AT&T Chief Data Off, Bedminster, NJ USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2022年 / 15卷 / 12期
关键词
D O I
10.14778/3554821.3554864
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Entity resolution (ER) aims at identifying record pairs that refer to the same real-world entity. Recent works have focused on deep learning (DL) techniques, to solve this problem. While such works have brought tremendous enhancements in terms of effectiveness in solving the ER problem, understanding their matching predictions is still a challenge, because of the intrinsic opaqueness of DL based solutions. Interpreting and trusting the predictions made by ER systems is crucial for humans in order to employ such methods in decision making pipelines. We demonstrate certem an explanation system for ER based on certa, a recently introduced explainability framework for ER, that is able to provide both saliency explanations, which associate each attribute with a saliency score, and counterfactual explanations, which provide examples of values that can flip a prediction. In this demonstration we will showcase how certem can be effectively employed to better understand and debug the behavior of state-of-the-art DL based ER systems on data from publicly available ER benchmarks.
引用
收藏
页码:3642 / 3645
页数:4
相关论文
共 50 条
  • [31] Safe Inputs Approximation for Black-Box Systems
    Xue, Bai
    Liu, Yang
    Ma, Lei
    Zhang, Xiyue
    Sun, Meng
    Xie, Xiaofei
    2019 24TH INTERNATIONAL CONFERENCE ON ENGINEERING OF COMPLEX COMPUTER SYSTEMS (ICECCS 2019), 2019, : 180 - 189
  • [32] DDImage: an image reduction based approach for automatically explaining black-box classifiers
    Jiang, Mingyue
    Tang, Chengjian
    Zhang, Xiao-Yi
    Zhao, Yangyang
    Ding, Zuohua
    EMPIRICAL SOFTWARE ENGINEERING, 2024, 29 (05)
  • [33] A MODEL DISTILLATION APPROACH FOR EXPLAINING BLACK-BOX MODELS FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Taskin, Gulsen
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3592 - 3595
  • [34] TREPAN Reloaded: A Knowledge-Driven Approach to Explaining Black-Box Models
    Confalonieri, Roberto
    Weyde, Tillman
    Besold, Tarek R.
    del Prado Martin, Fermin Moscoso
    ECAI 2020: 24TH EUROPEAN CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, 325 : 2457 - 2464
  • [35] MICROCOMPUTER SYSTEMS FOR UROLOGY HARDWARE - BLACK-BOX OR INSTRUMENT
    GOETZ, C
    SCHUSTER, C
    ZINK, R
    DIEDERICH, R
    MILLER, K
    RASSWEILER, J
    ZWERGE, T
    UROLOGE-AUSGABE A, 1989, 28 (01): : 1 - 10
  • [36] A survey of black-box modernization approaches for information systems
    Comella-Dorda, S
    Wallnau, K
    Seacord, RC
    Robert, J
    INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, PROCEEDINGS, 2000, : 173 - 183
  • [37] FACTS: Automated Black-Box Testing of FinTech Systems
    Wang, Qingshun
    Gu, Lintao
    Xue, Minhui
    Xu, Lihua
    Niu, Wenyu
    Dou, Liang
    He, Liang
    Xie, Tao
    ESEC/FSE'18: PROCEEDINGS OF THE 2018 26TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, 2018, : 839 - 844
  • [38] Barriers to Black-Box Constructions of Traitor Tracing Systems
    Tang, Bo
    Zhang, Jiapeng
    THEORY OF CRYPTOGRAPHY, TCC 2017, PT I, 2017, 10677 : 3 - 30
  • [39] Statistical model checking of black-box probabilistic systems
    Sen, K
    Viswanathan, M
    Agha, G
    COMPUTER AIDED VERIFICATION, 2004, 3114 : 202 - 215
  • [40] Black-Box Testing and Auditing of Bias in ADM Systems
    Krafft, Tobias D.
    Hauer, Marc P.
    Zweig, Katharina
    MINDS AND MACHINES, 2024, 34 (02)