CERTEM: Explaining and Debugging Black-box Entity Resolution Systems with CERTA

被引:0
|
作者
Teofili, Tommaso [1 ]
Firmani, Donatella [2 ]
Koudas, Nick [3 ]
Merialdo, Paolo [1 ]
Srivastava, Divesh [4 ]
机构
[1] Roma Tre Univ, Rome, Italy
[2] Sapienza Univ, Rome, Italy
[3] Univ Toronto, Toronto, ON, Canada
[4] AT&T Chief Data Off, Bedminster, NJ USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2022年 / 15卷 / 12期
关键词
D O I
10.14778/3554821.3554864
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Entity resolution (ER) aims at identifying record pairs that refer to the same real-world entity. Recent works have focused on deep learning (DL) techniques, to solve this problem. While such works have brought tremendous enhancements in terms of effectiveness in solving the ER problem, understanding their matching predictions is still a challenge, because of the intrinsic opaqueness of DL based solutions. Interpreting and trusting the predictions made by ER systems is crucial for humans in order to employ such methods in decision making pipelines. We demonstrate certem an explanation system for ER based on certa, a recently introduced explainability framework for ER, that is able to provide both saliency explanations, which associate each attribute with a saliency score, and counterfactual explanations, which provide examples of values that can flip a prediction. In this demonstration we will showcase how certem can be effectively employed to better understand and debug the behavior of state-of-the-art DL based ER systems on data from publicly available ER benchmarks.
引用
收藏
页码:3642 / 3645
页数:4
相关论文
共 50 条
  • [21] Composition of relational features with an application to explaining black-box predictors
    Ashwin Srinivasan
    A. Baskar
    Tirtharaj Dash
    Devanshu Shah
    Machine Learning, 2024, 113 : 1091 - 1132
  • [22] EMS SYSTEMS - OPENING THE BLACK-BOX
    MAIO, RF
    ANNALS OF EMERGENCY MEDICINE, 1993, 22 (04) : 730 - 731
  • [23] Composition of relational features with an application to explaining black-box predictors
    Srinivasan, Ashwin
    Baskar, A.
    Dash, Tirtharaj
    Shah, Devanshu
    MACHINE LEARNING, 2024, 113 (03) : 1091 - 1132
  • [24] Cluster-Explorer: Explaining Black-Box Clustering Results
    Tutay, Sariel
    Somech, Amit
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 5106 - 5110
  • [25] EB3: an entity-based black-box specification method for information systems
    M. Frappier
    R. St-Denis
    Software & Systems Modeling, 2003, 2 (2) : 134 - 149
  • [26] A Light-weight Application Monitoring and Statistical Debugging for a Black-box Application
    Tonouchi, Toshio
    2015 17TH ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM APNOMS, 2015, : 523 - 526
  • [27] A Rate-Distortion Framework for Explaining Black-Box Model Decisions
    Kolek, Stefan
    Nguyen, Duc Anh
    Levie, Ron
    Bruna, Joan
    Kutyniok, Gitta
    XXAI - BEYOND EXPLAINABLE AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, Austria, Revised and Extended Papers, 2022, 13200 : 91 - 115
  • [28] EXPLAN: Explaining Black-box Classifiers using Adaptive Neighborhood Generation
    Rasouli, Peyman
    Yu, Ingrid Chieh
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [29] Explaining A Black-box By Using A Deep Variational Information Bottleneck Approach
    Bang, Seojin
    Xie, Pengtao
    Lee, Heewook
    Wu, Wei
    Xing, Eric
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11396 - 11404
  • [30] Detailed Black-Box Monitoring of Distributed Systems
    Neves, Francisco
    Vilaca, Ricardo
    Pereira, Jose
    APPLIED COMPUTING REVIEW, 2021, 21 (01): : 24 - 36