Joint Entity Resolution

被引:11
作者
Whang, Steven Euijong [1 ]
Garcia-Molina, Hector [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
来源
2012 IEEE 28TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE) | 2012年
关键词
D O I
10.1109/ICDE.2012.119
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Entity resolution (ER) is the problem of identifying which records in a database represent the same entity. Often, records of different types are involved (e.g., authors, publications, institutions, venues), and resolving records of one type can impact the resolution of other types of records. In this paper we propose a flexible, modular resolution framework where existing ER algorithms developed for a given record type can be plugged in and used in concert with other ER algorithms. Our approach also makes it possible to run ER on subsets of similar records at a time, important when the full data is too large to resolve together. We study the scheduling and coordination of the individual ER algorithms in order to resolve the full data set. We then evaluate our joint ER techniques on synthetic and real data and show the scalability of our approach.
引用
收藏
页码:294 / 305
页数:12
相关论文
共 19 条
[1]  
[Anonymous], 2004, Scheduling algorithms
[2]  
[Anonymous], 2007, ACM Transactions on Knowledge Discovery from Data (TKDD), DOI [DOI 10.1145/1217299.1217304, 10.1145/1217299.1217304]
[3]  
[Anonymous], 2004, PROC KDD 2004 WORKSH
[4]  
[Anonymous], 2006, CURRENT
[5]   Large-Scale Deduplication with Constraints using Dedupalog [J].
Arasu, Arvind ;
Re, Christopher ;
Suciu, Dan .
ICDE: 2009 IEEE 25TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3, 2009, :952-963
[6]   Swoosh: a generic approach to entity resolution [J].
Benjelloun, Omar ;
Garcia-Molina, Hector ;
Menestrina, David ;
Su, Qi ;
Whang, Steven Euijong ;
Widom, Jennifer .
VLDB JOURNAL, 2009, 18 (01) :255-276
[7]  
Culotta Aron., 2005, A conditional model of deduplication for multi-type relational data
[8]  
Dong X., 2005, P 2005 ACM SIGMOD IN, P85, DOI DOI 10.1145/1066157.1066168
[9]   Duplicate record detection: A survey [J].
Elmagarmid, Ahmed K. ;
Ipeirotis, Panagiotis G. ;
Verykios, Vassilios S. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2007, 19 (01) :1-16
[10]  
Garey M. R., 1976, Mathematics of Operations Research, V1, P117, DOI 10.1287/moor.1.2.117