Integrating Spreadsheet Data via Accurate and Low-Effort Extraction

被引:37
作者
Chen, Zhe [1 ]
Cafarella, Michael [1 ]
机构
[1] Univ Michigan, Ann Arbor, MI 48109 USA
来源
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14) | 2014年
基金
美国国家科学基金会;
关键词
Information extraction; spreadsheets; graphical model;
D O I
10.1145/2623330.2623617
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Spreadsheets contain valuable data on many topics. However, spreadsheets are difficult to integrate with other data sources. Converting spreadsheet data to the relational model would allow data analysts to use relational integration tools. We propose a two-phase semiautomatic system that extracts accurate relational metadata while minimizing user effort. Based on an undirected graphical model, our system enables downstream spreadsheet integration applications. First, the automatic extractor uses hints from spreadsheets' graphical style and recovered metadata to extract the spreadsheet data as accurately as possible. Second, the interactive repair identifies similar regions in distinct spreadsheets scattered across large spreadsheet corpora, allowing a user's single manual repair to be amortized over many possible extraction errors. Our experiments show that a human can obtain the accurate extraction with just 31% of the manual operations required by a standard classification based technique on two real-world datasets.
引用
收藏
页码:1126 / 1135
页数:10
相关论文
共 27 条
[1]   UCheck: A spreadsheet type checker for end users [J].
Abraham, Robin ;
Erwig, Martin .
JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2007, 18 (01) :71-95
[2]  
Ahmad Y, 2003, 18TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING, PROCEEDINGS, P174
[3]  
[Anonymous], 2009, COLT
[4]  
Bollacker K., 2008, P 2008 ACM SIGMOD IN, P1247, DOI DOI 10.1145/1376616.1376746
[5]  
Cafarella MJ, 2009, PROC VLDB ENDOW, V2
[6]   WebTables: Exploring the Power of Tables on the Web [J].
Cafarella, Michael J. ;
Halevy, Alon ;
Wang, Daisy Zhe ;
Wu, Eugene ;
Zhang, Yang .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2008, 1 (01) :538-549
[7]  
Chai XY, 2009, ACM SIGMOD/PODS 2009 CONFERENCE, P87
[8]  
Chen Z., 2013, 2013 INT WORKSH
[9]  
Chen Z, 2014, SEMIAUTOMATIC APPROA
[10]  
Chen Zhe., 2013, VLDB Demo