Unsupervised Domain Adaptation Method with Semantic-Structural Alignment for Dependency Parsing

被引:0
作者
Lin, Boda [1 ]
Li, Mingzheng [1 ]
Li, Si [1 ]
Luo, Yong [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan, Peoples R China
来源
FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021 | 2021年
基金
中国国家自然科学基金;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised cross-domain dependency parsing is to accomplish domain adaptation for dependency parsing without using labeled data in target domain. Existing methods are often of the pseudo-annotation type, which generates data through self-annotation of the base model and performing iterative training. However, these methods fail to consider the change of model structure for domain adaptation. In addition, the structural information contained in the text cannot be fully exploited. To remedy these drawbacks, we propose a Semantics-Structure Adaptative Dependency Parser (SSADP), which accomplishes unsupervised cross-domain dependency parsing without relying on pseudo-annotation or data selection. In particular, we design two feature extractors to extract semantic and structural features respectively. For each type of features, a corresponding feature adaptation method is utilized to achieve domain adaptation to align the domain distribution, which effectively enhances the unsupervised crossdomain transfer capability of the model. We validate the effectiveness of our model by conducting experiments on the CODT1 and CTB9 respectively, and the results demonstrate that our model can achieve consistent performance improvement. Besides, we verify the structure transfer ability of the proposed model by introducing Weisfeiler-Lehman Test.
引用
收藏
页码:2158 / 2167
页数:10
相关论文
共 34 条
[1]  
[Anonymous], 2012, P 50 ANN M ASS COMP
[2]  
[Anonymous], 2011, P 49 ANN M ASS COMPU, DOI 10.5555/2002472.2002661
[3]   Integrating structured biological data by Kernel Maximum Mean Discrepancy [J].
Borgwardt, Karsten M. ;
Gretton, Arthur ;
Rasch, Malte J. ;
Kriegel, Hans-Peter ;
Schoelkopf, Bernhard ;
Smola, Alex J. .
BIOINFORMATICS, 2006, 22 (14) :E49-E57
[4]  
Chen S, 2015, FRONT ELEC ENGINEERI, V1, P1, DOI 10.2174/97816810812051150101
[5]  
Cohen R., 2012, Proceedings of ACL 2012 Student Research Workshop. Association for Computational Linguistics, P43
[6]  
Dozat Timothy, 2017, INT C LEARN REPR
[7]  
Dredze Mark, 2007, FRUSTRATINGLY HARD D, P1051
[8]  
Ghifary M, 2014, LECT NOTES ARTIF INT, V8862, P898, DOI 10.1007/978-3-319-13560-1_76
[9]  
Hamilton WL, 2017, ADV NEUR IN, V30
[10]  
Huang Zhiheng, 2015, Computer Science