Hybrid Enhancement-based prototypical networks for few-shot relation classification

被引:4
作者
Wang, Lei [1 ]
Qu, Jianfeng [1 ]
Xu, Tianyu [1 ]
Li, Zhixu [2 ]
Chen, Wei [1 ]
Xu, Jiajie [1 ]
Zhao, Lei [1 ]
机构
[1] Soochow Univ, Sch Comp Sci & Technol, Suzhou 215006, Peoples R China
[2] Fudan Univ, Sch Comp Sci, Shanghai 201203, Peoples R China
来源
WORLD WIDE WEB-INTERNET AND WEB INFORMATION SYSTEMS | 2023年 / 26卷 / 05期
基金
中国国家自然科学基金;
关键词
Few-shot learning; Relation classification; Prototypical networks; Enhancement-based; Unbiased relation prototypes;
D O I
10.1007/s11280-023-01184-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot relation classification is to recognize the semantic relation between an entity pair with very few samples. Prototypical network has proven to be a simple yet effective few-shot learning method for relation extraction. However, under the condition of data scarcity, the relation prototypes we achieve are usually biased compared to the real ones computed from all samples within a relation class. To alleviate this issue, we propose hybrid enhancement-based prototypical networks. In particular, our model contains three main enhancement modules: 1) a query-guided prototype enhancement module using rich interactive information between the support instances and the query instance as guidance to obtain more accurate prototype representations; 2) a query enhancement module to diminish the distribution gap between the query set and the support set; 3) a support enhancement module adopting a pseudo-label strategy to expand the scale of available data. On basis of these modules, we further design a novel prototype attention fusion mechanism to fuse information and compute discriminative relation prototypes for classification. In this way, we hope to obtain unbiased representations closer to our expected prototypes by improving the available data scale and data utilization efficiency. Extensive experimental results on the widely-used FewRel dataset demonstrate the superiority of our proposed model.
引用
收藏
页码:3207 / 3226
页数:20
相关论文
共 30 条
[1]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[2]  
Dong Bowen, 2020, P 28 INT C COMP LING, P1594, DOI [DOI 10.18653/V1/2020.COLING-MAIN.140, 10.18653/v1/2020.coling-main.140]
[3]   Large Margin Prototypical Network for Few-shot Relation Classification with Fine-grained Features [J].
Fan, Miao ;
Bai, Yeqi ;
Sun, Mingming ;
Li, Ping .
PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM '19), 2019, :2353-2356
[4]  
Finn C, 2017, PR MACH LEARN RES, V70
[5]  
Gao TY, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P6250
[6]  
Gao TY, 2019, AAAI CONF ARTIF INTE, P6407
[7]   MICK: A Meta-Learning Framework for Few-shot Relation Classification with Small Training Data [J].
Geng, Xiaoqing ;
Chen, Xiwen ;
Kenny Q Zhu ;
Shen, Libin ;
Zhao, Yinggong .
CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, :415-424
[8]   Learning Discriminative and Unbiased Representations for Few-Shot Relation Extraction [J].
Han, Jiale ;
Cheng, Bo ;
Nan, Guoshun .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, :638-648
[9]  
Han JL, 2021, 2021 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2021), P2605
[10]  
Han X, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P4803