A Multitask Cross-Lingual Summary Method Based on ABO Mechanism

被引:1
作者
Li, Qing [1 ]
Wan, Weibing [1 ]
Zhao, Yuming [2 ]
机构
[1] Shanghai Univ Engn Sci, Sch Elect & Elect Engn, Shanghai 201620, Peoples R China
[2] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 11期
关键词
cross-lingual summary; pre-trained language model; abstractive summarization;
D O I
10.3390/app13116723
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Recent cross-lingual summarization research has pursued the use of a unified end-to-end model which has demonstrated a certain level of improvement in performance and effectiveness, but this approach stitches together multiple tasks and makes the computation more complex. Less work has focused on alignment relationships across languages, which has led to persistent problems of summary misordering and loss of key information. For this reason, we first simplify the multitasking by converting the translation task into an equal proportion of cross-lingual summary tasks so that the model can perform only cross-lingual summary tasks when generating cross-lingual summaries. In addition, we splice monolingual and cross-lingual summary sequences as an input so that the model can fully learn the core content of the corpus. Then, we propose a reinforced regularization method based on the model to improve its robustness, and build a targeted ABO mechanism to enhance the semantic relationship alignment and key information retention of the cross-lingual summaries. Ablation experiments are conducted on three datasets of different orders of magnitude to demonstrate the effective enhancement of the model by the optimization approach; they outperform the mainstream approaches on the cross-lingual summarization task and the monolingual summarization task for the full dataset. Finally, we validate the model's capabilities on a cross-lingual summary dataset of professional domains, and the results demonstrate its superior performance and ability to improve cross-lingual sequencing.
引用
收藏
页数:18
相关论文
共 35 条
  • [1] Abdaoui Amine, 2020, P SUSTAINLP WORKSHOP
  • [2] Alfassy A, 2022, Arxiv, DOI arXiv:2209.03648
  • [3] Bai Y., 2021, arXiv
  • [4] Bishop C. M., 2006, Pattern recognition and machine learning, V1, DOI DOI 10.1007/978-0-387-45528-0
  • [5] Cao Y., 2020, P 58 ANN M ASS COMP, P6220, DOI [10.18653/v1/2020.acl-main.554, DOI 10.18653/V1/2020.ACL-MAIN.554]
  • [6] Chen Z, 2018, PR MACH LEARN RES, V80
  • [7] Duan XY, 2019, Arxiv, DOI arXiv:1910.13114
  • [8] Hermann KM, 2015, ADV NEUR IN, V28
  • [9] Hu BT, 2016, Arxiv, DOI arXiv:1506.05865
  • [10] Jiang SY, 2022, Arxiv, DOI arXiv:2203.02797