Cross-Lingual Knowledge Transferring by Structural Correspondence and Space Transfer

被引:6
作者
Wang, Deqing [1 ]
Wu, Junjie [2 ,3 ,4 ]
Yang, Jingyuan [5 ]
Jing, Baoyu [6 ]
Zhang, Wenjie [1 ]
He, Xiaonan [7 ]
Zhang, Hui [1 ]
机构
[1] Beihang Univ, Sch Comp Sci, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Econ & Management, Beijing 100191, Peoples R China
[3] Beihang Univ, Beijing Adv Innovat Ctr Big Data & Brain Comp, Beijing 100191, Peoples R China
[4] Beihang Univ, Beijing Key Lab Emergency Support Simulat Technol, Beijing 100191, Peoples R China
[5] George Mason Univ, Sch Business, Fairfax, VA 22030 USA
[6] Univ Illinois, Dept Comp Sci, Champaign, IL 61801 USA
[7] Baidu Inc, Dept Search, Beijing 100094, Peoples R China
关键词
Task analysis; Machine translation; Analytical models; Transfer learning; Dictionaries; Electronic mail; Time complexity; Cross-lingual sentiment classification; space transfer; structural correspondence learning (SCL); SENTIMENT CLASSIFICATION;
D O I
10.1109/TCYB.2021.3051005
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The cross-lingual sentiment analysis (CLSA) aims to leverage label-rich resources in the source language to improve the models of a resource-scarce domain in the target language, where monolingual approaches based on machine learning usually suffer from the unavailability of sentiment knowledge. Recently, the transfer learning paradigm that can transfer sentiment knowledge from resource-rich languages, for example, English, to resource-poor languages, for example, Chinese, has gained particular interest. Along this line, in this article, we propose semisupervised learning with SCL and space transfer (ssSCL-ST), a semisupervised transfer learning approach that makes use of structural correspondence learning as well as space transfer for cross-lingual sentiment analysis. The key idea behind ssSCL-ST, at a high level, is to explore the intrinsic sentiment knowledge in the target-lingual domain and to reduce the loss of valuable knowledge due to the knowledge transfer via semisupervised learning. ssSCL-ST also features in pivot set extension and space transfer, which helps to enhance the efficiency of knowledge transfer and improve the classification accuracy in the target language domain. Extensive experimental results demonstrate the superiority of ssSCL-ST to the state-of-the-art approaches without using any parallel corpora.
引用
收藏
页码:6555 / 6566
页数:12
相关论文
共 50 条
[31]   Is Translation Helpful? An Exploration of Cross-Lingual Transfer in Low-Resource Dialog Generation [J].
Shen, Lei ;
Yu, Shuai ;
Shen, Xiaoyu .
2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
[32]   Investigating cross-lingual training for offensive language detection [J].
Pelicon, Andraz ;
Shekhar, Ravi ;
Skrlj, Blaz ;
Purver, Matthew ;
Pollak, Senja .
PEERJ COMPUTER SCIENCE, 2021, 7 :2-39
[33]   Unsupervised Cross-Lingual Mapping for Phrase Embedding Spaces [J].
Ayana, Abraham G. ;
Cao, Hailong ;
Zhao, Tiejun .
ADVANCES IN INFORMATION AND COMMUNICATION, VOL 2, 2020, 1130 :512-524
[34]   Curriculum-Style Fine-Grained Adaption for Unsupervised Cross-Lingual Dependency Transfer [J].
Guo, Peiming ;
Huang, Shen ;
Jiang, Peijie ;
Sun, Yueheng ;
Zhang, Meishan ;
Zhang, Min .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 :322-332
[35]   Towards Cross-Lingual Generalization of Translation Gender Bias [J].
Cho, Won Ik ;
Kim, Jiwon ;
Yang, Jaeyeong ;
Kim, Nam Soo .
PROCEEDINGS OF THE 2021 ACM CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, FACCT 2021, 2021, :449-457
[36]   Manipuri–English comparable corpus for cross-lingual studies [J].
Lenin Laitonjam ;
Sanasam Ranbir Singh .
Language Resources and Evaluation, 2023, 57 :377-413
[37]   Improving Cross-Lingual Transfer Learning for End-to-End Speech Recognition with Speech Translation [J].
Wang, Changhan ;
Pino, Juan ;
Gu, Jiatao .
INTERSPEECH 2020, 2020, :4731-4735
[38]   Cross-Lingual Transfert Learning for Speech Emotion Recognition [J].
Baklouti, Imen ;
Ben Ahmed, Olfa ;
Baklouti, Raoudha ;
Fernandez, Christine .
2024 IEEE 7TH INTERNATIONAL CONFERENCE ON ADVANCED TECHNOLOGIES, SIGNAL AND IMAGE PROCESSING, ATSIP 2024, 2024, :559-563
[39]   CROSS-LINGUAL LEARNING IN MULTILINGUAL SCENE TEXT RECOGNITION [J].
Baek, Jeonghun ;
Matsui, Yusuke ;
Aizawa, Kiyoharu .
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, :6770-6774
[40]   An empirical study of cross-lingual transfer learning techniques for small-footprint keyword spotting [J].
Sun, Ming ;
Schwarz, Andreas ;
Wu, Minhua ;
Strom, Nikko ;
Matsoukas, Spyros ;
Vitaladevuni, Shiv .
2017 16TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2017, :255-260