Mimicking Infants' Bilingual Language Acquisition for Domain Specialized Neural Machine Translation

被引:4
作者
Park, Chanjun [1 ,2 ]
Go, Woo-Young [3 ]
Eo, Sugyeong [1 ]
Moon, Hyeonseok [1 ]
Lee, Seolhwa [4 ]
Lim, Heuiseok [1 ]
机构
[1] Korea Univ, Dept Comp Sci & Engn, Seoul 02841, South Korea
[2] Upstage, Yongin 16942, South Korea
[3] Affiliated Inst ETRI, Future Strategy Ctr, Daejeon 34129, South Korea
[4] Univ Copenhagen, Dept Comp Sci, DK-1165 Copenhagen, Denmark
基金
新加坡国家研究基金会;
关键词
Training; Machine translation; Task analysis; Licenses; Computational modeling; Brain modeling; Terminology; Domain-specialized neural machine translation; cross communication method; deep learning; neural machine translation; SPLIT-ATTENTION; NETWORK MODEL; SPEECH; DISCRIMINATION; EXPERIENCE; PERCEPTION; JAPANESE; ADULTS;
D O I
10.1109/ACCESS.2022.3165572
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Existing methods of training domain-specialized neural machine translation (DS-NMT) models are based on the pretrain-finetuning approach (PFA). In this study, we reinterpret existing methods based on the perspective of cognitive science related to cross language speech perception. We propose the cross communication method (CCM), a new DS-NMT training approach. Inspired by the learning method of infants, we perform DS-NMT training by configuring and training DC and GC concurrently in batches. Quantitative and qualitative analysis of our experimental results show that CCM can achieve superior performance compared to the conventional methods. Additionally, we conducted an experiment considering the DS-NMT service to meet industrial demands.
引用
收藏
页码:38684 / 38693
页数:10
相关论文
共 40 条
  • [31] Sato S, 2020, FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2020, P4269
  • [32] Autoassociator networks: insights into infant cognition
    Sirois, S
    [J]. DEVELOPMENTAL SCIENCE, 2004, 7 (02) : 133 - 140
  • [33] DISCRIMINATION OF FOREIGN SPEECH CONTRASTS BY INFANTS AND ADULTS
    TREHUB, SE
    [J]. CHILD DEVELOPMENT, 1976, 47 (02) : 466 - 472
  • [34] Vaswani A, 2017, ADV NEUR IN, V30
  • [35] Vertan C., 2001, P C HELD I U ET DEV, V23, P24
  • [36] CROSS-LANGUAGE SPEECH-PERCEPTION - EVIDENCE FOR PERCEPTUAL REORGANIZATION DURING THE 1ST YEAR OF LIFE
    WERKER, JF
    TEES, RC
    [J]. INFANT BEHAVIOR & DEVELOPMENT, 1984, 7 (01) : 49 - 63
  • [37] DEVELOPMENTAL ASPECTS OF CROSS-LANGUAGE SPEECH-PERCEPTION
    WERKER, JF
    GILBERT, JHV
    HUMPHREY, K
    TEES, RC
    [J]. CHILD DEVELOPMENT, 1981, 52 (01) : 349 - 355
  • [38] Cognitive load and learner expertise: Split-attention and redundancy effects in reading with explanatory notes
    Yeung, AS
    Jin, PT
    Sweller, J
    [J]. CONTEMPORARY EDUCATIONAL PSYCHOLOGY, 1998, 23 (01) : 1 - 21
  • [39] Code-switching as a marker of linguistic competence in bilingual children
    Yow, W. Quin
    Tan, Jessica S. H.
    Flynn, Suzanne
    [J]. BILINGUALISM-LANGUAGE AND COGNITION, 2018, 21 (05) : 1075 - 1090
  • [40] Effects of language experience: Neural commitment to language-specific auditory patterns
    Zhang, Y
    Kuhl, PK
    Imada, T
    Kotani, M
    Tohkura, Y
    [J]. NEUROIMAGE, 2005, 26 (03) : 703 - 720