Multitask and Multilingual Modelling for Lexical Analysis

被引:0
|
作者
Johannes Bjerva
机构
[1] University of Copenhagen,Department of Computer Science
关键词
Natural language processing; Deep learning; Multitask learning; Multilingual learning;
D O I
10.1007/s13218-018-0557-5
中图分类号
学科分类号
摘要
In Natural Language Processing (NLP), one traditionally considers a single task (e.g. part-of-speech tagging) for a single language (e.g. English) at a time. However, recent work has shown that it can be beneficial to take advantage of relatedness between tasks, as well as between languages. In this work I examine the concept of relatedness and explore how it can be utilised to build NLP models that require less manually annotated data. A large selection of NLP tasks is investigated for a substantial language sample comprising 60 languages. The results show potential for joint multitask and multilingual modelling, and hints at linguistic insights which can be gained from such models.
引用
收藏
页码:287 / 290
页数:3
相关论文
共 50 条
  • [1] Multitask and Multilingual Modelling for Lexical Analysis
    Bjerva, Johannes
    KUNSTLICHE INTELLIGENZ, 2018, 32 (04): : 287 - 290
  • [2] CreoleVal: Multilingual Multitask Benchmarks for Creoles
    Lent, Heather
    Tatariya, Kushal
    Dabre, Raj
    Chen, Yiyi
    Fekete, Marcell
    Ploeger, Esther
    Zhou, Li
    Armstrong, Ruth-Ann
    Eijansantos, Abee
    Malau, Catriona
    Heje, Hans Erik
    Lavrinovics, Ernests
    Kanojia, Diptesh
    Belony, Paul
    Bollmann, Marcel
    Grobol, Loic
    de Lhoneux, Miryam
    Hershcovich, Daniel
    DeGraff, Michel
    Sogaard, Anders
    Bjerva, Johannes
    TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2024, 12 : 950 - 978
  • [3] Towards Combining Multitask and Multilingual Learning
    Pikuliak, Matus
    Simko, Marian
    Bielikova, Maria
    THEORY AND PRACTICE OF COMPUTER SCIENCE, SOFSEM 2019, 2019, 11376 : 435 - 446
  • [4] Massively Multilingual Lexical Specialization of Multilingual Transformers
    Green, Tommaso
    Ponzetto, Simone Paolo
    Glavas, Goran
    PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1, 2023, : 7700 - 7715
  • [5] The LIMSI Multilingual, Multitask QAst System
    Rosset, Sophie
    Galibert, Olivier
    Bernard, Guillaume
    Bilinski, Eric
    Adda, Gilles
    EVALUATING SYSTEMS FOR MULTILINGUAL AND MULTIMODAL INFORMATION ACCESS, 2009, 5706 : 480 - 487
  • [6] Multilingual lexical databases, lexical gaps, and SIMuLLDA
    Janssen, M
    INTERNATIONAL JOURNAL OF LEXICOGRAPHY, 2004, 17 (02) : 137 - 154
  • [7] Automatically Creating Multilingual Lexical Resources
    Khang Nhut Lam
    PROCEEDINGS OF THE TWENTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2014, : 3077 - 3078
  • [8] Modelling lexical databases with Formal Concept Analysis
    Priss, U
    Old, LJ
    JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2004, 10 (08) : 967 - 984
  • [9] A Multitask Objective to Inject Lexical Contrast into Distributional Semantics
    Nghia The Pham
    Lazaridou, Angeliki
    Baroni, Marco
    PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL) AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (IJCNLP), VOL 2, 2015, : 21 - 26
  • [10] EuroWordNet: A multilingual database with lexical semantic networks
    Hirst, G
    COMPUTATIONAL LINGUISTICS, 1999, 25 (04) : 628 - 630