Improving Basic Natural Language Processing Tools for the Ainu Language

被引：3

作者：

Nowakowski, Karol ^{[1
]}

Ptaszynski, Michal ^{[1
]}

Masui, Fumito ^{[1
]}

Momouchi, Yoshio ^{[2
]}

机构：

[1] Kitami Inst Technol, Dept Comp Sci, 165 Koen Cho, Kitami, Hokkaido 0908507, Japan

[2] Hokkai Gakuen Univ, Fac Engn, Dept Elect & Informat Engn, Chuo Ku, 1-1,Nishi 11 Chome,Minami 26 Jo, Sapporo, Hokkaido 0640926, Japan

来源：

INFORMATION | 2019年 / 10卷 / 11期

关键词：

Ainu language; endangered languages; normalization; word segmentation; part-of-speech tagging;

D O I：

10.3390/info10110329

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Ainu is a critically endangered language spoken by the native inhabitants of northern Japan. This paper describes our research aimed at the development of technology for automatic processing of text in Ainu. In particular, we improved the existing tools for normalizing old transcriptions, word segmentation, and part-of-speech tagging. In the experiments we applied two Ainu language dictionaries from different domains (literary and colloquial) and created a new data set by combining them. The experiments revealed that expanding the lexicon had a positive impact on the overall performance of our tools, especially with test data unrelated to any of the training sets used.

引用

收藏

页数：21

相关论文

共 50 条

[21] Natural language tagging with genetic algorithms [J].

Alba, Enrique ;

Luque, Gabriel ;

Araujo, Lourdes .

INFORMATION PROCESSING LETTERS, 2006, 100 (05) :173-182

[22] Feature-Frequency-Adaptive On-line Training for Fast and Accurate Natural Language Processing [J].

Sun, Xu ;

Li, Wenjie ;

Wang, Houfeng ;

Lu, Qin .

COMPUTATIONAL LINGUISTICS, 2014, 40 (03) :563-586

[23] Combining Natural Language Processing and Statistical Methods to Assess Gender Gaps in the Mediated Personalization of Politics [J].

Brugnoli, Emanuele ;

Simone, Rosaria ;

Delmastro, Marco .

SOCIAL SCIENCE COMPUTER REVIEW, 2025, 43 (02) :279-294

[24] The nature of the language input affects brain activation during learning from a natural language [J].

Plante, Elena ;

Patterson, Dianne ;

Gomez, Rebecca ;

Almryde, Kyle R. ;

White, Milo G. ;

Asbjornsen, Arve E. .

JOURNAL OF NEUROLINGUISTICS, 2015, 36 :17-34

[25] A Basic Language Resource Kit Implementation for the IgboNLP Project [J].

Onyenwe, Ikechukwu E. ;

Hepple, Mark ;

Chinedu, Uchechukwu ;

Ezeani, Ignatius .

ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2018, 17 (02)

[26] Bridging the gap between speech technology and natural language processing: an evaluation toolbox for term discovery systems [J].

Ludusan, Bogdan ;

Versteegh, Maarten ;

Jansen, Aren ;

Gravier, Guillaume ;

Cao, Xuan-Nga ;

Johnson, Mark ;

Dupoux, Emmanuel .

LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, :560-567

[27] TaLAPi - A Thai Linguistically Annotated Corpus for Language Processing [J].

Aw, AiTi ;

Aljunied, Sharifah Mahani ;

Lertcheva, Nattadaporn ;

Kalunsima, Sasiwimon .

LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014,

[28] Clinical named entity recognition and relation extraction using natural language processing of medical free text: A systematic review [J].

Navarro, David Fraile ;

Ijaz, Kiran ;

Rezazadegan, Dana ;

Rahimi-Ardabili, Hania ;

Dras, Mark ;

Coiera, Enrico ;

Berkovsky, Shlomo .

INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2023, 177

[29] Modelling policy action using natural language processing: evidence for a long-run increase in policy activism in the UK [J].

Popa, Mircea .

JOURNAL OF COMPUTATIONAL SOCIAL SCIENCE, 2025, 8 (02)

[30] Offline segmentation and online language processing units The influence of literacy [J].

Veldhuis, Dorina ;

Kurvers, Jeanne .

WRITTEN LANGUAGE AND LITERACY, 2012, 15 (02) :165-184

← 1 2 3 4 5 →