Enhancing Word Embeddings for Improved Semantic Alignment

被引:0
|
作者
Szymanski, Julian [1 ]
Operlejn, Maksymilian [1 ]
Weichbroth, Pawel [2 ]
机构
[1] Gdansk Univ Technol, Fac Elect Telecommun & Informat, Dept Comp Syst Architecture, PL-80233 Gdansk, Poland
[2] Gdansk Univ Technol, Fac Elect Telecommun & Informat, Dept Software Engn, PL-80233 Gdansk, Poland
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 24期
关键词
natural language processing; semantic ambiguity; word vector representation; Word2vec; polysemous word embedding; word sense disambiguation;
D O I
10.3390/app142411519
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This study introduces a method for the improvement of word vectors, addressing the limitations of traditional approaches like Word2Vec or GloVe through introducing into embeddings richer semantic properties. Our approach leverages supervised learning methods, with shifts in vectors in the representation space enhancing the quality of word embeddings. This ensures better alignment with semantic reference resources, such as WordNet. The effectiveness of the method has been demonstrated through the application of modified embeddings to text classification and clustering. We also show how our method influences document class distributions, visualized through PCA projections. By comparing our results with state-of-the-art approaches and achieving better accuracy, we confirm the effectiveness of the proposed method. The results underscore the potential of adaptive embeddings to improve both the accuracy and efficiency of semantic analysis across a range of NLP.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Improved Learning of Word Embeddings with Word Definitions and Semantic Injection
    Zhang, Yichi
    Dai, Yinpei
    Ou, Zhijian
    Wang, Huixin
    Feng, Junlan
    INTERSPEECH 2020, 2020, : 4253 - 4257
  • [2] Improved Learning of Chinese Word Embeddings with Semantic Knowledge
    Yang, Liner
    Sun, Maosong
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA (CCL 2015), 2015, 9427 : 15 - 25
  • [3] Enhancing Semantic Representations of Bilingual Word Embeddings with Syntactic Dependencies
    Xu, Linli
    Ouyang, Wenjun
    Ren, Xiaoying
    Wang, Yang
    Jiang, Liang
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 4517 - 4524
  • [4] Enhancing Sensitivity Classification with Semantic Features Using Word Embeddings
    McDonald, Graham
    Macdonald, Craig
    Ounis, Iadh
    ADVANCES IN INFORMATION RETRIEVAL, ECIR 2017, 2017, 10193 : 450 - 463
  • [5] Learning interpretable word embeddings via bidirectional alignment of dimensions with semantic concepts
    Senel, Lutfi Kerem
    Sahinuc, Furkan
    Yuecesoy, Veysel
    Schuetze, Hinrich
    Cukur, Tolga
    Koc, Aykut
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (03)
  • [6] Enhancing Accuracy of Semantic Relatedness Measurement by Word Single-Meaning Embeddings
    Li, Xiaotao
    You, Shujuan
    Chen, Wai
    IEEE ACCESS, 2021, 9 (09): : 117424 - 117433
  • [7] Unsupervised Alignment of Distributional Word Embeddings
    Diallo, Aissatou
    Fuernkranz, Johannes
    ADVANCES IN ARTIFICIAL INTELLIGENCE, KI 2022, 2022, 13404 : 60 - 74
  • [8] GLOSS ALIGNMENT USING WORD EMBEDDINGS
    Walsh, Harry
    Sincan, Ozge Mercanoglu
    Saunders, Ben
    Bowden, Richard
    2023 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING WORKSHOPS, ICASSPW, 2023,
  • [9] Learning Word Embeddings in Parallel by Alignment
    Zubair, Sahil
    Zubair, Mohammad
    2017 INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING & SIMULATION (HPCS), 2017, : 566 - 571
  • [10] Integrating Word Embeddings into IBM Word Alignment Models
    Anh-Cuong Le
    Tuan-Phong Nguyen
    Quoc-Long Tran
    PROCEEDINGS OF 2018 10TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SYSTEMS ENGINEERING (KSE), 2018, : 79 - 84