Transformer-based approach to variable typing

被引:0
|
作者
Rey, Charles Arthel [1 ]
Danguilan, Jose Lorenzo [1 ]
Mendoza, Karl Patrick [1 ]
Remolona, Miguel Francisco [1 ]
机构
[1] Univ Philippines Diliman, Dept Chem Engn, Chem Engn Intelligence Learning Lab, Quezon City 1101, Philippines
关键词
Natural language processing; Transformers; Entity recognition; Relation extraction; Variable typing; Machine learning; Mathematical knowledge; NAMED ENTITY RECOGNITION;
D O I
10.1016/j.heliyon.2023.e20505
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The upsurge of multifarious endeavors across scientific fields propelled Big Data in the scientific domain. Despite the advancements in management systems, researchers find that mathematical knowledge remains one of the most challenging to manage due to the latter's inherent heterogeneity. One novel recourse being explored is variable typing where current works remain liminary and, thus, provide a wide room for contribution. In this study, a primordial attempt implement the end-to-end Entity Recognition (ER) and Relation Extraction (RE) approach variable typing was made using the BERT (Bidirectional Encoder Representations from Transformers) model. A micro-dataset was developed for this process. According to our findings, the model and RE model, respectively, have Precision of 0.8142 and 0.4919, Recall of 0.7816 0.6030, and F1-Scores of 0.7975 and 0.5418. Despite the limited dataset, the models performed par with values in the literature. This work also discusses the factors affecting this BERT-based
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Transformer-Based Approach to Pathology Diagnosis Using Audio Spectrogram
    Tami, Mohammad
    Masri, Sari
    Hasasneh, Ahmad
    Tadj, Chakib
    INFORMATION, 2024, 15 (05)
  • [32] Smart Home Notifications in Croatian Language: A Transformer-Based Approach
    Simunec, Magdalena
    Soic, Renato
    2023 17TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS, CONTEL, 2023,
  • [33] A Transformer-based network intrusion detection approach for cloud security
    Zhenyue Long
    Huiru Yan
    Guiquan Shen
    Xiaolu Zhang
    Haoyang He
    Long Cheng
    Journal of Cloud Computing, 13
  • [34] A Transformer-based network intrusion detection approach for cloud security
    Long, Zhenyue
    Yan, Huiru
    Shen, Guiquan
    Zhang, Xiaolu
    He, Haoyang
    Cheng, Long
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2024, 13 (01):
  • [35] Molecular Descriptors Property Prediction Using Transformer-Based Approach
    Tran, Tuan
    Ekenna, Chinwe
    INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES, 2023, 24 (15)
  • [36] The MERSA Dataset and a Transformer-Based Approach for Speech Emotion Recognition
    Zhang, Enshi
    Trujillo, Rafael
    Poellabauer, Christian
    PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 13960 - 13970
  • [37] A Transformer-Based Approach to Leakage Detection in Water Distribution Networks
    Luo, Juan
    Wang, Chongxiao
    Yang, Jielong
    Zhong, Xionghu
    SENSORS, 2024, 24 (19)
  • [38] RTIDS: A Robust Transformer-Based Approach for Intrusion Detection System
    Wu, Zihan
    Zhang, Hong
    Wang, Penghai
    Sun, Zhibo
    IEEE ACCESS, 2022, 10 : 64375 - 64387
  • [39] Transformer-Based Approach for Automatic Semantic Financial Document Verification
    Toprak, Ahmet
    Turan, Metin
    IEEE ACCESS, 2024, 12 : 184327 - 184349
  • [40] A Transformer-Based Approach for Smart Invocation of Automatic Code Completion
    de Moor, Aral
    van Deursen, Arie
    Izadi, Maliheh
    PROCEEDINGS OF THE 1ST ACM INTERNATIONAL CONFERENCE ON AI-POWERED SOFTWARE, AIWARE 2024, 2024, : 28 - 37