Transformer-based approach to variable typing

被引:0
|
作者
Rey, Charles Arthel [1 ]
Danguilan, Jose Lorenzo [1 ]
Mendoza, Karl Patrick [1 ]
Remolona, Miguel Francisco [1 ]
机构
[1] Univ Philippines Diliman, Dept Chem Engn, Chem Engn Intelligence Learning Lab, Quezon City 1101, Philippines
关键词
Natural language processing; Transformers; Entity recognition; Relation extraction; Variable typing; Machine learning; Mathematical knowledge; NAMED ENTITY RECOGNITION;
D O I
10.1016/j.heliyon.2023.e20505
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The upsurge of multifarious endeavors across scientific fields propelled Big Data in the scientific domain. Despite the advancements in management systems, researchers find that mathematical knowledge remains one of the most challenging to manage due to the latter's inherent heterogeneity. One novel recourse being explored is variable typing where current works remain liminary and, thus, provide a wide room for contribution. In this study, a primordial attempt implement the end-to-end Entity Recognition (ER) and Relation Extraction (RE) approach variable typing was made using the BERT (Bidirectional Encoder Representations from Transformers) model. A micro-dataset was developed for this process. According to our findings, the model and RE model, respectively, have Precision of 0.8142 and 0.4919, Recall of 0.7816 0.6030, and F1-Scores of 0.7975 and 0.5418. Despite the limited dataset, the models performed par with values in the literature. This work also discusses the factors affecting this BERT-based
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A Transformer-Based Approach for Choosing Actions in Social Robotics
    De Benedictis, Riccardo
    Beraldo, Gloria
    Cortellessa, Gabriella
    Fracasso, Francesca
    Cesta, Amedeo
    SOCIAL ROBOTICS, ICSR 2022, PT I, 2022, 13817 : 198 - 207
  • [22] Transformer-based approach for symptom recognition and multilingual linking
    Vassileva, Sylvia
    Grazhdanski, Georgi
    Koychev, Ivan
    Boytcheva, Svetla
    DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION, 2024, 2024
  • [23] Transformer-Based Approach for Predicting Transactive Energy in Neurorehabilitation
    Khan, Naveed Ahmad
    Goyal, Tanishka
    Hussain, Fahad
    Jamwal, Prashant K.
    Hussain, Shahid
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2025, 33 : 46 - 57
  • [24] A Transformer-Based Approach for Better Hand Gesture Recognition
    Besrour, Sinda
    Surapaneni, Yogesh
    Mubibya, Gael S.
    Ashkar, Fahim
    Almhana, Jalal
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 1135 - 1140
  • [25] A transformer-based approach for Arabic offline handwritten text recognition
    Momeni, Saleh
    Babaali, Bagher
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (04) : 3053 - 3062
  • [26] A Swin Transformer-based fault migration and diagnosis approach for gearboxes
    Zhang, Yan
    Wu, Zhe
    Wang, Xifeng
    Wang, Ziwen
    2024 5TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND APPLICATION, ICCEA 2024, 2024, : 1355 - 1361
  • [27] A transformer-based approach for improving app review response generation
    Zhang, Weizhe
    Gu, Wenchao
    Gao, Cuiyun
    Lyu, Michael R.
    SOFTWARE-PRACTICE & EXPERIENCE, 2023, 53 (02): : 438 - 454
  • [28] A Transformer-Based Approach to Authorship Attribution in Classical Arabic Texts
    AlZahrani, Fetoun Mansour
    Al-Yahya, Maha
    APPLIED SCIENCES-BASEL, 2023, 13 (12):
  • [29] RamanFormer: A Transformer-Based Quantification Approach for Raman Mixture Components
    Koyun, Onur Can
    Keser, Reyhan Kevser
    Sahin, Safa Onur
    Bulut, Damla
    Yorulmaz, Mustafa
    Yucesoy, Veysel
    Toreyin, Behcet Ugur
    ACS OMEGA, 2024, 9 (22): : 23241 - 23251
  • [30] A Transformer-based Approach for Translating Natural Language to Bash Commands
    Fu, Quchen
    Teng, Zhongwei
    White, Jules
    Schmidt, Douglas C.
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 1245 - 1248