Curriculum Learning for Graph Neural Networks: A Multiview Competence-based Approach

被引:0
|
作者
Vakil, Nidhi [1 ]
Amiri, Hadi [1 ]
机构
[1] Univ Massachusetts Lowell, Dept Comp Sci, Lowell, MA 01854 USA
来源
PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, VOL 1 | 2023年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A curriculum is a planned sequence of learning materials and an effective one can make learning efficient and effective for both humans and machines. Recent studies developed effective data-driven curriculum learning approaches for training graph neural networks in language applications. However, existing curriculum learning approaches often employ a single criterion of difficulty in their training paradigms. In this paper, we propose a new perspective on curriculum learning by introducing a novel approach that builds on graph complexity formalisms (as difficulty criteria) and model competence during training. The model consists of a scheduling scheme which derives effective curricula by accounting for different views of sample difficulty and model competence during training. The proposed solution advances existing research in curriculum learning for graph neural networks with the ability to incorporate a fine-grained spectrum of graph difficulty criteria in their training paradigms. Experimental results on real-world link prediction and node classification tasks illustrate the effectiveness of the proposed approach.(1)
引用
收藏
页码:7036 / 7051
页数:16
相关论文
共 50 条
  • [1] Competence-based Curriculum Learning for Neural Machine Translation
    Platanios, Emmanouil Antonios
    Stretcu, Otilia
    Neubig, Graham
    Poczos, Barnabas
    Mitchell, Tom M.
    2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, 2019, : 1162 - 1172
  • [2] Competence-Based Approach to Learning
    Umbleja, Kadri
    Kukk, Vello
    Jaanus, Martin
    2013 IEEE GLOBAL ENGINEERING EDUCATION CONFERENCE (EDUCON), 2013, : 552 - 559
  • [3] COMPETENCE-BASED CURRICULUM
    Patesan, Marioara
    15TH INTERNATIONAL CONFERENCE THE KNOWLEDGE-BASED ORGANIZATION: BEHAVIORAL AND SOCIAL SCIENCES, CONFERENCE PROCEEDINGS 4, 2009, 4 : 308 - 312
  • [4] Competence-based Curriculum Learning for Multilingual Machine Translation
    Zhang, Mingliang
    Meng, Fandong
    Tong, Yunhai
    Zhou, Jie
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EMNLP 2021, 2021, : 2481 - 2493
  • [5] Competence-based curriculum drafting
    Voicu, M.
    Rusu, C.
    QUALITY MANAGEMENT IN HIGHER EDUCATION, PROCEEDINGS, 2006, : 43 - 48
  • [6] Scaffolding competence-based learning design in the dental simulation curriculum
    Foxton, Richard
    San Diego, Jonathan P.
    Lu, Emily
    Bartlett, Anitha
    Mcilwane, Clare
    Austin, Rupert
    Srisontisuk, Pinsuda
    Sagoo, Anika K.
    Piper, Kim
    EUROPEAN JOURNAL OF DENTAL EDUCATION, 2023,
  • [7] Competence-based Multimodal Curriculum Learning for Medical Report Generation
    Liu, Fenglin
    Ge, Shen
    Wu, Xian
    59TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 11TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (ACL-IJCNLP 2021), VOL 1, 2021, : 3001 - 3012
  • [8] COMPETENCE-BASED CURRICULUM AND CURRICULA PLANNING
    Mantyla, Ritva
    Nisula, Leila
    ICERI2014: 7TH INTERNATIONAL CONFERENCE OF EDUCATION, RESEARCH AND INNOVATION, 2014, : 2738 - 2746
  • [9] Development of a competence-based colposcopy curriculum
    Redman, CWE
    Dollery, E
    Byrom, J
    Jordan, JA
    PROCEEDINGS OF THE XI INTERNATIONAL CONGRESS OF CERVICAL PATHOLOGY AND COLPOSCOPY, 2002, : 103 - 107
  • [10] A competence-based industrial learning approach for factories of the future
    Kiritsis, Dimitris
    Bufardi, Ahmed
    Mavrikios, Dimitris
    Knothe, Thomas
    Szigeti, Hadrien
    Majumdar, Anirban
    EDUCATION AND INFORMATION TECHNOLOGIES, 2013, 18 (02) : 331 - 350