Multi-task Learning for Features Extraction in Financial Annual Reports

被引:0
作者
Montariol, Syrielle [1 ]
Martinc, Matej [1 ]
Pelicon, Andraz [1 ]
Pollak, Senja [1 ]
Koloski, Boshko [1 ]
Loncarski, Igor [2 ]
Valentincic, Aljosa [2 ]
Sustar, Katarina Sitar [2 ]
Ichev, Riste [2 ]
Znidarsic, Martin [1 ]
机构
[1] Jozef Stefan Inst, Jamova Cesta 39, Ljubljana 1000, Slovenia
[2] Univ Ljubljana, Sch Econ & Business, Kardeljeva Pl 17, Ljubljana 1000, Slovenia
来源
MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II | 2023年 / 1753卷
关键词
Multi-task learning; Financial reports; Corporate social responsibility; INFORMATION; DISCLOSURE;
D O I
10.1007/978-3-031-23633-4_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For assessing various performance indicators of companies, the focus is shifting from strictly financial (quantitative) publicly disclosed information to qualitative (textual) information. This textual data can provide valuable weak signals, for example through stylistic features, which can complement the quantitative data on financial performance or on Environmental, Social and Governance (ESG) criteria. In this work, we use various multi-task learning methods for financial text classification with the focus on financial sentiment, objectivity, forward-looking sentence prediction and ESG-content detection. We propose different methods to combine the information extracted from training jointly on different tasks; our best-performing method highlights the positive effect of explicitly adding auxiliary task predictions as features for the final target task during the multi-task training. Next, we use these classifiers to extract textual features from annual reports of FTSE350 companies and investigate the link between ESG quantitative scores and these features.
引用
收藏
页码:7 / 24
页数:18
相关论文
共 50 条
  • [21] Calibrated Multi-Task Learning
    Nie, Feiping
    Hu, Zhanxuan
    Li, Xuelong
    KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 2012 - 2021
  • [22] Survey of Multi-Task Learning
    Zhang Y.
    Liu J.-W.
    Zuo X.
    1600, Science Press (43): : 1340 - 1378
  • [23] A Survey on Multi-Task Learning
    Zhang, Yu
    Yang, Qiang
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (12) : 5586 - 5609
  • [24] Boosted multi-task learning
    Chapelle, Olivier
    Shivaswamy, Pannagadatta
    Vadrevu, Srinivas
    Weinberger, Kilian
    Zhang, Ya
    Tseng, Belle
    MACHINE LEARNING, 2011, 85 (1-2) : 149 - 173
  • [25] Parallel Multi-Task Learning
    Zhang, Yu
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 629 - 638
  • [26] An overview of multi-task learning
    Yu Zhang
    Qiang Yang
    National Science Review, 2018, 5 (01) : 30 - 43
  • [27] A multi-task learning based approach to biomedical entity relation extraction
    Li, Qingqing
    Yang, Zhihao
    Luo, Ling
    Wang, Lei
    Zhang, Yin
    Lin, Hongfei
    Wang, Jian
    Yang, Liang
    Xu, Kan
    Zhang, Yijia
    PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, : 680 - 682
  • [28] Joint Extraction of Nested Entities and Relations Based on Multi-task Learning
    Wan, Jing
    Qin, Chunyu
    Yang, Jing
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2023, 2023, 14118 : 368 - 382
  • [29] Enhancing relation extraction using multi-task learning with SDP evidence
    Wang, Hailin
    Zhang, Dan
    Liu, Guisong
    Huang, Li
    Qin, Ke
    INFORMATION SCIENCES, 2024, 670
  • [30] Multi-task learning for aspect term extraction and aspect sentiment classification
    Akhtar, Md Shad
    Garg, Tarun
    Ekbal, Asif
    NEUROCOMPUTING, 2020, 398 : 247 - 256