Multi-task Learning for Features Extraction in Financial Annual Reports

被引:0
作者
Montariol, Syrielle [1 ]
Martinc, Matej [1 ]
Pelicon, Andraz [1 ]
Pollak, Senja [1 ]
Koloski, Boshko [1 ]
Loncarski, Igor [2 ]
Valentincic, Aljosa [2 ]
Sustar, Katarina Sitar [2 ]
Ichev, Riste [2 ]
Znidarsic, Martin [1 ]
机构
[1] Jozef Stefan Inst, Jamova Cesta 39, Ljubljana 1000, Slovenia
[2] Univ Ljubljana, Sch Econ & Business, Kardeljeva Pl 17, Ljubljana 1000, Slovenia
来源
MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II | 2023年 / 1753卷
关键词
Multi-task learning; Financial reports; Corporate social responsibility; INFORMATION; DISCLOSURE;
D O I
10.1007/978-3-031-23633-4_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For assessing various performance indicators of companies, the focus is shifting from strictly financial (quantitative) publicly disclosed information to qualitative (textual) information. This textual data can provide valuable weak signals, for example through stylistic features, which can complement the quantitative data on financial performance or on Environmental, Social and Governance (ESG) criteria. In this work, we use various multi-task learning methods for financial text classification with the focus on financial sentiment, objectivity, forward-looking sentence prediction and ESG-content detection. We propose different methods to combine the information extracted from training jointly on different tasks; our best-performing method highlights the positive effect of explicitly adding auxiliary task predictions as features for the final target task during the multi-task training. Next, we use these classifiers to extract textual features from annual reports of FTSE350 companies and investigate the link between ESG quantitative scores and these features.
引用
收藏
页码:7 / 24
页数:18
相关论文
共 50 条
  • [1] Multi-Task Learning for Relation Extraction
    Zhou, Kai
    Luo, Xiangfeng
    Wang, Hao
    Xu, Richard
    2019 IEEE 31ST INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2019), 2019, : 1480 - 1487
  • [2] Learning with Partially Shared Features for Multi-Task Learning
    Liu, Cheng
    Cao, Wen-Ming
    Zheng, Chu-Tao
    Wong, Hau-San
    NEURAL INFORMATION PROCESSING, ICONIP 2017, PT V, 2017, 10638 : 95 - 104
  • [3] Prototype Feature Extraction for Multi-task Learning
    Xin, Shen
    Jiao, Yuhang
    Long, Cheng
    Wang, Yuguang
    Wang, Xiaowei
    Yang, Sen
    Liu, Ji
    Zhang, Jie
    PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, : 2472 - 2481
  • [4] Multi-task gradient descent for multi-task learning
    Lu Bai
    Yew-Soon Ong
    Tiantian He
    Abhishek Gupta
    Memetic Computing, 2020, 12 : 355 - 369
  • [5] Multi-task Learning for Author Profiling with Hierarchical Features
    Jiang, Zhile
    Yu, Shuai
    Qu, Qiang
    Yang, Min
    Luo, Junyu
    Liu, Juncheng
    COMPANION PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2018 (WWW 2018), 2018, : 55 - 56
  • [6] Multi-task gradient descent for multi-task learning
    Bai, Lu
    Ong, Yew-Soon
    He, Tiantian
    Gupta, Abhishek
    MEMETIC COMPUTING, 2020, 12 (04) : 355 - 369
  • [7] MULTI-TASK LEARNING WITH COMPRESSIBLE FEATURES FOR COLLABORATIVE INTELLIGENCE
    Alvar, Saeed Ranjbar
    Bajic, Ivan V.
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1705 - 1709
  • [8] Pretraining Financial Language Model with Multi-Task Learning for Financial Text Mining
    Liu Z.
    Liu C.
    Lin W.
    Zhao J.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (08): : 1761 - 1772
  • [9] Seek for commonalities: Shared features extraction for multi-task reinforcement learning via adversarial training
    Meng, Jinling
    Zhu, Fei
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 224
  • [10] Multi-step Prediction of Photovoltaic Power Based on Multi-view Features Extraction and Multi-task Learning
    Chen, Dianhao
    Zang, Haixiang
    Liu, Jingxuan
    Wei, Zhinong
    Sun, Guoqiang
    Li, Xinxin
    Gaodianya Jishu/High Voltage Engineering, 2024, 50 (09): : 3924 - 3933