RAG-Based Crowdsourcing Task Decomposition via Masked Contrastive Learning With Prompts

被引:0
作者
Yang, Jing [1 ,2 ]
Wang, Xiao [2 ,3 ]
Zhao, Yu [4 ]
Liu, Yuhang [1 ,2 ]
Wang, Fei-Yue [5 ,6 ,7 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodal Artificial Intelligence S, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Qingdao Acad Intelligent Ind, Qingdao 230031, Peoples R China
[4] Natl Univ Def Technol, Natl Key Lab Informat Syst Engn, Changsha 410000, Peoples R China
[5] Macau Univ Sci & Technol, Macau 999078, Peoples R China
[6] Chinese Acad Sci, Beijing Engn Res Ctr Intelligent Syst & Technol, Beijing 100098, Peoples R China
[7] Chinese Acad Sci, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
关键词
Crowdsourcing; event detection; pretrained lan- guage models (PLMs); retrieval-augmented generation (RAG); task decomposition; PRODUCTS;
D O I
10.1109/TCSS.2024.3501316
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Crowdsourcing is a critical technology in social manufacturing, which leverages an extensive and boundless reservoir of human resources to handle a wide array of complex tasks. The successful execution of these complex tasks relies on task decomposition (TD) and allocation, with the former being a prerequisite for the latter. Recently, pretrained language models-based methods have garnered significant attention. However, they are constrained to handling straightforward common-sense tasks due to their inherent restrictions involving limited and difficult-to-update knowledge as well as the presence of "hallucinations." To address these issues, we propose a retrieval-augmented generation-based crowdsourcing framework that reformulates TD as event detection from the perspective of natural language understanding. However, the existing detection methods fail to distinguish differences between event types and always depend on heuristic rules and external semantic analyzing tools. Therefore, we present a prompt-based contrastive learning framework for TD (PBCT), which incorporates a prompt-based trigger detector to overcome dependence. Additionally, trigger-attentive sentinel and masked contrastive learning are designed to provide varying attention to trigger and contextual features according to different event types. Extensive experiment results demonstrate our method is highly competitive in both supervised and zero-shot detection. A case study on printed circuit board design and manufacturing is used to validate its adaptability and scalability in unfamiliar professional domains.
引用
收藏
页码:1535 / 1547
页数:13
相关论文
共 61 条
[1]  
Ahn D., 2006, P WORKSH ANN REAS TI, P8
[2]  
Botelho SC, 1999, ICRA '99: IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-4, PROCEEDINGS, P1234, DOI 10.1109/ROBOT.1999.772530
[3]  
Cobo L., 2012, Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems, V1, P483
[4]   Meta-Learning with Dynamic-Memory-Based Prototypical Network for Few-Shot Event Detection [J].
Deng, Shumin ;
Zhang, Ningyu ;
Kang, Jiaojian ;
Zhang, Yichi ;
Zhang, Wei ;
Chen, Huajun .
PROCEEDINGS OF THE 13TH INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM '20), 2020, :151-159
[5]  
Devlin J., 2018, arXiv
[6]   Swarmanoid: A novel concept for the study of heterogeneous robotic swarms [J].
Dorigo, Marco ;
Floreano, Dario ;
Gambardella, Luca Maria ;
Mondada, Francesco ;
Nolfi, Stefano ;
Baaboura, Tarek ;
Birattari, Mauro ;
Bonani, Michael ;
Brambilla, Manuele ;
Brutschy, Arne ;
Burnier, Daniel ;
Campo, Alexandre ;
Christensen, Anders Lyhne ;
Decugniere, Antal ;
Di Caro, Gianni ;
Ducatelle, Frederick ;
Ferrante, Eliseo ;
Förster, Alexander ;
Gonzales, Javier Martinez ;
Guzzi, Jerome ;
Longchamp, Valentin ;
Magnenat, Stephane ;
Mathews, Nithin ;
Montes De Oca, Marco ;
O'Grady, Rehan ;
Pinciroli, Carlo ;
Pini, Giovanni ;
Rétornaz, Philippe ;
Roberts, James ;
Sperati, Valerio ;
Stirling, Timothy ;
Stranieri, Alessandro ;
Stützle, Thomas ;
Trianni, Vito ;
Tuci, Elio ;
Turgut, Ali Emre ;
Vaussard, Florian .
IEEE Robotics and Automation Magazine, 2013, 20 (04) :60-71
[7]  
Du X., 2020, PROC C EMPIR METHODS
[8]  
Fadaee M, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P436
[9]  
Gao J., 2023, ARXIV
[10]  
HOVY EDUARD., 2006, P HLT NAACL 2006, P57, DOI DOI 10.3115/1614049.1614064