Mixture-of-Prompt-Experts for Multi-modal Semantic Understanding

被引：0
|
作者：
Wu, Zichen [1 ]
Huang, HsiuYuan [1 ]
Qu, Fanyi [1 ]
Wu, Yunfang [1 ]
机构：
[1] 不详
来源：
arXiv |
关键词：
Modal representation - Modal semantics - Multi-modal - Multi-modal sarcasm detection - Multi-modal sentiment analyse - Prompt learning - Semantics understanding - Sentiment analysis - Single-modal;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
58
引用
收藏
相关论文
共 50 条
  • [1] A Multi-modal System for Video Semantic Understanding
    Lv, Zhengwei
    Lei, Tao
    Liang, Xiao
    Shi, Zhizhong
    Liu, Duoxing
    CCKS 2021 - EVALUATION TRACK, 2022, 1553 : 34 - 43
  • [2] Multi-modal Mixture of Experts Represetation Learning for Sequential Recommendation
    Bian, Shuqing
    Pan, Xingyu
    Zhao, Wayne Xin
    Wang, Jinpeng
    Wang, Chuyuan
    Wen, Ji-Rong
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 110 - 119
  • [3] Scene-Aware Prompt for Multi-modal Dialogue Understanding and Generation
    Li, Bin
    Weng, Yixuan
    Ma, Ziyu
    Sun, Bin
    Li, Shutao
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2022, PT II, 2022, 13552 : 179 - 191
  • [4] MaPLe: Multi-modal Prompt Learning
    Khattak, Muhammad Uzair
    Rasheed, Hanoona
    Maaz, Muhammad
    Khan, Salman
    Khan, Fahad Shahbaz
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19113 - 19122
  • [5] Visual Prompt Multi-Modal Tracking
    Zhu, Jiawen
    Lai, Simiao
    Chen, Xin
    Wang, Dong
    Lu, Huchuan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 9516 - 9526
  • [6] Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Models
    Shi, Yuge
    Siddharth, N.
    Paige, Brooks
    Torr, Philip H. S.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [7] Variational Mixture of Stochastic Experts Auto-Encoder for Multi-Modal Recommendation
    Yi, Jing
    Chen, Zhenzhong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8941 - 8954
  • [8] Multi-modal long document classification based on Hierarchical Prompt and Multi-modal Transformer
    Liu, Tengfei
    Hu, Yongli
    Gao, Junbin
    Wang, Jiapu
    Sun, Yanfeng
    Yin, Baocai
    NEURAL NETWORKS, 2024, 176
  • [9] How to Read Paintings: Semantic Art Understanding with Multi-modal Retrieval
    Garcia, Noa
    Vogiatzis, George
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT II, 2019, 11130 : 676 - 691
  • [10] Progressive Multi-modal Conditional Prompt Tuning
    Qiu, Xiaoyu
    Feng, Hao
    Wang, Yuechen
    Zhou, Wengang
    Li, Houqiang
    PROCEEDINGS OF THE 4TH ANNUAL ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2024, 2024, : 46 - 54
12345