Adapting Large Multimodal Models to Distribution Shifts: The Role of In-Context Learning

被引：0

作者：

University of New South Wales, Australia ^{[1
]}

不详 ^{[2
]}

不详 ^{[3
]}

不详 ^{[4
]}

不详 ^{[5
]}

不详 ^{[6
]}

不详 ^{[7
]}

机构：

来源：

arXiv |

关键词：

D O I：

暂无

中图分类号：

学科分类号：

摘要：

Context learning - Domain specific - Fine tuning - In contexts - Language model - Learning methods - Multimodal models - Natural distribution - Parameter spaces - Specific adaptations

引用

共 50 条

[41] Stabilized In-Context Learning with Pre-trained Language Models for Few Shot Dialogue State Tracking
Chen, Derek
Qian, Kun
Yu, Zhou
17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1551 - 1564
[42] UniCode: Learning a Unified Codebook for Multimodal Large Language Models
Zheng, Sipeng
Zhou, Bohan
Feng, Yicheng
Wang, Ye
Lu, Zongqing
COMPUTER VISION - ECCV 2024, PT VIII, 2025, 15066 : 426 - 443
[43] An empirical study of Multimodal Entity-Based Sentiment Analysis with ChatGPT: Improving in-context learning via entity-aware contrastive learning
Yang, Li
Wang, Zengzhi
Li, Ziyan
Na, Jin-Cheon
Yu, Jianfei
INFORMATION PROCESSING & MANAGEMENT, 2024, 61 (04)
[44] Meta-in-context learning in large language models
Coda-Forno, Julian
Binz, Marcel
Akata, Zeynep
Botvinick, Matthew
Wang, Jane X.
Schulz, Eric
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
[45] Rethinking the Role of Scale for In-Context Learning: An Interpretability-based Case Study at 66 Billion Scale
Bansal, Hritik
Gopalakrishnan, Karthik
Dingliwal, Saket
Bodapati, Sravan
Kirchhoff, Katrin
Roth, Dan
PROCEEDINGS OF THE 61ST ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2023): LONG PAPERS, VOL 1, 2023, : 11833 - 11856
[46] Robust Prompt Optimization for Large Language Models Against Distribution Shifts
Li, Moxin
Wang, Wenjie
Feng, Fuli
Cao, Yixin
Zhang, Jizhi
Chua, Tat-Seng
2023 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING, EMNLP 2023, 2023, : 1539 - 1554
[47] Language Models can Exploit Cross-Task In-context Learning for Data-Scarce Novel Tasks
Chatterjee, Anwoy
Tanwar, Eshaan
Dutta, Subhabrata
Chakraborty, Tanmoy
PROCEEDINGS OF THE 62ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1: LONG PAPERS, 2024, : 11568 - 11587
[48] MULTIWAY-ADAPTER: ADAPTING MULTIMODAL LARGE LANGUAGE MODELS FOR SCALABLE IMAGE-TEXT RETRIEVAL
Long, Zijun
Killick, George
McCreadie, Richard
Camarasa, Gerardo Aragon
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 6580 - 6584
[49] Cloud-Device Collaborative Learning for Multimodal Large Language Models
Wang, Guanqun
Chen, Jiaming
Liu, Chenxuan
Zhang, Yuan
Ma, Junpeng
Wei, Xinyu
Zhang, Kevin
Chong, Maurice
Zhang, Renrui
Liu, Yijiang
Zhang, Shanghang
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 12646 - 12655
[50] Geo-LLaVA: A Large Multi-Modal Model for Solving Geometry Math Problems with Meta In-Context Learning
Xu, Shihao
Luo, Yiyang
Shi, Wei
PROCEEDINGS OF THE 2ND WORKSHOP ON LARGE GENERATIVE MODELS MEET MULTIMODAL APPLICATIONS, LGM(CUBE)A 2024, 2024, : 11 - 15

← 1 2 3 4 5 →