What's the next word in large language models?

被引：11

作者：

不详

机构：

来源：

NATURE MACHINE INTELLIGENCE | 2023年 / 5卷 / 04期

关键词：

D O I：

10.1038/s42256-023-00655-z

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We are trying to keep up with the torrent of developments and discussions in AI and language models since ChatGPT was unleashed on the world.

引用

页码：331 / 332

页数：2

共 9 条

[1]

Bender Emily M., 2020, P 58 ANN M ASS COMP, P5185, DOI DOI 10.18653/V1/2020.ACL-MAIN.463

[2]

Bubeck S, 2023, Arxiv, DOI [arXiv:2303.12712, 10.48550/arXiv.2303.12712, 10.48550/ARXIV.2303.12712]

[3] Transformer-based protein generation with regularized latent space optimization [J].

Castro, Egbert ;

Godavarthi, Abhinav ;

Rubinfien, Julian ;

Givechian, Kevin ;

Bhaskar, Dhananjay ;

Krishnaswamy, Smita .

NATURE MACHINE INTELLIGENCE, 2022, 4 (10) :840-851

[4] Parameter-efficient fine-tuning of large-scale pre-trained language models [J].

Ding, Ning ;

Qin, Yujia ;

Yang, Guang ;

Wei, Fuchao ;

Yang, Zonghan ;

Su, Yusheng ;

Hu, Shengding ;

Chen, Yulin ;

Chan, Chi-Min ;

Chen, Weize ;

Yi, Jing ;

Zhao, Weilin ;

Wang, Xiaozhi ;

Liu, Zhiyuan ;

Zheng, Hai-Tao ;

Chen, Jianfei ;

Liu, Yang ;

Tang, Jie ;

Li, Juanzi ;

Sun, Maosong .

NATURE MACHINE INTELLIGENCE, 2023, 5 (03) :220-+

[5] Shared computational principles for language processing in humans and deep language models [J].

Goldstein, Ariel ;

Zada, Zaid ;

Buchnik, Eliav ;

Schain, Mariano ;

Price, Amy ;

Aubrey, Bobbi ;

Nastase, Samuel A. ;

Feder, Amir ;

Emanuel, Dotan ;

Cohen, Alon ;

Jansen, Aren ;

Gazula, Harshvardhan ;

Choe, Gina ;

Rao, Aditi ;

Kim, Catherine ;

Casto, Colton ;

Fanda, Lora ;

Doyle, Werner ;

Friedman, Daniel ;

Dugan, Patricia ;

Melloni, Lucia ;

Reichart, Roi ;

Devore, Sasha ;

Flinker, Adeen ;

Hasenfratz, Liat ;

Levy, Omer ;

Hassidim, Avinatan ;

Brenner, Michael ;

Matias, Yossi ;

Norman, Kenneth A. ;

Devinsky, Orrin ;

Hasson, Uri .

NATURE NEUROSCIENCE, 2022, 25 (03) :369-+

[6] A multi-modal pre-training transformer for universal transfer learning in metal-organic frameworks [J].

Kang, Yeonghun ;

Park, Hyunsoo ;

Smit, Berend ;

Kim, Jihan .

NATURE MACHINE INTELLIGENCE, 2023, 5 (03) :309-318

[7] The debate over understanding in AI?s large language models [J].

Mitchell, Melanie ;

Krakauer, David C. .

PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2023, 120 (13)

[8]

Patel R., 2022, INT C LEARNING REPRE

[9] Large-scale chemical language representations capture molecular structure and properties [J].

Ross, Jerret ;

Belgodere, Brian ;

Chenthamarakshan, Vijil ;

Padhi, Inkit ;

Mroueh, Youssef ;

Das, Payel .

NATURE MACHINE INTELLIGENCE, 2022, 4 (12) :1256-1264

← 1 →