Similarity Search with Tensor Core Units

被引:5
作者
Ahle, Thomas D. [1 ,2 ]
Silvestri, Francesco [3 ]
机构
[1] IT Univ, Copenhagen, Denmark
[2] BARC, Copenhagen, Denmark
[3] Univ Padua, Padua, Italy
来源
SIMILARITY SEARCH AND APPLICATIONS, SISAP 2020 | 2020年 / 12440卷
关键词
Similarity search; Tensor core units; Dimensionality reduction; Similarity join; Locality sensitive hashing;
D O I
10.1007/978-3-030-60936-8_6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Tensor Core Units (TCUs) are hardware accelerators developed for deep neural networks, which efficiently support the multiplication of two dense root m x root m matrices, where m is a given hardware parameter. In this paper, we show that TCUs can speed up similarity search problems as well. We propose algorithms for the Johnson-Lindenstrauss dimensionality reduction and for similarity join that, by leveraging TCUs, achieve a Omega(root m) speedup up with respect to traditional approaches.
引用
收藏
页码:76 / 84
页数:9
相关论文
共 16 条
[11]  
Gionis A, 1999, PROCEEDINGS OF THE TWENTY-FIFTH INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES, P518
[12]   A Domain-Specific Architecture for Deep Neural Networks [J].
Jouppi, Norman P. ;
Young, Cliff ;
Patil, Nishant ;
Patterson, David .
COMMUNICATIONS OF THE ACM, 2018, 61 (09) :50-59
[13]   In-Datacenter Performance Analysis of a Tensor Processing Unit [J].
Jouppi, Norman P. ;
Young, Cliff ;
Patil, Nishant ;
Patterson, David ;
Agrawal, Gaurav ;
Bajwa, Raminder ;
Bates, Sarah ;
Bhatia, Suresh ;
Boden, Nan ;
Borchers, Al ;
Boyle, Rick ;
Cantin, Pierre-luc ;
Chao, Clifford ;
Clark, Chris ;
Coriell, Jeremy ;
Daley, Mike ;
Dau, Matt ;
Dean, Jeffrey ;
Gelb, Ben ;
Ghaemmaghami, Tara Vazir ;
Gottipati, Rajendra ;
Gulland, William ;
Hagmann, Robert ;
Ho, C. Richard ;
Hogberg, Doug ;
Hu, John ;
Hundt, Robert ;
Hurt, Dan ;
Ibarz, Julian ;
Jaffey, Aaron ;
Jaworski, Alek ;
Kaplan, Alexander ;
Khaitan, Harshit ;
Killebrew, Daniel ;
Koch, Andy ;
Kumar, Naveen ;
Lacy, Steve ;
Laudon, James ;
Law, James ;
Le, Diemthu ;
Leary, Chris ;
Liu, Zhuyuan ;
Lucke, Kyle ;
Lundin, Alan ;
MacKean, Gordon ;
Maggiore, Adriana ;
Mahony, Maire ;
Miller, Kieran ;
Nagarajan, Rahul ;
Narayanaswami, Ravi .
44TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2017), 2017, :1-12
[14]   Sparser Johnson-Lindenstrauss Transforms [J].
Kane, Daniel M. ;
Nelson, Jelani .
JOURNAL OF THE ACM, 2014, 61 (01)
[15]  
Lu T., 2020, LARGE SCALE DISCRETE
[16]   I/O-Efficient Similarity Join [J].
Pagh, Rasmus ;
Pham, Ninh ;
Silvestri, Francesco ;
Stockel, Morten .
ALGORITHMICA, 2017, 78 (04) :1263-1283