The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platform

被引:28
作者
Li, Jie [1 ]
Liu, Haifeng [1 ]
Gui, Chuanghua [1 ]
Chen, Jianyu [1 ]
Ni, Zhenyuan [1 ]
Wang, Ning [1 ]
Chen, Yuan [2 ]
机构
[1] JD Com, Beijing, Peoples R China
[2] JD Com Silicon Valley R&D Ctr, Mountain View, CA USA
来源
MIDDLEWARE INDUSTRY'18: PROCEEDINGS OF THE 2018 ACM/IFIP/USENIX MIDDLEWARE CONFERENCE (INDUSTRIAL TRACK) | 2018年
关键词
visual search; real time; image retrieval; scalability; distributed systems; e-commerce; indexing;
D O I
10.1145/3284028.3284030
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We present the design and implementation of a visual search system for real time image retrieval on JD.com, the world's third largest and China's largest e-commerce site. We demonstrate that our system can support real time visual search with hundreds of billions of product images at sub-second timescales and handle frequent image updates through distributed hierarchical architecture and efficient indexing methods. We hope that sharing our practice with our real production system will inspire the middleware community's interest and appreciation for building practical large scale systems for emerging applications, such as e-commerce visual search.
引用
收藏
页码:9 / 16
页数:8
相关论文
共 21 条
[1]  
Ahmed GF, 2011, INT J SOFT COMPUT EN, V1, P247
[2]  
[Anonymous], 2008, P 17 INT C WORLD WID, DOI DOI 10.1145/1367497.1367540
[3]   Building a web-scale image similarity search system [J].
Batko, Michal ;
Falchi, Fabrizio ;
Lucchese, Claudio ;
Novak, David ;
Perego, Raffaele ;
Rabitti, Fausto ;
Sedmidubsky, Jan ;
Zezula, Pavel .
MULTIMEDIA TOOLS AND APPLICATIONS, 2010, 47 (03) :599-629
[4]  
Budikova P, 2011, LECT NOTES COMPUT SC, V6966, P130, DOI 10.1007/978-3-642-24469-8_15
[5]   Earlybird: Real-Time Search at Twitter [J].
Busch, Michael ;
Gade, Krishna ;
Larson, Brian ;
Lok, Patrick ;
Luckenbill, Samuel ;
Lin, Jimmy .
2012 IEEE 28TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE), 2012, :1360-1369
[6]  
del Mundo Carlo C., VOOGLE VISUAL SEARCH
[7]  
Gionis A, 1999, PROCEEDINGS OF THE TWENTY-FIFTH INTERNATIONAL CONFERENCE ON VERY LARGE DATA BASES, P518
[8]   Web-Scale Responsive Visual Search at Bing [J].
Hu, Houdong ;
Wang, Yan ;
Yang, Linjun ;
Komlev, Pavel ;
Huang, Li ;
Chen, Xi ;
Huang, Jiapei ;
Wu, Ye ;
Merchant, Meenaz ;
Sacheti, Arun .
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, :359-367
[9]   VisualRank: Applying PageRank to large-scale image search [J].
Jing, Yushi ;
Baluja, Shumeet .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (11) :1877-1890
[10]   Visual Search at Pinterest [J].
Jing, Yushi ;
Liu, David ;
Kislyuk, Dmitry ;
Zhai, Andrew ;
Xu, Jiajing ;
Donahue, Jeff ;
Tavel, Sarah .
KDD'15: PROCEEDINGS OF THE 21ST ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2015, :1889-1898