LightGlue: Local Feature Matching at Light Speed

被引:263
作者
Lindenberger, Philipp [1 ]
Sarlin, Paul-Edouard [1 ]
Pollefeys, Marc [1 ,2 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] Microsoft Mixed Real & AI Lab, Zurich, Switzerland
来源
2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023) | 2023年
关键词
D O I
10.1109/ICCV51070.2023.01616
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We introduce LightGlue, a deep neural network that learns to match local features across images. We revisit multiple design decisions of SuperGlue, the state of the art in sparse matching, and derive simple but effective improvements. Cumulatively, they make LightGlue more efficient - in terms of both memory and computation, more accurate, and much easier to train. One key property is that LightGlue is adaptive to the difficulty of the problem: the inference is much faster on image pairs that are intuitively easy to match, for example because of a larger visual overlap or limited appearance change. This opens up exciting prospects for deploying deep matchers in latency-sensitive applications like 3D reconstruction. The code and trained models are publicly available at github.com/cvg/LightGlue.
引用
收藏
页码:17581 / 17592
页数:12
相关论文
共 78 条
[1]  
[Anonymous], 2019, NEURIPS
[2]  
[Anonymous], 2017, CVPR, DOI DOI 10.1109/CVPR.2017.684
[3]  
Arandjelovic R, 2018, IEEE T PATTERN ANAL, V40, P1437, DOI [10.1109/TPAMI.2017.2711011, 10.1109/CVPR.2016.572]
[4]   HPatches: A benchmark and evaluation of handcrafted and learned local descriptors [J].
Balntas, Vassileios ;
Lenc, Karel ;
Vedaldi, Andrea ;
Mikolajczyk, Krystian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3852-3861
[5]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[6]   Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age [J].
Cadena, Cesar ;
Carlone, Luca ;
Carrillo, Henry ;
Latif, Yasir ;
Scaramuzza, Davide ;
Neira, Jose ;
Reid, Ian ;
Leonard, John J. .
IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) :1309-1332
[7]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[8]   Handcrafted Outlier Detection Revisited [J].
Cavalli, Luca ;
Larsson, Viktor ;
Oswald, Martin Ralf ;
Sattler, Torsten ;
Pollefeys, Marc .
COMPUTER VISION - ECCV 2020, PT XIX, 2020, 12364 :770-787
[9]  
Chen H., 2021, ICCV
[10]   ASpanFormer: Detector-Free Image Matching with Adaptive Span Transformer [J].
Chen, Hongkai ;
Luo, Zixin ;
Zhou, Lei ;
Tian, Yurun ;
Zhen, Mingmin ;
Fang, Tian ;
McKinnon, David ;
Tsin, Yanghai ;
Quan, Long .
COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 :20-36