Robust Image Registration via Consistent Topology Sort and Vision Inspection

被引:1
作者
Yang, Jian [1 ,2 ]
Han, Pengfei [2 ]
Huang, Ju [2 ,3 ]
Li, Qiang [2 ]
Wang, Cong [4 ]
Li, Xuelong [5 ]
机构
[1] Northwest Univ, Sch Math, Xian 710027, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence OPt & Elect iOPEN, Xian 710072, Shaanxi, Peoples R China
[3] Shanghai Artificial Intelligence Lab, Shanghai 200232, Peoples R China
[4] Northwestern Polytech Univ, Sch Math & Stat, Xian 710129, Peoples R China
[5] Inst Artificial Intelligence TeleAI China Telecom, Beijing 100033, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2025年 / 63卷
基金
中国国家自然科学基金;
关键词
Image registration; machine vision; proximity structure; topology sort; visual inspection;
D O I
10.1109/TGRS.2025.3556000
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Machine vision plays a crucial role in Earth observation. As a fundamental and challenging task in vision systems, image registration faces new challenges due to increasing collaborative and customization applications. The prevalence of more false matches and low-precision matches is particularly evident in complex and changeable scenarios. In this article, we propose a robust image registration method via topology sort and vision consistence. Initial candidate matches are established via the nearest neighbor ratio of image intensity descriptors. A topological sort across the proximity structure around the point pairs is defined to assess the reliability of candidate matched pairs, effectively eliminating more false matches while retaining highly reliable point pairs. To preserve more point pairs, we develop a spatial visual inspection mechanism to further determine the potential matches from the remaining pairs that do not satisfy the previous topological constraint. During vision inspection, the spatial transformation model is simultaneously estimated. Experimental results on public datasets show that the proposed method outperforms state-of-the-art approaches in both matching accuracy and visual effect.
引用
收藏
页数:15
相关论文
共 45 条
[1]   HPatches: A benchmark and evaluation of handcrafted and learned local descriptors [J].
Balntas, Vassileios ;
Lenc, Karel ;
Vedaldi, Andrea ;
Mikolajczyk, Krystian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3852-3861
[2]   Marginalizing Sample Consensus [J].
Barath, Daniel ;
Noskova, Jana ;
Matas, Jiri .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) :8420-8432
[3]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[4]   Matching with PROSAC - Progressive Sample Consensus [J].
Chum, O ;
Matas, J .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :220-226
[5]   Monocular 3D Fingerprint Reconstruction and Unwarping [J].
Cui, Zhe ;
Feng, Jianjiang ;
Zhou, Jie .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) :8679-8695
[6]   Second-Order Optimization of Mutual Information for Real-Time Image Registration [J].
Dame, Amaury ;
Marchand, Eric .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (09) :4190-4203
[7]   Rigid image registration by General Adaptive Neighborhood matching [J].
Debayle, Johan ;
Presles, Benoit .
PATTERN RECOGNITION, 2016, 55 :45-57
[8]   Interpretable Multi-Modal Image Registration Network Based on Disentangled Convolutional Sparse Coding [J].
Deng, Xin ;
Liu, Enpeng ;
Li, Shengxi ;
Duan, Yiping ;
Xu, Mai .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :1078-1091
[9]   Coherent Point Drift Revisited for Non-rigid Shape Matching and Registration [J].
Fan, Aoxiang ;
Ma, Jiayi ;
Tian, Xin ;
Mei, Xiaoguang ;
Lin, Wei .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :1414-1424
[10]   Advances and Opportunities in Remote Sensing Image Geometric Registration: A Systematic Review of State-of-the-Art Approaches and Future Research Directions [J].
Feng, Ruitao ;
Shen, Huanfeng ;
Bai, Jianjun ;
Li, Xinghua .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2021, 9 (04) :120-142