Superpixel-Based Seamless Image Stitching for UAV Images

被引:55
作者
Yuan, Yiting [1 ]
Fang, Faming [1 ]
Zhang, Guixu [1 ]
机构
[1] East China Normal Univ, Sch Comp Sci & Techonol, Shanghai 200062, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2021年 / 59卷 / 02期
基金
中国国家自然科学基金;
关键词
Image color analysis; Unmanned aerial vehicles; Image registration; Complexity theory; Image segmentation; Distortion; Color blending; image stitching; seam cutting; superpixels; unmanned aerial vehicle~(UAV) images;
D O I
10.1109/TGRS.2020.2999404
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Image stitching aims to generate a natural seamless high-resolution panoramic image free of distortions or artifacts as fast as possible. In this article, we propose a new seam cutting strategy based on superpixels for unmanned aerial vehicle (UAV) image stitching. Explicitly, we decompose the issue into three steps: image registration, seam cutting, and image blending. First, we employ adaptive as-natural-as-possible (AANAP) warps for registration, obtaining two aligned images in the same coordinate system. Then, we propose a novel superpixel-based energy function that integrates color difference, gradient difference, and texture complexity information to search a perceptually optimal seam located in continuous areas with high similarity. We apply the graph cut algorithm to solve the problem and thereby conceal artifacts in the overlapping area. Finally, we utilize a superpixel-based color blending approach to eliminate visible seams and achieve natural color transitions. Experimental results demonstrate that our method can effectively and efficiently realize seamless stitching, and is superior to several state-of-the-art methods in UAV image stitching.
引用
收藏
页码:1565 / 1576
页数:12
相关论文
共 48 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Interactive digital photomontage [J].
Agarwala, A ;
Dontcheva, M ;
Agrawala, M ;
Drucker, S ;
Colburn, A ;
Curless, B ;
Salesin, D ;
Cohen, M .
ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03) :294-302
[3]  
AGRAWAL H, 1990, SIGPLAN NOTICES, V25, P246, DOI 10.1145/93548.93576
[4]   An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision [J].
Boykov, Y ;
Kolmogorov, V .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2004, 26 (09) :1124-1137
[5]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[6]   A MULTIRESOLUTION SPLINE WITH APPLICATION TO IMAGE MOSAICS [J].
BURT, PJ ;
ADELSON, EH .
ACM TRANSACTIONS ON GRAPHICS, 1983, 2 (04) :217-236
[7]   Shape-Preserving Half-Projective Warps for Image Stitching [J].
Chang, Che-Han ;
Sato, Yoichi ;
Chuang, Yung-Yu .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3254-3261
[8]   Natural Image Stitching with the Global Similarity Prior [J].
Chen, Yu-Sheng ;
Chuang, Yung-Yu .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :186-201
[9]   Mosaics of scenes with moving objects [J].
Davis, J .
1998 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1998, :354-360
[10]   A Novel Image Registration Method Based on Phase Correlation Using Low-Rank Matrix Factorization With Mixture of Gaussian [J].
Dong, Yunyun ;
Long, Tengfei ;
Jiao, Weili ;
He, Guojin ;
Zhang, Zhaoming .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (01) :446-460