Cross-domain change object detection using generative adversarial networks

被引:0
作者
Sugimoto T. [1 ]
Tanaka K. [1 ]
Yamaguchi K. [1 ]
机构
[1] University of Fukui 3-9-1 Bunkyo, Fukui-shi, 910-8507, Fukui
来源
Journal of Robotics and Mechatronics | 2019年 / 31卷 / 02期
基金
日本学术振兴会;
关键词
Cross-season change object detection; Generative adversarial networks; Long-term map maintenance;
D O I
10.20965/jrm.2019.p0221
中图分类号
学科分类号
摘要
Image change detection is a fundamental problem for robotic map maintenance and long-term map learning. Local feature-based image comparison is one of the most basic schemes for addressing this problem. However, the local-feature approach encounters difficulties when the query and reference images involve different domains (e.g., time of the day, weather, season). In this paper, we address the local-feature approach from the novel perspective of object-level region features. This study is inspired by the recent success of object-level region features in cross-domain visual place recognition (CD-VPR). Unlike the previous contributions of the CD-VPR task, in the cross-domain change detection (CD-CD) tasks, we consider matching a small part (i.e., the change) of the scene and not the entire image, which is considerably more demanding. To address this issue, we explore the use of two independent object proposal techniques: Supervised object proposal (e.g., YOLO) and unsupervised object proposal (e.g., BING). We combine these techniques and compute appearance features of their arbitrarily shaped objects by aggregating local features from a deep convolutional neural network (DCN). Experiments using a publicly available cross-season NCLT dataset validate the efficacy of the proposed approach. © 2019, Fuji Technology Press. All rights reserved.
引用
收藏
页码:221 / 230
页数:9
相关论文
共 32 条
[1]  
Van De Wouw D.W., Dubbelman G., De With P.H., Hierarchical 2.5-d scene alignment for change detection with large viewpoint differences, IEEE Robotics and Automation Letters, 1, 1, pp. 361-368, (2016)
[2]  
Mathias B., Marcin D., Igor G., Cesar C., Roland S., Juan N., Map management for efficient long-term visual localization in outdoor environments, Proc. of 2018 IEEE Intelligent Vehicles Symp. (IV), pp. 682-688, (2018)
[3]  
Radke R.J., Andra S., Al-Kofahi O., Roysam B., Image change detection algorithms: A systematic survey, IEEE Trans. on Image Processing, 14, 3, pp. 294-307, (2005)
[4]  
Finman R., Whelan T., Kaess M., Leonard J.J., “Toward lifelong object segmentation from change detection in dense rgb-d maps, 2013 European Conf. on Mobile Robots (ECMR), pp. 178-185, (2013)
[5]  
Kim K., Chalidabhongse T.H., Harwood D., Davis L., Background modeling and subtraction by codebook construction, 2004, Int. Conf. on Image Processing (ICIP’04), pp. 3061-3064, (2004)
[6]  
Kosecka J., Detecting changes in images of street scenes, Asian Conf. on Computer Vision, pp. 590-601, (2012)
[7]  
Gueguen L., Hamid R., Large-scale damage detection using satellite imagery, Proc. of 2015 IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1321-1328, (2015)
[8]  
Cover T., Hart P., Nearest neighbor pattern classification, IEEE Trans. on Information Theory, 13, 1, pp. 21-27, (1967)
[9]  
Tuytelaars T., Mikolajczyk K., Et al., Local invariant feature detectors: A survey, Foundations and Trends R ® in Computer Graphics and Vision, 3, 3, pp. 177-280, (2008)
[10]  
Li J., Liang X., Wei Y., Xu T., Feng J., Yan S., “Perceptual generative adversarial networks for small object detection, 2017 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 1951-1959, (2017)