Fusing Local and Global Features for High-Resolution Scene Classification

被引:165
作者
Bian, Xiaoyong [1 ,2 ]
Chen, Chen [3 ]
Tian, Long [4 ]
Du, Qian [4 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Comp Sci, Wuhan 430065, Hubei, Peoples R China
[2] Hubei Prov Key Lab Intelligent Informat Proc & Re, Wuhan 430065, Hubei, Peoples R China
[3] Univ Cent Florida, Ctr Comp Vis Res, Orlando, FL 32816 USA
[4] Mississippi State Univ, Dept Elect & Comp Engn, Starkville, MS 39762 USA
基金
中国国家自然科学基金;
关键词
Codebookless model (CLM); feature representation; image descriptors; rotation invariance; scene classification; saliency detection; OBJECT DETECTION; REPRESENTATION; DESCRIPTORS; SCALE;
D O I
10.1109/JSTARS.2017.2683799
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, a fused global saliency-based multiscale multiresolution multistructure local binary pattern (salM(3)LBP) feature and local codebookless model (CLM) feature is proposed for high-resolution image scene classification. First, two different but complementary types of descriptors (pixel intensities and differences) are developed to extract global features, characterizing the dominant spatial features in multiple scale, multiple resolution, and multiple structure manner. The micro/macrostructure information and rotation invariance are guaranteed in the global feature extraction process. For dense local feature extraction, CLM is utilized to model local enrichment scale invariant feature transform descriptor and dimension reduction is conducted via joint low-rank learning with support vector machine. Finally, a fused feature representation between salM(3)LBP and CLM as the scene descriptor to train a kernel-based extreme learning machine for scene classification is presented. The proposed approach is extensively evaluated on three challenging benchmark scene datasets (the 21-class land-use scene, 19-class satellite scene, and a newly available 30-class aerial scene), and the experimental results show that the proposed approach leads to superior classification performance compared with the state-of-the-art classification methods.
引用
收藏
页码:2889 / 2901
页数:13
相关论文
共 51 条
[1]  
[Anonymous], PAMI
[2]  
[Anonymous], 2014, 2 INT C LEARN REPR I
[3]  
[Anonymous], 2015, LAND USE CLASSIFICAT
[4]  
[Anonymous], IEEE T GEOS IN PRESS
[5]  
[Anonymous], 2016, REMOTE SENS
[6]   EXTENDED MULTI-STRUCTURE LOCAL BINARY PATTERN FOR HIGH-RESOLUTION IMAGE SCENE CLASSIFICATION [J].
Bian, Xiaoyong ;
Chen, Chen ;
Du, Qian ;
Sheng, Yuxia .
2016 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2016, :5134-5137
[7]   Advances in Hyperspectral Image Classification [J].
Camps-Valls, Gustavo ;
Tuia, Devis ;
Bruzzone, Lorenzo ;
Benediktsson, Jon Atli .
IEEE SIGNAL PROCESSING MAGAZINE, 2014, 31 (01) :45-54
[8]   Free-Form Region Description with Second-Order Pooling [J].
Carreira, Joao ;
Caseiro, Rui ;
Batista, Jorge ;
Sminchisescu, Cristian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (06) :1177-1189
[9]   Land-use scene classification using multi-scale completed local binary patterns [J].
Chen, Chen ;
Zhang, Baochang ;
Su, Hongjun ;
Li, Wei ;
Wang, Lu .
SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (04) :745-752
[10]   Pyramid of Spatial Relatons for Scene-Level Land Use Classification [J].
Chen, Shizhi ;
Tian, YingLi .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (04) :1947-1957