Remote Sensing Image Retrieval Based on Multi-scale Pooling and Norm Attention Mechanism

被引:1
作者
Ge, Yun [1 ]
Ma, Lin [1 ]
Ye, Famao [2 ]
Chu, Jun [1 ]
机构
[1] Nanchang Hangkong Univ, Sch Software, Nanchang 330063, Jiangxi, Peoples R China
[2] East China Univ Technol, Sch Surveying & Mapping Engn, Nanchang 330013, Jiangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing image retrieval; Spatial pyramid; Norm; Attention mechanism; Cascading pooling; CLASSIFICATION; SIMILARITY; NETWORK;
D O I
10.11999/JEIT210052
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing images have rich content, and then the features extracted by the general depth modelare easily interfered by the complex background. The key features can not be extracted well, and it is difficultto express the spatial information of the image. A deep convolutional neural network based on multi-scalepooling and norm attention mechanism is proposed, which weights adaptively salient features at the channellevel and the spatial level. First, in the multi-scale pooling channel attention module, the max pooling ofdifferent scales is performed on the feature map of each channel based on spatial pyramid pooling. Next, thefeature maps of different sizes are transformed to a uniform size by adaptive average pooling. Thus the salientfeatures of different scales can be paid attention by element-wise addition. Then, in the norm spatial attentionmodule, the pixels corresponding to the same spatial position of each channel are formed into vectors, and thefeature map with spatial information is obtained by calculating the L1 norm and L2 norm of the vector group.Finally, the cascaded pooling method is adopted to optimize the high-level features, and the high-level featuresare used for remote sensing image retrieval. Experiment are conducted on UC Merced data set, AID data setand NWPU-RESISC45 data set. The results show that the proposed attention model improves the retrievalperformance by concerning the salient features of different scales and combining the spatial information
引用
收藏
页码:543 / 551
页数:9
相关论文
共 26 条
[1]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[2]  
[储珺 Chu Jun], 2020, [模式识别与人工智能, Pattern Recognition and Artificial Intelligence], V33, P889
[3]   Region-based cascade pooling of convolutional features for HRRS image retrieval [J].
Ge, Yun ;
Tang, Yiling ;
Jiang, Shunliang ;
Leng, Lu ;
Xu, Shaoping ;
Ye, Famao .
REMOTE SENSING LETTERS, 2018, 9 (10) :1002-1010
[4]   Global-Local Attention Network for Aerial Scene Classification [J].
Guo, Yiyou ;
Ji, Jinsheng ;
Lu, Xiankai ;
Huo, Hong ;
Fang, Tao ;
Li, Deren .
IEEE ACCESS, 2019, 7 :67200-67212
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/CVPR.2018.00745, 10.1109/TPAMI.2019.2913372]
[7]   Large-Scale Remote Sensing Image Retrieval by Deep Hashing Neural Networks [J].
Li, Yansheng ;
Zhang, Yongjun ;
Huang, Xin ;
Zhu, Hu ;
Ma, Jiayi .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (02) :950-965
[8]   Deep Hash Learning for Remote Sensing Image Retrieval [J].
Liu, Chao ;
Ma, Jingjing ;
Tang, Xu ;
Liu, Fang ;
Zhang, Xiangrong ;
Jiao, Licheng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (04) :3420-3443
[9]   High-Resolution Remote Sensing Image Retrieval Based on Classification-Similarity Networks and Double Fusion [J].
Liu, Yishu ;
Chen, Conghui ;
Han, Zhengzhuo ;
Ding, Liwang ;
Liu, Yingbin .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :1119-1133
[10]   Multi-Layers Feature Fusion of Convolutional Neural Network for Scene Classification of Remote Sensing [J].
Ma, Chenhui ;
Mu, Xiaodong ;
Sha, Dexuan .
IEEE ACCESS, 2019, 7 :121685-121694