3D multi-resolution wavelet convolutional neural networks for hyperspectral image classification

被引:36
作者
Shi, Cheng [1 ]
Pun, Chi-Man [1 ]
机构
[1] Univ Macau, Dept Comp & Informat Sci, Macau, Peoples R China
关键词
Hyperspectral image classification; 3D multi-resolution wavelet; Convolutional neural networks; Feature extraction; FEATURE-EXTRACTION; DECOMPOSITION; FUSION;
D O I
10.1016/j.ins.2017.08.051
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Hyperspectral images contain abundant spectral information, and three-dimensional (3D) feature extraction methods have been shown to be effective for classification. In this paper, we propose a hyperspectral image classification method that uses 3D multi-resolution wavelet convolutional network (3D MWCNNs) in which wavelets are first characterized by their time-frequency and multi-resolution. Then, the 3D-MWCNNs extract features from coarse to fine scales. In addition, 3D-MWCNNs work stably and effectively for approximation. In the conventional implementation of wavelets, empirical parameters must be determined in advance and the feature extraction process is not adaptive. Convolutional neural networks (CNNs) have strong adaptive learning capabilities and can extract features from low to high levels; however, they lack the theoretical underpinnings to perform multi resolution approximation for filter learning. Therefore, by combining the CNNs framework with multi-resolution analysis theory, a model called 3D MWCNNs is proposed to extract the 3D features from different scales and different depths adaptively. 3D MWCNNs model is better at feature representation and approximation from 3D cube data; therefore, they capture the spatial and spectral features more discriminatively to improve the classification accuracy. Experimental results on three well-known hyperspectral images demonstrate that the proposed framework achieves considerably higher classification accuracy than do several state-of-the-art algorithms. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:49 / 65
页数:17
相关论文
共 44 条
[11]   Morphological Attribute Profiles for the Analysis of Very High Resolution Images [J].
Dalla Mura, Mauro ;
Benediktsson, Jon Atli ;
Waske, Bjoern ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2010, 48 (10) :3747-3762
[12]   A hyperspectral image classification framework and its application [J].
Deng, Shuiguang ;
Xu, Yifei ;
He, Yong ;
Yin, Jianwei ;
Wu, Zhaohui .
INFORMATION SCIENCES, 2015, 299 :379-393
[13]   WAVELET TRANSFORMS AND THEIR APPLICATIONS TO TURBULENCE [J].
FARGE, M .
ANNUAL REVIEW OF FLUID MECHANICS, 1992, 24 :395-457
[14]   DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE [J].
GROSSMANN, A ;
MORLET, J .
SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 1984, 15 (04) :723-736
[15]  
Hariharan B, 2015, PROC CVPR IEEE, P447, DOI 10.1109/CVPR.2015.7298642
[16]   A fast learning algorithm for deep belief nets [J].
Hinton, Geoffrey E. ;
Osindero, Simon ;
Teh, Yee-Whye .
NEURAL COMPUTATION, 2006, 18 (07) :1527-1554
[17]   Deep Convolutional Neural Networks for Hyperspectral Image Classification [J].
Hu, Wei ;
Huang, Yangyu ;
Wei, Li ;
Zhang, Fan ;
Li, Hengchao .
JOURNAL OF SENSORS, 2015, 2015
[18]   3D Convolutional Neural Networks for Human Action Recognition [J].
Ji, Shuiwang ;
Xu, Wei ;
Yang, Ming ;
Yu, Kai .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (01) :221-231
[19]   Convolutional Neural Networks for Document Image Classification [J].
Kang, Le ;
Kumar, Jayant ;
Ye, Peng ;
Li, Yi ;
Doermann, David .
2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, :3168-3172
[20]   Feature Extraction of Hyperspectral Images With Image Fusion and Recursive Filtering [J].
Kang, Xudong ;
Li, Shutao ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2014, 52 (06) :3742-3752