A Method for Multimodal Remote Sensing Image Classification

被引:0
作者
Sun, Zhanming [1 ]
Hu, Bin [2 ]
机构
[1] Hunan Police Acad, Changsha, Peoples R China
[2] Changsha Normal Univ, Changsha, Peoples R China
关键词
Remote Sensing; Multimodality; Attention Mechanism; HS-LiDAR Houston2013 Dataset; HS-SAR Berlin Benchmarks;
D O I
10.4018/JOEUC.384397
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In remote sensing, images are widely used in applications, such as land cover classification, urban monitoring, and disaster management, providing rich information about the Earth's surface. However, due to data heterogeneity and scarcity, different modalities of remote-sensing images often face challenges in classification tasks. The proposed deep learning model for remote-sensing image classification addresses these challenges through multimodal fusion. By combining a convolutional neural network, a generative adversarial network, and a graph convolutional network, the model is organized into three main components: data preprocessing and feature extraction, multimodal data generation and enhancement, and multimodal feature fusion and classification. Experimental results on the Hyperspectral-Light Detection and Ranging Houston2013 dataset and the Hyperspectral-Synthetic Aperture Radar Berlin dataset show that the proposed method significantly outperforms traditional methods and other deep learning models in classification performance, with better stability and robustness.
引用
收藏
页数:18
相关论文
共 27 条
[1]   Modern RF Measurements With Hot Atoms: A Technology Review of Rydberg Atom-Based Radio Frequency Field Sensors [J].
Artusio-Glimpse, Alexandra ;
Simons, Matthew T. ;
Prajapati, Nikunjkumar ;
Holloway, Christopher L. .
IEEE MICROWAVE MAGAZINE, 2022, 23 (05) :44-56
[2]   MULTIMODAL TRANSFORMER USING CROSS-CHANNEL ATTENTION FOR OBJECT DETECTION IN REMOTE SENSING IMAGES [J].
Bahaduri, Bissmella ;
Ming, Zuheng ;
Feng, Fangchen ;
Mokraoui, Anissa .
2024 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2024, :2620-2626
[3]   Interactions between soil properties, agricultural management and cultivar type drive structural and functional adaptations of the wheat rhizosphere microbiome to drought [J].
Breitkreuz, Claudia ;
Herzig, Laura ;
Buscot, Francois ;
Reitz, Thomas ;
Tarkka, Mika .
ENVIRONMENTAL MICROBIOLOGY, 2021, 23 (10) :5866-5882
[4]   Classification of Hyperspectral and LiDAR Data Using Coupled CNNs [J].
Hang, Renlong ;
Li, Zhu ;
Ghamisi, Pedram ;
Hong, Danfeng ;
Xia, Guiyu ;
Liu, Qingshan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (07) :4939-4950
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]   Decoupled-and-Coupled Networks: Self-Supervised Hyperspectral Image Super-Resolution With Subpixel Fusion [J].
Hong, Danfeng ;
Yao, Jing ;
Li, Chenyu ;
Meng, Deyu ;
Yokoya, Naoto ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
[7]   More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification [J].
Hong, Danfeng ;
Gao, Lianru ;
Yokoya, Naoto ;
Yao, Jing ;
Chanussot, Jocelyn ;
Du, Qian ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05) :4340-4354
[8]   CoSpace: Common Subspace Learning From Hyperspectral-Multispectral Correspondences [J].
Hong, Danfeng ;
Yokoya, Naoto ;
Chanussot, Jocelyn ;
Zhu, Xiao Xiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (07) :4349-4359
[9]   Learnable manifold alignment (LeMA): A semi-supervised cross-modality learning framework for land cover and land use classification [J].
Hong, Danfeng ;
Yokoya, Naoto ;
Ge, Nan ;
Chanussot, Jocelyn ;
Zhu, Xiao Xiang .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 147 :193-205
[10]   GAN-Based Synthetic Data Augmentation for Infrared Small Target Detection [J].
Kim, Jun-Hyung ;
Hwang, Youngbae .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60