Stereo Attention Cross-Decoupling Fusion-Guided Federated Neural Learning for Hyperspectral Image Classification

被引:3
作者
Cai, Weiwei [1 ]
Gao, Ming [1 ]
Ding, Yao [2 ]
Ning, Xin [3 ]
Bai, Xiao [4 ]
Qian, Pengjiang [1 ]
机构
[1] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi 214122, Peoples R China
[2] Xian Res Inst High Technol, Xian 710025, Peoples R China
[3] Chinese Acad Sci, Inst Semicond, Beijing 100083, Peoples R China
[4] Beihang Univ, Sch Comp Sci & Engn, Beijing 100191, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Computational modeling; Federated learning; Hyperspectral imaging; Data models; Servers; Reliability; Image edge detection; Edge computing; feature fusion; federated learning; hyperspectral image classification; neural networks; NETWORKS;
D O I
10.1109/TGRS.2023.3320044
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Federated learning is a promising solution in several industries for cotraining models among distributed clients via centralized servers without leaving private user data on the devices. Thus, federated learning can be seen as a stimulus for the edge computing paradigm as it supports collaborative learning and model optimization. In view of the strict requirements for data security and system reliability of hyperspectral classification techniques for surveillance, aerospace, and military missions, this article proposes a novel stereo attention cross-decoupling fusion (CDF)-guided federated neural learning algorithm for hyperspectral image classification, which first trains client devices using a scalable federated learning approach consisting of master server, secure aggregator and edge client devices of a certain size. The distributed devices train local models of the neural network for classifying hyperspectral images and send them to the secure aggregator, which aggregates the local models using a weighted averaging strategy and sends them to the master server for iteration. In addition, the stereo attention CDF module is used to mine the multidimensional spatial details of the hyperspectral images, specifically by first extracting the most discriminative features from different directions (horizontal, vertical, and spatial) using the attention mechanism and then using the decoupling fusion strategy to classify the original feature map into three levels: significant, minor, and redundant, and use them to model the multidimensional spatial relationships, thus strengthening the capability to represent features. Extensive experiments on several public datasets have shown that the proposed method provides competitive performance, and more importantly, is effective in enhancing privacy and reliability for hyperspectral image classification.
引用
收藏
页数:16
相关论文
共 37 条
[1]   A Comprehensive Review of Internet of Things: Technology Stack, Middlewares, and Fog/Edge Computing Interface [J].
Ali, Omer ;
Ishak, Mohamad Khairi ;
Bhatti, Muhammad Kamran Liaquat ;
Khan, Imran ;
Kim, Ki-Il .
SENSORS, 2022, 22 (03)
[2]   Tri-CNN: A Three Branch Model for Hyperspectral Image Classification [J].
Alkhatib, Mohammed Q. Q. ;
Al-Saad, Mina ;
Aburaed, Nour ;
Almansoori, Saeed ;
Zabalza, Jaime ;
Marshall, Stephen ;
Al-Ahmad, Hussain .
REMOTE SENSING, 2023, 15 (02)
[3]   BS-Nets: An End-to-End Framework for Band Selection of Hyperspectral Image [J].
Cai, Yaoming ;
Liu, Xiaobo ;
Cai, Zhihua .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1969-1984
[4]   Sensor-based and vision-based human activity recognition: A comprehensive survey [J].
Dang, L. Minh ;
Min, Kyungbok ;
Wang, Hanxiang ;
Piran, Md. Jalil ;
Lee, Cheol Hee ;
Moon, Hyeonjoon .
PATTERN RECOGNITION, 2020, 108
[5]   Weighted Feature Fusion of Convolutional Neural Network and Graph Attention Network for Hyperspectral Image Classification [J].
Dong, Yanni ;
Liu, Quanwei ;
Du, Bo ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1559-1572
[6]   Fully Parallel Stochastic Computing Hardware Implementation of Convolutional Neural Networks for Edge Computing Applications [J].
Frasser, Christiam F. ;
Linares-Serrano, Pablo ;
de los Rios, Ivan Diez ;
Moran, Alejandro ;
Skibinsky-Gitlin, Erik S. ;
Font-Rossello, Joan ;
Canals, Vincent ;
Roca, Miquel ;
Serrano-Gotarredona, Teresa ;
Rossello, Josep L. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) :10408-10418
[7]   Trends in IoT based solutions for health care: Moving AI to the edge [J].
Greco, Luca ;
Percannella, Gennaro ;
Ritrovato, Pierluigi ;
Tortorella, Francesco ;
Vento, Mario .
PATTERN RECOGNITION LETTERS, 2020, 135 :346-353
[8]   Privacy-Preserving Asynchronous Vertical Federated Learning Algorithms for Multiparty Collaborative Learning [J].
Gu, Bin ;
Xu, An ;
Huo, Zhouyuan ;
Deng, Cheng ;
Huang, Heng .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) :6103-6115
[9]   Active emulation of computer codes with Gaussian processes Application to remote sensing [J].
Heestermans Svendsen, Daniel ;
Martino, Luca ;
Camps-Valls, Gustau .
PATTERN RECOGNITION, 2020, 100
[10]   Graph Convolutional Networks for Hyperspectral Image Classification [J].
Hong, Danfeng ;
Gao, Lianru ;
Yao, Jing ;
Zhang, Bing ;
Plaza, Antonio ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07) :5966-5978