TeCCo: A Terminal-Cloud Cross-Domain Collaborative Framework for Remote Sensing Image Classification

被引:0
作者
Zhang, Ting [1 ,2 ]
Cheng, Peirui [1 ,3 ]
Zhao, Liangjin [1 ,3 ]
Wang, Zhirui [1 ,3 ]
Kong, Lingyu [1 ,2 ]
Liu, Chenglong [1 ,2 ]
Xu, Guangluan [1 ,3 ]
Sun, Xian [1 ,2 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Target Cognit & Applicat Technol TCAT, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2025年 / 63卷
关键词
Collaboration; Training; Cloud computing; Accuracy; Data models; Adaptation models; Image classification; Robustness; Inference mechanisms; Feature extraction; Domain adaptation; multiplatform image classification; remote sensing (RS); terminal-cloud collaboration; ADAPTATION; INTELLIGENCE; INFERENCE; ALIGNMENT; NETWORK; SET;
D O I
10.1109/TGRS.2024.3515464
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The terminal-cloud collaborative framework boosts precision and efficiency by integrating cloud computing power with low-latency terminal responsiveness, offering a suitable solution for the growing demands of multiplatform remote sensing (RS) image interpretation. However, the significant differences in data distribution across various RS platforms present a great challenge in balancing the cloud's centralized processing capabilities with the local interpretation abilities of different terminals. To address this challenge, we propose a terminal-cloud cross-domain collaborative (TeCCo) framework that inherits the efficiency advantages of multiple platforms while ensuring high-accuracy interpretation of diverse data distributions from different terminals. First, the dual classifier co-learning (DCCL) module is designed to enhance cloud robustness. By combining a multilayer perceptron for instance-level classification and a graph convolutional network (GCN) for feature-level aggregation, it achieves mutual supervision and improves feature alignment across different data distributions. Second, the hypernetwork personalization (HNP) module is introduced to generate personalized classifier parameters for each terminal with little fine-tuning cost, allowing terminals to maintain their uniqueness while benefiting from the generalization advantages of collaborative training. Finally, a data-assisted progressive inference mechanism is proposed to enhance accuracy by jointly clustering the features transmitted from terminals and the features of supervised data in the cloud. Extensive experiments demonstrate that TeCCo effectively addresses data distribution challenges, enhancing both the generalization of the cloud model and the personalization of terminal models, achieving state-of-the-art (SOTA) performance in cross-domain and multiplatform RS image classification.
引用
收藏
页数:20
相关论文
共 93 条
[1]   HyperStyle: Sty1eGAN Inversion with HyperNetworks for Real Image Editing [J].
Alaluf, Yuval ;
Tov, Omer ;
Mokady, Ron ;
Gal, Rinon ;
Bermano, Amit .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :18490-18500
[2]  
[Anonymous], 2024, IEEE Trans. Geosci. Remote Sens., V62
[3]   Auto-Split: A General Framework of Collaborative Edge-Cloud AI [J].
Banitalebi-Dehkordi, Amin ;
Vedula, Naveen ;
Pei, Jian ;
Xia, Fei ;
Wang, Lanjun ;
Zhang, Yong .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :2543-2553
[4]   Unsupervised Domain Adaptation With Debiased Contrastive Learning and Support-Set Guided Pseudolabeling for Remote Sensing Images [J].
Biswas, Debojyoti ;
Tesic, Jelena .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :3197-3210
[5]  
Chang O, 2023, Arxiv, DOI arXiv:2312.08399
[6]  
Chen XY, 2019, PR MACH LEARN RES, V97
[7]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[8]   Iterative weighted active transfer learning hyperspectral image classification [J].
Cui, Ying ;
Wang, Lingxiu ;
Su, Jingjing ;
Gao, Shan ;
Wang, Liguo .
JOURNAL OF APPLIED REMOTE SENSING, 2021, 15 (03)
[9]   Dynamic Instance Domain Adaptation [J].
Deng, Zhongying ;
Zhou, Kaiyang ;
Li, Da ;
He, Junjun ;
Song, Yi-Zhe ;
Xiang, Tao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :4585-4597
[10]   JointDNN: An Efficient Training and Inference Engine for Intelligent Mobile Cloud Computing Services [J].
Eshratifar, Amir Erfan ;
Abrishami, Mohammad Saeed ;
Pedram, Massoud .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (02) :565-576