Efficient DDPG via the Self-Supervised Method

被引:0
作者
Zhang, Guanghao [1 ]
Chen, Hongliang [2 ]
Li, Jianxun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai, Peoples R China
[2] AVIC, Inst Electroopt Equipment, Luoyang 4710009, Peoples R China
来源
PROCEEDINGS OF THE 32ND 2020 CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2020) | 2020年
关键词
Efficient DDPG; Self-Supervised Method; Inverse and Forward Model; MODEL;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, embedded with self-supervised learning network, an efficient DDPG(Deep Deterministic Policy Gradient) RL algorithm is investigated. With more essential characteristics of observing data included, the inputs of actor network and critic network of DDPG are replaced by the high-dimensional outputs from feature extracting layers and forward network respectively. Additionally, the parameters of these auxiliary layers are optimized with a self-supervised method by minimizing predicting errors, and thus both optimizing progresses can run parallelly and simultaneously. Lastly, an antagonistic air-fight simulation with a novel customized training index is introduced to perform the effectiveness and rising efficiency of our self-supervised DDPG RL algorithm.
引用
收藏
页码:4636 / 4642
页数:7
相关论文
共 50 条
  • [21] TERA: Self-Supervised Learning of Transformer Encoder Representation for Speech
    Liu, Andy T.
    Li, Shang-Wen
    Lee, Hung-yi
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 : 2351 - 2366
  • [22] FLUID: Few-Shot Self-Supervised Image Deraining
    Rai, Shyam Nandan
    Saluja, Rohit
    Arora, Chetan
    Balasubramanian, Vineeth N.
    Subramanian, Anbumani
    Jawahar, C., V
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 418 - 427
  • [23] A General Self-Supervised Framework for Remote Sensing Image Classification
    Gao, Yuan
    Sun, Xiaojuan
    Liu, Chao
    REMOTE SENSING, 2022, 14 (19)
  • [24] Self-Supervised Marine Organism Detection From Underwater Images
    Li, Jiahua
    Yang, Wentao
    Qiao, Shishi
    Gu, Zhaorui
    Zheng, Bing
    Zheng, Haiyong
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2025, 50 (01) : 120 - 135
  • [25] A high-quality self-supervised image denoising method based on SDDW-GAN and CHRNet
    Chen, Yinan
    Zhou, Guoxiong
    Li, Lin
    Chen, Aibin
    Wang, Yanfeng
    Li, Liujun
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 258
  • [26] Nuclei segmentation with point annotations from pathology images via self-supervised learning and co-training
    Lin, Yi
    Qu, Zhiyong
    Chen, Hao
    Gao, Zhongke
    Li, Yuexiang
    Xia, Lili
    Ma, Kai
    Zheng, Yefeng
    Cheng, Kwang-Ting
    MEDICAL IMAGE ANALYSIS, 2023, 89
  • [27] Supervised and self-supervised learning-based cascade spatiotemporal fusion framework and its application
    Sun, Weixuan
    Li, Jie
    Jiang, Menghui
    Yuan, Qiangqiang
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 203 : 19 - 36
  • [28] Sparsely Self-Supervised Generative Adversarial Nets for Radio Frequency Estimation
    Li, Zhuo
    Cao, Jiannong
    Wang, Hongwei
    Zhao, Miao
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (11) : 2428 - 2442
  • [29] Consequential Advancements of Self-Supervised Learning (SSL) in Deep Learning Contexts
    Abdulrazzaq, Mohammed Majid
    Ramaha, Nehad T. A.
    Hameed, Alaa Ali
    Salman, Mohammad
    Yon, Dong Keon
    Fitriyani, Norma Latif
    Syafrudin, Muhammad
    Lee, Seung Won
    MATHEMATICS, 2024, 12 (05)
  • [30] Self-supervised anomaly detection based on foreground enhancement and autoencoder reconstruction
    Zhao, Lijie
    Chai, Yuan
    Zhang, Qichun
    Karimi, Hamid Reza
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (01) : 343 - 350