SELF-SUPERVISED ADAPTIVE NETWORKS

被引:9
|
作者
LUTTRELL, SP
机构
关键词
SELF-SUPERVISED ADAPTIVE NETWORKS; TRAINING;
D O I
10.1049/ip-f-2.1992.0053
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
A scheme for training multilayer unsupervised networks is presented, in which control signals propagate downwards from the higher layers to influence the optimisation of the lower layers. Because there is no external teacher involved, this is called self-supervised training. The author demonstrates both theoretically and numerically how self-supervision emerges when a simple network built out of vector quantisers is optimised.
引用
收藏
页码:371 / 377
页数:7
相关论文
共 50 条
  • [1] Adaptive Memory Networks With Self-Supervised Learning for Unsupervised Anomaly Detection
    Zhang, Yuxin
    Wang, Jindong
    Chen, Yiqiang
    Yu, Han
    Qin, Tao
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12068 - 12080
  • [2] Self-Adaptive Training: Bridging Supervised and Self-Supervised Learning
    Huang, Lang
    Zhang, Chao
    Zhang, Hongyang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1362 - 1377
  • [3] Self-Supervised MultiModal Versatile Networks
    Alayrac, Jean-Baptiste
    Recasens, Adria
    Schneider, Rosalia
    Arandjelovic, Relja
    Ramapuram, Jason
    De Fauw, Jeffrey
    Smaira, Lucas
    Dieleman, Sander
    Zisserman, Andrew
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [4] Adaptive Self-Supervised Graph Representation Learning
    Gong, Yunchi
    36TH INTERNATIONAL CONFERENCE ON INFORMATION NETWORKING (ICOIN 2022), 2022, : 254 - 259
  • [5] Self-supervised Adaptive Aggregator Learning on Graph
    Lin, Bei
    Luo, Binli
    He, Jiaojiao
    Gui, Ning
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2021, PT III, 2021, 12714 : 29 - 41
  • [6] Adaptive self-supervised learning for sequential recommendation
    Sun, Xiujuan
    Sun, Fuzhen
    Zhang, Zhiwei
    Li, Pengcheng
    Wang, Shaoqing
    NEURAL NETWORKS, 2024, 179
  • [7] Self-supervised hamiltonian mechanics neural networks
    Zhan, Youqiu
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 271 - 275
  • [8] Slimmable Networks for Contrastive Self-supervised Learning
    Zhao, Shuai
    Zhu, Linchao
    Wang, Xiaohan
    Yang, Yi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025, 133 (03) : 1222 - 1237
  • [9] Self-Supervised Pretraining Improves Self-Supervised Pretraining
    Reed, Colorado J.
    Yue, Xiangyu
    Nrusimha, Ani
    Ebrahimi, Sayna
    Vijaykumar, Vivek
    Mao, Richard
    Li, Bo
    Zhang, Shanghang
    Guillory, Devin
    Metzger, Sean
    Keutzer, Kurt
    Darrell, Trevor
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 1050 - 1060
  • [10] VideoClusterNet: Self-supervised and Adaptive Face Clustering for Videos
    Walawalkar, Devesh
    Garrido, Pablo
    COMPUTER VISION - ECCV 2024, PT XXX, 2025, 15088 : 377 - 396